Evaluator 2504

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

45633

11122

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-1

aido5-LF-sim-validation

LFv-sim

timeout

nogpu-prod-02

2020-11-30 23:09:48+00:00

No reset possible

45619

11842

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI_multi-sim-validation

LFVIv-sim

aborted

nogpu-prod-02

2020-11-30 23:08:53+00:00

2020-11-30 23:09:26+00:00

0:00:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45599

11817

Bea Baselines 🐤

template-ros

aido5-LFVI-sim-testing

LFVIt-sim

aborted

nogpu-prod-02

2020-11-30 23:07:29+00:00

2020-11-30 23:08:15+00:00

0:00:46

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45571

11817

Bea Baselines 🐤

template-ros

aido5-LFVI-sim-testing

LFVIt-sim

aborted

nogpu-prod-02

2020-11-30 23:06:22+00:00

2020-11-30 23:06:54+00:00

0:00:32

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45543

11841

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI-sim-testing

LFVIt-sim

aborted

nogpu-prod-02

2020-11-30 23:05:19+00:00

2020-11-30 23:06:06+00:00

0:00:47

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45512

11810

Bea Baselines 🐤

template-ros

aido5-LFP-sim-testing

LFP-sim

aborted

nogpu-prod-02

2020-11-30 23:04:45+00:00

2020-11-30 23:05:10+00:00

0:00:25

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45495

11787

Bea Baselines 🐤

template-random

aido5-LFV_multi-sim-validation

LFVmultibodyv-sim

aborted

nogpu-prod-02

2020-11-30 23:03:15+00:00

2020-11-30 23:03:48+00:00

0:00:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45466

11807

Bea Baselines 🐤

template-ros

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-02

2020-11-30 23:02:12+00:00

2020-11-30 23:03:06+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07830506373689916
survival_time_median	0.49999999999999994
deviation-center-line_median	0.009141666163397674
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.012485850941051136
agent_compute-ego_mean	0.012485850941051136
agent_compute-ego_median	0.012485850941051136
agent_compute-ego_min	0.012485850941051136
complete-iteration_max	0.15222969922152432
complete-iteration_mean	0.15222969922152432
complete-iteration_median	0.15222969922152432
complete-iteration_min	0.15222969922152432
deviation-center-line_max	0.009141666163397674
deviation-center-line_mean	0.009141666163397674
deviation-center-line_min	0.009141666163397674
deviation-heading_max	0.06890501211444891
deviation-heading_mean	0.06890501211444891
deviation-heading_median	0.06890501211444891
deviation-heading_min	0.06890501211444891
driven_any_max	0.07932350794900189
driven_any_mean	0.07932350794900189
driven_any_median	0.07932350794900189
driven_any_min	0.07932350794900189
driven_lanedir_consec_max	0.07830506373689916
driven_lanedir_consec_mean	0.07830506373689916
driven_lanedir_consec_min	0.07830506373689916
driven_lanedir_max	0.07830506373689916
driven_lanedir_mean	0.07830506373689916
driven_lanedir_median	0.07830506373689916
driven_lanedir_min	0.07830506373689916
get_duckie_state_max	0.002404993230646307
get_duckie_state_mean	0.002404993230646307
get_duckie_state_median	0.002404993230646307
get_duckie_state_min	0.002404993230646307
get_robot_state_max	0.007980390028520063
get_robot_state_mean	0.007980390028520063
get_robot_state_median	0.007980390028520063
get_robot_state_min	0.007980390028520063
get_state_dump_max	0.007466402920809659
get_state_dump_mean	0.007466402920809659
get_state_dump_median	0.007466402920809659
get_state_dump_min	0.007466402920809659
get_ui_image_max	0.02832913398742676
get_ui_image_mean	0.02832913398742676
get_ui_image_median	0.02832913398742676
get_ui_image_min	0.02832913398742676
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.07932350794900189, "get_ui_image": 0.02832913398742676, "step_physics": 0.07119601423090155, "survival_time": 0.49999999999999994, "driven_lanedir": 0.07830506373689916, "get_state_dump": 0.007466402920809659, "sim_render-ego": 0.003818620334972035, "get_robot_state": 0.007980390028520063, "get_duckie_state": 0.002404993230646307, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012485850941051136, "deviation-heading": 0.06890501211444891, "complete-iteration": 0.15222969922152432, "set_robot_commands": 0.0025338693098588424, "deviation-center-line": 0.009141666163397674, "driven_lanedir_consec": 0.07830506373689916, "sim_compute_sim_state": 0.013492735949429598, "sim_compute_performance-ego": 0.0024314576929265804}}
set_robot_commands_max	0.0025338693098588424
set_robot_commands_mean	0.0025338693098588424
set_robot_commands_median	0.0025338693098588424
set_robot_commands_min	0.0025338693098588424
sim_compute_performance-ego_max	0.0024314576929265804
sim_compute_performance-ego_mean	0.0024314576929265804
sim_compute_performance-ego_median	0.0024314576929265804
sim_compute_performance-ego_min	0.0024314576929265804
sim_compute_sim_state_max	0.013492735949429598
sim_compute_sim_state_mean	0.013492735949429598
sim_compute_sim_state_median	0.013492735949429598
sim_compute_sim_state_min	0.013492735949429598
sim_render-ego_max	0.003818620334972035
sim_render-ego_mean	0.003818620334972035
sim_render-ego_median	0.003818620334972035
sim_render-ego_min	0.003818620334972035
simulation-passed	1
step_physics_max	0.07119601423090155
step_physics_mean	0.07119601423090155
step_physics_median	0.07119601423090155
step_physics_min	0.07119601423090155
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

45387

11783

Bea Baselines 🐤

template-random

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-02

2020-11-30 23:00:09+00:00

2020-11-30 23:01:49+00:00

0:01:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06871089847212986
survival_time_median	0.49999999999999994
deviation-center-line_median	0.008019844335283851
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01047693599354137
agent_compute-ego_mean	0.01047693599354137
agent_compute-ego_median	0.01047693599354137
agent_compute-ego_min	0.01047693599354137
complete-iteration_max	0.14532262628728693
complete-iteration_mean	0.14532262628728693
complete-iteration_median	0.14532262628728693
complete-iteration_min	0.14532262628728693
deviation-center-line_max	0.008019844335283851
deviation-center-line_mean	0.008019844335283851
deviation-center-line_min	0.008019844335283851
deviation-heading_max	0.05040343959962079
deviation-heading_mean	0.05040343959962079
deviation-heading_median	0.05040343959962079
deviation-heading_min	0.05040343959962079
driven_any_max	0.0689817689678746
driven_any_mean	0.0689817689678746
driven_any_median	0.0689817689678746
driven_any_min	0.0689817689678746
driven_lanedir_consec_max	0.06871089847212986
driven_lanedir_consec_mean	0.06871089847212986
driven_lanedir_consec_min	0.06871089847212986
driven_lanedir_max	0.06871089847212986
driven_lanedir_mean	0.06871089847212986
driven_lanedir_median	0.06871089847212986
driven_lanedir_min	0.06871089847212986
get_duckie_state_max	0.0021587935360995207
get_duckie_state_mean	0.0021587935360995207
get_duckie_state_median	0.0021587935360995207
get_duckie_state_min	0.0021587935360995207
get_robot_state_max	0.007439851760864258
get_robot_state_mean	0.007439851760864258
get_robot_state_median	0.007439851760864258
get_robot_state_min	0.007439851760864258
get_state_dump_max	0.00740140134638006
get_state_dump_mean	0.00740140134638006
get_state_dump_median	0.00740140134638006
get_state_dump_min	0.00740140134638006
get_ui_image_max	0.028171365911310368
get_ui_image_mean	0.028171365911310368
get_ui_image_median	0.028171365911310368
get_ui_image_min	0.028171365911310368
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.0689817689678746, "get_ui_image": 0.028171365911310368, "step_physics": 0.068780855699019, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06871089847212986, "get_state_dump": 0.00740140134638006, "sim_render-ego": 0.0036268017508766866, "get_robot_state": 0.007439851760864258, "get_duckie_state": 0.0021587935360995207, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01047693599354137, "deviation-heading": 0.05040343959962079, "complete-iteration": 0.14532262628728693, "set_robot_commands": 0.002170497720891779, "deviation-center-line": 0.008019844335283851, "driven_lanedir_consec": 0.06871089847212986, "sim_compute_sim_state": 0.01285145499489524, "sim_compute_performance-ego": 0.0021712129766290836}}
set_robot_commands_max	0.002170497720891779
set_robot_commands_mean	0.002170497720891779
set_robot_commands_median	0.002170497720891779
set_robot_commands_min	0.002170497720891779
sim_compute_performance-ego_max	0.0021712129766290836
sim_compute_performance-ego_mean	0.0021712129766290836
sim_compute_performance-ego_median	0.0021712129766290836
sim_compute_performance-ego_min	0.0021712129766290836
sim_compute_sim_state_max	0.01285145499489524
sim_compute_sim_state_mean	0.01285145499489524
sim_compute_sim_state_median	0.01285145499489524
sim_compute_sim_state_min	0.01285145499489524
sim_render-ego_max	0.0036268017508766866
sim_render-ego_mean	0.0036268017508766866
sim_render-ego_median	0.0036268017508766866
sim_render-ego_min	0.0036268017508766866
simulation-passed	1
step_physics_max	0.068780855699019
step_physics_mean	0.068780855699019
step_physics_median	0.068780855699019
step_physics_min	0.068780855699019
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

ID	2504
evaluator	`nogpu-prod-02`
owner	I don't have one 😀
machine	nogpu-prod_288a5f806de8
process	nogpu-prod-02_288a5f806de8
version	6.1.27
first heard	2020-11-30 22:59:36+00:00
last heard	2020-12-01 00:01:27+00:00
status	inactive
# evaluating
# success	2 `45387`
# timeout	1 `45633`
# failed
# error
# aborted	6 `45495`
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 2504

Evaluator jobs