Evaluator 2503

ID	2503
evaluator	`nogpu-prod-07`
owner	I don't have one 😀
machine	nogpu-prod_28b688c58884
process	nogpu-prod-07_28b688c58884
version	6.1.27
first heard	2020-11-30 22:59:35+00:00
last heard	2020-12-01 00:02:20+00:00
status	inactive
# evaluating
# success	1 `45542`
# timeout	1 `45641`
# failed
# error
# aborted	3 `45404`
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

45641

11798

Bea Baselines 🐤

straight

aido5-LFP-sim-testing

LFP-sim

timeout

nogpu-prod-07

2020-11-30 23:09:52+00:00

No reset possible

45617

11787

Bea Baselines 🐤

template-random

aido5-LFV_multi-sim-validation

LFVmultibodyv-sim

aborted

nogpu-prod-07

2020-11-30 23:08:53+00:00

2020-11-30 23:09:23+00:00

0:00:30

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45586

11810

Bea Baselines 🐤

template-ros

aido5-LFP-sim-testing

LFP-sim

aborted

nogpu-prod-07

2020-11-30 23:06:54+00:00

2020-11-30 23:07:22+00:00

0:00:28

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45542

11807

Bea Baselines 🐤

template-ros

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-07

2020-11-30 23:05:19+00:00

2020-11-30 23:06:16+00:00

0:00:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0403967857311569
survival_time_median	0.49999999999999994
deviation-center-line_median	0.007420584610876298
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.013238495046442204
agent_compute-ego_mean	0.013238495046442204
agent_compute-ego_median	0.013238495046442204
agent_compute-ego_min	0.013238495046442204
complete-iteration_max	0.16313060847195712
complete-iteration_mean	0.16313060847195712
complete-iteration_median	0.16313060847195712
complete-iteration_min	0.16313060847195712
deviation-center-line_max	0.007420584610876298
deviation-center-line_mean	0.007420584610876298
deviation-center-line_min	0.007420584610876298
deviation-heading_max	0.03939405783885053
deviation-heading_mean	0.03939405783885053
deviation-heading_median	0.03939405783885053
deviation-heading_min	0.03939405783885053
driven_any_max	0.04045057122843355
driven_any_mean	0.04045057122843355
driven_any_median	0.04045057122843355
driven_any_min	0.04045057122843355
driven_lanedir_consec_max	0.0403967857311569
driven_lanedir_consec_mean	0.0403967857311569
driven_lanedir_consec_min	0.0403967857311569
driven_lanedir_max	0.0403967857311569
driven_lanedir_mean	0.0403967857311569
driven_lanedir_median	0.0403967857311569
driven_lanedir_min	0.0403967857311569
get_duckie_state_max	0.0023495500737970524
get_duckie_state_mean	0.0023495500737970524
get_duckie_state_median	0.0023495500737970524
get_duckie_state_min	0.0023495500737970524
get_robot_state_max	0.008417909795587713
get_robot_state_mean	0.008417909795587713
get_robot_state_median	0.008417909795587713
get_robot_state_min	0.008417909795587713
get_state_dump_max	0.008177063681862572
get_state_dump_mean	0.008177063681862572
get_state_dump_median	0.008177063681862572
get_state_dump_min	0.008177063681862572
get_ui_image_max	0.029843698848377575
get_ui_image_mean	0.029843698848377575
get_ui_image_median	0.029843698848377575
get_ui_image_min	0.029843698848377575
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.04045057122843355, "get_ui_image": 0.029843698848377575, "step_physics": 0.07853425632823598, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0403967857311569, "get_state_dump": 0.008177063681862572, "sim_render-ego": 0.003948298367587003, "get_robot_state": 0.008417909795587713, "get_duckie_state": 0.0023495500737970524, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013238495046442204, "deviation-heading": 0.03939405783885053, "complete-iteration": 0.16313060847195712, "set_robot_commands": 0.002375927838412198, "deviation-center-line": 0.007420584610876298, "driven_lanedir_consec": 0.0403967857311569, "sim_compute_sim_state": 0.01376188885081898, "sim_compute_performance-ego": 0.002394957975907759}}
set_robot_commands_max	0.002375927838412198
set_robot_commands_mean	0.002375927838412198
set_robot_commands_median	0.002375927838412198
set_robot_commands_min	0.002375927838412198
sim_compute_performance-ego_max	0.002394957975907759
sim_compute_performance-ego_mean	0.002394957975907759
sim_compute_performance-ego_median	0.002394957975907759
sim_compute_performance-ego_min	0.002394957975907759
sim_compute_sim_state_max	0.01376188885081898
sim_compute_sim_state_mean	0.01376188885081898
sim_compute_sim_state_median	0.01376188885081898
sim_compute_sim_state_min	0.01376188885081898
sim_render-ego_max	0.003948298367587003
sim_render-ego_mean	0.003948298367587003
sim_render-ego_median	0.003948298367587003
sim_render-ego_min	0.003948298367587003
simulation-passed	1
step_physics_max	0.07853425632823598
step_physics_mean	0.07853425632823598
step_physics_median	0.07853425632823598
step_physics_min	0.07853425632823598
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

45404

11808

Bea Baselines 🐤

template-ros

aido5-LF-sim-validation

LFv-sim

aborted

nogpu-prod-07

2020-11-30 23:00:34+00:00

2020-11-30 23:01:37+00:00

0:01:03

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible