Duckietown Challenges Home Challenges Submissions

Evaluator 2069

ID2069
evaluatorreg01-db73f9a5c1dc-1
ownerI don't have one 😀
machinearchimede
processreg01-db73f9a5c1dc-1
versiond-c:6.1.15;d-c-r:6.0.43
first heard
last heard
statusinactive
# evaluating
# success54 35586
# timeout1 35952
# failed
# error1 35941
# aborted5 35584
# host-error1 35855
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
359529824Bea Baselines 🐤template-pytorchaido5-LFVI_multi-sim-validationLFVIv-simtimeoutnoreg01-db73f9a5c1dc-11:05:53
I can see how the jo [...]
I can see how the job 35952 is timeout because passed 3953 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359419807Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simerrornoreg01-db73f9a5c1dc-11:00:53
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359349781Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.20880585936578705
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.030985930760701497
agent_compute-ego_mean0.02977458914120992
agent_compute-ego_median0.02977458914120992
agent_compute-ego_min0.028563247521718346
complete-iteration_max0.3227096605300903
complete-iteration_mean0.3026537823677063
complete-iteration_median0.3026537823677063
complete-iteration_min0.28259790420532227
deviation-center-line_max0.20880585936578705
deviation-center-line_mean0.20880585936578705
deviation-center-line_min0.20880585936578705
deviation-heading_max1.6198720948235377
deviation-heading_mean1.6198720948235377
deviation-heading_median1.6198720948235377
deviation-heading_min1.6198720948235377
driven_any_max1.328474932138796e-13
driven_any_mean1.328474932138796e-13
driven_any_median1.328474932138796e-13
driven_any_min1.328474932138796e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.022968594233194983
get_state_dump_mean0.02133765737215678
get_state_dump_median0.02133765737215678
get_state_dump_min0.01970672051111857
get_ui_image_max0.06316643158594767
get_ui_image_mean0.058043577273686725
get_ui_image_median0.058043577273686725
get_ui_image_min0.05292072296142578
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.06316643158594767, "step_physics": 0.13085843722025553, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.022968594233194983, "sim_render-ego": 0.01087637980779012, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030985930760701497, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.3227096605300903, "set_robot_commands": 0.0087437637646993, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021485238869984945, "sim_compute_performance-ego": 0.007257704734802246, "sim_compute_robot_state-ego": 0.012429351806640626, "sim_compute_robot_state-parked0": 0.01373381773630778}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.05292072296142578, "step_physics": 0.11704809983571372, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01970672051111857, "sim_render-ego": 0.009251004854838051, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028563247521718346, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.28259790420532227, "set_robot_commands": 0.006830875873565674, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01972313404083252, "sim_compute_performance-ego": 0.006627551714579264, "sim_compute_robot_state-ego": 0.0108833114306132, "sim_compute_robot_state-parked0": 0.010827004114786784}}
set_robot_commands_max0.0087437637646993
set_robot_commands_mean0.007787319819132487
set_robot_commands_median0.007787319819132487
set_robot_commands_min0.006830875873565674
sim_compute_performance-ego_max0.007257704734802246
sim_compute_performance-ego_mean0.006942628224690755
sim_compute_performance-ego_median0.006942628224690755
sim_compute_performance-ego_min0.006627551714579264
sim_compute_robot_state-ego_max0.012429351806640626
sim_compute_robot_state-ego_mean0.011656331618626913
sim_compute_robot_state-ego_median0.011656331618626913
sim_compute_robot_state-ego_min0.0108833114306132
sim_compute_robot_state-parked0_max0.01373381773630778
sim_compute_robot_state-parked0_mean0.01228041092554728
sim_compute_robot_state-parked0_median0.01228041092554728
sim_compute_robot_state-parked0_min0.010827004114786784
sim_compute_sim_state_max0.021485238869984945
sim_compute_sim_state_mean0.020604186455408735
sim_compute_sim_state_median0.020604186455408735
sim_compute_sim_state_min0.01972313404083252
sim_render-ego_max0.01087637980779012
sim_render-ego_mean0.010063692331314086
sim_render-ego_median0.010063692331314086
sim_render-ego_min0.009251004854838051
simulation-passed1
step_physics_max0.13085843722025553
step_physics_mean0.12395326852798462
step_physics_median0.12395326852798462
step_physics_min0.11704809983571372
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
359296728Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359256754Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359186761Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359126800Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359076803Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358996807Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358916816Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358876824Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358836829Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358776830Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358716842Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358656846Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358596847Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358556848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg01-db73f9a5c1dc-10:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, reg01-db73f9a5c1dc-1-job35855-514828, pull]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'reg01-db73f9a5c1dc-1-job35855-514828', 'pull']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358509226Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358429233Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358379238Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358319242Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358279247Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358199256Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358139260Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358079273Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358029277Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357989278Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357899284Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357849289Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg01-db73f9a5c1dc-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357799297Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357719307Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357649313Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357599316Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357529324Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357469330Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357399334Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357339337Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg01-db73f9a5c1dc-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357289340Jerome Labonte 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoreg01-db73f9a5c1dc-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357229349Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357159363Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg01-db73f9a5c1dc-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357109368Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357049370Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356969374Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356899379Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356849383Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356769387Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356719391Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356659395Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356589735Bea Baselines 🐤baseline-duckietownaido5-LF-sim-testingLFt-simsuccessnoreg01-db73f9a5c1dc-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356529736Bea Baselines 🐤baseline-duckietownaido5-LFV-sim-validationLFVv-simsuccessnoreg01-db73f9a5c1dc-10:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356469739Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simsuccessnoreg01-db73f9a5c1dc-10:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356439741Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simsuccessnoreg01-db73f9a5c1dc-10:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356379750Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356339753Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simsuccessnoreg01-db73f9a5c1dc-10:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356309755Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simsuccessnoreg01-db73f9a5c1dc-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356229760Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356179761Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356079774Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356029773Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355929779Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355869784Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg01-db73f9a5c1dc-10:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355846729Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simabortednoreg01-db73f9a5c1dc-10:03:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.43-py3.8.egg/duckietown_challenges_runner/runner.py", line 1040, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.43-py3.8.egg/duckietown_challenges_runner/runner.py", line 521, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible