Duckietown Challenges Home Challenges Submissions

Evaluator 2130

ID2130
evaluatorreg03-074ae20ceee7-1
ownerI don't have one 😀
machinearchimede
processreg03-074ae20ceee7-1
versiond-c:6.1.19;d-c-r:6.0.48
first heard
last heard
statusinactive
# evaluating
# success2 36599
# timeout1 36608
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3660810071Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnoreg03-074ae20ceee7-11:05:06
I can see how the jo [...]
I can see how the job 36608 is timeout because passed 3906 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3660410068Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg03-074ae20ceee7-10:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4865218409289458
survival_time_median12.000000000000036
deviation-center-line_median0.23325443746176255
in-drivable-lane_median6.1250000000000435


other stats
agent_compute-ego_max0.030303311347961423
agent_compute-ego_mean0.029537878070169027
agent_compute-ego_median0.029655826256420072
agent_compute-ego_min0.028536548419874543
complete-iteration_max0.27110419193903607
complete-iteration_mean0.2657876454814963
complete-iteration_median0.26718526083681027
complete-iteration_min0.2576758683133287
deviation-center-line_max0.32225308522154034
deviation-center-line_mean0.237919826463338
deviation-center-line_min0.16291734570828637
deviation-heading_max3.456647308125053
deviation-heading_mean1.6725072888777095
deviation-heading_median1.3632139546146491
deviation-heading_min0.5069539381564874
driven_any_max2.6948498016886657
driven_any_mean2.2657204689429515
driven_any_median2.3089187891797653
driven_any_min1.7501944957236106
driven_lanedir_consec_max2.00983861101362
driven_lanedir_consec_mean1.4192788738653277
driven_lanedir_consec_min0.6942332025897984
driven_lanedir_max2.00983861101362
driven_lanedir_mean1.4220070306117762
driven_lanedir_median1.4919781544218431
driven_lanedir_min0.6942332025897984
get_state_dump_max0.019785140759378508
get_state_dump_mean0.019318017188813725
get_state_dump_median0.01939823826154073
get_state_dump_min0.01869045147279493
get_ui_image_max0.046968745390574135
get_ui_image_mean0.04608529868125288
get_ui_image_median0.04604956081935338
get_ui_image_min0.04527332769573064
in-drivable-lane_max11.800000000000058
in-drivable-lane_mean6.2375000000000345
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.7501944957236106, "get_ui_image": 0.046968745390574135, "step_physics": 0.10513063351313272, "survival_time": 14.950000000000076, "driven_lanedir": 1.1225779253038513, "get_state_dump": 0.019719236691792805, "sim_render-ego": 0.009475069046020508, "in-drivable-lane": 8.150000000000084, "agent_compute-ego": 0.029472196102142335, "deviation-heading": 3.456647308125053, "complete-iteration": 0.27110419193903607, "set_robot_commands": 0.007857793966929118, "deviation-center-line": 0.32225308522154034, "driven_lanedir_consec": 1.1116652983180562, "sim_compute_sim_state": 0.021405927340189614, "sim_compute_performance-ego": 0.006923542817433675, "sim_compute_robot_state-ego": 0.01234389623006185, "sim_compute_robot_state-parked0": 0.011579554080963134}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.224351929579025, "get_ui_image": 0.046548775264195034, "step_physics": 0.09872895844128668, "survival_time": 7.349999999999982, "driven_lanedir": 1.8613783835398352, "get_state_dump": 0.01869045147279493, "sim_render-ego": 0.009098717955504956, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.028536548419874543, "deviation-heading": 0.9006101679825025, "complete-iteration": 0.2576758683133287, "set_robot_commands": 0.007462548560836688, "deviation-center-line": 0.21928167900402443, "driven_lanedir_consec": 1.8613783835398352, "sim_compute_sim_state": 0.01937876591066114, "sim_compute_performance-ego": 0.006423794493383291, "sim_compute_robot_state-ego": 0.01144410801582596, "sim_compute_robot_state-parked0": 0.011149135576624449}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.393485648780506, "get_ui_image": 0.04555034637451172, "step_physics": 0.1065539503097534, "survival_time": 14.950000000000076, "driven_lanedir": 0.6942332025897984, "get_state_dump": 0.019077239831288655, "sim_render-ego": 0.009750874042510986, "in-drivable-lane": 11.800000000000058, "agent_compute-ego": 0.030303311347961423, "deviation-heading": 1.825817741246796, "complete-iteration": 0.2671925052007039, "set_robot_commands": 0.008178671995798747, "deviation-center-line": 0.2472271959195007, "driven_lanedir_consec": 0.6942332025897984, "sim_compute_sim_state": 0.016465022563934326, "sim_compute_performance-ego": 0.006757656733194987, "sim_compute_robot_state-ego": 0.01230714718500773, "sim_compute_robot_state-parked0": 0.012023335297902425}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6948498016886657, "get_ui_image": 0.04527332769573064, "step_physics": 0.09935733231391695, "survival_time": 9.049999999999994, "driven_lanedir": 2.00983861101362, "get_state_dump": 0.019785140759378508, "sim_render-ego": 0.010086346726391197, "in-drivable-lane": 4.100000000000003, "agent_compute-ego": 0.02983945641069781, "deviation-heading": 0.5069539381564874, "complete-iteration": 0.26717801647291656, "set_robot_commands": 0.008298378622992921, "deviation-center-line": 0.16291734570828637, "driven_lanedir_consec": 2.00983861101362, "sim_compute_sim_state": 0.021863322231651012, "sim_compute_performance-ego": 0.007284938959785588, "sim_compute_robot_state-ego": 0.012776353741219031, "sim_compute_robot_state-parked0": 0.012378136756011794}}
set_robot_commands_max0.008298378622992921
set_robot_commands_mean0.007949348286639369
set_robot_commands_median0.008018232981363933
set_robot_commands_min0.007462548560836688
sim_compute_performance-ego_max0.007284938959785588
sim_compute_performance-ego_mean0.006847483250949386
sim_compute_performance-ego_median0.006840599775314331
sim_compute_performance-ego_min0.006423794493383291
sim_compute_robot_state-ego_max0.012776353741219031
sim_compute_robot_state-ego_mean0.012217876293028642
sim_compute_robot_state-ego_median0.01232552170753479
sim_compute_robot_state-ego_min0.01144410801582596
sim_compute_robot_state-parked0_max0.012378136756011794
sim_compute_robot_state-parked0_mean0.011782540427875451
sim_compute_robot_state-parked0_median0.01180144468943278
sim_compute_robot_state-parked0_min0.011149135576624449
sim_compute_sim_state_max0.021863322231651012
sim_compute_sim_state_mean0.019778259511609025
sim_compute_sim_state_median0.020392346625425377
sim_compute_sim_state_min0.016465022563934326
sim_render-ego_max0.010086346726391197
sim_render-ego_mean0.009602751942606912
sim_render-ego_median0.009612971544265748
sim_render-ego_min0.009098717955504956
simulation-passed1
step_physics_max0.1065539503097534
step_physics_mean0.10244271864452244
step_physics_median0.10224398291352484
step_physics_min0.09872895844128668
survival_time_max14.950000000000076
survival_time_mean11.575000000000037
survival_time_min7.349999999999982
No reset possible
3659910064Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg03-074ae20ceee7-10:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4550146507125055
survival_time_median14.950000000000076
deviation-center-line_median0.35065044084023145
in-drivable-lane_median5.475000000000055


other stats
agent_compute-ego_max0.09697392463684082
agent_compute-ego_mean0.0881072062253952
agent_compute-ego_median0.09249719301859538
agent_compute-ego_min0.07046051422754923
complete-iteration_max0.33234909693400067
complete-iteration_mean0.32387710571289063
complete-iteration_median0.32656653722127277
complete-iteration_min0.3100262514750163
deviation-center-line_max0.41940916201916223
deviation-center-line_mean0.3464959718565323
deviation-center-line_min0.2652738437265041
deviation-heading_max2.4516615950015286
deviation-heading_mean2.0684373414524653
deviation-heading_median2.208403196534073
deviation-heading_min1.405281377740186
driven_any_max4.094267698987128
driven_any_mean3.3906892987110826
driven_any_median3.39434879797096
driven_any_min2.679791899915283
driven_lanedir_consec_max3.626470690041503
driven_lanedir_consec_mean2.440617441084395
driven_lanedir_consec_min1.225969772871065
driven_lanedir_max3.626470690041503
driven_lanedir_mean2.440617441084395
driven_lanedir_median2.4550146507125055
driven_lanedir_min1.225969772871065
get_state_dump_max0.019619718392690024
get_state_dump_mean0.0186335563659668
get_state_dump_median0.01892674167950948
get_state_dump_min0.017061023712158202
get_ui_image_max0.04714974562327067
get_ui_image_mean0.04657262325286865
get_ui_image_median0.046568470398585
get_ui_image_min0.04600380659103394
in-drivable-lane_max8.900000000000091
in-drivable-lane_mean5.712500000000051
in-drivable-lane_min3.0000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.7092054357740807, "get_ui_image": 0.04714974562327067, "step_physics": 0.09964504718780516, "survival_time": 14.950000000000076, "driven_lanedir": 1.225969772871065, "get_state_dump": 0.019619718392690024, "sim_render-ego": 0.009900760650634766, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.07046051422754923, "deviation-heading": 1.405281377740186, "complete-iteration": 0.3100262514750163, "set_robot_commands": 0.008598159948984782, "deviation-center-line": 0.2878405148426939, "driven_lanedir_consec": 1.225969772871065, "sim_compute_sim_state": 0.022635884284973144, "sim_compute_performance-ego": 0.006889557838439942, "sim_compute_robot_state-ego": 0.01257952133814494, "sim_compute_robot_state-parked0": 0.01230897347132365}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.094267698987128, "get_ui_image": 0.046801925500233967, "step_physics": 0.10001067638397217, "survival_time": 14.950000000000076, "driven_lanedir": 3.626470690041503, "get_state_dump": 0.018992019494374592, "sim_render-ego": 0.009250590006510417, "in-drivable-lane": 3.0000000000000027, "agent_compute-ego": 0.09697392463684082, "deviation-heading": 2.4516615950015286, "complete-iteration": 0.33234909693400067, "set_robot_commands": 0.00868961493174235, "deviation-center-line": 0.41940916201916223, "driven_lanedir_consec": 3.626470690041503, "sim_compute_sim_state": 0.021583112080891927, "sim_compute_performance-ego": 0.0064998443921407065, "sim_compute_robot_state-ego": 0.011698083877563476, "sim_compute_robot_state-parked0": 0.011624346574147544}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.679791899915283, "get_ui_image": 0.04633501529693604, "step_physics": 0.1088285223642985, "survival_time": 14.950000000000076, "driven_lanedir": 1.4972933426320951, "get_state_dump": 0.017061023712158202, "sim_render-ego": 0.008914282321929931, "in-drivable-lane": 6.750000000000096, "agent_compute-ego": 0.0905077584584554, "deviation-heading": 2.173529230620604, "complete-iteration": 0.3230825312932332, "set_robot_commands": 0.007111059029897054, "deviation-center-line": 0.2652738437265041, "driven_lanedir_consec": 1.4972933426320951, "sim_compute_sim_state": 0.01679468313852946, "sim_compute_performance-ego": 0.005946463743845622, "sim_compute_robot_state-ego": 0.010635124842325844, "sim_compute_robot_state-parked0": 0.010738716125488282}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.079492160167839, "get_ui_image": 0.04600380659103394, "step_physics": 0.10304444392522176, "survival_time": 14.950000000000076, "driven_lanedir": 3.412735958792916, "get_state_dump": 0.01886146386464437, "sim_render-ego": 0.009244900544484456, "in-drivable-lane": 4.200000000000014, "agent_compute-ego": 0.09448662757873535, "deviation-heading": 2.243277162447542, "complete-iteration": 0.3300505431493123, "set_robot_commands": 0.0074591517448425295, "deviation-center-line": 0.413460366837769, "driven_lanedir_consec": 3.412735958792916, "sim_compute_sim_state": 0.021193054517110187, "sim_compute_performance-ego": 0.006345330874125163, "sim_compute_robot_state-ego": 0.01170681873957316, "sim_compute_robot_state-parked0": 0.011483380794525148}}
set_robot_commands_max0.00868961493174235
set_robot_commands_mean0.007964496413866679
set_robot_commands_median0.008028655846913656
set_robot_commands_min0.007111059029897054
sim_compute_performance-ego_max0.006889557838439942
sim_compute_performance-ego_mean0.0064202992121378585
sim_compute_performance-ego_median0.0064225876331329345
sim_compute_performance-ego_min0.005946463743845622
sim_compute_robot_state-ego_max0.01257952133814494
sim_compute_robot_state-ego_mean0.011654887199401855
sim_compute_robot_state-ego_median0.01170245130856832
sim_compute_robot_state-ego_min0.010635124842325844
sim_compute_robot_state-parked0_max0.01230897347132365
sim_compute_robot_state-parked0_mean0.011538854241371157
sim_compute_robot_state-parked0_median0.011553863684336346
sim_compute_robot_state-parked0_min0.010738716125488282
sim_compute_sim_state_max0.022635884284973144
sim_compute_sim_state_mean0.02055168350537618
sim_compute_sim_state_median0.021388083299001055
sim_compute_sim_state_min0.01679468313852946
sim_render-ego_max0.009900760650634766
sim_render-ego_mean0.009327633380889893
sim_render-ego_median0.009247745275497436
sim_render-ego_min0.008914282321929931
simulation-passed1
step_physics_max0.1088285223642985
step_physics_mean0.1028821724653244
step_physics_median0.10152756015459696
step_physics_min0.09964504718780516
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible