Duckietown Challenges Home Challenges Submissions

Evaluator 2012

ID2012
evaluatorreg09-a05db8e378d9-1
ownerI don't have one 😀
machinearchimede
processreg09-a05db8e378d9-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34883
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348839385Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg09-a05db8e378d9-10:34:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7650379204732574
survival_time_median13.600000000000058
deviation-center-line_median0.3617149949328106
in-drivable-lane_median2.350000000000027


other stats
agent_compute-ego_max0.08092238744099935
agent_compute-ego_mean0.05649632941175244
agent_compute-ego_median0.06251142262047835
agent_compute-ego_min0.02948801918367369
complete-iteration_max0.38641736189524334
complete-iteration_mean0.3620534618744886
complete-iteration_median0.371835403372097
complete-iteration_min0.31538063129492566
deviation-center-line_max0.7139065092745842
deviation-center-line_mean0.3902425752250814
deviation-center-line_min0.2534418338788217
deviation-heading_max2.6881427537524365
deviation-heading_mean1.774247327159093
deviation-heading_median1.7468119852992674
deviation-heading_min1.027549906359564
driven_any_max3.002341625436066
driven_any_mean2.252981296421724
driven_any_median2.268794681109566
driven_any_min1.3384748016438104
driven_lanedir_consec_max2.5712629857347715
driven_lanedir_consec_mean1.6504218313451815
driven_lanedir_consec_min0.7916741351893725
driven_lanedir_max2.5712629857347715
driven_lanedir_mean1.6504218313451815
driven_lanedir_median1.7650379204732574
driven_lanedir_min0.7916741351893725
get_state_dump_max0.017373332935096943
get_state_dump_mean0.016875710478304197
get_state_dump_median0.016998536833771713
get_state_dump_min0.01589625040690104
get_ui_image_max0.07870888864839232
get_ui_image_mean0.07124201649035618
get_ui_image_median0.07277818766383617
get_ui_image_min0.06523121453319806
in-drivable-lane_max9.30000000000006
in-drivable-lane_mean3.4800000000000337
in-drivable-lane_min0.4999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.3384748016438104, "get_ui_image": 0.07870888864839232, "step_physics": 0.1783115616092434, "survival_time": 7.699999999999981, "driven_lanedir": 1.166758882716183, "get_state_dump": 0.017293422253100904, "sim_render-ego": 0.009192106011626008, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.030128986804516283, "deviation-heading": 1.7467901572168054, "complete-iteration": 0.37312262553673287, "set_robot_commands": 0.006676130480580516, "deviation-center-line": 0.2534418338788217, "driven_lanedir_consec": 1.166758882716183, "sim_compute_sim_state": 0.02496895542392483, "sim_compute_performance-ego": 0.006151813965339165, "sim_compute_robot_state-ego": 0.011354489759965376, "sim_compute_robot_state-parked0": 0.010148731144991789}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.8015727146422913, "get_ui_image": 0.06523121453319806, "step_physics": 0.13596367712465593, "survival_time": 9.650000000000002, "driven_lanedir": 1.3805706177700838, "get_state_dump": 0.017328858993214027, "sim_render-ego": 0.009404205905341112, "in-drivable-lane": 2.3000000000000203, "agent_compute-ego": 0.029870470570776745, "deviation-heading": 1.027549906359564, "complete-iteration": 0.31606765238114587, "set_robot_commands": 0.007180742649216726, "deviation-center-line": 0.290792117381101, "driven_lanedir_consec": 1.3805706177700838, "sim_compute_sim_state": 0.02187641791111447, "sim_compute_performance-ego": 0.006533752451288885, "sim_compute_robot_state-ego": 0.011496629122007695, "sim_compute_robot_state-parked0": 0.01097748810763186}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.9523442022693045, "get_ui_image": 0.06670753723752182, "step_physics": 0.1383383063088476, "survival_time": 11.300000000000026, "driven_lanedir": 1.7593056356048509, "get_state_dump": 0.017373332935096943, "sim_render-ego": 0.009049529522921132, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.02948801918367369, "deviation-heading": 1.8245156390322648, "complete-iteration": 0.31538063129492566, "set_robot_commands": 0.00673005538704121, "deviation-center-line": 0.3435981511164846, "driven_lanedir_consec": 1.7593056356048509, "sim_compute_sim_state": 0.020554045660305865, "sim_compute_performance-ego": 0.006275603201537006, "sim_compute_robot_state-ego": 0.01045381811867773, "sim_compute_robot_state-parked0": 0.010199189186096191}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.9483173551602535, "get_ui_image": 0.07344542859910845, "step_physics": 0.1556183368236095, "survival_time": 11.100000000000025, "driven_lanedir": 1.7707702053416638, "get_state_dump": 0.017039077775972383, "sim_render-ego": 0.008890091835915504, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.06754587577269958, "deviation-heading": 1.9460302058130703, "complete-iteration": 0.377731179331874, "set_robot_commands": 0.0064586637256381745, "deviation-center-line": 0.39348717369789815, "driven_lanedir_consec": 1.7707702053416638, "sim_compute_sim_state": 0.0202088721163638, "sim_compute_performance-ego": 0.006195608560029451, "sim_compute_robot_state-ego": 0.01168743339744774, "sim_compute_robot_state-parked0": 0.01043155171849706}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.312599606334376, "get_ui_image": 0.0731130329767863, "step_physics": 0.16168510754903156, "survival_time": 14.950000000000076, "driven_lanedir": 0.7916741351893725, "get_state_dump": 0.016957995891571046, "sim_render-ego": 0.009419324398040772, "in-drivable-lane": 9.20000000000006, "agent_compute-ego": 0.07006373961766561, "deviation-heading": 2.5786089672945227, "complete-iteration": 0.3825748801231385, "set_robot_commands": 0.006231719652811686, "deviation-center-line": 0.3294631547694495, "driven_lanedir_consec": 0.7916741351893725, "sim_compute_sim_state": 0.017189407348632814, "sim_compute_performance-ego": 0.006537285645802816, "sim_compute_robot_state-ego": 0.0108663813273112, "sim_compute_robot_state-parked0": 0.010274251302083334}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4541873160513754, "get_ui_image": 0.07247501611709595, "step_physics": 0.15601715246836345, "survival_time": 14.950000000000076, "driven_lanedir": 0.80428405913308, "get_state_dump": 0.016842506726582846, "sim_render-ego": 0.009195959568023682, "in-drivable-lane": 9.30000000000006, "agent_compute-ego": 0.08092238744099935, "deviation-heading": 2.6881427537524365, "complete-iteration": 0.38641736189524334, "set_robot_commands": 0.0065736826260884606, "deviation-center-line": 0.3072068314791437, "driven_lanedir_consec": 0.80428405913308, "sim_compute_sim_state": 0.016798925399780274, "sim_compute_performance-ego": 0.006246756712595621, "sim_compute_robot_state-ego": 0.01088426192601522, "sim_compute_robot_state-parked0": 0.010252863566080728}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.224989755884755, "get_ui_image": 0.07308135921057639, "step_physics": 0.153123884599925, "survival_time": 13.150000000000052, "driven_lanedir": 1.825749304763888, "get_state_dump": 0.017070177390094945, "sim_render-ego": 0.009152065211829125, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.06263820844004817, "deviation-heading": 1.7468338133817294, "complete-iteration": 0.370548181207461, "set_robot_commands": 0.0064794092577219915, "deviation-center-line": 0.3798318387491366, "driven_lanedir_consec": 1.825749304763888, "sim_compute_sim_state": 0.021008632028964084, "sim_compute_performance-ego": 0.006428203655286434, "sim_compute_robot_state-ego": 0.011211902923003805, "sim_compute_robot_state-parked0": 0.010118431918068075}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.8212258114498416, "get_ui_image": 0.06758519593506945, "step_physics": 0.1492970176438844, "survival_time": 14.050000000000065, "driven_lanedir": 1.962977711206244, "get_state_dump": 0.016646542158839542, "sim_render-ego": 0.009256269583922687, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.062384636800908534, "deviation-heading": 1.029228770333079, "complete-iteration": 0.3599352675400595, "set_robot_commands": 0.00642162031126192, "deviation-center-line": 0.39052594361571735, "driven_lanedir_consec": 1.962977711206244, "sim_compute_sim_state": 0.021121514649577837, "sim_compute_performance-ego": 0.0061186208419528295, "sim_compute_robot_state-ego": 0.010782790777946282, "sim_compute_robot_state-parked0": 0.010117676758681329}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.6737597753451676, "get_ui_image": 0.06885871807734172, "step_physics": 0.1447382640838623, "survival_time": 14.950000000000076, "driven_lanedir": 2.470864775991678, "get_state_dump": 0.01589625040690104, "sim_render-ego": 0.008806612491607666, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.06183804194132487, "deviation-heading": 1.5283847522401466, "complete-iteration": 0.3538481338818868, "set_robot_commands": 0.006367595195770264, "deviation-center-line": 0.5001721982884769, "driven_lanedir_consec": 2.470864775991678, "sim_compute_sim_state": 0.019991047382354736, "sim_compute_performance-ego": 0.005922951698303223, "sim_compute_robot_state-ego": 0.011143608887990316, "sim_compute_robot_state-parked0": 0.010086995760599772}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.002341625436066, "get_ui_image": 0.07321377356847127, "step_physics": 0.1618553352355957, "survival_time": 14.950000000000076, "driven_lanedir": 2.5712629857347715, "get_state_dump": 0.016308940251668295, "sim_render-ego": 0.009390660921732585, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.0700829275449117, "deviation-heading": 1.6263883061673148, "complete-iteration": 0.384908705552419, "set_robot_commands": 0.006142336527506511, "deviation-center-line": 0.7139065092745842, "driven_lanedir_consec": 2.5712629857347715, "sim_compute_sim_state": 0.020598697662353515, "sim_compute_performance-ego": 0.006444221337636312, "sim_compute_robot_state-ego": 0.010684008598327636, "sim_compute_robot_state-parked0": 0.00996335744857788}}
set_robot_commands_max0.007180742649216726
set_robot_commands_mean0.006526195581363746
set_robot_commands_median0.006469036491680083
set_robot_commands_min0.006142336527506511
sim_compute_performance-ego_max0.006537285645802816
sim_compute_performance-ego_mean0.006285481806977173
sim_compute_performance-ego_median0.006261179957066314
sim_compute_performance-ego_min0.005922951698303223
sim_compute_robot_state-ego_max0.01168743339744774
sim_compute_robot_state-ego_mean0.0110565324838693
sim_compute_robot_state-ego_median0.011013935407002767
sim_compute_robot_state-ego_min0.01045381811867773
sim_compute_robot_state-parked0_max0.01097748810763186
sim_compute_robot_state-parked0_mean0.010257053691130802
sim_compute_robot_state-parked0_median0.010173960165543993
sim_compute_robot_state-parked0_min0.00996335744857788
sim_compute_sim_state_max0.02496895542392483
sim_compute_sim_state_mean0.020431651558337222
sim_compute_sim_state_median0.02057637166132969
sim_compute_sim_state_min0.016798925399780274
sim_render-ego_max0.009419324398040772
sim_render-ego_mean0.009175682545096028
sim_render-ego_median0.009194032789824846
sim_render-ego_min0.008806612491607666
simulation-passed1
step_physics_max0.1783115616092434
step_physics_mean0.1534948643447019
step_physics_median0.15437111071176723
step_physics_min0.13596367712465593
survival_time_max14.950000000000076
survival_time_mean12.675000000000043
survival_time_min7.699999999999981
No reset possible