Duckietown Challenges Home Challenges Submissions

Evaluator 2311

ID2311
evaluatorafdaniele14-c2f8de79a86b-1
ownerI don't have one πŸ˜€
machinebox1
processafdaniele14-c2f8de79a86b-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 42424
# timeout
# failed
# error1 42431
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4245311457Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LF-sim-validationLFv-simsuccessnoafdaniele14-c2f8de79a86b-10:13:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.443965542220632
survival_time_median14.950000000000076
deviation-center-line_median0.9910148114158884
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.04200739622116089
agent_compute-ego_mean0.03839268267154694
agent_compute-ego_median0.03927411913871765
agent_compute-ego_min0.033015096187591554
complete-iteration_max0.34394513765970863
complete-iteration_mean0.33225452244281767
complete-iteration_median0.33746140480041503
complete-iteration_min0.31015014251073203
deviation-center-line_max1.6057017977503962
deviation-center-line_mean1.114638858873506
deviation-center-line_min0.8708240149118502
deviation-heading_max6.901162127754947
deviation-heading_mean3.4657048371449424
deviation-heading_median2.3995877683129367
deviation-heading_min2.1624816841989496
driven_any_max5.971089782381822
driven_any_mean4.533419389807312
driven_any_median4.6941419174556085
driven_any_min2.774303941936213
driven_lanedir_consec_max5.873012229540927
driven_lanedir_consec_mean4.367163523058167
driven_lanedir_consec_min2.707710778250479
driven_lanedir_max5.873012229540927
driven_lanedir_mean4.367163523058167
driven_lanedir_median4.443965542220632
driven_lanedir_min2.707710778250479
get_duckie_state_max2.924601236979167e-06
get_duckie_state_mean2.8693675994873047e-06
get_duckie_state_median2.895991007486979e-06
get_duckie_state_min2.7608871459960938e-06
get_robot_state_max0.02332411766052246
get_robot_state_mean0.022958818674087524
get_robot_state_median0.02303043842315674
get_robot_state_min0.02245028018951416
get_state_dump_max0.019661777019500733
get_state_dump_mean0.019364458123842875
get_state_dump_median0.019379958709081012
get_state_dump_min0.01903613805770874
get_ui_image_max0.054824076493581134
get_ui_image_mean0.0530844235420227
get_ui_image_median0.054218165079752606
get_ui_image_min0.049077287515004474
in-drivable-lane_max5.350000000000069
in-drivable-lane_mean1.3375000000000172
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.971089782381822, "get_ui_image": 0.049077287515004474, "step_physics": 0.12273714860280356, "survival_time": 14.950000000000076, "driven_lanedir": 5.873012229540927, "get_state_dump": 0.01903613805770874, "sim_render-ego": 0.009668842156728108, "get_robot_state": 0.02332411766052246, "get_duckie_state": 2.924601236979167e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.033015096187591554, "deviation-heading": 2.1624816841989496, "complete-iteration": 0.31015014251073203, "set_robot_commands": 0.006942277749379476, "deviation-center-line": 0.9557286386120613, "driven_lanedir_consec": 5.873012229540927, "sim_compute_sim_state": 0.04010027329126994, "sim_compute_performance-ego": 0.006083556811014811}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.7592301228883302, "get_ui_image": 0.054824076493581134, "step_physics": 0.1321378493309021, "survival_time": 14.950000000000076, "driven_lanedir": 3.3590416953375595, "get_state_dump": 0.019537739753723145, "sim_render-ego": 0.010185168584187826, "get_robot_state": 0.02296948035558065, "get_duckie_state": 2.923011779785156e-06, "in-drivable-lane": 5.350000000000069, "agent_compute-ego": 0.03999476512273153, "deviation-heading": 2.5576830936903896, "complete-iteration": 0.3345143604278564, "set_robot_commands": 0.007346588770548503, "deviation-center-line": 0.8708240149118502, "driven_lanedir_consec": 3.3590416953375595, "sim_compute_sim_state": 0.04088052988052368, "sim_compute_performance-ego": 0.006468950112660726}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.774303941936213, "get_ui_image": 0.05402585903803508, "step_physics": 0.13604360659917197, "survival_time": 14.950000000000076, "driven_lanedir": 2.707710778250479, "get_state_dump": 0.019661777019500733, "sim_render-ego": 0.010011203289031982, "get_robot_state": 0.02309139649073283, "get_duckie_state": 2.868970235188802e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04200739622116089, "deviation-heading": 6.901162127754947, "complete-iteration": 0.34040844917297364, "set_robot_commands": 0.007368206977844238, "deviation-center-line": 1.6057017977503962, "driven_lanedir_consec": 2.707710778250479, "sim_compute_sim_state": 0.04177735408147176, "sim_compute_performance-ego": 0.0062535834312438966}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.629053712022886, "get_ui_image": 0.054410471121470134, "step_physics": 0.13693495194117228, "survival_time": 14.950000000000076, "driven_lanedir": 5.528889389103705, "get_state_dump": 0.01922217766443888, "sim_render-ego": 0.010075606505076091, "get_robot_state": 0.02245028018951416, "get_duckie_state": 2.7608871459960938e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.038553473154703775, "deviation-heading": 2.241492442935484, "complete-iteration": 0.34394513765970863, "set_robot_commands": 0.007144268353780111, "deviation-center-line": 1.0263009842197155, "driven_lanedir_consec": 5.528889389103705, "sim_compute_sim_state": 0.048677525520324706, "sim_compute_performance-ego": 0.006308555603027344}}
set_robot_commands_max0.007368206977844238
set_robot_commands_mean0.0072003354628880824
set_robot_commands_median0.007245428562164306
set_robot_commands_min0.006942277749379476
sim_compute_performance-ego_max0.006468950112660726
sim_compute_performance-ego_mean0.006278661489486694
sim_compute_performance-ego_median0.00628106951713562
sim_compute_performance-ego_min0.006083556811014811
sim_compute_sim_state_max0.048677525520324706
sim_compute_sim_state_mean0.04285892069339752
sim_compute_sim_state_median0.04132894198099772
sim_compute_sim_state_min0.04010027329126994
sim_render-ego_max0.010185168584187826
sim_render-ego_mean0.009985205133756002
sim_render-ego_median0.010043404897054038
sim_render-ego_min0.009668842156728108
simulation-passed1
step_physics_max0.13693495194117228
step_physics_mean0.13196338911851246
step_physics_median0.13409072796503702
step_physics_min0.12273714860280356
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4244611455Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessnoafdaniele14-c2f8de79a86b-10:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.509703988821926
survival_time_median8.424999999999985
deviation-center-line_median0.49528443420975343
in-drivable-lane_median0.5000000000000027


other stats
agent_compute-ego_max0.02638568176082307
agent_compute-ego_mean0.02546992519671671
agent_compute-ego_median0.025607361313940463
agent_compute-ego_min0.02427929639816284
complete-iteration_max0.28908857742945354
complete-iteration_mean0.2812597209630276
complete-iteration_median0.2798960431125657
complete-iteration_min0.2761582201975255
deviation-center-line_max0.6894493920572036
deviation-center-line_mean0.4858781439925763
deviation-center-line_min0.26349431549359487
deviation-heading_max2.9435581391633985
deviation-heading_mean2.1864135776435827
deviation-heading_median2.412526139218576
deviation-heading_min0.9770438929737806
driven_any_max3.1484587729879094
driven_any_mean2.204657273544162
driven_any_median2.1124496155450263
driven_any_min1.445271090098687
driven_lanedir_consec_max1.839622598971531
driven_lanedir_consec_mean1.4630891412027809
driven_lanedir_consec_min0.9933259881957396
driven_lanedir_max1.839622598971531
driven_lanedir_mean1.4630891412027809
driven_lanedir_median1.509703988821926
driven_lanedir_min0.9933259881957396
get_duckie_state_max2.947946389516195e-06
get_duckie_state_mean2.9005625725683544e-06
get_duckie_state_median2.9193121811439255e-06
get_duckie_state_min2.8156795384693732e-06
get_robot_state_max0.02291922171910604
get_robot_state_mean0.020837581857243458
get_robot_state_median0.02037659878360814
get_robot_state_min0.019677908142651516
get_state_dump_max0.020058164993921917
get_state_dump_mean0.019727109976900407
get_state_dump_median0.019784491078640595
get_state_dump_min0.01928129275639852
get_ui_image_max0.0445190970102946
get_ui_image_mean0.044198410457369094
get_ui_image_median0.04449391469420343
get_ui_image_min0.043286715430774905
in-drivable-lane_max8.650000000000054
in-drivable-lane_mean2.512500000000015
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.445271090098687, "get_ui_image": 0.04447492708762487, "step_physics": 0.11014014730850856, "survival_time": 4.799999999999991, "driven_lanedir": 1.2188656183196276, "get_state_dump": 0.020058164993921917, "sim_render-ego": 0.00869526465733846, "get_robot_state": 0.02099798619747162, "get_duckie_state": 2.947946389516195e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.02427929639816284, "deviation-heading": 0.9770438929737806, "complete-iteration": 0.27698716272910434, "set_robot_commands": 0.007421649992465973, "deviation-center-line": 0.26349431549359487, "driven_lanedir_consec": 1.2188656183196276, "sim_compute_sim_state": 0.03460819522539774, "sim_compute_performance-ego": 0.006136116882165273}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.053298753499872, "get_ui_image": 0.044512902300782, "step_physics": 0.11094474353673268, "survival_time": 8.14999999999998, "driven_lanedir": 1.8005423593242242, "get_state_dump": 0.019652695743584195, "sim_render-ego": 0.008751088124842732, "get_robot_state": 0.019677908142651516, "get_duckie_state": 2.8156795384693732e-06, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.02638568176082307, "deviation-heading": 2.3255232848512, "complete-iteration": 0.2761582201975255, "set_robot_commands": 0.00700776416099876, "deviation-center-line": 0.559791546084838, "driven_lanedir_consec": 1.8005423593242242, "sim_compute_sim_state": 0.03307125319732479, "sim_compute_performance-ego": 0.005978534558068024}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1484587729879094, "get_ui_image": 0.0445190970102946, "step_physics": 0.1160320766766866, "survival_time": 14.950000000000076, "driven_lanedir": 0.9933259881957396, "get_state_dump": 0.01928129275639852, "sim_render-ego": 0.009494892756144206, "get_robot_state": 0.02291922171910604, "get_duckie_state": 2.921422322591146e-06, "in-drivable-lane": 8.650000000000054, "agent_compute-ego": 0.02606985648473104, "deviation-heading": 2.9435581391633985, "complete-iteration": 0.28908857742945354, "set_robot_commands": 0.00777711550394694, "deviation-center-line": 0.4307773223346688, "driven_lanedir_consec": 0.9933259881957396, "sim_compute_sim_state": 0.036669175624847415, "sim_compute_performance-ego": 0.006148847738901774}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.1716004775901805, "get_ui_image": 0.043286715430774905, "step_physics": 0.1144790115027592, "survival_time": 8.699999999999989, "driven_lanedir": 1.839622598971531, "get_state_dump": 0.01991628641369699, "sim_render-ego": 0.008575657318378317, "get_robot_state": 0.019755211369744664, "get_duckie_state": 2.9172020396967046e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.02514486614314989, "deviation-heading": 2.499528993585952, "complete-iteration": 0.2828049234960271, "set_robot_commands": 0.006972266339707649, "deviation-center-line": 0.6894493920572036, "driven_lanedir_consec": 1.839622598971531, "sim_compute_sim_state": 0.03840545128131735, "sim_compute_performance-ego": 0.006085720555535678}}
set_robot_commands_max0.00777711550394694
set_robot_commands_mean0.00729469899927983
set_robot_commands_median0.007214707076732366
set_robot_commands_min0.006972266339707649
sim_compute_performance-ego_max0.006148847738901774
sim_compute_performance-ego_mean0.006087304933667687
sim_compute_performance-ego_median0.006110918718850476
sim_compute_performance-ego_min0.005978534558068024
sim_compute_sim_state_max0.03840545128131735
sim_compute_sim_state_mean0.03568851883222182
sim_compute_sim_state_median0.03563868542512258
sim_compute_sim_state_min0.03307125319732479
sim_render-ego_max0.009494892756144206
sim_render-ego_mean0.00887922571417593
sim_render-ego_median0.008723176391090597
sim_render-ego_min0.008575657318378317
simulation-passed1
step_physics_max0.1160320766766866
step_physics_mean0.11289899475617177
step_physics_median0.11271187751974596
step_physics_min0.11014014730850856
survival_time_max14.950000000000076
survival_time_mean9.15000000000001
survival_time_min4.799999999999991
No reset possible
4243911453Cliff ChandlerΒ πŸ‡ΊπŸ‡Έbaseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoafdaniele14-c2f8de79a86b-10:10:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4299972854012577
survival_time_median14.950000000000076
deviation-center-line_median0.6347723288289412
in-drivable-lane_median2.400000000000034


other stats
agent_compute-ego_max0.02389781395594279
agent_compute-ego_mean0.023699091374874113
agent_compute-ego_median0.02375556409358978
agent_compute-ego_min0.023387423356374105
complete-iteration_max0.29605392694473265
complete-iteration_mean0.28157941649357476
complete-iteration_median0.27817690233389536
complete-iteration_min0.27390993436177574
deviation-center-line_max0.822787786458942
deviation-center-line_mean0.5796607006290799
deviation-center-line_min0.22631035839949523
deviation-heading_max3.0588426484777873
deviation-heading_mean1.5926732683106275
deviation-heading_median1.148438469935689
deviation-heading_min1.0149734848933436
driven_any_max1.9399940002822296
driven_any_mean1.840472476998091
driven_any_median1.9367903610068948
driven_any_min1.5483151856963442
driven_lanedir_consec_max1.7026531649923136
driven_lanedir_consec_mean1.2891553211490248
driven_lanedir_consec_min0.5939735488012707
driven_lanedir_max1.7026531649923136
driven_lanedir_mean1.3504920114969174
driven_lanedir_median1.5526706660970429
driven_lanedir_min0.5939735488012707
get_duckie_state_max4.280408223470052e-06
get_duckie_state_mean4.216233889261881e-06
get_duckie_state_median4.1985511779785155e-06
get_duckie_state_min4.1874249776204425e-06
get_robot_state_max0.023989349206288656
get_robot_state_mean0.02170222262541453
get_robot_state_median0.02135157267252604
get_robot_state_min0.020116395950317383
get_state_dump_max0.019942586421966554
get_state_dump_mean0.019771979053815204
get_state_dump_median0.019803301095962525
get_state_dump_min0.01953872760136922
get_ui_image_max0.045091365973154704
get_ui_image_mean0.04496339445312818
get_ui_image_median0.04497530619303386
get_ui_image_min0.0448115994532903
in-drivable-lane_max7.000000000000045
in-drivable-lane_mean3.3625000000000345
in-drivable-lane_min1.6500000000000234
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336110806052056, "get_ui_image": 0.044969242413838706, "step_physics": 0.11285057624181112, "survival_time": 14.950000000000076, "driven_lanedir": 1.4868403203380884, "get_state_dump": 0.019942586421966554, "sim_render-ego": 0.008951058387756347, "get_robot_state": 0.020116395950317383, "get_duckie_state": 4.1874249776204425e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.02376619736353556, "deviation-heading": 3.0588426484777873, "complete-iteration": 0.2791609279314677, "set_robot_commands": 0.006842592557271322, "deviation-center-line": 0.8152783673747477, "driven_lanedir_consec": 1.2414935589465177, "sim_compute_sim_state": 0.03547708034515381, "sim_compute_performance-ego": 0.006063770453135172}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939969641408584, "get_ui_image": 0.044981369972229006, "step_physics": 0.10970118681589762, "survival_time": 14.950000000000076, "driven_lanedir": 1.6185010118559977, "get_state_dump": 0.01953872760136922, "sim_render-ego": 0.008864656289418538, "get_robot_state": 0.0205419397354126, "get_duckie_state": 4.196961720784505e-06, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.023387423356374105, "deviation-heading": 1.0599928766118685, "complete-iteration": 0.27390993436177574, "set_robot_commands": 0.007059804598490397, "deviation-center-line": 0.822787786458942, "driven_lanedir_consec": 1.6185010118559977, "sim_compute_sim_state": 0.033636659781138105, "sim_compute_performance-ego": 0.006017615000406901}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5483151856963442, "get_ui_image": 0.0448115994532903, "step_physics": 0.10922558705012005, "survival_time": 12.000000000000036, "driven_lanedir": 0.5939735488012707, "get_state_dump": 0.01979361375172933, "sim_render-ego": 0.009383522470792134, "get_robot_state": 0.022161205609639485, "get_duckie_state": 4.200140635172526e-06, "in-drivable-lane": 7.000000000000045, "agent_compute-ego": 0.023744930823644, "deviation-heading": 1.0149734848933436, "complete-iteration": 0.27719287673632304, "set_robot_commands": 0.007706096768379212, "deviation-center-line": 0.22631035839949523, "driven_lanedir_consec": 0.5939735488012707, "sim_compute_sim_state": 0.03410640358924866, "sim_compute_performance-ego": 0.006077149510383606}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399940002822296, "get_ui_image": 0.045091365973154704, "step_physics": 0.11786283493041992, "survival_time": 14.950000000000076, "driven_lanedir": 1.7026531649923136, "get_state_dump": 0.01981298844019572, "sim_render-ego": 0.009853761990865071, "get_robot_state": 0.023989349206288656, "get_duckie_state": 4.280408223470052e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.02389781395594279, "deviation-heading": 1.23688406325951, "complete-iteration": 0.29605392694473265, "set_robot_commands": 0.008190494378407796, "deviation-center-line": 0.4542662902831347, "driven_lanedir_consec": 1.7026531649923136, "sim_compute_sim_state": 0.04100435256958008, "sim_compute_performance-ego": 0.006166086991628011}}
set_robot_commands_max0.008190494378407796
set_robot_commands_mean0.007449747075637182
set_robot_commands_median0.0073829506834348045
set_robot_commands_min0.006842592557271322
sim_compute_performance-ego_max0.006166086991628011
sim_compute_performance-ego_mean0.006081155488888422
sim_compute_performance-ego_median0.006070459981759389
sim_compute_performance-ego_min0.006017615000406901
sim_compute_sim_state_max0.04100435256958008
sim_compute_sim_state_mean0.03605612407128016
sim_compute_sim_state_median0.03479174196720124
sim_compute_sim_state_min0.033636659781138105
sim_render-ego_max0.009853761990865071
sim_render-ego_mean0.009263249784708024
sim_render-ego_median0.00916729042927424
sim_render-ego_min0.008864656289418538
simulation-passed1
step_physics_max0.11786283493041992
step_physics_mean0.11241004625956218
step_physics_median0.11127588152885436
step_physics_min0.10922558705012005
survival_time_max14.950000000000076
survival_time_mean14.212500000000066
survival_time_min12.000000000000036
No reset possible
4243711451Aleksandar PetrovΒ πŸ‡¨πŸ‡­exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoafdaniele14-c2f8de79a86b-10:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7955137034540066
survival_time_median6.499999999999988
deviation-center-line_median0.16046531334123337
in-drivable-lane_median1.8749999999999964


other stats
agent_compute-ego_max0.024778386820917545
agent_compute-ego_mean0.0242387181719032
agent_compute-ego_median0.024327363286699568
agent_compute-ego_min0.02352175929329612
complete-iteration_max0.28876925650097074
complete-iteration_mean0.27905218955848077
complete-iteration_median0.2778019794362336
complete-iteration_min0.2718355428604853
deviation-center-line_max0.27826137993446565
deviation-center-line_mean0.16815556309769514
deviation-center-line_min0.07343024577384821
deviation-heading_max0.5705858770134726
deviation-heading_mean0.4313807344391016
deviation-heading_median0.40681310901046014
deviation-heading_min0.3413108427220136
driven_any_max2.8166528663194685
driven_any_mean1.93440316633633
driven_any_median2.135311158620138
driven_any_min0.6503374817855758
driven_lanedir_consec_max1.9766897141280495
driven_lanedir_consec_mean0.998707962151866
driven_lanedir_consec_min0.42711472757140134
driven_lanedir_max1.9766897141280495
driven_lanedir_mean0.998707962151866
driven_lanedir_median0.7955137034540066
driven_lanedir_min0.42711472757140134
get_duckie_state_max3.106537319365002e-06
get_duckie_state_mean2.8870936708218765e-06
get_duckie_state_median2.9258723091141284e-06
get_duckie_state_min2.590092745694247e-06
get_robot_state_max0.024266398471334705
get_robot_state_mean0.021636913968932036
get_robot_state_median0.021217595963251023
get_robot_state_min0.019846065477891403
get_state_dump_max0.02019201083616777
get_state_dump_mean0.01992203075485716
get_state_dump_median0.01989731636847028
get_state_dump_min0.019701479446320308
get_ui_image_max0.04616105556488037
get_ui_image_mean0.04474882181448472
get_ui_image_median0.04449743387244996
get_ui_image_min0.04383936394815859
in-drivable-lane_max6.0999999999999845
in-drivable-lane_mean2.6124999999999945
in-drivable-lane_min0.5999999999999994
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.453969450920836, "get_ui_image": 0.04383936394815859, "step_physics": 0.10815192564674046, "survival_time": 4.599999999999992, "driven_lanedir": 0.9417719874933046, "get_state_dump": 0.01993855445281319, "sim_render-ego": 0.009805497915848442, "get_robot_state": 0.024266398471334705, "get_duckie_state": 2.9595001884128735e-06, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.024778386820917545, "deviation-heading": 0.3413108427220136, "complete-iteration": 0.280994246835294, "set_robot_commands": 0.008182219837022863, "deviation-center-line": 0.27826137993446565, "driven_lanedir_consec": 0.9417719874933046, "sim_compute_sim_state": 0.035648789094841996, "sim_compute_performance-ego": 0.006196758021479068}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6503374817855758, "get_ui_image": 0.04616105556488037, "step_physics": 0.11145563559098676, "survival_time": 2.2, "driven_lanedir": 0.42711472757140134, "get_state_dump": 0.02019201083616777, "sim_render-ego": 0.008656734769994562, "get_robot_state": 0.019846065477891403, "get_duckie_state": 2.590092745694247e-06, "in-drivable-lane": 0.5999999999999994, "agent_compute-ego": 0.02352175929329612, "deviation-heading": 0.3987533767534558, "complete-iteration": 0.27460971203717316, "set_robot_commands": 0.007010221481323242, "deviation-center-line": 0.13028918484893084, "driven_lanedir_consec": 0.42711472757140134, "sim_compute_sim_state": 0.0315690203146501, "sim_compute_performance-ego": 0.006020665168762207}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8166528663194685, "get_ui_image": 0.04416255156199137, "step_physics": 0.10548068512053715, "survival_time": 8.399999999999984, "driven_lanedir": 0.6492554194147087, "get_state_dump": 0.019701479446320308, "sim_render-ego": 0.009223928054173788, "get_robot_state": 0.02130239208539327, "get_duckie_state": 3.106537319365002e-06, "in-drivable-lane": 6.0999999999999845, "agent_compute-ego": 0.024741248005912417, "deviation-heading": 0.4148728412674645, "complete-iteration": 0.2718355428604853, "set_robot_commands": 0.007823491380328224, "deviation-center-line": 0.07343024577384821, "driven_lanedir_consec": 0.6492554194147087, "sim_compute_sim_state": 0.033058211916968935, "sim_compute_performance-ego": 0.006153488443011329}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.816652866319441, "get_ui_image": 0.04483231618290856, "step_physics": 0.1155156053247906, "survival_time": 8.399999999999984, "driven_lanedir": 1.9766897141280495, "get_state_dump": 0.01985607828412737, "sim_render-ego": 0.009007253817149572, "get_robot_state": 0.021132799841108777, "get_duckie_state": 2.8922444298153833e-06, "in-drivable-lane": 2.299999999999998, "agent_compute-ego": 0.02391347856748672, "deviation-heading": 0.5705858770134726, "complete-iteration": 0.28876925650097074, "set_robot_commands": 0.007269345578693208, "deviation-center-line": 0.19064144183353585, "driven_lanedir_consec": 1.9766897141280495, "sim_compute_sim_state": 0.04092161286444891, "sim_compute_performance-ego": 0.006135956162498111}}
set_robot_commands_max0.008182219837022863
set_robot_commands_mean0.007571319569341884
set_robot_commands_median0.007546418479510716
set_robot_commands_min0.007010221481323242
sim_compute_performance-ego_max0.006196758021479068
sim_compute_performance-ego_mean0.006126716948937679
sim_compute_performance-ego_median0.006144722302754721
sim_compute_performance-ego_min0.006020665168762207
sim_compute_sim_state_max0.04092161286444891
sim_compute_sim_state_mean0.035299408547727486
sim_compute_sim_state_median0.034353500505905465
sim_compute_sim_state_min0.0315690203146501
sim_render-ego_max0.009805497915848442
sim_render-ego_mean0.00917335363929159
sim_render-ego_median0.00911559093566168
sim_render-ego_min0.008656734769994562
simulation-passed1
step_physics_max0.1155156053247906
step_physics_mean0.11015096292076376
step_physics_median0.10980378061886362
step_physics_min0.10548068512053715
survival_time_max8.399999999999984
survival_time_mean5.89999999999999
survival_time_min2.2
No reset possible
4243111449Cliff ChandlerΒ πŸ‡ΊπŸ‡Έtemplate-pytorchaido5-LF-sim-validationLFv-simerrornoafdaniele14-c2f8de79a86b-10:05:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 21, in init
             ||     self.check_gpu_available(context)
             ||   File "solution.py", line 48, in check_gpu_available
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 21, in init
             || |     self.check_gpu_available(context)
             || |   File "solution.py", line 48, in check_gpu_available
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4242411448Cliff ChandlerΒ πŸ‡ΊπŸ‡Έtemplate-randomaido5-LF-sim-validationLFv-simsuccessnoafdaniele14-c2f8de79a86b-10:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.02404939686810529
agent_compute-ego_mean0.02381116313891603
agent_compute-ego_median0.023819869245451784
agent_compute-ego_min0.023555517196655273
complete-iteration_max0.26953669930949353
complete-iteration_mean0.25903598966289243
complete-iteration_median0.2559294574603448
complete-iteration_min0.2547483444213867
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max3.3257371288234903e-06
get_duckie_state_mean3.0428956671862936e-06
get_duckie_state_median2.9897019933162214e-06
get_duckie_state_min2.86644155328924e-06
get_robot_state_max0.018669621419098417
get_robot_state_mean0.01852515007906312
get_robot_state_median0.01851504110894136
get_robot_state_min0.01840089667927135
get_state_dump_max0.018645335051972987
get_state_dump_mean0.018462462828939458
get_state_dump_median0.01852284701986345
get_state_dump_min0.01815882222405795
get_ui_image_max0.04179615085407839
get_ui_image_mean0.0414957483148437
get_ui_image_median0.04163273068984654
get_ui_image_min0.040921381025603325
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.04179615085407839, "step_physics": 0.10052301520008151, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.018645335051972987, "sim_render-ego": 0.008106963109161895, "get_robot_state": 0.018669621419098417, "get_duckie_state": 3.3257371288234903e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.0238154621447547, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.2558892015683449, "set_robot_commands": 0.00686822907399323, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.0314238354311151, "sim_compute_performance-ego": 0.005855782557342012}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.04158988492242221, "step_physics": 0.10164278129051472, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.01815882222405795, "sim_render-ego": 0.008168705578508049, "get_robot_state": 0.018486762868946995, "get_duckie_state": 3.0583348767510776e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.023555517196655273, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.2547483444213867, "set_robot_commands": 0.0069881965374124465, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.03029111336017477, "sim_compute_performance-ego": 0.005666675238773741}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.04167557645727087, "step_physics": 0.09953311460989492, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.01860394831056948, "sim_render-ego": 0.00922840259693287, "get_robot_state": 0.018543319348935727, "get_duckie_state": 2.9210691098813657e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.02404939686810529, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.25596971335234464, "set_robot_commands": 0.006751060485839844, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.03168031727826154, "sim_compute_performance-ego": 0.005720106760660807}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.040921381025603325, "step_physics": 0.10956893003348148, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.018441745729157417, "sim_render-ego": 0.008029533155036695, "get_robot_state": 0.01840089667927135, "get_duckie_state": 2.86644155328924e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.023824276346148865, "deviation-heading": 0.976837469261332, "complete-iteration": 0.26953669930949353, "set_robot_commands": 0.006902315399863503, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.0376201994491346, "sim_compute_performance-ego": 0.005638052116740833}}
set_robot_commands_max0.0069881965374124465
set_robot_commands_mean0.006877450374277255
set_robot_commands_median0.006885272236928367
set_robot_commands_min0.006751060485839844
sim_compute_performance-ego_max0.005855782557342012
sim_compute_performance-ego_mean0.0057201541683793485
sim_compute_performance-ego_median0.005693390999717274
sim_compute_performance-ego_min0.005638052116740833
sim_compute_sim_state_max0.0376201994491346
sim_compute_sim_state_mean0.0327538663796715
sim_compute_sim_state_median0.03155207635468832
sim_compute_sim_state_min0.03029111336017477
sim_render-ego_max0.00922840259693287
sim_render-ego_mean0.008383401109909877
sim_render-ego_median0.008137834343834971
sim_render-ego_min0.008029533155036695
simulation-passed1
step_physics_max0.10956893003348148
step_physics_mean0.10281696028349316
step_physics_median0.10108289824529812
step_physics_min0.09953311460989492
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible