308256335Gianmarco Bernasconi challenge-aido_LF-VanillaCNN aido3-off-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 6 months 5 years, 6 months 0:09:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.1870173906147663 survival_time_median 14.950000000000076 deviation-center-line_median 0.5624154147124506 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.029080402851104737 agent_compute-ego_mean 0.02821737994483454 agent_compute-ego_median 0.028157389163970942 agent_compute-ego_min 0.02742022542811152 deviation-center-line_max 0.7431937878374654 deviation-center-line_mean 0.5618590024139108 deviation-center-line_min 0.2986464040777921 deviation-heading_max 3.6530001079594743 deviation-heading_mean 2.5315933186880115 deviation-heading_median 2.5549023928582124 deviation-heading_min 1.4478135437075894 driven_any_max 2.2469978109630167 driven_any_mean 1.9933132821907136 driven_any_median 2.246969307099983 driven_any_min 0.978676811580312 driven_lanedir_consec_max 2.210252145420446 driven_lanedir_consec_mean 1.9000281836369224 driven_lanedir_consec_min 0.7585532564597317 driven_lanedir_max 2.210252145420446 driven_lanedir_mean 1.9000281836369224 driven_lanedir_median 2.1870173906147663 driven_lanedir_min 0.7585532564597317 in-drivable-lane_max 1.0499999999999965 in-drivable-lane_mean 0.20999999999999924 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.246951244515383, "sim_physics": 0.07549310286839803, "survival_time": 14.950000000000076, "driven_lanedir": 2.144968607917706, "sim_render-ego": 0.009343663851420084, "in-drivable-lane": 0, "agent_compute-ego": 0.029080402851104737, "deviation-heading": 3.6530001079594743, "set_robot_commands": 0.007312250137329101, "deviation-center-line": 0.7431937878374654, "driven_lanedir_consec": 2.144968607917706, "sim_compute_sim_state": 0.004038800398508707, "sim_compute_performance-ego": 0.005475602944691976, "sim_compute_robot_state-ego": 0.006888665358225504}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.246969307099983, "sim_physics": 0.07608794530232747, "survival_time": 14.950000000000076, "driven_lanedir": 2.199349517771964, "sim_render-ego": 0.009366012414296469, "in-drivable-lane": 0, "agent_compute-ego": 0.028115024566650392, "deviation-heading": 2.5549023928582124, "set_robot_commands": 0.007063601016998291, "deviation-center-line": 0.5049179677025469, "driven_lanedir_consec": 2.199349517771964, "sim_compute_sim_state": 0.003971669673919678, "sim_compute_performance-ego": 0.005371978282928467, "sim_compute_robot_state-ego": 0.006840951442718506}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.978676811580312, "sim_physics": 0.07512171588726897, "survival_time": 6.699999999999984, "driven_lanedir": 0.7585532564597317, "sim_render-ego": 0.009190543374018884, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02742022542811152, "deviation-heading": 1.4478135437075894, "set_robot_commands": 0.006840205904263169, "deviation-center-line": 0.2986464040777921, "driven_lanedir_consec": 0.7585532564597317, "sim_compute_sim_state": 0.003890898690294864, "sim_compute_performance-ego": 0.0052051544189453125, "sim_compute_robot_state-ego": 0.006559718900652074}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2469712367948724, "sim_physics": 0.07744813283284505, "survival_time": 14.950000000000076, "driven_lanedir": 2.1870173906147663, "sim_render-ego": 0.009526306788126628, "in-drivable-lane": 0, "agent_compute-ego": 0.028157389163970942, "deviation-heading": 2.567546958136153, "set_robot_commands": 0.006879146099090576, "deviation-center-line": 0.7001214377392992, "driven_lanedir_consec": 2.1870173906147663, "sim_compute_sim_state": 0.004100848038991293, "sim_compute_performance-ego": 0.005474214553833008, "sim_compute_robot_state-ego": 0.006840945879618327}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2469978109630167, "sim_physics": 0.07724421103795369, "survival_time": 14.950000000000076, "driven_lanedir": 2.210252145420446, "sim_render-ego": 0.0096012012163798, "in-drivable-lane": 0, "agent_compute-ego": 0.028313857714335124, "deviation-heading": 2.4347035907786276, "set_robot_commands": 0.007077913284301757, "deviation-center-line": 0.5624154147124506, "driven_lanedir_consec": 2.210252145420446, "sim_compute_sim_state": 0.0040339469909667965, "sim_compute_performance-ego": 0.005423686504364014, "sim_compute_robot_state-ego": 0.006858104070027669}}set_robot_commands_max 0.007312250137329101 set_robot_commands_mean 0.0070346232883965795 set_robot_commands_median 0.007063601016998291 set_robot_commands_min 0.006840205904263169 sim_compute_performance-ego_max 0.005475602944691976 sim_compute_performance-ego_mean 0.005390127340952555 sim_compute_performance-ego_median 0.005423686504364014 sim_compute_performance-ego_min 0.0052051544189453125 sim_compute_robot_state-ego_max 0.006888665358225504 sim_compute_robot_state-ego_mean 0.006797677130248416 sim_compute_robot_state-ego_median 0.006840951442718506 sim_compute_robot_state-ego_min 0.006559718900652074 sim_compute_sim_state_max 0.004100848038991293 sim_compute_sim_state_mean 0.004007232758536268 sim_compute_sim_state_median 0.0040339469909667965 sim_compute_sim_state_min 0.003890898690294864 sim_physics_max 0.07744813283284505 sim_physics_mean 0.07627902158575864 sim_physics_median 0.07608794530232747 sim_physics_min 0.07512171588726897 sim_render-ego_max 0.0096012012163798 sim_render-ego_mean 0.009405545528848373 sim_render-ego_median 0.009366012414296469 sim_render-ego_min 0.009190543374018884 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.300000000000058 survival_time_min 6.699999999999984
No reset possible 308016325Lisa Rangosch challenge-aido_LF-template-random aido3-off-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 6 months 5 years, 6 months 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4838163264350306 survival_time_median 1.7000000000000008 deviation-center-line_median 0.08751730474052305 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.014482076351459207 agent_compute-ego_mean 0.013680492595062526 agent_compute-ego_median 0.013601314826089828 agent_compute-ego_min 0.013155292062198414 deviation-center-line_max 0.10683019887032848 deviation-center-line_mean 0.08719800587294524 deviation-center-line_min 0.07065220523066396 deviation-heading_max 0.5050851849885492 deviation-heading_mean 0.37472646794797326 deviation-heading_median 0.3711400756311837 deviation-heading_min 0.242154099114489 driven_any_max 1.224736399271231 driven_any_mean 0.7001682289165533 driven_any_median 0.6334906616120762 driven_any_min 0.311949329092399 driven_lanedir_consec_max 0.6642632200434848 driven_lanedir_consec_mean 0.47031102562542887 driven_lanedir_consec_min 0.28855079430839536 driven_lanedir_max 0.6642632200434848 driven_lanedir_mean 0.47031102562542887 driven_lanedir_median 0.4838163264350306 driven_lanedir_min 0.28855079430839536 in-drivable-lane_max 1.5999999999999963 in-drivable-lane_mean 0.4499999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.057126838427323565, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.007168636872218206, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.014482076351459207, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.005008486601022573, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.002743945671961858, "sim_compute_performance-ego": 0.004181357530447153, "sim_compute_robot_state-ego": 0.005039421411661001}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.057537424564361575, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.006965231895446777, "in-drivable-lane": 0, "agent_compute-ego": 0.013384497165679932, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.004866552352905273, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.002647137641906738, "sim_compute_performance-ego": 0.0038787126541137695, "sim_compute_robot_state-ego": 0.004894125461578369}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.05565376141492058, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.006867093198439654, "in-drivable-lane": 0, "agent_compute-ego": 0.013155292062198414, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.004779380910536822, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.002680063247680664, "sim_compute_performance-ego": 0.003888522877412684, "sim_compute_robot_state-ego": 0.004867820178761202}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.05435294792300365, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.007091467497778721, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.013601314826089828, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.004891188418278928, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.002728786624845911, "sim_compute_performance-ego": 0.003914754898821721, "sim_compute_robot_state-ego": 0.005033227263904008}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06031206521120938, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.007215239784934304, "in-drivable-lane": 0, "agent_compute-ego": 0.013779282569885254, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.004795713858170943, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.0027483051473444157, "sim_compute_performance-ego": 0.003954865715720437, "sim_compute_robot_state-ego": 0.005217010324651545}}set_robot_commands_max 0.005008486601022573 set_robot_commands_mean 0.004868264428182908 set_robot_commands_median 0.004866552352905273 set_robot_commands_min 0.004779380910536822 sim_compute_performance-ego_max 0.004181357530447153 sim_compute_performance-ego_mean 0.003963642735303153 sim_compute_performance-ego_median 0.003914754898821721 sim_compute_performance-ego_min 0.0038787126541137695 sim_compute_robot_state-ego_max 0.005217010324651545 sim_compute_robot_state-ego_mean 0.005010320928111225 sim_compute_robot_state-ego_median 0.005033227263904008 sim_compute_robot_state-ego_min 0.004867820178761202 sim_compute_sim_state_max 0.0027483051473444157 sim_compute_sim_state_mean 0.0027096476667479172 sim_compute_sim_state_median 0.002728786624845911 sim_compute_sim_state_min 0.002647137641906738 sim_physics_max 0.06031206521120938 sim_physics_mean 0.05699660750816375 sim_physics_median 0.057126838427323565 sim_physics_min 0.05435294792300365 sim_render-ego_max 0.007215239784934304 sim_render-ego_mean 0.007061533849763532 sim_render-ego_median 0.007091467497778721 sim_render-ego_min 0.006867093198439654 simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 1.8899999999999997 survival_time_min 1.0000000000000002
No reset possible 306955967c reddy challenge-aido_LF-baseline-duckietown aido3-LF-real-validationeval0-visualize aborted no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 2.542792658602044 survival_time 34 deviation-center-line 1.388712956199853 in-drivable-lane 12.666599999999995
other stats deviation-heading 6.099662810910446 driven_any 4.366948473112254 driven_lanedir 2.542792658602044 visualized-eval0-passed 1
No reset possible 305926018Philippe Marcotte pp + veh dect aido3-LFV-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0.962257982133532 survival_time 6 deviation-center-line 0.3492946278546323 in-drivable-lane 1.3333000000000004
other stats deviation-heading 1.5758262086433292 driven_any 1.6007595344643262 driven_lanedir 0.962257982133532 visualized-eval0-passed 1
No reset possible 305826063Oliver Widler challenge-aido_LF-template-pytorch aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 305605827Robert Moni kaland-225308 aido3-LFV-real-validationeval0-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 304776273Aleksei Shpilman 0439 seasons aido3-LFV-sim-testingstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:34:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.9550533222565054 survival_time_median 10.550000000000017 deviation-center-line_median 0.8916591753309837 in-drivable-lane_median 1.3000000000000016
other stats agent_compute-ego_max 0.024587164080239893 agent_compute-ego_mean 0.02292693658115076 agent_compute-ego_median 0.022809359986903303 agent_compute-ego_min 0.02158865247453962 deviation-center-line_max 1.2272445937465273 deviation-center-line_mean 0.7952393474221163 deviation-center-line_min 0.1587083208297919 deviation-heading_max 5.311841052505892 deviation-heading_mean 3.2428999053094993 deviation-heading_median 2.96443909456284 deviation-heading_min 1.430106431403272 driven_any_max 6.3238783117265145 driven_any_mean 3.8264452840059513 driven_any_median 3.619845114807396 driven_any_min 1.4933699971065175 driven_lanedir_consec_max 5.984700778532881 driven_lanedir_consec_mean 3.286604695927228 driven_lanedir_consec_min 0.7296872010003053 driven_lanedir_max 5.984700778532881 driven_lanedir_mean 3.286604695927228 driven_lanedir_median 2.9550533222565054 driven_lanedir_min 0.7296872010003053 in-drivable-lane_max 2.699999999999991 in-drivable-lane_mean 1.240000000000003 in-drivable-lane_min 0.05000000000000071 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.081485926179942, "sim_physics": 0.1324876479017056, "survival_time": 6.149999999999986, "driven_lanedir": 1.5278035075260872, "sim_render-ego": 0.0079241574295168, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.024587164080239893, "deviation-heading": 1.6650874193226046, "set_robot_commands": 0.006152647297556807, "deviation-center-line": 0.2534035901283986, "driven_lanedir_consec": 1.5278035075260872, "sim_compute_sim_state": 0.0032117928915876685, "sim_compute_performance-ego": 0.004472048302006915, "sim_compute_robot_state-ego": 0.005867992959371428, "sim_compute_robot_state-npc0": 0.005565234316073782, "sim_compute_robot_state-npc1": 0.005134179340145453, "sim_compute_robot_state-npc2": 0.005188261590352873, "sim_compute_robot_state-npc3": 0.005101081801623833}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.712853764854162, "sim_physics": 0.13776466131210327, "survival_time": 14.950000000000076, "driven_lanedir": 4.097488815652644, "sim_render-ego": 0.009327750205993652, "in-drivable-lane": 1.3000000000000054, "agent_compute-ego": 0.023120129108428956, "deviation-heading": 4.898988346476245, "set_robot_commands": 0.007322356700897216, "deviation-center-line": 1.1091885759354043, "driven_lanedir_consec": 4.097488815652644, "sim_compute_sim_state": 0.0037427035967508952, "sim_compute_performance-ego": 0.005334631601969401, "sim_compute_robot_state-ego": 0.0068832691510518395, "sim_compute_robot_state-npc0": 0.006710662047068278, "sim_compute_robot_state-npc1": 0.006347605387369792, "sim_compute_robot_state-npc2": 0.0064259568850199384, "sim_compute_robot_state-npc3": 0.006327776114145914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.498988695613085, "sim_physics": 0.13249331712722778, "survival_time": 14.950000000000076, "driven_lanedir": 4.947439501434664, "sim_render-ego": 0.008652230898539226, "in-drivable-lane": 1.3000000000000016, "agent_compute-ego": 0.021903897921244305, "deviation-heading": 3.705437199392485, "set_robot_commands": 0.006455938816070556, "deviation-center-line": 0.9386676476431252, "driven_lanedir_consec": 4.947439501434664, "sim_compute_sim_state": 0.0034929577509562174, "sim_compute_performance-ego": 0.004891075293223063, "sim_compute_robot_state-ego": 0.00641659418741862, "sim_compute_robot_state-npc0": 0.006064715385437011, "sim_compute_robot_state-npc1": 0.005665762424468994, "sim_compute_robot_state-npc2": 0.005713725090026855, "sim_compute_robot_state-npc3": 0.005665830771128337}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0289724435290313, "sim_physics": 0.13610020128347106, "survival_time": 5.899999999999987, "driven_lanedir": 1.8517557953058077, "sim_render-ego": 0.008373456486200883, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.022809359986903303, "deviation-heading": 1.7356260169481237, "set_robot_commands": 0.006628656791428388, "deviation-center-line": 0.4098911288019564, "driven_lanedir_consec": 1.8517557953058077, "sim_compute_sim_state": 0.003321092007523876, "sim_compute_performance-ego": 0.004722692198672537, "sim_compute_robot_state-ego": 0.006142606169490491, "sim_compute_robot_state-npc0": 0.005947941440646931, "sim_compute_robot_state-npc1": 0.0057280184858936375, "sim_compute_robot_state-npc2": 0.00550107026504258, "sim_compute_robot_state-npc3": 0.0053973682856155655}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.913954497387781, "sim_physics": 0.12561700977174575, "survival_time": 8.84999999999999, "driven_lanedir": 2.7589492558880884, "sim_render-ego": 0.008413165302599892, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.022039259894419523, "deviation-heading": 2.369456558629372, "set_robot_commands": 0.006654288135679428, "deviation-center-line": 0.708977183005559, "driven_lanedir_consec": 2.7589492558880884, "sim_compute_sim_state": 0.003360746944018003, "sim_compute_performance-ego": 0.004731563525011311, "sim_compute_robot_state-ego": 0.0062079402686512405, "sim_compute_robot_state-npc0": 0.00602910074137025, "sim_compute_robot_state-npc1": 0.005604679301633673, "sim_compute_robot_state-npc2": 0.005634435826102219, "sim_compute_robot_state-npc3": 0.005549564199932551}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.921713039828107, "sim_physics": 0.1341550495084478, "survival_time": 9.049999999999994, "driven_lanedir": 2.4648808445100796, "sim_render-ego": 0.008364776221428128, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.024387022408332616, "deviation-heading": 2.80484383496767, "set_robot_commands": 0.006441888229623025, "deviation-center-line": 0.7648430115408693, "driven_lanedir_consec": 2.4648808445100796, "sim_compute_sim_state": 0.003365379670706902, "sim_compute_performance-ego": 0.004689696085387172, "sim_compute_robot_state-ego": 0.006045702412642168, "sim_compute_robot_state-npc0": 0.005865766198595584, "sim_compute_robot_state-npc1": 0.005554228197803814, "sim_compute_robot_state-npc2": 0.005499722549269871, "sim_compute_robot_state-npc3": 0.005452274617569222}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.029914277325611, "sim_physics": 0.13694629033406577, "survival_time": 14.950000000000076, "driven_lanedir": 4.461781653516237, "sim_render-ego": 0.008739808400472004, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02317201773325602, "deviation-heading": 4.77931693247623, "set_robot_commands": 0.007117065588633219, "deviation-center-line": 1.2248262953892242, "driven_lanedir_consec": 4.461781653516237, "sim_compute_sim_state": 0.003591053485870361, "sim_compute_performance-ego": 0.004939002990722656, "sim_compute_robot_state-ego": 0.006407152811686198, "sim_compute_robot_state-npc0": 0.0063931155204772945, "sim_compute_robot_state-npc1": 0.006098127365112305, "sim_compute_robot_state-npc2": 0.005968793233235677, "sim_compute_robot_state-npc3": 0.005927050113677978}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.770938297110685, "sim_physics": 0.1387549368540446, "survival_time": 14.950000000000076, "driven_lanedir": 3.877904137984438, "sim_render-ego": 0.008717284202575684, "in-drivable-lane": 1.9500000000000064, "agent_compute-ego": 0.023579049905141196, "deviation-heading": 5.2889693068522226, "set_robot_commands": 0.007068227926890055, "deviation-center-line": 1.2200403547007206, "driven_lanedir_consec": 3.877904137984438, "sim_compute_sim_state": 0.003577728271484375, "sim_compute_performance-ego": 0.00491352637608846, "sim_compute_robot_state-ego": 0.006431179046630859, "sim_compute_robot_state-npc0": 0.006301888624827067, "sim_compute_robot_state-npc1": 0.005857216517130534, "sim_compute_robot_state-npc2": 0.005850389003753662, "sim_compute_robot_state-npc3": 0.005866595904032389}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.860832765493928, "sim_physics": 0.1276393053008289, "survival_time": 14.350000000000067, "driven_lanedir": 3.9825860124393584, "sim_render-ego": 0.008866640748877974, "in-drivable-lane": 1.650000000000019, "agent_compute-ego": 0.022396561160735552, "deviation-heading": 5.311841052505892, "set_robot_commands": 0.0068222803521239385, "deviation-center-line": 1.2272445937465273, "driven_lanedir_consec": 3.9825860124393584, "sim_compute_sim_state": 0.0036485685288698416, "sim_compute_performance-ego": 0.005102859556882639, "sim_compute_robot_state-ego": 0.006457116130337067, "sim_compute_robot_state-npc0": 0.006416703765815974, "sim_compute_robot_state-npc1": 0.005896353140109923, "sim_compute_robot_state-npc2": 0.0058916138439643675, "sim_compute_robot_state-npc3": 0.005953384193393827}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.394464235518583, "sim_physics": 0.12772930941535432, "survival_time": 10.300000000000011, "driven_lanedir": 2.8605488740341185, "sim_render-ego": 0.009569223644663989, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.02236184217397449, "deviation-heading": 3.359067816990592, "set_robot_commands": 0.00688462581449342, "deviation-center-line": 0.9038591486060088, "driven_lanedir_consec": 2.8605488740341185, "sim_compute_sim_state": 0.003849242497416376, "sim_compute_performance-ego": 0.005449656143929195, "sim_compute_robot_state-ego": 0.006987918927831557, "sim_compute_robot_state-npc0": 0.006605862413795249, "sim_compute_robot_state-npc1": 0.006228062713030473, "sim_compute_robot_state-npc2": 0.006454657582403387, "sim_compute_robot_state-npc3": 0.006399693998318274}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.619845114807396, "sim_physics": 0.12679127268316623, "survival_time": 10.550000000000017, "driven_lanedir": 2.9550533222565054, "sim_render-ego": 0.007972552313058863, "in-drivable-lane": 2.349999999999998, "agent_compute-ego": 0.02209399096773699, "deviation-heading": 2.7233982117456357, "set_robot_commands": 0.006125184596997302, "deviation-center-line": 0.6491664182630761, "driven_lanedir_consec": 2.9550533222565054, "sim_compute_sim_state": 0.003239319787771216, "sim_compute_performance-ego": 0.004504639955493511, "sim_compute_robot_state-ego": 0.005876533228074205, "sim_compute_robot_state-npc0": 0.005669820930155532, "sim_compute_robot_state-npc1": 0.0053286473332988145, "sim_compute_robot_state-npc2": 0.005277078863568781, "sim_compute_robot_state-npc3": 0.005312475547971319}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 5.711490536648425, "sim_physics": 0.1469740385878576, "survival_time": 14.600000000000072, "driven_lanedir": 4.947401909562591, "sim_render-ego": 0.008744423520075132, "in-drivable-lane": 1.5500000000000158, "agent_compute-ego": 0.02331351825635727, "deviation-heading": 3.967611144864433, "set_robot_commands": 0.006953950614145357, "deviation-center-line": 0.8916591753309837, "driven_lanedir_consec": 4.947401909562591, "sim_compute_sim_state": 0.003641537607532658, "sim_compute_performance-ego": 0.004921690241931236, "sim_compute_robot_state-ego": 0.006340070130073861, "sim_compute_robot_state-npc0": 0.006363191833234813, "sim_compute_robot_state-npc1": 0.005933297823553216, "sim_compute_robot_state-npc2": 0.0059012770652771, "sim_compute_robot_state-npc3": 0.005954654249426437}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 6.3238783117265145, "sim_physics": 0.13038705110549928, "survival_time": 14.950000000000076, "driven_lanedir": 5.984700778532881, "sim_render-ego": 0.008760193983713785, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.02383008082707723, "deviation-heading": 2.96443909456284, "set_robot_commands": 0.007178659439086914, "deviation-center-line": 1.0080723488216248, "driven_lanedir_consec": 5.984700778532881, "sim_compute_sim_state": 0.003563703695933024, "sim_compute_performance-ego": 0.00496575117111206, "sim_compute_robot_state-ego": 0.006426362991333008, "sim_compute_robot_state-npc0": 0.006285623709360758, "sim_compute_robot_state-npc1": 0.006026473045349121, "sim_compute_robot_state-npc2": 0.006111572583516439, "sim_compute_robot_state-npc3": 0.00597191333770752}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.4933699971065175, "sim_physics": 0.13105755306425548, "survival_time": 5.249999999999989, "driven_lanedir": 0.7296872010003053, "sim_render-ego": 0.008595368975684756, "in-drivable-lane": 2.699999999999991, "agent_compute-ego": 0.02158865247453962, "deviation-heading": 1.430106431403272, "set_robot_commands": 0.006736605507986886, "deviation-center-line": 0.1587083208297919, "driven_lanedir_consec": 0.7296872010003053, "sim_compute_sim_state": 0.003464342298961821, "sim_compute_performance-ego": 0.004754706791469029, "sim_compute_robot_state-ego": 0.0061923912593296595, "sim_compute_robot_state-npc0": 0.006210663205101377, "sim_compute_robot_state-npc1": 0.005692298071725028, "sim_compute_robot_state-npc2": 0.005811800275530134, "sim_compute_robot_state-npc3": 0.005748916807628813}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.033977356959496, "sim_physics": 0.1375356996268557, "survival_time": 5.699999999999988, "driven_lanedir": 1.8510888292646115, "sim_render-ego": 0.008680548584252074, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.022721501818874425, "deviation-heading": 1.6393092125048707, "set_robot_commands": 0.006769598576060513, "deviation-center-line": 0.4600424185884739, "driven_lanedir_consec": 1.8510888292646115, "sim_compute_sim_state": 0.003488032441390188, "sim_compute_performance-ego": 0.004821894461648506, "sim_compute_robot_state-ego": 0.006267873864424856, "sim_compute_robot_state-npc0": 0.006328051550346508, "sim_compute_robot_state-npc1": 0.005939414626673648, "sim_compute_robot_state-npc2": 0.005772910620036878, "sim_compute_robot_state-npc3": 0.005761374507034034}}set_robot_commands_max 0.007322356700897216 set_robot_commands_mean 0.006754131625844868 set_robot_commands_median 0.006769598576060513 set_robot_commands_min 0.006125184596997302 sim_compute_performance-ego_max 0.005449656143929195 sim_compute_performance-ego_mean 0.004881028979703179 sim_compute_performance-ego_median 0.004891075293223063 sim_compute_performance-ego_min 0.004472048302006915 sim_compute_robot_state-ego_max 0.006987918927831557 sim_compute_robot_state-ego_mean 0.006330046902556469 sim_compute_robot_state-ego_median 0.006340070130073861 sim_compute_robot_state-ego_min 0.005867992959371428 sim_compute_robot_state-npc0_max 0.006710662047068278 sim_compute_robot_state-npc0_mean 0.006183889445487093 sim_compute_robot_state-npc0_median 0.006285623709360758 sim_compute_robot_state-npc0_min 0.005565234316073782 sim_compute_robot_state-npc1_max 0.006347605387369792 sim_compute_robot_state-npc1_mean 0.005802290918219895 sim_compute_robot_state-npc1_median 0.005857216517130534 sim_compute_robot_state-npc1_min 0.005134179340145453 sim_compute_robot_state-npc2_max 0.006454657582403387 sim_compute_robot_state-npc2_mean 0.0058002176851400505 sim_compute_robot_state-npc2_median 0.005811800275530134 sim_compute_robot_state-npc2_min 0.005188261590352873 sim_compute_robot_state-npc3_max 0.006399693998318274 sim_compute_robot_state-npc3_mean 0.005759330296613736 sim_compute_robot_state-npc3_median 0.005761374507034034 sim_compute_robot_state-npc3_min 0.005101081801623833 sim_compute_sim_state_max 0.003849242497416376 sim_compute_sim_state_mean 0.003503880098451561 sim_compute_sim_state_median 0.0034929577509562174 sim_compute_sim_state_min 0.0032117928915876685 sim_physics_max 0.1469740385878576 sim_physics_mean 0.13349555625844192 sim_physics_median 0.13249331712722778 sim_physics_min 0.12561700977174575 sim_render-ego_max 0.009569223644663989 sim_render-ego_mean 0.008646772061176857 sim_render-ego_median 0.008680548584252074 sim_render-ego_min 0.0079241574295168 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.030000000000031 survival_time_min 5.249999999999989
No reset possible 304676278Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LFV-sim-testingstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:24:52 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 304545897Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 304305897Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0.6615916660781769 survival_time 8.6667 deviation-center-line 0.1916605354953601 in-drivable-lane 3.3334
other stats deviation-heading 1.452862526669214 driven_any 1.247810067638563 driven_lanedir 0.6615916660781769 visualized-eval0-passed 1
No reset possible 302486171Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2563370947381176 survival_time_median 4.6499999999999915 deviation-center-line_median 0.1909350453221214 in-drivable-lane_median 0.1999999999999993
other stats agent_compute-ego_max 0.022488076965530197 agent_compute-ego_mean 0.021885988778199063 agent_compute-ego_median 0.021698661064833737 agent_compute-ego_min 0.021260724484341815 deviation-center-line_max 0.7468145631623697 deviation-center-line_mean 0.3693988047978628 deviation-center-line_min 0.16009946837603384 deviation-heading_max 2.9796175967429046 deviation-heading_mean 1.566577418185974 deviation-heading_median 1.0012398125070718 deviation-heading_min 0.7345024828988511 driven_any_max 3.3370881744115897 driven_any_mean 2.1892765289867073 driven_any_median 1.60357814224784 driven_any_min 1.269275055697421 driven_lanedir_consec_max 3.0444488611168823 driven_lanedir_consec_mean 1.8805295149124663 driven_lanedir_consec_min 0.8462600755694243 driven_lanedir_max 3.0444488611168823 driven_lanedir_mean 1.8805295149124663 driven_lanedir_median 1.2563370947381176 driven_lanedir_min 0.8462600755694243 in-drivable-lane_max 1.3999999999999964 in-drivable-lane_mean 0.5399999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.269275055697421, "sim_physics": 0.06069907389189068, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2187284917526633, "sim_render-ego": 0.007350134222131027, "in-drivable-lane": 0, "agent_compute-ego": 0.022318187512849506, "deviation-heading": 0.8161434424604656, "set_robot_commands": 0.005459954864100406, "deviation-center-line": 0.1909350453221214, "driven_lanedir_consec": 1.2187284917526633, "sim_compute_sim_state": 0.0031513759964390806, "sim_compute_performance-ego": 0.004350423812866211, "sim_compute_robot_state-ego": 0.005285470109236867}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5589409595619548, "sim_physics": 0.05925456889263995, "survival_time": 3.8499999999999943, "driven_lanedir": 0.8462600755694243, "sim_render-ego": 0.007323611866344105, "in-drivable-lane": 1.3999999999999964, "agent_compute-ego": 0.022488076965530197, "deviation-heading": 1.0012398125070718, "set_robot_commands": 0.0053130217960902625, "deviation-center-line": 0.18718999451707535, "driven_lanedir_consec": 0.8462600755694243, "sim_compute_sim_state": 0.003174822051803787, "sim_compute_performance-ego": 0.004061519325553597, "sim_compute_robot_state-ego": 0.0052580492837088445}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1775003130147317, "sim_physics": 0.056518127617326754, "survival_time": 10.300000000000011, "driven_lanedir": 3.0444488611168823, "sim_render-ego": 0.00704512434098327, "in-drivable-lane": 0, "agent_compute-ego": 0.021260724484341815, "deviation-heading": 2.301383756320577, "set_robot_commands": 0.005042241614999123, "deviation-center-line": 0.5619549526117138, "driven_lanedir_consec": 3.0444488611168823, "sim_compute_sim_state": 0.003058747180457254, "sim_compute_performance-ego": 0.003935487524977008, "sim_compute_robot_state-ego": 0.0051199915339645834}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.60357814224784, "sim_physics": 0.056099653244018555, "survival_time": 4.6499999999999915, "driven_lanedir": 1.2563370947381176, "sim_render-ego": 0.007199797579037246, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02166429386344007, "deviation-heading": 0.7345024828988511, "set_robot_commands": 0.005223910013834636, "deviation-center-line": 0.16009946837603384, "driven_lanedir_consec": 1.2563370947381176, "sim_compute_sim_state": 0.0031295079056934644, "sim_compute_performance-ego": 0.004011761757635301, "sim_compute_robot_state-ego": 0.00515521469936576}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3370881744115897, "sim_physics": 0.05699188923567868, "survival_time": 8.899999999999991, "driven_lanedir": 3.0368730513852444, "sim_render-ego": 0.00720076078779242, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.021698661064833737, "deviation-heading": 2.9796175967429046, "set_robot_commands": 0.005233301205581494, "deviation-center-line": 0.7468145631623697, "driven_lanedir_consec": 3.0368730513852444, "sim_compute_sim_state": 0.003068151098958562, "sim_compute_performance-ego": 0.003997220082229443, "sim_compute_robot_state-ego": 0.005144756831479877}}set_robot_commands_max 0.005459954864100406 set_robot_commands_mean 0.0052544858989211855 set_robot_commands_median 0.005233301205581494 set_robot_commands_min 0.005042241614999123 sim_compute_performance-ego_max 0.004350423812866211 sim_compute_performance-ego_mean 0.004071282500652312 sim_compute_performance-ego_median 0.004011761757635301 sim_compute_performance-ego_min 0.003935487524977008 sim_compute_robot_state-ego_max 0.005285470109236867 sim_compute_robot_state-ego_mean 0.005192696491551187 sim_compute_robot_state-ego_median 0.00515521469936576 sim_compute_robot_state-ego_min 0.0051199915339645834 sim_compute_sim_state_max 0.003174822051803787 sim_compute_sim_state_mean 0.0031165208466704297 sim_compute_sim_state_median 0.0031295079056934644 sim_compute_sim_state_min 0.003058747180457254 sim_physics_max 0.06069907389189068 sim_physics_mean 0.057912662576310926 sim_physics_median 0.05699188923567868 sim_physics_min 0.056099653244018555 sim_render-ego_max 0.007350134222131027 sim_render-ego_mean 0.007223885759257613 sim_render-ego_median 0.00720076078779242 sim_render-ego_min 0.00704512434098327 simulation-passed 1 survival_time_max 10.300000000000011 survival_time_mean 6.299999999999996 survival_time_min 3.7999999999999945
No reset possible 302274454Bea Baselines challenge-aido_LF-baseline-duckietown aido3-LFV-real-validationeval2-visualize host-error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:56 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
get_file_from_cache(fn, sha256hex)
File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
raise KeyError(msg)
KeyError: 'Hash not in cache'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
server_host=server_host,
File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
File "/project/src/duckietown_challenges_runner/runner.py", line 1420, in download_artefacts
copy_to_cache(fn, sha256hex)
File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
shutil.copy(fn, have)
File "/usr/lib/python3.6/shutil.py", line 245, in copy
copyfile(src, dst, follow_symlinks=follow_symlinks)
File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
copyfileobj(fsrc, fdst)
File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
fdst.write(buf)
OSError: [Errno 28] No space left on device
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
copy_to_cache(realfile, sha256hex)
File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
shutil.copy(fn, have)
File "/usr/lib/python3.6/shutil.py", line 245, in copy
copyfile(src, dst, follow_symlinks=follow_symlinks)
File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
copyfileobj(fsrc, fdst)
File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 302196157Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.6611271404889785 survival_time_median 12.900000000000048 deviation-center-line_median 0.9029386946831992 in-drivable-lane_median 0.25000000000000355
other stats agent_compute-ego_max 0.027114043864168862 agent_compute-ego_mean 0.026005802120262524 agent_compute-ego_median 0.026121856371561687 agent_compute-ego_min 0.024489009702527844 deviation-center-line_max 1.3886841456628305 deviation-center-line_mean 0.6827888697604145 deviation-center-line_min 0.0785244431714113 deviation-heading_max 4.325952365283331 deviation-heading_mean 2.564808802649311 deviation-heading_median 3.483590514556625 deviation-heading_min 0.4508394673380015 driven_any_max 3.378603779432466 driven_any_mean 1.954912306571493 driven_any_median 2.376291118163664 driven_any_min 0.33138156713638206 driven_lanedir_consec_max 2.3865592232961337 driven_lanedir_consec_mean 1.299231248354949 driven_lanedir_consec_min 0.3071316827477175 driven_lanedir_max 3.1079871910088563 driven_lanedir_mean 1.6360725538837029 driven_lanedir_median 1.6611271404889785 driven_lanedir_min 0.3071316827477175 in-drivable-lane_max 3.9500000000000224 in-drivable-lane_mean 1.330000000000008 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.376291118163664, "sim_physics": 0.08628582159678141, "survival_time": 14.950000000000076, "driven_lanedir": 1.6611271404889785, "sim_render-ego": 0.010237041314442951, "in-drivable-lane": 3.9500000000000224, "agent_compute-ego": 0.026497021516164145, "deviation-heading": 4.050560845645404, "set_robot_commands": 0.01082684834798177, "deviation-center-line": 0.9054603482299404, "driven_lanedir_consec": 1.6611271404889785, "sim_compute_sim_state": 0.005455609957377116, "sim_compute_performance-ego": 0.006377119223276774, "sim_compute_robot_state-ego": 0.007695557276407878}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3046662995830913, "sim_physics": 0.08299345193907272, "survival_time": 12.900000000000048, "driven_lanedir": 2.745008487639658, "sim_render-ego": 0.010437617006227952, "in-drivable-lane": 2.4500000000000144, "agent_compute-ego": 0.027114043864168862, "deviation-heading": 3.483590514556625, "set_robot_commands": 0.01017487695974897, "deviation-center-line": 0.9029386946831992, "driven_lanedir_consec": 1.782229927708613, "sim_compute_sim_state": 0.005179561385812686, "sim_compute_performance-ego": 0.005926597025967383, "sim_compute_robot_state-ego": 0.007459926974865817}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3836187685418624, "sim_physics": 0.08580053819192422, "survival_time": 1.850000000000001, "driven_lanedir": 0.3591082675333026, "sim_render-ego": 0.009889087161502323, "in-drivable-lane": 0, "agent_compute-ego": 0.024489009702527844, "deviation-heading": 0.5131008204231946, "set_robot_commands": 0.0104404591225289, "deviation-center-line": 0.13833671705469144, "driven_lanedir_consec": 0.3591082675333026, "sim_compute_sim_state": 0.005730867385864258, "sim_compute_performance-ego": 0.005768775939941406, "sim_compute_robot_state-ego": 0.007396582010630015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.33138156713638206, "sim_physics": 0.08725864045760211, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3071316827477175, "sim_render-ego": 0.010119389085208668, "in-drivable-lane": 0, "agent_compute-ego": 0.02580707914689008, "deviation-heading": 0.4508394673380015, "set_robot_commands": 0.011245433021994196, "deviation-center-line": 0.0785244431714113, "driven_lanedir_consec": 0.3071316827477175, "sim_compute_sim_state": 0.005631664220024557, "sim_compute_performance-ego": 0.005747563698712517, "sim_compute_robot_state-ego": 0.007200339261223288}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.378603779432466, "sim_physics": 0.08460903326670328, "survival_time": 14.950000000000076, "driven_lanedir": 3.1079871910088563, "sim_render-ego": 0.01052919069925944, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.026121856371561687, "deviation-heading": 4.325952365283331, "set_robot_commands": 0.010710373719533284, "deviation-center-line": 1.3886841456628305, "driven_lanedir_consec": 2.3865592232961337, "sim_compute_sim_state": 0.005566024780273437, "sim_compute_performance-ego": 0.006192613442738851, "sim_compute_robot_state-ego": 0.007688774267832438}}set_robot_commands_max 0.011245433021994196 set_robot_commands_mean 0.010679598234357424 set_robot_commands_median 0.010710373719533284 set_robot_commands_min 0.01017487695974897 sim_compute_performance-ego_max 0.006377119223276774 sim_compute_performance-ego_mean 0.006002533866127387 sim_compute_performance-ego_median 0.005926597025967383 sim_compute_performance-ego_min 0.005747563698712517 sim_compute_robot_state-ego_max 0.007695557276407878 sim_compute_robot_state-ego_mean 0.007488235958191887 sim_compute_robot_state-ego_median 0.007459926974865817 sim_compute_robot_state-ego_min 0.007200339261223288 sim_compute_sim_state_max 0.005730867385864258 sim_compute_sim_state_mean 0.005512745545870411 sim_compute_sim_state_median 0.005566024780273437 sim_compute_sim_state_min 0.005179561385812686 sim_physics_max 0.08725864045760211 sim_physics_mean 0.08538949709041675 sim_physics_median 0.08580053819192422 sim_physics_min 0.08299345193907272 sim_render-ego_max 0.01052919069925944 sim_render-ego_mean 0.010242465053328268 sim_render-ego_median 0.010237041314442951 sim_render-ego_min 0.009889087161502323 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.270000000000042 survival_time_min 1.7000000000000008
No reset possible 302086148Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.120841924217262 survival_time_median 5.599999999999988 deviation-center-line_median 0.3782364103335421 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.058898581833135885 agent_compute-ego_mean 0.03744520157083943 agent_compute-ego_median 0.03256798267364502 agent_compute-ego_min 0.025841529880251204 deviation-center-line_max 0.8297707699828777 deviation-center-line_mean 0.4024628747472576 deviation-center-line_min 0.09950310559965204 deviation-heading_max 2.31547923647238 deviation-heading_mean 1.346048064931696 deviation-heading_median 1.309770583868421 deviation-heading_min 0.6515909010104917 driven_any_max 5.345885784958272 driven_any_mean 2.5864129292571456 driven_any_median 2.2431766388174186 driven_any_min 1.0054410226525208 driven_lanedir_consec_max 5.254942413663555 driven_lanedir_consec_mean 2.2862866357033704 driven_lanedir_consec_min 0.7032317749721232 driven_lanedir_max 5.254942413663555 driven_lanedir_mean 2.2862866357033704 driven_lanedir_median 2.120841924217262 driven_lanedir_min 0.7032317749721232 in-drivable-lane_max 1.8999999999999932 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0054410226525208, "sim_physics": 0.1240319978623163, "survival_time": 3.149999999999997, "driven_lanedir": 0.7032317749721232, "sim_render-ego": 0.013845201522584944, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.04147839167761424, "deviation-heading": 0.6515909010104917, "set_robot_commands": 0.010233617964245025, "deviation-center-line": 0.09950310559965204, "driven_lanedir_consec": 0.7032317749721232, "sim_compute_sim_state": 0.005579728928823319, "sim_compute_performance-ego": 0.00838265721760099, "sim_compute_robot_state-ego": 0.009690288513425797}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2336557913729504, "sim_physics": 0.14396817566918546, "survival_time": 3.049999999999997, "driven_lanedir": 1.1624420730059235, "sim_render-ego": 0.01548722532928967, "in-drivable-lane": 0, "agent_compute-ego": 0.058898581833135885, "deviation-heading": 0.8824400928708209, "set_robot_commands": 0.011900338970246862, "deviation-center-line": 0.24088747348619, "driven_lanedir_consec": 1.1624420730059235, "sim_compute_sim_state": 0.0065567141673604, "sim_compute_performance-ego": 0.009082868450977765, "sim_compute_robot_state-ego": 0.011720207870983686}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.345885784958272, "sim_physics": 0.08377412160237631, "survival_time": 14.950000000000076, "driven_lanedir": 5.254942413663555, "sim_render-ego": 0.0096320907274882, "in-drivable-lane": 0, "agent_compute-ego": 0.03256798267364502, "deviation-heading": 2.31547923647238, "set_robot_commands": 0.007868505318959555, "deviation-center-line": 0.8297707699828777, "driven_lanedir_consec": 5.254942413663555, "sim_compute_sim_state": 0.004166350364685058, "sim_compute_performance-ego": 0.0056048695246378585, "sim_compute_robot_state-ego": 0.007077196439107259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1039054084845663, "sim_physics": 0.0780359499202752, "survival_time": 8.04999999999998, "driven_lanedir": 2.189974992657989, "sim_render-ego": 0.00954065855985843, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.02843952178955078, "deviation-heading": 1.309770583868421, "set_robot_commands": 0.00762629360886094, "deviation-center-line": 0.4639166143340261, "driven_lanedir_consec": 2.189974992657989, "sim_compute_sim_state": 0.004160393839297088, "sim_compute_performance-ego": 0.005536200837318941, "sim_compute_robot_state-ego": 0.006759616899194184}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2431766388174186, "sim_physics": 0.06907199323177338, "survival_time": 5.599999999999988, "driven_lanedir": 2.120841924217262, "sim_render-ego": 0.008632353373936244, "in-drivable-lane": 0, "agent_compute-ego": 0.025841529880251204, "deviation-heading": 1.5709595104363654, "set_robot_commands": 0.0063018351793289185, "deviation-center-line": 0.3782364103335421, "driven_lanedir_consec": 2.120841924217262, "sim_compute_sim_state": 0.003619751759937831, "sim_compute_performance-ego": 0.004903897643089294, "sim_compute_robot_state-ego": 0.006310861025537763}}set_robot_commands_max 0.011900338970246862 set_robot_commands_mean 0.00878611820832826 set_robot_commands_median 0.007868505318959555 set_robot_commands_min 0.0063018351793289185 sim_compute_performance-ego_max 0.009082868450977765 sim_compute_performance-ego_mean 0.006702098734724969 sim_compute_performance-ego_median 0.0056048695246378585 sim_compute_performance-ego_min 0.004903897643089294 sim_compute_robot_state-ego_max 0.011720207870983686 sim_compute_robot_state-ego_mean 0.008311634149649737 sim_compute_robot_state-ego_median 0.007077196439107259 sim_compute_robot_state-ego_min 0.006310861025537763 sim_compute_sim_state_max 0.0065567141673604 sim_compute_sim_state_mean 0.0048165878120207395 sim_compute_sim_state_median 0.004166350364685058 sim_compute_sim_state_min 0.003619751759937831 sim_physics_max 0.14396817566918546 sim_physics_mean 0.09977644765718532 sim_physics_median 0.08377412160237631 sim_physics_min 0.06907199323177338 sim_render-ego_max 0.01548722532928967 sim_render-ego_mean 0.011427505902631498 sim_render-ego_median 0.0096320907274882 sim_render-ego_min 0.008632353373936244 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.960000000000008 survival_time_min 3.049999999999997
No reset possible 301136140Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.637683945796139 survival_time_median 13.950000000000063 deviation-center-line_median 0.8680732392464326 in-drivable-lane_median 0.5500000000000078
other stats agent_compute-ego_max 0.022350896994272867 agent_compute-ego_mean 0.021822790441337097 agent_compute-ego_median 0.02181250430919506 agent_compute-ego_min 0.02144129453194015 deviation-center-line_max 0.9232840918496956 deviation-center-line_mean 0.8121455165264633 deviation-center-line_min 0.5383279087747405 deviation-heading_max 3.700525194765367 deviation-heading_mean 3.184017820469929 deviation-heading_median 3.5656714968260927 deviation-heading_min 1.610343933215377 driven_any_max 4.950290043559574 driven_any_mean 4.103677096572961 driven_any_median 4.226953260485665 driven_any_min 2.5502558572116976 driven_lanedir_consec_max 4.442558293784182 driven_lanedir_consec_mean 3.5627273619181814 driven_lanedir_consec_min 2.446031814806487 driven_lanedir_max 4.442558293784182 driven_lanedir_mean 3.5627273619181814 driven_lanedir_median 3.637683945796139 driven_lanedir_min 2.446031814806487 in-drivable-lane_max 2.800000000000032 in-drivable-lane_mean 0.8500000000000073 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.950290043559574, "sim_physics": 0.05758315324783325, "survival_time": 14.950000000000076, "driven_lanedir": 3.637683945796139, "sim_render-ego": 0.007180616855621338, "in-drivable-lane": 2.800000000000032, "agent_compute-ego": 0.022350896994272867, "deviation-heading": 3.5656714968260927, "set_robot_commands": 0.005305485725402832, "deviation-center-line": 0.9232840918496956, "driven_lanedir_consec": 3.637683945796139, "sim_compute_sim_state": 0.0030789891878763836, "sim_compute_performance-ego": 0.004169983069101969, "sim_compute_robot_state-ego": 0.005254501501719157}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5502558572116976, "sim_physics": 0.055961336912932216, "survival_time": 6.749999999999984, "driven_lanedir": 2.446031814806487, "sim_render-ego": 0.007265294039690936, "in-drivable-lane": 0, "agent_compute-ego": 0.02181250430919506, "deviation-heading": 1.610343933215377, "set_robot_commands": 0.005177815755208333, "deviation-center-line": 0.5383279087747405, "driven_lanedir_consec": 2.446031814806487, "sim_compute_sim_state": 0.0030678607799388743, "sim_compute_performance-ego": 0.004038067217226382, "sim_compute_robot_state-ego": 0.005196219903451425}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.226953260485665, "sim_physics": 0.054722471708964965, "survival_time": 14.150000000000066, "driven_lanedir": 3.7664275996822902, "sim_render-ego": 0.007104652088017009, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.02144129453194015, "deviation-heading": 3.700525194765367, "set_robot_commands": 0.005221117511654911, "deviation-center-line": 0.8680732392464326, "driven_lanedir_consec": 3.7664275996822902, "sim_compute_sim_state": 0.0030365579962309173, "sim_compute_performance-ego": 0.003990762225309446, "sim_compute_robot_state-ego": 0.0051874212999647165}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.7600803476666, "sim_physics": 0.05614842821620271, "survival_time": 13.950000000000063, "driven_lanedir": 4.442558293784182, "sim_render-ego": 0.007241529375848804, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.02160285707015718, "deviation-heading": 3.3584275627675413, "set_robot_commands": 0.005282549020637321, "deviation-center-line": 0.9151084087254548, "driven_lanedir_consec": 4.442558293784182, "sim_compute_sim_state": 0.0031347462780586706, "sim_compute_performance-ego": 0.004072106440007473, "sim_compute_robot_state-ego": 0.005225180725042965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.03080597394127, "sim_physics": 0.05626671229090009, "survival_time": 11.200000000000024, "driven_lanedir": 3.520935155521808, "sim_render-ego": 0.007252297231129238, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.021906399301120212, "deviation-heading": 3.685120914775267, "set_robot_commands": 0.0052553872976984295, "deviation-center-line": 0.815933934035993, "driven_lanedir_consec": 3.520935155521808, "sim_compute_sim_state": 0.0031173910413469586, "sim_compute_performance-ego": 0.004085527999060494, "sim_compute_robot_state-ego": 0.005259217960493905}}set_robot_commands_max 0.005305485725402832 set_robot_commands_mean 0.005248471062120365 set_robot_commands_median 0.0052553872976984295 set_robot_commands_min 0.005177815755208333 sim_compute_performance-ego_max 0.004169983069101969 sim_compute_performance-ego_mean 0.0040712893901411525 sim_compute_performance-ego_median 0.004072106440007473 sim_compute_performance-ego_min 0.003990762225309446 sim_compute_robot_state-ego_max 0.005259217960493905 sim_compute_robot_state-ego_mean 0.005224508278134433 sim_compute_robot_state-ego_median 0.005225180725042965 sim_compute_robot_state-ego_min 0.0051874212999647165 sim_compute_sim_state_max 0.0031347462780586706 sim_compute_sim_state_mean 0.003087109056690361 sim_compute_sim_state_median 0.0030789891878763836 sim_compute_sim_state_min 0.0030365579962309173 sim_physics_max 0.05758315324783325 sim_physics_mean 0.05613642047536664 sim_physics_median 0.05614842821620271 sim_physics_min 0.054722471708964965 sim_render-ego_max 0.007265294039690936 sim_render-ego_mean 0.007208877918061464 sim_render-ego_median 0.007241529375848804 sim_render-ego_min 0.007104652088017009 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.200000000000042 survival_time_min 6.749999999999984
No reset possible 300805974c reddy challenge-aido_LF-baseline-duckietown aido3-LFV-sim-testingstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:44:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.4385886058229653 survival_time_median 14.950000000000076 deviation-center-line_median 0.5992109288442646 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.042550663948059085 agent_compute-ego_mean 0.023561540360730614 agent_compute-ego_median 0.022355458736419677 agent_compute-ego_min 0.0214375638961792 deviation-center-line_max 0.8650780855287 deviation-center-line_mean 0.6175308988094207 deviation-center-line_min 0.343397254807446 deviation-heading_max 4.416207273297534 deviation-heading_mean 3.4627971358737373 deviation-heading_median 3.495567448295744 deviation-heading_min 2.306624533883395 driven_any_max 2.5533632869336427 driven_any_mean 2.3798138077965687 driven_any_median 2.5532981065662 driven_any_min 1.068355175544494 driven_lanedir_consec_max 2.4675403893464356 driven_lanedir_consec_mean 2.1788305708855225 driven_lanedir_consec_min 0.1954134383409576 driven_lanedir_max 2.4675403893464356 driven_lanedir_mean 2.201105065991557 driven_lanedir_median 2.4385886058229653 driven_lanedir_min 0.5199621617711738 in-drivable-lane_max 2.149999999999995 in-drivable-lane_mean 0.3533333333333328 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5450035180518595, "sim_physics": 0.1392773461341858, "survival_time": 14.950000000000076, "driven_lanedir": 2.4385886058229653, "sim_render-ego": 0.009738403956095378, "in-drivable-lane": 0, "agent_compute-ego": 0.022482739289601643, "deviation-heading": 3.495567448295744, "set_robot_commands": 0.009541045824686688, "deviation-center-line": 0.5396314812257215, "driven_lanedir_consec": 2.4385886058229653, "sim_compute_sim_state": 0.003946665128072103, "sim_compute_performance-ego": 0.005550884405771892, "sim_compute_robot_state-ego": 0.0070302446683247885, "sim_compute_robot_state-npc0": 0.007852741082509359, "sim_compute_robot_state-npc1": 0.007080887158711751, "sim_compute_robot_state-npc2": 0.00664761463801066, "sim_compute_robot_state-npc3": 0.006412790616353353}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.553323436854347, "sim_physics": 0.14525314410527548, "survival_time": 14.950000000000076, "driven_lanedir": 2.412632108942123, "sim_render-ego": 0.009391466776529947, "in-drivable-lane": 0, "agent_compute-ego": 0.021742350260416668, "deviation-heading": 4.031963356378237, "set_robot_commands": 0.00930340051651001, "deviation-center-line": 0.7065020791924511, "driven_lanedir_consec": 2.412632108942123, "sim_compute_sim_state": 0.0038233359654744462, "sim_compute_performance-ego": 0.005436418851216634, "sim_compute_robot_state-ego": 0.007135663032531738, "sim_compute_robot_state-npc0": 0.007929596900939941, "sim_compute_robot_state-npc1": 0.006843794186909994, "sim_compute_robot_state-npc2": 0.006408835252126058, "sim_compute_robot_state-npc3": 0.00633968432744344}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5532616751555652, "sim_physics": 0.13613724788029988, "survival_time": 14.950000000000076, "driven_lanedir": 2.396001359585413, "sim_render-ego": 0.009616101582845052, "in-drivable-lane": 0, "agent_compute-ego": 0.022246410846710207, "deviation-heading": 4.331683106356726, "set_robot_commands": 0.00922866980234782, "deviation-center-line": 0.7644518375994688, "driven_lanedir_consec": 2.396001359585413, "sim_compute_sim_state": 0.003811069329579671, "sim_compute_performance-ego": 0.005605600674947103, "sim_compute_robot_state-ego": 0.007115533351898193, "sim_compute_robot_state-npc0": 0.007854608694712321, "sim_compute_robot_state-npc1": 0.006870076656341552, "sim_compute_robot_state-npc2": 0.0065210509300231935, "sim_compute_robot_state-npc3": 0.006450091203053792}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.527132350816215, "sim_physics": 0.15291465202967325, "survival_time": 14.950000000000076, "driven_lanedir": 2.4455843978491285, "sim_render-ego": 0.009311447143554688, "in-drivable-lane": 0, "agent_compute-ego": 0.022496118545532223, "deviation-heading": 3.311383029745426, "set_robot_commands": 0.009302860101064046, "deviation-center-line": 0.4983113306863141, "driven_lanedir_consec": 2.4455843978491285, "sim_compute_sim_state": 0.0038305171330769855, "sim_compute_performance-ego": 0.005479582150777181, "sim_compute_robot_state-ego": 0.007066998481750488, "sim_compute_robot_state-npc0": 0.008049772580464682, "sim_compute_robot_state-npc1": 0.006895233790079752, "sim_compute_robot_state-npc2": 0.006446337699890137, "sim_compute_robot_state-npc3": 0.006324307918548584}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.55336202848694, "sim_physics": 0.1319259548187256, "survival_time": 14.950000000000076, "driven_lanedir": 2.4621864819495483, "sim_render-ego": 0.009392379919687908, "in-drivable-lane": 0, "agent_compute-ego": 0.021665225823720297, "deviation-heading": 3.141447647637542, "set_robot_commands": 0.009255836804707844, "deviation-center-line": 0.7564584710034387, "driven_lanedir_consec": 2.4621864819495483, "sim_compute_sim_state": 0.0038507914543151854, "sim_compute_performance-ego": 0.00548628568649292, "sim_compute_robot_state-ego": 0.006917445659637451, "sim_compute_robot_state-npc0": 0.007840628623962403, "sim_compute_robot_state-npc1": 0.006709932486216227, "sim_compute_robot_state-npc2": 0.006440203189849853, "sim_compute_robot_state-npc3": 0.006320790449778239}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.5532981065662, "sim_physics": 0.15252837578455608, "survival_time": 14.950000000000076, "driven_lanedir": 2.4024614980868173, "sim_render-ego": 0.009714499314626058, "in-drivable-lane": 0, "agent_compute-ego": 0.022696771621704102, "deviation-heading": 4.416207273297534, "set_robot_commands": 0.009447015921274822, "deviation-center-line": 0.5992109288442646, "driven_lanedir_consec": 2.4024614980868173, "sim_compute_sim_state": 0.004007287820180257, "sim_compute_performance-ego": 0.005649127960205078, "sim_compute_robot_state-ego": 0.007141489187876384, "sim_compute_robot_state-npc0": 0.007937715848286947, "sim_compute_robot_state-npc1": 0.006808603604634603, "sim_compute_robot_state-npc2": 0.00665284792582194, "sim_compute_robot_state-npc3": 0.006627334753672282}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5533313914907327, "sim_physics": 0.15100067059199015, "survival_time": 14.950000000000076, "driven_lanedir": 2.270992175467626, "sim_render-ego": 0.009597319761912028, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.02164537270863851, "deviation-heading": 4.0517754881861245, "set_robot_commands": 0.009198437531789144, "deviation-center-line": 0.7345919936852437, "driven_lanedir_consec": 2.270992175467626, "sim_compute_sim_state": 0.003903823693593343, "sim_compute_performance-ego": 0.005736376444498698, "sim_compute_robot_state-ego": 0.007097443739573161, "sim_compute_robot_state-npc0": 0.008066851298014323, "sim_compute_robot_state-npc1": 0.006931461493174235, "sim_compute_robot_state-npc2": 0.0066114600499471024, "sim_compute_robot_state-npc3": 0.0064202284812927245}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.4702019944665845, "sim_physics": 0.13280471801757812, "survival_time": 8.74999999999999, "driven_lanedir": 1.0881811250064972, "sim_render-ego": 0.00918701308114188, "in-drivable-lane": 1.5500000000000025, "agent_compute-ego": 0.021522527422223773, "deviation-heading": 2.306624533883395, "set_robot_commands": 0.009397896357945034, "deviation-center-line": 0.343397254807446, "driven_lanedir_consec": 1.078612421846191, "sim_compute_sim_state": 0.003607085091727121, "sim_compute_performance-ego": 0.005332756042480469, "sim_compute_robot_state-ego": 0.006685553959437779, "sim_compute_robot_state-npc0": 0.007531776428222656, "sim_compute_robot_state-npc1": 0.006506819043840681, "sim_compute_robot_state-npc2": 0.006191151482718331, "sim_compute_robot_state-npc3": 0.006131692613874163}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.068355175544494, "sim_physics": 0.1495339223580767, "survival_time": 6.449999999999985, "driven_lanedir": 0.5199621617711738, "sim_render-ego": 0.010088116623634517, "in-drivable-lane": 2.149999999999995, "agent_compute-ego": 0.022196000860643016, "deviation-heading": 2.5884713166145623, "set_robot_commands": 0.008986295655716297, "deviation-center-line": 0.40206361883344416, "driven_lanedir_consec": 0.1954134383409576, "sim_compute_sim_state": 0.00398960224417753, "sim_compute_performance-ego": 0.005721711373144342, "sim_compute_robot_state-ego": 0.007187821144281432, "sim_compute_robot_state-npc0": 0.00770087389982948, "sim_compute_robot_state-npc1": 0.006852711818014928, "sim_compute_robot_state-npc2": 0.00666992608890977, "sim_compute_robot_state-npc3": 0.006783982580022294}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.5533602561953037, "sim_physics": 0.1604535667101542, "survival_time": 14.950000000000076, "driven_lanedir": 2.2982435502439804, "sim_render-ego": 0.009892273743947346, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.022742364406585693, "deviation-heading": 3.4230078859800983, "set_robot_commands": 0.009766593774159747, "deviation-center-line": 0.5289883235103909, "driven_lanedir_consec": 2.2982435502439804, "sim_compute_sim_state": 0.004156880378723145, "sim_compute_performance-ego": 0.005903387069702148, "sim_compute_robot_state-ego": 0.0072626304626464844, "sim_compute_robot_state-npc0": 0.008345236778259277, "sim_compute_robot_state-npc1": 0.007403445243835449, "sim_compute_robot_state-npc2": 0.007075188954671224, "sim_compute_robot_state-npc3": 0.006966953277587891}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.553313886298487, "sim_physics": 0.1426874860127767, "survival_time": 14.950000000000076, "driven_lanedir": 2.448607316019686, "sim_render-ego": 0.010034471352895102, "in-drivable-lane": 0, "agent_compute-ego": 0.02287301778793335, "deviation-heading": 3.5110760266035776, "set_robot_commands": 0.009742456277211507, "deviation-center-line": 0.8650780855287, "driven_lanedir_consec": 2.448607316019686, "sim_compute_sim_state": 0.0041866016387939456, "sim_compute_performance-ego": 0.005929733117421468, "sim_compute_robot_state-ego": 0.007425012588500976, "sim_compute_robot_state-npc0": 0.008224172592163086, "sim_compute_robot_state-npc1": 0.0072427121798197425, "sim_compute_robot_state-npc2": 0.007010337511698405, "sim_compute_robot_state-npc3": 0.007034071286519368}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5532950634254084, "sim_physics": 0.13058962186177572, "survival_time": 14.950000000000076, "driven_lanedir": 2.4529307944380903, "sim_render-ego": 0.009694656531016033, "in-drivable-lane": 0, "agent_compute-ego": 0.022770519256591796, "deviation-heading": 3.549978031656498, "set_robot_commands": 0.0095171324412028, "deviation-center-line": 0.5600961945829367, "driven_lanedir_consec": 2.4529307944380903, "sim_compute_sim_state": 0.004036297003428141, "sim_compute_performance-ego": 0.00562507152557373, "sim_compute_robot_state-ego": 0.007108753522237142, "sim_compute_robot_state-npc0": 0.008098460833231609, "sim_compute_robot_state-npc1": 0.007128358681996664, "sim_compute_robot_state-npc2": 0.006886813640594482, "sim_compute_robot_state-npc3": 0.006976457436879476}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.5533632869336427, "sim_physics": 0.14100961128870643, "survival_time": 14.950000000000076, "driven_lanedir": 2.4675403893464356, "sim_render-ego": 0.009973117510477702, "in-drivable-lane": 0, "agent_compute-ego": 0.0214375638961792, "deviation-heading": 2.935305997841662, "set_robot_commands": 0.009480986595153808, "deviation-center-line": 0.6762022004695478, "driven_lanedir_consec": 2.4675403893464356, "sim_compute_sim_state": 0.004066306749979655, "sim_compute_performance-ego": 0.005812902450561524, "sim_compute_robot_state-ego": 0.00728599230448405, "sim_compute_robot_state-npc0": 0.00801432212193807, "sim_compute_robot_state-npc1": 0.007063754399617513, "sim_compute_robot_state-npc2": 0.006890806357065836, "sim_compute_robot_state-npc3": 0.00677335262298584}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.5532824796658766, "sim_physics": 0.1406351629892985, "survival_time": 14.950000000000076, "driven_lanedir": 2.44568890113539, "sim_render-ego": 0.00955795923868815, "in-drivable-lane": 0, "agent_compute-ego": 0.022355458736419677, "deviation-heading": 3.7072689536247743, "set_robot_commands": 0.009677948156992596, "deviation-center-line": 0.578868095077582, "driven_lanedir_consec": 2.44568890113539, "sim_compute_sim_state": 0.004005454381306966, "sim_compute_performance-ego": 0.005552462736765544, "sim_compute_robot_state-ego": 0.007049698829650879, "sim_compute_robot_state-npc0": 0.00797100305557251, "sim_compute_robot_state-npc1": 0.006953291893005371, "sim_compute_robot_state-npc2": 0.006722519397735596, "sim_compute_robot_state-npc3": 0.006633450190226237}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.5533224669968737, "sim_physics": 0.15407147804896038, "survival_time": 14.950000000000076, "driven_lanedir": 2.466975124208483, "sim_render-ego": 0.009766141573588053, "in-drivable-lane": 0, "agent_compute-ego": 0.042550663948059085, "deviation-heading": 3.140196942004158, "set_robot_commands": 0.007740981578826904, "deviation-center-line": 0.70911158709436, "driven_lanedir_consec": 2.466975124208483, "sim_compute_sim_state": 0.003985657691955567, "sim_compute_performance-ego": 0.005539669195810954, "sim_compute_robot_state-ego": 0.007045724391937256, "sim_compute_robot_state-npc0": 0.007160494327545166, "sim_compute_robot_state-npc1": 0.006639966169993083, "sim_compute_robot_state-npc2": 0.006622369289398193, "sim_compute_robot_state-npc3": 0.006658594608306884}}set_robot_commands_max 0.009766593774159747 set_robot_commands_mean 0.009305837155972604 set_robot_commands_median 0.009397896357945034 set_robot_commands_min 0.007740981578826904 sim_compute_performance-ego_max 0.005929733117421468 sim_compute_performance-ego_mean 0.005624131312357978 sim_compute_performance-ego_median 0.005605600674947103 sim_compute_performance-ego_min 0.005332756042480469 sim_compute_robot_state-ego_max 0.007425012588500976 sim_compute_robot_state-ego_mean 0.00710373368831788 sim_compute_robot_state-ego_median 0.007108753522237142 sim_compute_robot_state-ego_min 0.006685553959437779 sim_compute_robot_state-npc0_max 0.008345236778259277 sim_compute_robot_state-npc0_mean 0.00790521700437679 sim_compute_robot_state-npc0_median 0.007937715848286947 sim_compute_robot_state-npc0_min 0.007160494327545166 sim_compute_robot_state-npc1_max 0.007403445243835449 sim_compute_robot_state-npc1_mean 0.006928736587079436 sim_compute_robot_state-npc1_median 0.006895233790079752 sim_compute_robot_state-npc1_min 0.006506819043840681 sim_compute_robot_state-npc2_max 0.007075188954671224 sim_compute_robot_state-npc2_mean 0.006653164160564052 sim_compute_robot_state-npc2_median 0.00664761463801066 sim_compute_robot_state-npc2_min 0.006191151482718331 sim_compute_robot_state-npc3_max 0.007034071286519368 sim_compute_robot_state-npc3_mean 0.006590252157769638 sim_compute_robot_state-npc3_median 0.006627334753672282 sim_compute_robot_state-npc3_min 0.006131692613874163 sim_compute_sim_state_max 0.0041866016387939456 sim_compute_sim_state_mean 0.003947158380292271 sim_compute_sim_state_median 0.003985657691955567 sim_compute_sim_state_min 0.003607085091727121 sim_physics_max 0.1604535667101542 sim_physics_mean 0.14405486390880223 sim_physics_median 0.1426874860127767 sim_physics_min 0.13058962186177572 sim_render-ego_max 0.010088116623634517 sim_render-ego_mean 0.009663691207375988 sim_render-ego_median 0.009694656531016033 sim_render-ego_min 0.00918701308114188 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.970000000000065 survival_time_min 6.449999999999985
No reset possible 300366111Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:17:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0968940338245075 survival_time_median 8.14999999999998 deviation-center-line_median 0.4235317304036771 in-drivable-lane_median 0.7499999999999984
other stats agent_compute-ego_max 0.030296384865510548 agent_compute-ego_mean 0.02668371379588889 agent_compute-ego_median 0.0275560048493472 agent_compute-ego_min 0.021620293132594375 deviation-center-line_max 0.6920403562224673 deviation-center-line_mean 0.41924470608144027 deviation-center-line_min 0.12786055260085166 deviation-heading_max 3.49084981044569 deviation-heading_mean 2.0143469971619608 deviation-heading_median 2.147227904196788 deviation-heading_min 0.6807243183022771 driven_any_max 5.085345710067441 driven_any_mean 2.6993105104650823 driven_any_median 2.408325948345022 driven_any_min 1.2336027853764606 driven_lanedir_consec_max 4.6921274704425295 driven_lanedir_consec_mean 2.2757081042595804 driven_lanedir_consec_min 0.9468072236860456 driven_lanedir_max 4.6921274704425295 driven_lanedir_mean 2.2757081042595804 driven_lanedir_median 2.0968940338245075 driven_lanedir_min 0.9468072236860456 in-drivable-lane_max 2.3999999999999915 in-drivable-lane_mean 0.7433333333333345 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3797792887450224, "sim_physics": 0.06735621923687814, "survival_time": 4.3499999999999925, "driven_lanedir": 1.3413119053816311, "sim_render-ego": 0.008228384215256264, "in-drivable-lane": 0, "agent_compute-ego": 0.025942983298466123, "deviation-heading": 0.7485475017637755, "set_robot_commands": 0.006589067393335803, "deviation-center-line": 0.12786055260085166, "driven_lanedir_consec": 1.3413119053816311, "sim_compute_sim_state": 0.0035209546143981233, "sim_compute_performance-ego": 0.004960419117719278, "sim_compute_robot_state-ego": 0.005858503538986732}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.349903489550506, "sim_physics": 0.08170144347583547, "survival_time": 3.399999999999996, "driven_lanedir": 0.9468072236860456, "sim_render-ego": 0.010216986431795009, "in-drivable-lane": 0.7499999999999984, "agent_compute-ego": 0.027866654536303354, "deviation-heading": 0.9682727007853604, "set_robot_commands": 0.007350038079654469, "deviation-center-line": 0.20584487556542044, "driven_lanedir_consec": 0.9468072236860456, "sim_compute_sim_state": 0.004056236323188333, "sim_compute_performance-ego": 0.005647038712221033, "sim_compute_robot_state-ego": 0.007339312749750474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.085345710067441, "sim_physics": 0.07300872802734375, "survival_time": 14.950000000000076, "driven_lanedir": 4.6921274704425295, "sim_render-ego": 0.009262557029724122, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.02806992769241333, "deviation-heading": 3.49084981044569, "set_robot_commands": 0.007233937581380208, "deviation-center-line": 0.6811696815529484, "driven_lanedir_consec": 4.6921274704425295, "sim_compute_sim_state": 0.004049007892608643, "sim_compute_performance-ego": 0.005470875104268392, "sim_compute_robot_state-ego": 0.006827410062154134}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2915734208756797, "sim_physics": 0.07442819121425137, "survival_time": 8.14999999999998, "driven_lanedir": 2.7799207851233714, "sim_render-ego": 0.0100874856937151, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.028736009188224932, "deviation-heading": 1.643614584244473, "set_robot_commands": 0.007302433435170928, "deviation-center-line": 0.47014645465158833, "driven_lanedir_consec": 2.7799207851233714, "sim_compute_sim_state": 0.004239405591063704, "sim_compute_performance-ego": 0.005850411631578316, "sim_compute_robot_state-ego": 0.007239474840690753}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2786984498216136, "sim_physics": 0.07021912317427378, "survival_time": 3.149999999999997, "driven_lanedir": 1.241994559663683, "sim_render-ego": 0.008802678849962022, "in-drivable-lane": 0, "agent_compute-ego": 0.02508054082355802, "deviation-heading": 0.6977766529769889, "set_robot_commands": 0.006969951447986421, "deviation-center-line": 0.1703251345671759, "driven_lanedir_consec": 1.241994559663683, "sim_compute_sim_state": 0.003627833865937733, "sim_compute_performance-ego": 0.004871720359438942, "sim_compute_robot_state-ego": 0.006170480970352415}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.20829836722176, "sim_physics": 0.08419751444606917, "survival_time": 7.049999999999983, "driven_lanedir": 2.0968940338245075, "sim_render-ego": 0.010158858400710086, "in-drivable-lane": 0, "agent_compute-ego": 0.030296384865510548, "deviation-heading": 1.8810498955404011, "set_robot_commands": 0.007635270450132112, "deviation-center-line": 0.39083160319884175, "driven_lanedir_consec": 2.0968940338245075, "sim_compute_sim_state": 0.0041473013289431305, "sim_compute_performance-ego": 0.0058145100343311934, "sim_compute_robot_state-ego": 0.007087861392514925}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.2652662240085326, "sim_physics": 0.08197289569811388, "survival_time": 8.79999999999999, "driven_lanedir": 2.528771861823925, "sim_render-ego": 0.009444173086773266, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.0275560048493472, "deviation-heading": 3.0499599346171675, "set_robot_commands": 0.00700060481374914, "deviation-center-line": 0.6851358264841864, "driven_lanedir_consec": 2.528771861823925, "sim_compute_sim_state": 0.004106535152955489, "sim_compute_performance-ego": 0.005567673932422291, "sim_compute_robot_state-ego": 0.006856796416369351}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.929595581619094, "sim_physics": 0.07792079051335653, "survival_time": 14.950000000000076, "driven_lanedir": 3.7957567736510622, "sim_render-ego": 0.009820194244384763, "in-drivable-lane": 0, "agent_compute-ego": 0.029110134442647297, "deviation-heading": 3.354669183503592, "set_robot_commands": 0.007372911771138509, "deviation-center-line": 0.6025518604747091, "driven_lanedir_consec": 3.7957567736510622, "sim_compute_sim_state": 0.00410092035929362, "sim_compute_performance-ego": 0.005693506399790446, "sim_compute_robot_state-ego": 0.007126889228820801}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.722582381596717, "sim_physics": 0.0788747231165568, "survival_time": 14.950000000000076, "driven_lanedir": 2.9743480568003453, "sim_render-ego": 0.010152753194173176, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.02956419626871745, "deviation-heading": 3.2059295729971855, "set_robot_commands": 0.007344648838043213, "deviation-center-line": 0.6067427053752495, "driven_lanedir_consec": 2.9743480568003453, "sim_compute_sim_state": 0.004334932168324789, "sim_compute_performance-ego": 0.006043004989624024, "sim_compute_robot_state-ego": 0.007270932197570801}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.5953604681115525, "sim_physics": 0.08113947442050354, "survival_time": 10.85000000000002, "driven_lanedir": 2.8013616270736574, "sim_render-ego": 0.009685340564921156, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02919259269116661, "deviation-heading": 2.2092556162376837, "set_robot_commands": 0.00726568973558839, "deviation-center-line": 0.5125130883890804, "driven_lanedir_consec": 2.8013616270736574, "sim_compute_sim_state": 0.004234394170172203, "sim_compute_performance-ego": 0.005794363637124339, "sim_compute_robot_state-ego": 0.007153935146771268}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.5351180136022045, "sim_physics": 0.07548044667099461, "survival_time": 9.900000000000006, "driven_lanedir": 2.8649383711695724, "sim_render-ego": 0.008972394345986724, "in-drivable-lane": 1.2000000000000126, "agent_compute-ego": 0.02705051561798712, "deviation-heading": 2.6401102960712604, "set_robot_commands": 0.007116380364003807, "deviation-center-line": 0.6920403562224673, "driven_lanedir_consec": 2.8649383711695724, "sim_compute_sim_state": 0.003897247892437559, "sim_compute_performance-ego": 0.005211166661195081, "sim_compute_robot_state-ego": 0.006565511828721172}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.105048915136481, "sim_physics": 0.0679706802555159, "survival_time": 10.20000000000001, "driven_lanedir": 1.8727892546510192, "sim_render-ego": 0.008612411863663617, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.02566835225797167, "deviation-heading": 2.147227904196788, "set_robot_commands": 0.0063398071363860485, "deviation-center-line": 0.4235317304036771, "driven_lanedir_consec": 1.8727892546510192, "sim_compute_sim_state": 0.0037765830170874504, "sim_compute_performance-ego": 0.004938789442473767, "sim_compute_robot_state-ego": 0.006268871765510708}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.1011586128981437, "sim_physics": 0.05855319023132324, "survival_time": 4.99999999999999, "driven_lanedir": 1.3740602012417191, "sim_render-ego": 0.007364063262939453, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.02212100028991699, "deviation-heading": 1.046038364083047, "set_robot_commands": 0.005328388214111328, "deviation-center-line": 0.15351376025835473, "driven_lanedir_consec": 1.3740602012417191, "sim_compute_sim_state": 0.003088068962097168, "sim_compute_performance-ego": 0.004103620052337647, "sim_compute_robot_state-ego": 0.005290923118591309}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.408325948345022, "sim_physics": 0.056716499599159184, "survival_time": 7.049999999999983, "driven_lanedir": 1.636331068310653, "sim_render-ego": 0.007325970534737229, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.022380116983508388, "deviation-heading": 2.4511786216637166, "set_robot_commands": 0.0052056566197821435, "deviation-center-line": 0.36660319444545914, "driven_lanedir_consec": 1.636331068310653, "sim_compute_sim_state": 0.0030900197671660293, "sim_compute_performance-ego": 0.004093138038689363, "sim_compute_robot_state-ego": 0.005229019949622188}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2336027853764606, "sim_physics": 0.05732549995672507, "survival_time": 3.049999999999997, "driven_lanedir": 1.188208371049987, "sim_render-ego": 0.007346630096435547, "in-drivable-lane": 0, "agent_compute-ego": 0.021620293132594375, "deviation-heading": 0.6807243183022771, "set_robot_commands": 0.005208406292024206, "deviation-center-line": 0.19985976703159353, "driven_lanedir_consec": 1.188208371049987, "sim_compute_sim_state": 0.0030525512382632396, "sim_compute_performance-ego": 0.004092677694852235, "sim_compute_robot_state-ego": 0.005151846369758981}}set_robot_commands_max 0.007635270450132112 set_robot_commands_mean 0.006750879478165782 set_robot_commands_median 0.007116380364003807 set_robot_commands_min 0.0052056566197821435 sim_compute_performance-ego_max 0.006043004989624024 sim_compute_performance-ego_mean 0.0052101943872044235 sim_compute_performance-ego_median 0.005470875104268392 sim_compute_performance-ego_min 0.004092677694852235 sim_compute_robot_state-ego_max 0.007339312749750474 sim_compute_robot_state-ego_mean 0.006495851305079067 sim_compute_robot_state-ego_median 0.006827410062154134 sim_compute_robot_state-ego_min 0.005151846369758981 sim_compute_sim_state_max 0.004334932168324789 sim_compute_sim_state_mean 0.003821466156262482 sim_compute_sim_state_median 0.004049007892608643 sim_compute_sim_state_min 0.0030525512382632396 sim_physics_max 0.08419751444606917 sim_physics_mean 0.07245769466912667 sim_physics_median 0.07442819121425137 sim_physics_min 0.056716499599159184 sim_render-ego_max 0.010216986431795009 sim_render-ego_mean 0.009032058787678505 sim_render-ego_median 0.009262557029724122 sim_render-ego_min 0.007325970534737229 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.38666666666668 survival_time_min 3.049999999999997
No reset possible 300226106Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2196556377387948 survival_time_median 7.79999999999998 deviation-center-line_median 0.4168422454108154 in-drivable-lane_median 1.750000000000016
other stats agent_compute-ego_max 0.017310210636683872 agent_compute-ego_mean 0.016466912570957972 agent_compute-ego_median 0.01645500063896179 agent_compute-ego_min 0.01605596621831258 deviation-center-line_max 1.2802666030957617 deviation-center-line_mean 0.4301808576969815 deviation-center-line_min 0.09805451948596432 deviation-heading_max 3.993937685626312 deviation-heading_mean 1.8496826707204224 deviation-heading_median 1.915315892439604 deviation-heading_min 0.3750691476463869 driven_any_max 3.0640631900317525 driven_any_mean 1.7874217451055665 driven_any_median 1.5651949306815471 driven_any_min 0.548428278752101 driven_lanedir_consec_max 2.7532663459925892 driven_lanedir_consec_mean 1.236032513126048 driven_lanedir_consec_min 0.23356498916711055 driven_lanedir_max 2.7532663459925892 driven_lanedir_mean 1.236032513126048 driven_lanedir_median 1.2196556377387948 driven_lanedir_min 0.23356498916711055 in-drivable-lane_max 3.999999999999986 in-drivable-lane_mean 2.2066666666666745 in-drivable-lane_min 0.29999999999999893 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.094000280289931, "sim_physics": 0.06148618033954075, "survival_time": 5.599999999999988, "driven_lanedir": 0.741001429907009, "sim_render-ego": 0.007460268480437142, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.017310210636683872, "deviation-heading": 1.3013360147099122, "set_robot_commands": 0.007763594388961792, "deviation-center-line": 0.16617375437839663, "driven_lanedir_consec": 0.741001429907009, "sim_compute_sim_state": 0.004002884030342102, "sim_compute_performance-ego": 0.00443402784211295, "sim_compute_robot_state-ego": 0.00549886269228799}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.256973753754519, "sim_physics": 0.056842188577394225, "survival_time": 11.100000000000025, "driven_lanedir": 1.882111065091817, "sim_render-ego": 0.007577990626429653, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.01622210000012372, "deviation-heading": 2.0990276787406223, "set_robot_commands": 0.007398494729050645, "deviation-center-line": 0.49146156179314954, "driven_lanedir_consec": 1.882111065091817, "sim_compute_sim_state": 0.003881439432367548, "sim_compute_performance-ego": 0.004265429737331631, "sim_compute_robot_state-ego": 0.005399584770202637}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0640631900317525, "sim_physics": 0.05741823116938273, "survival_time": 14.950000000000076, "driven_lanedir": 2.7532663459925892, "sim_render-ego": 0.007389677365620931, "in-drivable-lane": 0.7499999999999976, "agent_compute-ego": 0.01605596621831258, "deviation-heading": 3.993937685626312, "set_robot_commands": 0.007482140858968099, "deviation-center-line": 1.2802666030957617, "driven_lanedir_consec": 2.7532663459925892, "sim_compute_sim_state": 0.0036266970634460448, "sim_compute_performance-ego": 0.004148776531219482, "sim_compute_robot_state-ego": 0.005330360730489095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.548428278752101, "sim_physics": 0.05971385664859061, "survival_time": 2.9499999999999975, "driven_lanedir": 0.23356498916711055, "sim_render-ego": 0.007725586325435315, "in-drivable-lane": 1.3499999999999968, "agent_compute-ego": 0.01638463392096051, "deviation-heading": 0.5977586442794591, "set_robot_commands": 0.00743260626065529, "deviation-center-line": 0.09805451948596432, "driven_lanedir_consec": 0.23356498916711055, "sim_compute_sim_state": 0.003680754516084315, "sim_compute_performance-ego": 0.004264108205245713, "sim_compute_robot_state-ego": 0.005363476478447348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7391692399408636, "sim_physics": 0.057637121250380334, "survival_time": 13.400000000000055, "driven_lanedir": 1.9321847316291707, "sim_render-ego": 0.007382987150505407, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.01658563115703526, "deviation-heading": 1.915315892439604, "set_robot_commands": 0.00746194462277996, "deviation-center-line": 0.5892941265403125, "driven_lanedir_consec": 1.9321847316291707, "sim_compute_sim_state": 0.003576461058944019, "sim_compute_performance-ego": 0.0041753284966767725, "sim_compute_robot_state-ego": 0.0053611842554007}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.156385651323344, "sim_physics": 0.05904336057157598, "survival_time": 5.849999999999987, "driven_lanedir": 0.7940493584324086, "sim_render-ego": 0.010677944900643112, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.01650916409288716, "deviation-heading": 0.881517523429374, "set_robot_commands": 0.007743678541264982, "deviation-center-line": 0.1474377765339289, "driven_lanedir_consec": 0.7940493584324086, "sim_compute_sim_state": 0.00394037238553039, "sim_compute_performance-ego": 0.004304606690366044, "sim_compute_robot_state-ego": 0.005419083130665314}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.8796172120143697, "sim_physics": 0.0587829646243844, "survival_time": 9.299999999999995, "driven_lanedir": 1.4363600797696665, "sim_render-ego": 0.008283777903485041, "in-drivable-lane": 1.750000000000016, "agent_compute-ego": 0.01607163106241534, "deviation-heading": 1.97600453305172, "set_robot_commands": 0.007452544345650622, "deviation-center-line": 0.4168422454108154, "driven_lanedir_consec": 1.4363600797696665, "sim_compute_sim_state": 0.0036399941290578535, "sim_compute_performance-ego": 0.004086266281784222, "sim_compute_robot_state-ego": 0.005288227911918394}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.4561172872120185, "sim_physics": 0.058067100176672715, "survival_time": 12.050000000000036, "driven_lanedir": 1.5778178082832028, "sim_render-ego": 0.007441694805730923, "in-drivable-lane": 3.400000000000036, "agent_compute-ego": 0.016280914243326148, "deviation-heading": 2.95369374681578, "set_robot_commands": 0.007304389447097462, "deviation-center-line": 0.5343608111678108, "driven_lanedir_consec": 1.5778178082832028, "sim_compute_sim_state": 0.003749578325580265, "sim_compute_performance-ego": 0.004174678652118351, "sim_compute_robot_state-ego": 0.005356902403455552}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.397457911213687, "sim_physics": 0.059155331339154925, "survival_time": 6.999999999999983, "driven_lanedir": 1.2196556377387948, "sim_render-ego": 0.00753159693309239, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01641965253012521, "deviation-heading": 2.3371985658774466, "set_robot_commands": 0.007453099318913051, "deviation-center-line": 0.4960795888294243, "driven_lanedir_consec": 1.2196556377387948, "sim_compute_sim_state": 0.0038482700075422017, "sim_compute_performance-ego": 0.004206917967115129, "sim_compute_robot_state-ego": 0.005342650413513184}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3513145926034276, "sim_physics": 0.06007986564140815, "survival_time": 11.55000000000003, "driven_lanedir": 1.384513167596502, "sim_render-ego": 0.007537887209937686, "in-drivable-lane": 3.7000000000000286, "agent_compute-ego": 0.016529208137875513, "deviation-heading": 2.5342628241894545, "set_robot_commands": 0.007517610277448382, "deviation-center-line": 0.3836439419569468, "driven_lanedir_consec": 1.384513167596502, "sim_compute_sim_state": 0.0038570593961905607, "sim_compute_performance-ego": 0.0042179559732412365, "sim_compute_robot_state-ego": 0.005419063361692222}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.083002883717504, "sim_physics": 0.05987753001126376, "survival_time": 5.4999999999999885, "driven_lanedir": 0.25596193360073616, "sim_render-ego": 0.01062809554013339, "in-drivable-lane": 3.249999999999992, "agent_compute-ego": 0.016274597428061744, "deviation-heading": 1.676928987818607, "set_robot_commands": 0.007499703493985263, "deviation-center-line": 0.23062163014227327, "driven_lanedir_consec": 0.25596193360073616, "sim_compute_sim_state": 0.003772462498057972, "sim_compute_performance-ego": 0.004220320961692116, "sim_compute_robot_state-ego": 0.0053515455939553}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.8524062493057287, "sim_physics": 0.05908572402867404, "survival_time": 4.399999999999992, "driven_lanedir": 0.24990608207657183, "sim_render-ego": 0.007608676498586481, "in-drivable-lane": 2.799999999999992, "agent_compute-ego": 0.016506438905542545, "deviation-heading": 0.3750691476463869, "set_robot_commands": 0.007591261105103927, "deviation-center-line": 0.16319987590804963, "driven_lanedir_consec": 0.24990608207657183, "sim_compute_sim_state": 0.003741527145559138, "sim_compute_performance-ego": 0.004342136057940396, "sim_compute_robot_state-ego": 0.005514293909072876}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.5651949306815471, "sim_physics": 0.06295669690156594, "survival_time": 7.79999999999998, "driven_lanedir": 0.7008541324150647, "sim_render-ego": 0.007487235925136468, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.016785056163103152, "deviation-heading": 0.7586519591873593, "set_robot_commands": 0.00783707239688971, "deviation-center-line": 0.1656823731455883, "driven_lanedir_consec": 0.7008541324150647, "sim_compute_sim_state": 0.0038361350695292154, "sim_compute_performance-ego": 0.0042256483664879435, "sim_compute_robot_state-ego": 0.005382016683236146}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5022662282463437, "sim_physics": 0.06030738194783529, "survival_time": 7.499999999999981, "driven_lanedir": 0.8846841968967404, "sim_render-ego": 0.007570691108703613, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.016613483428955078, "deviation-heading": 1.770376292465654, "set_robot_commands": 0.007647663752237956, "deviation-center-line": 0.5950566873129458, "driven_lanedir_consec": 0.8846841968967404, "sim_compute_sim_state": 0.003839723269144694, "sim_compute_performance-ego": 0.004216535886128744, "sim_compute_robot_state-ego": 0.0054073127110799155}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.8649284874963574, "sim_physics": 0.05744346295084272, "survival_time": 14.000000000000064, "driven_lanedir": 2.4945567382933356, "sim_render-ego": 0.007496228388377598, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.01645500063896179, "deviation-heading": 2.5741605645286456, "set_robot_commands": 0.007544150522777012, "deviation-center-line": 0.6945373697533539, "driven_lanedir_consec": 2.4945567382933356, "sim_compute_sim_state": 0.003865287985120501, "sim_compute_performance-ego": 0.004229838507516044, "sim_compute_robot_state-ego": 0.005360985653741019}}set_robot_commands_max 0.00783707239688971 set_robot_commands_mean 0.007541996937452278 set_robot_commands_median 0.007499703493985263 set_robot_commands_min 0.007304389447097462 sim_compute_performance-ego_max 0.00443402784211295 sim_compute_performance-ego_mean 0.004234171743798451 sim_compute_performance-ego_median 0.004220320961692116 sim_compute_performance-ego_min 0.004086266281784222 sim_compute_robot_state-ego_max 0.005514293909072876 sim_compute_robot_state-ego_mean 0.005386370046610513 sim_compute_robot_state-ego_median 0.005363476478447348 sim_compute_robot_state-ego_min 0.005288227911918394 sim_compute_sim_state_max 0.004002884030342102 sim_compute_sim_state_mean 0.0037905764208331218 sim_compute_sim_state_median 0.0038361350695292154 sim_compute_sim_state_min 0.003576461058944019 sim_physics_max 0.06295669690156594 sim_physics_mean 0.05919313307857776 sim_physics_median 0.05908572402867404 sim_physics_min 0.056842188577394225 sim_render-ego_max 0.010677944900643112 sim_render-ego_mean 0.007986689277483677 sim_render-ego_median 0.007537887209937686 sim_render-ego_min 0.007382987150505407 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.863333333333346 survival_time_min 2.9499999999999975
No reset possible 300135976c reddy challenge-aido_LF-baseline-duckietown aido3-LF-real-validationeval0-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 300055839Soroush Saryazdi upduck aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 299026032Frank (Chude) Qian 2019-12-10|FrankNet|(Kay❤️Frank) aido3-LFVI-sim-testingstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:27:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0430845108730957 survival_time_median 8.899999999999991 deviation-center-line_median 0.5564187781426759 in-drivable-lane_median 0.29999999999999893
other stats agent_compute-ego_max 0.041672548522119934 agent_compute-ego_mean 0.04020722259875951 agent_compute-ego_median 0.040181189048581006 agent_compute-ego_min 0.03934795122880202 deviation-center-line_max 1.0848690119322717 deviation-center-line_mean 0.5829228325208616 deviation-center-line_min 0.06650911420425878 deviation-heading_max 4.113159511174116 deviation-heading_mean 2.40670946774968 deviation-heading_median 2.575700675624764 deviation-heading_min 0.22812095620341347 driven_any_max 4.771804360958216 driven_any_mean 2.786647327411616 driven_any_median 2.5420412363145894 driven_any_min 0.3482039304076668 driven_lanedir_consec_max 4.235112544025343 driven_lanedir_consec_mean 2.1348305529121023 driven_lanedir_consec_min 0.33926650649240164 driven_lanedir_max 4.2356959871507325 driven_lanedir_mean 2.2198704816932593 driven_lanedir_median 2.0430845108730957 driven_lanedir_min 0.33926650649240164 in-drivable-lane_max 7.650000000000041 in-drivable-lane_mean 1.233333333333339 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 2.6142593458561985, "sim_physics": 0.13098392408827078, "survival_time": 9.199999999999996, "driven_lanedir": 2.4742021862180614, "sim_render-ego": 0.0071960493274357005, "in-drivable-lane": 0, "agent_compute-ego": 0.041672548522119934, "deviation-heading": 2.575700675624764, "set_robot_commands": 0.005019973153653352, "deviation-center-line": 0.5299945346992335, "driven_lanedir_consec": 2.091933707406027, "sim_compute_sim_state": 0.002900674291279005, "sim_compute_performance-ego": 0.004010950741560563, "sim_compute_robot_state-ego": 0.00521631992381552, "sim_compute_robot_state-npc0": 0.0049277103465536366, "sim_compute_robot_state-npc1": 0.004579119060350501, "sim_compute_robot_state-npc2": 0.004566949346791143, "sim_compute_robot_state-npc3": 0.004529096510099328}, "udem1-1-0": {"driven_any": 2.2804187348354765, "sim_physics": 0.11675519271184934, "survival_time": 7.449999999999981, "driven_lanedir": 2.135133545457107, "sim_render-ego": 0.007084190445458329, "in-drivable-lane": 0, "agent_compute-ego": 0.040591315135059744, "deviation-heading": 2.0960805707415293, "set_robot_commands": 0.004976176575526295, "deviation-center-line": 0.4468640685632116, "driven_lanedir_consec": 2.135133545457107, "sim_compute_sim_state": 0.0028181748102175308, "sim_compute_performance-ego": 0.00392348814330645, "sim_compute_robot_state-ego": 0.005093673731656682, "sim_compute_robot_state-npc0": 0.004961898662899964, "sim_compute_robot_state-npc1": 0.0045802193200028185, "sim_compute_robot_state-npc2": 0.0045139485557607354, "sim_compute_robot_state-npc3": 0.004496603204099924}, "udem1-2-0": {"driven_any": 2.5420412363145894, "sim_physics": 0.10869000098284554, "survival_time": 8.499999999999986, "driven_lanedir": 1.618370814214086, "sim_render-ego": 0.007103830225327436, "in-drivable-lane": 1.5999999999999996, "agent_compute-ego": 0.0397193894666784, "deviation-heading": 3.3609882729754053, "set_robot_commands": 0.005050140268662397, "deviation-center-line": 0.6245533619143259, "driven_lanedir_consec": 1.6080763569209728, "sim_compute_sim_state": 0.0028496349559110753, "sim_compute_performance-ego": 0.003928204143748564, "sim_compute_robot_state-ego": 0.005152560682857738, "sim_compute_robot_state-npc0": 0.004943555944106158, "sim_compute_robot_state-npc1": 0.0045870780944824215, "sim_compute_robot_state-npc2": 0.004544195006875431, "sim_compute_robot_state-npc3": 0.004521092246560489}, "udem1-3-0": {"driven_any": 3.3976809704390027, "sim_physics": 0.11798702380357882, "survival_time": 11.55000000000003, "driven_lanedir": 3.1898381931372257, "sim_render-ego": 0.007099575810618214, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.04049750117512493, "deviation-heading": 2.585495997328589, "set_robot_commands": 0.005054798993197354, "deviation-center-line": 0.5564187781426759, "driven_lanedir_consec": 3.0605906283799578, "sim_compute_sim_state": 0.0028815816491197196, "sim_compute_performance-ego": 0.00397494448211802, "sim_compute_robot_state-ego": 0.0052196370574819064, "sim_compute_robot_state-npc0": 0.005010431463068182, "sim_compute_robot_state-npc1": 0.004620006074120988, "sim_compute_robot_state-npc2": 0.004571563753730807, "sim_compute_robot_state-npc3": 0.0045847944366983525}, "udem1-4-0": {"driven_any": 4.464194375559483, "sim_physics": 0.13371339082717895, "survival_time": 14.950000000000076, "driven_lanedir": 4.2356959871507325, "sim_render-ego": 0.007092751661936442, "in-drivable-lane": 0, "agent_compute-ego": 0.040213236014048255, "deviation-heading": 4.113159511174116, "set_robot_commands": 0.0050201725959777834, "deviation-center-line": 0.7390601063263351, "driven_lanedir_consec": 4.235112544025343, "sim_compute_sim_state": 0.002840855916341146, "sim_compute_performance-ego": 0.003977494239807129, "sim_compute_robot_state-ego": 0.005217920939127604, "sim_compute_robot_state-npc0": 0.004977463086446126, "sim_compute_robot_state-npc1": 0.004596391518910726, "sim_compute_robot_state-npc2": 0.004559635321299235, "sim_compute_robot_state-npc3": 0.004542637666066488}, "udem1-5-0": {"driven_any": 1.7304042053514797, "sim_physics": 0.12203983098518947, "survival_time": 5.949999999999987, "driven_lanedir": 1.5426142053106455, "sim_render-ego": 0.007062681582795472, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.04017985167623568, "deviation-heading": 1.7946767885552315, "set_robot_commands": 0.005003314058319861, "deviation-center-line": 0.3816313948507872, "driven_lanedir_consec": 1.5426142053106455, "sim_compute_sim_state": 0.0028314550383752132, "sim_compute_performance-ego": 0.003914672787449941, "sim_compute_robot_state-ego": 0.005131809651350775, "sim_compute_robot_state-npc0": 0.004910989969718356, "sim_compute_robot_state-npc1": 0.004548756014399168, "sim_compute_robot_state-npc2": 0.004516034567055582, "sim_compute_robot_state-npc3": 0.0045006014719730664}, "udem1-6-0": {"driven_any": 4.325529400068097, "sim_physics": 0.11616681019465128, "survival_time": 14.950000000000076, "driven_lanedir": 1.8353508512756145, "sim_render-ego": 0.006968139807383219, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.04000048398971558, "deviation-heading": 2.2546342566454487, "set_robot_commands": 0.0049094843864440916, "deviation-center-line": 0.7994606405879052, "driven_lanedir_consec": 1.8353508512756145, "sim_compute_sim_state": 0.002843747138977051, "sim_compute_performance-ego": 0.003916712601979574, "sim_compute_robot_state-ego": 0.005148608684539795, "sim_compute_robot_state-npc0": 0.004928276538848877, "sim_compute_robot_state-npc1": 0.004541644255320231, "sim_compute_robot_state-npc2": 0.00454973300298055, "sim_compute_robot_state-npc3": 0.0045094752311706544}, "udem1-7-0": {"driven_any": 4.771804360958216, "sim_physics": 0.11963562409083048, "survival_time": 14.950000000000076, "driven_lanedir": 3.403102498509415, "sim_render-ego": 0.00698689619700114, "in-drivable-lane": 3.2000000000000073, "agent_compute-ego": 0.03982335408528646, "deviation-heading": 3.748269341783986, "set_robot_commands": 0.004939312140146891, "deviation-center-line": 1.0848690119322717, "driven_lanedir_consec": 3.3449834146317303, "sim_compute_sim_state": 0.0028500668207804363, "sim_compute_performance-ego": 0.003926931222279866, "sim_compute_robot_state-ego": 0.005144880612691243, "sim_compute_robot_state-npc0": 0.004934554100036621, "sim_compute_robot_state-npc1": 0.004541292985280354, "sim_compute_robot_state-npc2": 0.004528283278147379, "sim_compute_robot_state-npc3": 0.004519567489624023}, "udem1-8-0": {"driven_any": 2.539359898457967, "sim_physics": 0.11586553728982305, "survival_time": 8.899999999999991, "driven_lanedir": 1.9592378495311344, "sim_render-ego": 0.0071001334136791446, "in-drivable-lane": 0.9000000000000021, "agent_compute-ego": 0.040253110146254635, "deviation-heading": 2.8615575709262147, "set_robot_commands": 0.004990482598208309, "deviation-center-line": 0.7142332468488863, "driven_lanedir_consec": 1.9292300771396884, "sim_compute_sim_state": 0.0029219375567489797, "sim_compute_performance-ego": 0.003965107242712814, "sim_compute_robot_state-ego": 0.0051983581500106985, "sim_compute_robot_state-npc0": 0.004964494973086239, "sim_compute_robot_state-npc1": 0.00457980123798499, "sim_compute_robot_state-npc2": 0.00454054923539751, "sim_compute_robot_state-npc3": 0.004557689923918649}, "udem1-9-0": {"driven_any": 4.5770385221968946, "sim_physics": 0.1223219354947408, "survival_time": 14.950000000000076, "driven_lanedir": 3.4578432334812654, "sim_render-ego": 0.00701946496963501, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.03996659755706787, "deviation-heading": 3.2080891604572273, "set_robot_commands": 0.004968854586283366, "deviation-center-line": 0.8085633318023308, "driven_lanedir_consec": 3.240809303634323, "sim_compute_sim_state": 0.0028498252232869465, "sim_compute_performance-ego": 0.00395442008972168, "sim_compute_robot_state-ego": 0.0051717996597290036, "sim_compute_robot_state-npc0": 0.004961254596710205, "sim_compute_robot_state-npc1": 0.004591091473897298, "sim_compute_robot_state-npc2": 0.0045302963256835934, "sim_compute_robot_state-npc3": 0.004534533023834228}, "udem1-10-0": {"driven_any": 0.6344298496150305, "sim_physics": 0.12476215759913128, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5225363581388027, "sim_render-ego": 0.007362266381581624, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.04045606652895609, "deviation-heading": 0.6114530399896185, "set_robot_commands": 0.004863768815994263, "deviation-center-line": 0.06650911420425878, "driven_lanedir_consec": 0.5225363581388027, "sim_compute_sim_state": 0.0028508156538009644, "sim_compute_performance-ego": 0.0039927661418914795, "sim_compute_robot_state-ego": 0.005203177531560262, "sim_compute_robot_state-npc0": 0.0049244314432144165, "sim_compute_robot_state-npc1": 0.004600072900454204, "sim_compute_robot_state-npc2": 0.004529044032096863, "sim_compute_robot_state-npc3": 0.004549920558929443}, "udem1-11-0": {"driven_any": 2.3086616831500213, "sim_physics": 0.12514299551645916, "survival_time": 7.499999999999981, "driven_lanedir": 2.0430845108730957, "sim_render-ego": 0.007176157633463542, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.04032011191050212, "deviation-heading": 1.8578369419243932, "set_robot_commands": 0.005005162556966146, "deviation-center-line": 0.4432328345321882, "driven_lanedir_consec": 2.0430845108730957, "sim_compute_sim_state": 0.0029271475474039713, "sim_compute_performance-ego": 0.0039918820063273115, "sim_compute_robot_state-ego": 0.005226219495137532, "sim_compute_robot_state-npc0": 0.004984949429829915, "sim_compute_robot_state-npc1": 0.004622009595235189, "sim_compute_robot_state-npc2": 0.004549264907836914, "sim_compute_robot_state-npc3": 0.004581392606099447}, "udem1-12-0": {"driven_any": 0.3482039304076668, "sim_physics": 0.1258676969088041, "survival_time": 1.3000000000000005, "driven_lanedir": 0.33926650649240164, "sim_render-ego": 0.007231510602510893, "in-drivable-lane": 0, "agent_compute-ego": 0.03934795122880202, "deviation-heading": 0.22812095620341347, "set_robot_commands": 0.005053566052363469, "deviation-center-line": 0.10107992507849936, "driven_lanedir_consec": 0.33926650649240164, "sim_compute_sim_state": 0.00285183466397799, "sim_compute_performance-ego": 0.00407868165236253, "sim_compute_robot_state-ego": 0.005098443764906663, "sim_compute_robot_state-npc0": 0.0048906894830557015, "sim_compute_robot_state-npc1": 0.00457452810727633, "sim_compute_robot_state-npc2": 0.00451364884009728, "sim_compute_robot_state-npc3": 0.004497830684368427}, "udem1-13-0": {"driven_any": 1.8399475490499315, "sim_physics": 0.11205006227260685, "survival_time": 6.149999999999986, "driven_lanedir": 1.537540435001138, "sim_render-ego": 0.0071328733025527585, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.040181189048581006, "deviation-heading": 1.753687939496438, "set_robot_commands": 0.0048900212698835665, "deviation-center-line": 0.4141121002709987, "driven_lanedir_consec": 1.1315885840496165, "sim_compute_sim_state": 0.0028540874884380556, "sim_compute_performance-ego": 0.0039838465248666155, "sim_compute_robot_state-ego": 0.005198292615937024, "sim_compute_robot_state-npc0": 0.00494832139674241, "sim_compute_robot_state-npc1": 0.004586739268729358, "sim_compute_robot_state-npc2": 0.004517592065702609, "sim_compute_robot_state-npc3": 0.004520708952492815}, "udem1-14-0": {"driven_any": 3.425735848914185, "sim_physics": 0.12160265130816764, "survival_time": 13.250000000000052, "driven_lanedir": 3.004240050608165, "sim_render-ego": 0.0070583334508931865, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.039885632496959755, "deviation-heading": 3.050890992418822, "set_robot_commands": 0.00495056836110241, "deviation-center-line": 1.0332600380590171, "driven_lanedir_consec": 2.962147699946214, "sim_compute_sim_state": 0.0028390038688227816, "sim_compute_performance-ego": 0.003945119425935565, "sim_compute_robot_state-ego": 0.0051541976208956735, "sim_compute_robot_state-npc0": 0.00492945707069253, "sim_compute_robot_state-npc1": 0.0045529824382853955, "sim_compute_robot_state-npc2": 0.004524953410310565, "sim_compute_robot_state-npc3": 0.004533132517112876}}set_robot_commands_max 0.005054798993197354 set_robot_commands_mean 0.004979719760848637 set_robot_commands_median 0.004990482598208309 set_robot_commands_min 0.004863768815994263 sim_compute_performance-ego_max 0.00407868165236253 sim_compute_performance-ego_mean 0.003965681429737873 sim_compute_performance-ego_median 0.003965107242712814 sim_compute_performance-ego_min 0.003914672787449941 sim_compute_robot_state-ego_max 0.005226219495137532 sim_compute_robot_state-ego_mean 0.005171726674779875 sim_compute_robot_state-ego_median 0.0051717996597290036 sim_compute_robot_state-ego_min 0.005093673731656682 sim_compute_robot_state-npc0_max 0.005010431463068182 sim_compute_robot_state-npc0_mean 0.0049465652336672895 sim_compute_robot_state-npc0_median 0.004943555944106158 sim_compute_robot_state-npc0_min 0.0048906894830557015 sim_compute_robot_state-npc1_max 0.004622009595235189 sim_compute_robot_state-npc1_mean 0.004580115489648664 sim_compute_robot_state-npc1_median 0.0045802193200028185 sim_compute_robot_state-npc1_min 0.004541292985280354 sim_compute_robot_state-npc2_max 0.004571563753730807 sim_compute_robot_state-npc2_mean 0.004537046109984413 sim_compute_robot_state-npc2_median 0.0045302963256835934 sim_compute_robot_state-npc2_min 0.00451364884009728 sim_compute_robot_state-npc3_max 0.0045847944366983525 sim_compute_robot_state-npc3_mean 0.00453193843486988 sim_compute_robot_state-npc3_median 0.004529096510099328 sim_compute_robot_state-npc3_min 0.004496603204099924 sim_compute_sim_state_max 0.0029271475474039713 sim_compute_sim_state_mean 0.002860722841565391 sim_compute_sim_state_median 0.0028500668207804363 sim_compute_sim_state_min 0.0028181748102175308 sim_physics_max 0.13371339082717895 sim_physics_mean 0.12090565560494183 sim_physics_median 0.12160265130816764 sim_physics_min 0.10869000098284554 sim_render-ego_max 0.007362266381581624 sim_render-ego_mean 0.007111656987484808 sim_render-ego_median 0.007099575810618214 sim_render-ego_min 0.006968139807383219 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.463333333333354 survival_time_min 1.3000000000000005
No reset possible 298865783Robert Moni kaland-225210 aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 298806032Frank (Chude) Qian 2019-12-10|FrankNet|(Kay❤️Frank) aido3-LFVI-sim-testingstep1-simulation aborted yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:41 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 298436016Philippe Marcotte pp + veh dect aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:40:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.444366096683189 survival_time_median 14.950000000000076 deviation-center-line_median 0.6249380060386445 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06688666025797527 agent_compute-ego_mean 0.05706870979732938 agent_compute-ego_median 0.06063803195953369 agent_compute-ego_min 0.01898357391357422 deviation-center-line_max 0.7539040323556109 deviation-center-line_mean 0.5462388016820036 deviation-center-line_min 0.2045198805655877 deviation-heading_max 3.774946979659895 deviation-heading_mean 2.415557645721431 deviation-heading_median 2.502604695538442 deviation-heading_min 1.059355974382155 driven_any_max 2.529342612803986 driven_any_mean 2.5114002346353077 driven_any_median 2.5087118138988314 driven_any_min 2.4909680106237175 driven_lanedir_consec_max 2.4944595349080902 driven_lanedir_consec_mean 2.4381741572234796 driven_lanedir_consec_min 2.2826908309241047 driven_lanedir_max 2.4944595349080902 driven_lanedir_mean 2.4381741572234796 driven_lanedir_median 2.444366096683189 driven_lanedir_min 2.2826908309241047 in-drivable-lane_max 0.6000000000000085 in-drivable-lane_mean 0.07333333333333437 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.4909680106237175, "sim_physics": 0.0598152224222819, "survival_time": 14.950000000000076, "driven_lanedir": 2.41031027125007, "sim_render-ego": 0.007278655370076497, "in-drivable-lane": 0, "agent_compute-ego": 0.01898357391357422, "deviation-heading": 3.155434671795963, "set_robot_commands": 0.008078173796335856, "deviation-center-line": 0.7106471410851425, "driven_lanedir_consec": 2.41031027125007, "sim_compute_sim_state": 0.004105972448984782, "sim_compute_performance-ego": 0.004284149010976156, "sim_compute_robot_state-ego": 0.005411969820658366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5274242227689228, "sim_physics": 0.12442527691523234, "survival_time": 14.950000000000076, "driven_lanedir": 2.426666724633068, "sim_render-ego": 0.0132866636912028, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.06048921823501587, "deviation-heading": 2.795308376372075, "set_robot_commands": 0.011033632755279542, "deviation-center-line": 0.50772933244705, "driven_lanedir_consec": 2.426666724633068, "sim_compute_sim_state": 0.0057842055956522625, "sim_compute_performance-ego": 0.007745532194773356, "sim_compute_robot_state-ego": 0.010254029432932537}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5215010205766495, "sim_physics": 0.12779534022013347, "survival_time": 14.950000000000076, "driven_lanedir": 2.444366096683189, "sim_render-ego": 0.01351684808731079, "in-drivable-lane": 0, "agent_compute-ego": 0.06020333925882975, "deviation-heading": 2.775302365673186, "set_robot_commands": 0.010627644062042236, "deviation-center-line": 0.6308103234317698, "driven_lanedir_consec": 2.444366096683189, "sim_compute_sim_state": 0.0053750014305114745, "sim_compute_performance-ego": 0.007864935398101807, "sim_compute_robot_state-ego": 0.010181411902109782}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.496556381938889, "sim_physics": 0.11601691802342733, "survival_time": 14.950000000000076, "driven_lanedir": 2.4673674462283612, "sim_render-ego": 0.013082045714060466, "in-drivable-lane": 0, "agent_compute-ego": 0.06084241390228271, "deviation-heading": 1.859787761532988, "set_robot_commands": 0.01032199223836263, "deviation-center-line": 0.3881770626372194, "driven_lanedir_consec": 2.4673674462283612, "sim_compute_sim_state": 0.005608719984690348, "sim_compute_performance-ego": 0.008047266006469727, "sim_compute_robot_state-ego": 0.01003965139389038}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5025873947266257, "sim_physics": 0.11413044850031535, "survival_time": 14.950000000000076, "driven_lanedir": 2.4944595349080902, "sim_render-ego": 0.013029709657033284, "in-drivable-lane": 0, "agent_compute-ego": 0.06407232284545898, "deviation-heading": 1.059355974382155, "set_robot_commands": 0.010413597424825031, "deviation-center-line": 0.2045198805655877, "driven_lanedir_consec": 2.4944595349080902, "sim_compute_sim_state": 0.005388141473134359, "sim_compute_performance-ego": 0.007840729554494223, "sim_compute_robot_state-ego": 0.00966811736424764}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.523594260714212, "sim_physics": 0.13287965377171834, "survival_time": 14.950000000000076, "driven_lanedir": 2.485985724288075, "sim_render-ego": 0.01380939563115438, "in-drivable-lane": 0, "agent_compute-ego": 0.06688666025797527, "deviation-heading": 2.116884684851609, "set_robot_commands": 0.01094419240951538, "deviation-center-line": 0.4638377317461179, "driven_lanedir_consec": 2.485985724288075, "sim_compute_sim_state": 0.005662397543589274, "sim_compute_performance-ego": 0.007918067773183187, "sim_compute_robot_state-ego": 0.010387752850850423}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.525094649185559, "sim_physics": 0.11814015467961628, "survival_time": 14.950000000000076, "driven_lanedir": 2.4624095842255684, "sim_render-ego": 0.013043766816457112, "in-drivable-lane": 0, "agent_compute-ego": 0.06018478790918986, "deviation-heading": 2.370990233383221, "set_robot_commands": 0.010358249346415202, "deviation-center-line": 0.599750582371302, "driven_lanedir_consec": 2.4624095842255684, "sim_compute_sim_state": 0.005465728441874186, "sim_compute_performance-ego": 0.007774458726247152, "sim_compute_robot_state-ego": 0.009719372590382894}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.502467323137797, "sim_physics": 0.1161314074198405, "survival_time": 14.950000000000076, "driven_lanedir": 2.4349737449397235, "sim_render-ego": 0.013240684668223065, "in-drivable-lane": 0, "agent_compute-ego": 0.06063803195953369, "deviation-heading": 2.6055043933500412, "set_robot_commands": 0.01072049856185913, "deviation-center-line": 0.7108390632205521, "driven_lanedir_consec": 2.4349737449397235, "sim_compute_sim_state": 0.005749163627624512, "sim_compute_performance-ego": 0.007752924760182699, "sim_compute_robot_state-ego": 0.009844094117482504}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.497656601412271, "sim_physics": 0.11545608441034952, "survival_time": 14.950000000000076, "driven_lanedir": 2.356576188645111, "sim_render-ego": 0.01295797824859619, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.06185667276382446, "deviation-heading": 2.502604695538442, "set_robot_commands": 0.010310798486073813, "deviation-center-line": 0.6249380060386445, "driven_lanedir_consec": 2.356576188645111, "sim_compute_sim_state": 0.005355690320332845, "sim_compute_performance-ego": 0.007526926199595134, "sim_compute_robot_state-ego": 0.009448872407277426}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.521868854749871, "sim_physics": 0.12530005137125652, "survival_time": 14.950000000000076, "driven_lanedir": 2.4400437898565297, "sim_render-ego": 0.013350567022959392, "in-drivable-lane": 0, "agent_compute-ego": 0.06348597685496013, "deviation-heading": 2.984845260098058, "set_robot_commands": 0.010856626033782958, "deviation-center-line": 0.7539040323556109, "driven_lanedir_consec": 2.4400437898565297, "sim_compute_sim_state": 0.005854084491729737, "sim_compute_performance-ego": 0.007939767837524415, "sim_compute_robot_state-ego": 0.009992284774780274}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.529342612803986, "sim_physics": 0.10938425302505492, "survival_time": 14.950000000000076, "driven_lanedir": 2.468555955857884, "sim_render-ego": 0.012358943621317543, "in-drivable-lane": 0, "agent_compute-ego": 0.058159452279408774, "deviation-heading": 2.5000593863853404, "set_robot_commands": 0.01054826498031616, "deviation-center-line": 0.6335406362570019, "driven_lanedir_consec": 2.468555955857884, "sim_compute_sim_state": 0.005369320710500081, "sim_compute_performance-ego": 0.007469635009765625, "sim_compute_robot_state-ego": 0.009349838892618817}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5071953435397516, "sim_physics": 0.11545889854431152, "survival_time": 14.950000000000076, "driven_lanedir": 2.2826908309241047, "sim_render-ego": 0.012813506126403808, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.061461655298868816, "deviation-heading": 3.774946979659895, "set_robot_commands": 0.010257916450500488, "deviation-center-line": 0.6949453452278544, "driven_lanedir_consec": 2.2826908309241047, "sim_compute_sim_state": 0.005202364921569824, "sim_compute_performance-ego": 0.007593049208323161, "sim_compute_robot_state-ego": 0.00980286677678426}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.523549285367999, "sim_physics": 0.0931461517016093, "survival_time": 14.950000000000076, "driven_lanedir": 2.485213333479746, "sim_render-ego": 0.01078318993250529, "in-drivable-lane": 0, "agent_compute-ego": 0.0511368997891744, "deviation-heading": 1.7166171749425951, "set_robot_commands": 0.008455150922139486, "deviation-center-line": 0.3832479119462192, "driven_lanedir_consec": 2.485213333479746, "sim_compute_sim_state": 0.004545133908589681, "sim_compute_performance-ego": 0.006307833989461263, "sim_compute_robot_state-ego": 0.007997614542643229}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.4924857440845214, "sim_physics": 0.0780669895807902, "survival_time": 14.950000000000076, "driven_lanedir": 2.4195383893245825, "sim_render-ego": 0.009765863418579102, "in-drivable-lane": 0, "agent_compute-ego": 0.04664600054423014, "deviation-heading": 2.7594612915265384, "set_robot_commands": 0.00759370485941569, "deviation-center-line": 0.6269352942862328, "driven_lanedir_consec": 2.4195383893245825, "sim_compute_sim_state": 0.00405694564183553, "sim_compute_performance-ego": 0.005820628007253011, "sim_compute_robot_state-ego": 0.007112600803375244}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.5087118138988314, "sim_physics": 0.1172359840075175, "survival_time": 14.950000000000076, "driven_lanedir": 2.493454743108095, "sim_render-ego": 0.012598905563354492, "in-drivable-lane": 0, "agent_compute-ego": 0.06098364114761352, "deviation-heading": 1.2562614363293605, "set_robot_commands": 0.010712082386016846, "deviation-center-line": 0.2597596816137483, "driven_lanedir_consec": 2.493454743108095, "sim_compute_sim_state": 0.005411237080891927, "sim_compute_performance-ego": 0.007492781480153402, "sim_compute_robot_state-ego": 0.00961236317952474}}set_robot_commands_max 0.011033632755279542 set_robot_commands_mean 0.01008216831419203 set_robot_commands_median 0.010413597424825031 set_robot_commands_min 0.00759370485941569 sim_compute_performance-ego_max 0.008047266006469727 sim_compute_performance-ego_mean 0.007291912343766954 sim_compute_performance-ego_median 0.007745532194773356 sim_compute_performance-ego_min 0.004284149010976156 sim_compute_robot_state-ego_max 0.010387752850850423 sim_compute_robot_state-ego_mean 0.009254856056637234 sim_compute_robot_state-ego_median 0.009719372590382894 sim_compute_robot_state-ego_min 0.005411969820658366 sim_compute_sim_state_max 0.005854084491729737 sim_compute_sim_state_mean 0.005262273841434056 sim_compute_sim_state_median 0.005388141473134359 sim_compute_sim_state_min 0.00405694564183553 sim_physics_max 0.13287965377171834 sim_physics_mean 0.11089218897289696 sim_physics_median 0.11601691802342733 sim_physics_min 0.0598152224222819 sim_render-ego_max 0.01380939563115438 sim_render-ego_mean 0.01232778157128228 sim_render-ego_median 0.013029709657033284 sim_render-ego_min 0.007278655370076497 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 298306057Frank (Chude) Qian 2019-12-10|FrankNet|(Kay❤️Frank) aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:39 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 298236043Frank (Chude) Qian 2019-12-10|FrankNet|(Kay❤️Frank) aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.057163671017831 survival_time_median 14.950000000000076 deviation-center-line_median 0.8167293589999013 in-drivable-lane_median 1.399999999999995
other stats agent_compute-ego_max 0.08687031645523874 agent_compute-ego_mean 0.0726293408803578 agent_compute-ego_median 0.06945068359375 agent_compute-ego_min 0.066282586256663 deviation-center-line_max 0.8518758044169465 deviation-center-line_mean 0.702376120653637 deviation-center-line_min 0.28623285537329035 deviation-heading_max 3.1612082560002497 deviation-heading_mean 2.398893699420875 deviation-heading_median 2.422898419726409 deviation-heading_min 1.2377031556662097 driven_any_max 5.887149512198296 driven_any_mean 4.391421607296218 driven_any_median 4.626332791877775 driven_any_min 1.762274620833939 driven_lanedir_consec_max 5.202840048179104 driven_lanedir_consec_mean 3.997171924067607 driven_lanedir_consec_min 1.684526305324645 driven_lanedir_max 5.202840048179104 driven_lanedir_mean 3.997171924067607 driven_lanedir_median 4.057163671017831 driven_lanedir_min 1.684526305324645 in-drivable-lane_max 1.7000000000000242 in-drivable-lane_mean 0.910000000000006 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.376632129270365, "sim_physics": 0.10522091070810954, "survival_time": 14.950000000000076, "driven_lanedir": 3.8977530912004057, "sim_render-ego": 0.012539592583974205, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.06945068359375, "deviation-heading": 3.1612082560002497, "set_robot_commands": 0.009405662218729656, "deviation-center-line": 0.8167293589999013, "driven_lanedir_consec": 3.8977530912004057, "sim_compute_sim_state": 0.005260436534881592, "sim_compute_performance-ego": 0.0076618401209513345, "sim_compute_robot_state-ego": 0.009363600413004556}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.762274620833939, "sim_physics": 0.13036243790074398, "survival_time": 4.749999999999991, "driven_lanedir": 1.684526305324645, "sim_render-ego": 0.013243690289949116, "in-drivable-lane": 0, "agent_compute-ego": 0.08687031645523874, "deviation-heading": 1.2377031556662097, "set_robot_commands": 0.010549442391646536, "deviation-center-line": 0.28623285537329035, "driven_lanedir_consec": 1.684526305324645, "sim_compute_sim_state": 0.005681921306409334, "sim_compute_performance-ego": 0.007998624600862201, "sim_compute_robot_state-ego": 0.010397421686272872}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.887149512198296, "sim_physics": 0.10096671024958292, "survival_time": 14.950000000000076, "driven_lanedir": 5.1435765046160515, "sim_render-ego": 0.01180163304011027, "in-drivable-lane": 1.4500000000000115, "agent_compute-ego": 0.066282586256663, "deviation-heading": 2.1631251171811745, "set_robot_commands": 0.009241936206817626, "deviation-center-line": 0.7060059781174405, "driven_lanedir_consec": 5.1435765046160515, "sim_compute_sim_state": 0.004961600303649902, "sim_compute_performance-ego": 0.007409782409667969, "sim_compute_robot_state-ego": 0.009027729034423828}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.626332791877775, "sim_physics": 0.11125960460928984, "survival_time": 12.900000000000048, "driven_lanedir": 4.057163671017831, "sim_render-ego": 0.012811651525571364, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07248527504676996, "deviation-heading": 3.009533548530333, "set_robot_commands": 0.009850097257037496, "deviation-center-line": 0.8510366063606064, "driven_lanedir_consec": 4.057163671017831, "sim_compute_sim_state": 0.005297975946766461, "sim_compute_performance-ego": 0.007643353107363679, "sim_compute_robot_state-ego": 0.009545842806498207}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.304718982300713, "sim_physics": 0.10730651140213011, "survival_time": 14.950000000000076, "driven_lanedir": 5.202840048179104, "sim_render-ego": 0.012710013389587403, "in-drivable-lane": 0, "agent_compute-ego": 0.06805784304936727, "deviation-heading": 2.422898419726409, "set_robot_commands": 0.009141669273376464, "deviation-center-line": 0.8518758044169465, "driven_lanedir_consec": 5.202840048179104, "sim_compute_sim_state": 0.005446943442026774, "sim_compute_performance-ego": 0.007617060343424479, "sim_compute_robot_state-ego": 0.009203408559163411}}set_robot_commands_max 0.010549442391646536 set_robot_commands_mean 0.009637761469521555 set_robot_commands_median 0.009405662218729656 set_robot_commands_min 0.009141669273376464 sim_compute_performance-ego_max 0.007998624600862201 sim_compute_performance-ego_mean 0.007666132116453933 sim_compute_performance-ego_median 0.007643353107363679 sim_compute_performance-ego_min 0.007409782409667969 sim_compute_robot_state-ego_max 0.010397421686272872 sim_compute_robot_state-ego_mean 0.009507600499872575 sim_compute_robot_state-ego_median 0.009363600413004556 sim_compute_robot_state-ego_min 0.009027729034423828 sim_compute_sim_state_max 0.005681921306409334 sim_compute_sim_state_mean 0.005329775506746811 sim_compute_sim_state_median 0.005297975946766461 sim_compute_sim_state_min 0.004961600303649902 sim_physics_max 0.13036243790074398 sim_physics_mean 0.11102323497397128 sim_physics_median 0.10730651140213011 sim_physics_min 0.10096671024958292 sim_render-ego_max 0.013243690289949116 sim_render-ego_mean 0.01262131616583847 sim_render-ego_median 0.012710013389587403 sim_render-ego_min 0.01180163304011027 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.500000000000052 survival_time_min 4.749999999999991
No reset possible 297975985Frank (Chude) Qian 2019-12-09|FrankNet|v3-LFSIM aido3-LFV-sim-testingstep1-simulation aborted yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:34:28 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 297755975c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:19:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.466807437118008 survival_time_median 14.950000000000076 deviation-center-line_median 0.6133283813113732 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.02121273994445801 agent_compute-ego_mean 0.016253283795005045 agent_compute-ego_median 0.015942156314849854 agent_compute-ego_min 0.015350244839986165 deviation-center-line_max 0.8124472771143988 deviation-center-line_mean 0.5582746082721882 deviation-center-line_min 0.1586144874632296 deviation-heading_max 4.570750883985417 deviation-heading_mean 2.9001160512845963 deviation-heading_median 3.0836555078409833 deviation-heading_min 0.4556982665119492 driven_any_max 2.5633892345706006 driven_any_mean 2.349451998952498 driven_any_median 2.5533638593362062 driven_any_min 0.48322960278100624 driven_lanedir_consec_max 2.5245901993871476 driven_lanedir_consec_mean 2.20780308638056 driven_lanedir_consec_min 0.17267790571822217 driven_lanedir_max 2.5245901993871476 driven_lanedir_mean 2.2113317573002624 driven_lanedir_median 2.466807437118008 driven_lanedir_min 0.17267790571822217 in-drivable-lane_max 1.6999999999999964 in-drivable-lane_mean 0.28333333333333394 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.545042862524618, "sim_physics": 0.06124173005421956, "survival_time": 14.950000000000076, "driven_lanedir": 2.411711004681317, "sim_render-ego": 0.007102444966634114, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.016470287640889484, "deviation-heading": 3.2039829037821, "set_robot_commands": 0.007300750414530436, "deviation-center-line": 0.6624039495161994, "driven_lanedir_consec": 2.411711004681317, "sim_compute_sim_state": 0.003857592741648356, "sim_compute_performance-ego": 0.00411442518234253, "sim_compute_robot_state-ego": 0.005249858697255453}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5533638593362062, "sim_physics": 0.05707031091054281, "survival_time": 14.950000000000076, "driven_lanedir": 2.504786165247391, "sim_render-ego": 0.00716070016225179, "in-drivable-lane": 0, "agent_compute-ego": 0.016070461273193358, "deviation-heading": 2.4279548866201752, "set_robot_commands": 0.007168250878651937, "deviation-center-line": 0.36423991849227894, "driven_lanedir_consec": 2.504786165247391, "sim_compute_sim_state": 0.0036867237091064457, "sim_compute_performance-ego": 0.0039848407109578455, "sim_compute_robot_state-ego": 0.00513133684794108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5533919676404624, "sim_physics": 0.055631435712178545, "survival_time": 14.950000000000076, "driven_lanedir": 2.466807437118008, "sim_render-ego": 0.007032682100931803, "in-drivable-lane": 0, "agent_compute-ego": 0.015350244839986165, "deviation-heading": 3.244616253714198, "set_robot_commands": 0.007010524272918701, "deviation-center-line": 0.7498927890769652, "driven_lanedir_consec": 2.466807437118008, "sim_compute_sim_state": 0.003583168188730876, "sim_compute_performance-ego": 0.003978165785471598, "sim_compute_robot_state-ego": 0.00510737419128418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.553349426908167, "sim_physics": 0.05609010378519694, "survival_time": 14.950000000000076, "driven_lanedir": 2.473161151588807, "sim_render-ego": 0.0071396573384602865, "in-drivable-lane": 0, "agent_compute-ego": 0.015906794071197508, "deviation-heading": 2.9947245673704654, "set_robot_commands": 0.007055343786875407, "deviation-center-line": 0.4507341833331751, "driven_lanedir_consec": 2.473161151588807, "sim_compute_sim_state": 0.0036890800793965657, "sim_compute_performance-ego": 0.0040289934476216635, "sim_compute_robot_state-ego": 0.005180757045745849}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5633892345706006, "sim_physics": 0.05509212573369344, "survival_time": 14.950000000000076, "driven_lanedir": 2.5119965254687067, "sim_render-ego": 0.007134328683217367, "in-drivable-lane": 0, "agent_compute-ego": 0.0161281156539917, "deviation-heading": 2.3485603862929656, "set_robot_commands": 0.007161071300506592, "deviation-center-line": 0.41624427369993855, "driven_lanedir_consec": 2.5119965254687067, "sim_compute_sim_state": 0.00389501412709554, "sim_compute_performance-ego": 0.004005831082661946, "sim_compute_robot_state-ego": 0.005159916877746582}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.553186562308784, "sim_physics": 0.05661751349767049, "survival_time": 14.950000000000076, "driven_lanedir": 2.377320739807981, "sim_render-ego": 0.007139161427815755, "in-drivable-lane": 0, "agent_compute-ego": 0.016205054918924967, "deviation-heading": 4.570750883985417, "set_robot_commands": 0.007074924310048422, "deviation-center-line": 0.7022396113735349, "driven_lanedir_consec": 2.377320739807981, "sim_compute_sim_state": 0.003896231651306152, "sim_compute_performance-ego": 0.0040012216567993164, "sim_compute_robot_state-ego": 0.005176592667897543}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.553367802666369, "sim_physics": 0.05608813762664795, "survival_time": 14.950000000000076, "driven_lanedir": 2.4897536501641704, "sim_render-ego": 0.007115327517191569, "in-drivable-lane": 0, "agent_compute-ego": 0.015942156314849854, "deviation-heading": 2.766360871708968, "set_robot_commands": 0.007187829812367757, "deviation-center-line": 0.6133283813113732, "driven_lanedir_consec": 2.4897536501641704, "sim_compute_sim_state": 0.00367901881535848, "sim_compute_performance-ego": 0.003994638919830322, "sim_compute_robot_state-ego": 0.0051621325810750325}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.5533886685818272, "sim_physics": 0.057260446548461914, "survival_time": 14.950000000000076, "driven_lanedir": 2.4652855841843686, "sim_render-ego": 0.007075713475545247, "in-drivable-lane": 0, "agent_compute-ego": 0.015621232191721596, "deviation-heading": 3.267606492275787, "set_robot_commands": 0.007259651025136312, "deviation-center-line": 0.8124472771143988, "driven_lanedir_consec": 2.4652855841843686, "sim_compute_sim_state": 0.0038199583689371742, "sim_compute_performance-ego": 0.003960417906443278, "sim_compute_robot_state-ego": 0.005113948980967203}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.559058179253398, "sim_physics": 0.05547807057698568, "survival_time": 14.950000000000076, "driven_lanedir": 2.348150582166239, "sim_render-ego": 0.007010475794474284, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.01565351406733195, "deviation-heading": 3.165320745993371, "set_robot_commands": 0.006937824885050456, "deviation-center-line": 0.6472763623902961, "driven_lanedir_consec": 2.348150582166239, "sim_compute_sim_state": 0.003715794881184896, "sim_compute_performance-ego": 0.003951104482014974, "sim_compute_robot_state-ego": 0.005054065386454264}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.553394426884977, "sim_physics": 0.056900662581125895, "survival_time": 14.950000000000076, "driven_lanedir": 2.4746674066533023, "sim_render-ego": 0.006991241772969564, "in-drivable-lane": 0, "agent_compute-ego": 0.015491533279418945, "deviation-heading": 3.0836555078409833, "set_robot_commands": 0.007005155086517334, "deviation-center-line": 0.7406590695899682, "driven_lanedir_consec": 2.4746674066533023, "sim_compute_sim_state": 0.0036742512385050455, "sim_compute_performance-ego": 0.003936796188354492, "sim_compute_robot_state-ego": 0.005020519097646077}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.48322960278100624, "sim_physics": 0.0591310647226149, "survival_time": 3.099999999999997, "driven_lanedir": 0.17267790571822217, "sim_render-ego": 0.007129192352294922, "in-drivable-lane": 1.6999999999999964, "agent_compute-ego": 0.016015714214694117, "deviation-heading": 0.4556982665119492, "set_robot_commands": 0.007306225838199738, "deviation-center-line": 0.1586144874632296, "driven_lanedir_consec": 0.17267790571822217, "sim_compute_sim_state": 0.003631607178718813, "sim_compute_performance-ego": 0.003947873269357989, "sim_compute_robot_state-ego": 0.005062764690768334}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.5575150773724673, "sim_physics": 0.056304291132334115, "survival_time": 9.249999999999996, "driven_lanedir": 1.2053137843174442, "sim_render-ego": 0.007014014269854572, "in-drivable-lane": 0.9000000000000039, "agent_compute-ego": 0.015808468895989497, "deviation-heading": 3.6130793023082215, "set_robot_commands": 0.007126694756585198, "deviation-center-line": 0.5670172990947965, "driven_lanedir_consec": 1.152383720521911, "sim_compute_sim_state": 0.003759099341727592, "sim_compute_performance-ego": 0.003940729192785314, "sim_compute_robot_state-ego": 0.00503195943059148}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.553353198984686, "sim_physics": 0.056867593924204506, "survival_time": 14.950000000000076, "driven_lanedir": 2.4857028350034733, "sim_render-ego": 0.006967302958170573, "in-drivable-lane": 0, "agent_compute-ego": 0.015882414182027182, "deviation-heading": 2.746063585082667, "set_robot_commands": 0.007079360485076905, "deviation-center-line": 0.505429225305074, "driven_lanedir_consec": 2.4857028350034733, "sim_compute_sim_state": 0.003800650437672933, "sim_compute_performance-ego": 0.003939535617828369, "sim_compute_robot_state-ego": 0.005053470929463705}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.5533284696262912, "sim_physics": 0.054282070795694984, "survival_time": 14.950000000000076, "driven_lanedir": 2.258051387997358, "sim_render-ego": 0.0069412970542907714, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.016040525436401366, "deviation-heading": 3.704933221669624, "set_robot_commands": 0.006925032138824463, "deviation-center-line": 0.6592189870991606, "driven_lanedir_consec": 2.258051387997358, "sim_compute_sim_state": 0.003620908260345459, "sim_compute_performance-ego": 0.003924409548441569, "sim_compute_robot_state-ego": 0.004980355898539225}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.5534206448476056, "sim_physics": 0.08116942723592123, "survival_time": 14.950000000000076, "driven_lanedir": 2.5245901993871476, "sim_render-ego": 0.00994231144587199, "in-drivable-lane": 0, "agent_compute-ego": 0.02121273994445801, "deviation-heading": 1.9084328941120436, "set_robot_commands": 0.009082565307617188, "deviation-center-line": 0.3243733092224321, "driven_lanedir_consec": 2.5245901993871476, "sim_compute_sim_state": 0.004852753480275472, "sim_compute_performance-ego": 0.005670169194539388, "sim_compute_robot_state-ego": 0.007193636894226074}}set_robot_commands_max 0.009082565307617188 set_robot_commands_mean 0.0072454136199271236 set_robot_commands_median 0.007126694756585198 set_robot_commands_min 0.006925032138824463 sim_compute_performance-ego_max 0.005670169194539388 sim_compute_performance-ego_mean 0.00409194347903004 sim_compute_performance-ego_median 0.003978165785471598 sim_compute_performance-ego_min 0.003924409548441569 sim_compute_robot_state-ego_max 0.007193636894226074 sim_compute_robot_state-ego_mean 0.005245246014506806 sim_compute_robot_state-ego_median 0.005113948980967203 sim_compute_robot_state-ego_min 0.004980355898539225 sim_compute_sim_state_max 0.004852753480275472 sim_compute_sim_state_mean 0.00381079016666732 sim_compute_sim_state_median 0.003715794881184896 sim_compute_sim_state_min 0.003583168188730876 sim_physics_max 0.08116942723592123 sim_physics_mean 0.05834833232249954 sim_physics_median 0.05661751349767049 sim_physics_min 0.054282070795694984 sim_render-ego_max 0.00994231144587199 sim_render-ego_mean 0.00725972342133164 sim_render-ego_median 0.007102444966634114 sim_render-ego_min 0.0069412970542907714 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.780000000000063 survival_time_min 3.099999999999997
No reset possible 297445954c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.4451691197037295 survival_time_median 14.950000000000076 deviation-center-line_median 0.545817053636861 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.02244287172953288 agent_compute-ego_mean 0.021555160204569497 agent_compute-ego_median 0.02141455014546712 agent_compute-ego_min 0.021081120173136392 deviation-center-line_max 0.8082613121638655 deviation-center-line_mean 0.5506863663200087 deviation-center-line_min 0.3667432037190008 deviation-heading_max 5.333701659045768 deviation-heading_mean 3.6260657236618905 deviation-heading_median 3.520604661041446 deviation-heading_min 2.4529544078704064 driven_any_max 2.6419746417109184 driven_any_mean 2.5818530282406553 driven_any_median 2.563266003555237 driven_any_min 2.5449391819431546 driven_lanedir_consec_max 2.5723769571442983 driven_lanedir_consec_mean 2.196374364415232 driven_lanedir_consec_min 1.0067383643980068 driven_lanedir_max 2.5723769571442983 driven_lanedir_mean 2.409466141953005 driven_lanedir_median 2.4451691197037295 driven_lanedir_min 2.072197252086871 in-drivable-lane_max 1.1999999999999984 in-drivable-lane_mean 0.23999999999999969 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5449391819431546, "sim_physics": 0.07769261837005616, "survival_time": 14.950000000000076, "driven_lanedir": 2.4451691197037295, "sim_render-ego": 0.009338934421539309, "in-drivable-lane": 0, "agent_compute-ego": 0.021721944014231363, "deviation-heading": 3.520604661041446, "set_robot_commands": 0.009253188769022624, "deviation-center-line": 0.545817053636861, "driven_lanedir_consec": 2.4451691197037295, "sim_compute_sim_state": 0.004707862536112467, "sim_compute_performance-ego": 0.005522252718607585, "sim_compute_robot_state-ego": 0.006884908676147461}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.596180285256571, "sim_physics": 0.07771626313527426, "survival_time": 14.950000000000076, "driven_lanedir": 2.5472551252738818, "sim_render-ego": 0.009823407332102458, "in-drivable-lane": 0, "agent_compute-ego": 0.02244287172953288, "deviation-heading": 2.4529544078704064, "set_robot_commands": 0.00938515027364095, "deviation-center-line": 0.3667432037190008, "driven_lanedir_consec": 2.5472551252738818, "sim_compute_sim_state": 0.004754993915557861, "sim_compute_performance-ego": 0.005831088225046794, "sim_compute_robot_state-ego": 0.007247268358866373}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5629050287373945, "sim_physics": 0.0765981141726176, "survival_time": 14.950000000000076, "driven_lanedir": 2.410332255556241, "sim_render-ego": 0.009619474411010742, "in-drivable-lane": 0, "agent_compute-ego": 0.02141455014546712, "deviation-heading": 4.111520669034502, "set_robot_commands": 0.009305105209350586, "deviation-center-line": 0.8082613121638655, "driven_lanedir_consec": 2.410332255556241, "sim_compute_sim_state": 0.004688616593678792, "sim_compute_performance-ego": 0.005687581698099772, "sim_compute_robot_state-ego": 0.00714539368947347}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6419746417109184, "sim_physics": 0.07853208621342977, "survival_time": 14.950000000000076, "driven_lanedir": 2.5723769571442983, "sim_render-ego": 0.009096349875132245, "in-drivable-lane": 0, "agent_compute-ego": 0.021081120173136392, "deviation-heading": 2.711547221317329, "set_robot_commands": 0.009527184168497722, "deviation-center-line": 0.4055702454940244, "driven_lanedir_consec": 2.5723769571442983, "sim_compute_sim_state": 0.004623015721638997, "sim_compute_performance-ego": 0.005371046861012777, "sim_compute_robot_state-ego": 0.0069889330863952635}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.563266003555237, "sim_physics": 0.07810894727706909, "survival_time": 14.950000000000076, "driven_lanedir": 2.072197252086871, "sim_render-ego": 0.009294325510660808, "in-drivable-lane": 1.1999999999999984, "agent_compute-ego": 0.021115314960479737, "deviation-heading": 5.333701659045768, "set_robot_commands": 0.008966050148010253, "deviation-center-line": 0.6270400165862919, "driven_lanedir_consec": 1.0067383643980068, "sim_compute_sim_state": 0.004480351607004801, "sim_compute_performance-ego": 0.005554121335347493, "sim_compute_robot_state-ego": 0.007029056549072266}}set_robot_commands_max 0.009527184168497722 set_robot_commands_mean 0.009287335713704426 set_robot_commands_median 0.009305105209350586 set_robot_commands_min 0.008966050148010253 sim_compute_performance-ego_max 0.005831088225046794 sim_compute_performance-ego_mean 0.005593218167622883 sim_compute_performance-ego_median 0.005554121335347493 sim_compute_performance-ego_min 0.005371046861012777 sim_compute_robot_state-ego_max 0.007247268358866373 sim_compute_robot_state-ego_mean 0.007059112071990966 sim_compute_robot_state-ego_median 0.007029056549072266 sim_compute_robot_state-ego_min 0.006884908676147461 sim_compute_sim_state_max 0.004754993915557861 sim_compute_sim_state_mean 0.004650968074798584 sim_compute_sim_state_median 0.004688616593678792 sim_compute_sim_state_min 0.004480351607004801 sim_physics_max 0.07853208621342977 sim_physics_mean 0.07772960583368937 sim_physics_median 0.07771626313527426 sim_physics_min 0.0765981141726176 sim_render-ego_max 0.009823407332102458 sim_render-ego_mean 0.009434498310089112 sim_render-ego_median 0.009338934421539309 sim_render-ego_min 0.009096349875132245 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 297345938Aleksei Shpilman challenge-aido_LF-baseline-IL-0226 aido3-LFVI-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2455612234785365 survival_time_median 5.649999999999988 deviation-center-line_median 0.3729958214536931 in-drivable-lane_median 0.2499999999999991
other stats agent_compute-ego_max 0.019030884579495266 agent_compute-ego_mean 0.017684540589916586 agent_compute-ego_median 0.017517515818277995 agent_compute-ego_min 0.01695065371758115 deviation-center-line_max 1.1361127505666997 deviation-center-line_mean 0.6188212715991115 deviation-center-line_min 0.2496761522090961 deviation-heading_max 5.109650451838826 deviation-heading_mean 2.7312631435349903 deviation-heading_median 1.287869656550502 deviation-heading_min 1.142602112856682 driven_any_max 4.8661096518706435 driven_any_mean 3.145429283838257 driven_any_median 2.332891628030758 driven_any_min 1.4691041819130084 driven_lanedir_consec_max 3.950949915895549 driven_lanedir_consec_mean 2.686857771343195 driven_lanedir_consec_min 1.2069352078271272 driven_lanedir_max 4.2630623945458055 driven_lanedir_mean 2.798675919835591 driven_lanedir_median 2.2455612234785365 driven_lanedir_min 1.2888066916909993 in-drivable-lane_max 2.0000000000000018 in-drivable-lane_mean 0.6000000000000008 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 2.332891628030758, "sim_physics": 0.13219848409429327, "survival_time": 5.549999999999988, "driven_lanedir": 2.2455612234785365, "sim_render-ego": 0.007212842906917537, "in-drivable-lane": 0, "agent_compute-ego": 0.019030884579495266, "deviation-heading": 1.287869656550502, "set_robot_commands": 0.004929499583201365, "deviation-center-line": 0.3729958214536931, "driven_lanedir_consec": 2.2455612234785365, "sim_compute_sim_state": 0.0028387834359933665, "sim_compute_performance-ego": 0.003978548823176204, "sim_compute_robot_state-ego": 0.005202572624962609, "sim_compute_robot_state-npc0": 0.004810251631178298, "sim_compute_robot_state-npc1": 0.0045761138469249275, "sim_compute_robot_state-npc2": 0.004689564576020112, "sim_compute_robot_state-npc3": 0.004564871659149995}, "udem1-1-0": {"driven_any": 4.8661096518706435, "sim_physics": 0.11669032335281372, "survival_time": 14.950000000000076, "driven_lanedir": 4.015469477529743, "sim_render-ego": 0.007075469493865966, "in-drivable-lane": 2.0000000000000018, "agent_compute-ego": 0.017390275796254476, "deviation-heading": 4.83535793584374, "set_robot_commands": 0.0049847555160522465, "deviation-center-line": 0.9855675816930868, "driven_lanedir_consec": 3.950949915895549, "sim_compute_sim_state": 0.0029639259974161784, "sim_compute_performance-ego": 0.003947780132293701, "sim_compute_robot_state-ego": 0.005205902258555094, "sim_compute_robot_state-npc0": 0.004918886025746663, "sim_compute_robot_state-npc1": 0.0047555168469746905, "sim_compute_robot_state-npc2": 0.004719587961832682, "sim_compute_robot_state-npc3": 0.004648690223693848}, "udem1-2-0": {"driven_any": 2.316833304477307, "sim_physics": 0.10442251230763124, "survival_time": 5.649999999999988, "driven_lanedir": 2.1804798119328725, "sim_render-ego": 0.007242266055756966, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.01695065371758115, "deviation-heading": 1.280835560585202, "set_robot_commands": 0.004978412020522936, "deviation-center-line": 0.34975405207298144, "driven_lanedir_consec": 2.1804798119328725, "sim_compute_sim_state": 0.002850045145085427, "sim_compute_performance-ego": 0.003912012133978109, "sim_compute_robot_state-ego": 0.005151086148962511, "sim_compute_robot_state-npc0": 0.004805364439972734, "sim_compute_robot_state-npc1": 0.004595534991374058, "sim_compute_robot_state-npc2": 0.004553657717409387, "sim_compute_robot_state-npc3": 0.004501678247367386}, "udem1-3-0": {"driven_any": 1.4691041819130084, "sim_physics": 0.12243074417114258, "survival_time": 3.7499999999999942, "driven_lanedir": 1.2888066916909993, "sim_render-ego": 0.007266915639241536, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.017517515818277995, "deviation-heading": 1.142602112856682, "set_robot_commands": 0.005009053548177083, "deviation-center-line": 0.2496761522090961, "driven_lanedir_consec": 1.2069352078271272, "sim_compute_sim_state": 0.0028476524353027344, "sim_compute_performance-ego": 0.003921972910563151, "sim_compute_robot_state-ego": 0.005193891525268554, "sim_compute_robot_state-npc0": 0.004831460316975912, "sim_compute_robot_state-npc1": 0.004700536727905273, "sim_compute_robot_state-npc2": 0.004537258148193359, "sim_compute_robot_state-npc3": 0.004540545145670573}, "udem1-4-0": {"driven_any": 4.742207652899566, "sim_physics": 0.1335340785980225, "survival_time": 14.950000000000076, "driven_lanedir": 4.2630623945458055, "sim_render-ego": 0.007071032524108887, "in-drivable-lane": 0.6000000000000032, "agent_compute-ego": 0.01753337303797404, "deviation-heading": 5.109650451838826, "set_robot_commands": 0.0049719691276550295, "deviation-center-line": 1.1361127505666997, "driven_lanedir_consec": 3.850362697581889, "sim_compute_sim_state": 0.002853960196177165, "sim_compute_performance-ego": 0.003926349480946859, "sim_compute_robot_state-ego": 0.0051596474647521975, "sim_compute_robot_state-npc0": 0.004859970410664876, "sim_compute_robot_state-npc1": 0.0046532988548278805, "sim_compute_robot_state-npc2": 0.004593189557393392, "sim_compute_robot_state-npc3": 0.004595551490783691}}set_robot_commands_max 0.005009053548177083 set_robot_commands_mean 0.004974737959121732 set_robot_commands_median 0.004978412020522936 set_robot_commands_min 0.004929499583201365 sim_compute_performance-ego_max 0.003978548823176204 sim_compute_performance-ego_mean 0.003937332696191604 sim_compute_performance-ego_median 0.003926349480946859 sim_compute_performance-ego_min 0.003912012133978109 sim_compute_robot_state-ego_max 0.005205902258555094 sim_compute_robot_state-ego_mean 0.005182620004500193 sim_compute_robot_state-ego_median 0.005193891525268554 sim_compute_robot_state-ego_min 0.005151086148962511 sim_compute_robot_state-npc0_max 0.004918886025746663 sim_compute_robot_state-npc0_mean 0.004845186564907697 sim_compute_robot_state-npc0_median 0.004831460316975912 sim_compute_robot_state-npc0_min 0.004805364439972734 sim_compute_robot_state-npc1_max 0.0047555168469746905 sim_compute_robot_state-npc1_mean 0.004656200253601366 sim_compute_robot_state-npc1_median 0.0046532988548278805 sim_compute_robot_state-npc1_min 0.0045761138469249275 sim_compute_robot_state-npc2_max 0.004719587961832682 sim_compute_robot_state-npc2_mean 0.004618651592169787 sim_compute_robot_state-npc2_median 0.004593189557393392 sim_compute_robot_state-npc2_min 0.004537258148193359 sim_compute_robot_state-npc3_max 0.004648690223693848 sim_compute_robot_state-npc3_mean 0.004570267353333098 sim_compute_robot_state-npc3_median 0.004564871659149995 sim_compute_robot_state-npc3_min 0.004501678247367386 sim_compute_sim_state_max 0.0029639259974161784 sim_compute_sim_state_mean 0.002870873441994974 sim_compute_sim_state_median 0.002850045145085427 sim_compute_sim_state_min 0.0028387834359933665 sim_physics_max 0.1335340785980225 sim_physics_mean 0.12185522850478066 sim_physics_median 0.12243074417114258 sim_physics_min 0.10442251230763124 sim_render-ego_max 0.007266915639241536 sim_render-ego_mean 0.007173705323978178 sim_render-ego_median 0.007212842906917537 sim_render-ego_min 0.007071032524108887 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.970000000000024 survival_time_min 3.7499999999999942
No reset possible 297265943Aleksei Shpilman challenge-aido_LF-baseline-IL-0215 aido3-LFV-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:25 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 297225942Aleksei Shpilman challenge-aido_LF-baseline-IL-0215 aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.677697888049035 survival_time_median 12.000000000000036 deviation-center-line_median 0.9342036334388478 in-drivable-lane_median 0.8999999999999968
other stats agent_compute-ego_max 0.02348544398943583 agent_compute-ego_mean 0.022868373194814245 agent_compute-ego_median 0.022645788192749025 agent_compute-ego_min 0.02213559522257223 deviation-center-line_max 1.1295990081804914 deviation-center-line_mean 0.7837848486136505 deviation-center-line_min 0.2954441670234104 deviation-heading_max 4.518275546045711 deviation-heading_mean 3.3726736828804547 deviation-heading_median 4.362547570661335 deviation-heading_min 1.2521834443468092 driven_any_max 4.904810093449572 driven_any_mean 3.756064486151448 driven_any_median 4.04980109851177 driven_any_min 2.3384105713192045 driven_lanedir_consec_max 3.966186298156369 driven_lanedir_consec_mean 3.2122225022778457 driven_lanedir_consec_min 2.0797350256380147 driven_lanedir_max 3.966186298156369 driven_lanedir_mean 3.212726851181641 driven_lanedir_median 3.677697888049035 driven_lanedir_min 2.0797350256380147 in-drivable-lane_max 2.9500000000000197 in-drivable-lane_mean 1.3100000000000038 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.641362899755193, "sim_physics": 0.07312628904978434, "survival_time": 14.950000000000076, "driven_lanedir": 3.966186298156369, "sim_render-ego": 0.008356361389160157, "in-drivable-lane": 1.850000000000006, "agent_compute-ego": 0.023443648815155028, "deviation-heading": 4.518275546045711, "set_robot_commands": 0.006665498415629069, "deviation-center-line": 1.0612581797178935, "driven_lanedir_consec": 3.966186298156369, "sim_compute_sim_state": 0.0035504865646362304, "sim_compute_performance-ego": 0.004909795125325521, "sim_compute_robot_state-ego": 0.006222844918568929}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.904810093449572, "sim_physics": 0.07720838785171509, "survival_time": 14.950000000000076, "driven_lanedir": 3.953048324685443, "sim_render-ego": 0.009184431234995525, "in-drivable-lane": 2.9500000000000197, "agent_compute-ego": 0.022645788192749025, "deviation-heading": 4.385040015437305, "set_robot_commands": 0.006965616544087728, "deviation-center-line": 0.9342036334388478, "driven_lanedir_consec": 3.953048324685443, "sim_compute_sim_state": 0.0038359824816385905, "sim_compute_performance-ego": 0.005298769474029541, "sim_compute_robot_state-ego": 0.006734776496887207}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3384105713192045, "sim_physics": 0.08019056206657774, "survival_time": 6.299999999999986, "driven_lanedir": 2.0797350256380147, "sim_render-ego": 0.009514700798761277, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.02263138975415911, "deviation-heading": 1.2521834443468092, "set_robot_commands": 0.006847283196827722, "deviation-center-line": 0.2954441670234104, "driven_lanedir_consec": 2.0797350256380147, "sim_compute_sim_state": 0.004076329488602895, "sim_compute_performance-ego": 0.005696977887834821, "sim_compute_robot_state-ego": 0.007174266709221734}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.04980109851177, "sim_physics": 0.07537082930405935, "survival_time": 12.000000000000036, "driven_lanedir": 3.677697888049035, "sim_render-ego": 0.010213395953178406, "in-drivable-lane": 0, "agent_compute-ego": 0.02348544398943583, "deviation-heading": 4.362547570661335, "set_robot_commands": 0.007174569368362427, "deviation-center-line": 1.1295990081804914, "driven_lanedir_consec": 3.677697888049035, "sim_compute_sim_state": 0.003817454973856608, "sim_compute_performance-ego": 0.005191251635551453, "sim_compute_robot_state-ego": 0.006607865293820699}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8459377677215016, "sim_physics": 0.07227113649442599, "survival_time": 7.699999999999981, "driven_lanedir": 2.3869667193793456, "sim_render-ego": 0.009585809398007085, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02213559522257223, "deviation-heading": 2.345321837911116, "set_robot_commands": 0.006938209781399021, "deviation-center-line": 0.4984192547076087, "driven_lanedir_consec": 2.384444974860369, "sim_compute_sim_state": 0.004222588105635209, "sim_compute_performance-ego": 0.005377880938641437, "sim_compute_robot_state-ego": 0.006836330735838258}}set_robot_commands_max 0.007174569368362427 set_robot_commands_mean 0.006918235461261193 set_robot_commands_median 0.006938209781399021 set_robot_commands_min 0.006665498415629069 sim_compute_performance-ego_max 0.005696977887834821 sim_compute_performance-ego_mean 0.0052949350122765545 sim_compute_performance-ego_median 0.005298769474029541 sim_compute_performance-ego_min 0.004909795125325521 sim_compute_robot_state-ego_max 0.007174266709221734 sim_compute_robot_state-ego_mean 0.006715216830867366 sim_compute_robot_state-ego_median 0.006734776496887207 sim_compute_robot_state-ego_min 0.006222844918568929 sim_compute_sim_state_max 0.004222588105635209 sim_compute_sim_state_mean 0.003900568322873906 sim_compute_sim_state_median 0.0038359824816385905 sim_compute_sim_state_min 0.0035504865646362304 sim_physics_max 0.08019056206657774 sim_physics_mean 0.07563344095331251 sim_physics_median 0.07537082930405935 sim_physics_min 0.07227113649442599 sim_render-ego_max 0.010213395953178406 sim_render-ego_mean 0.009370939754820487 sim_render-ego_median 0.009514700798761277 sim_render-ego_min 0.008356361389160157 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.180000000000032 survival_time_min 6.299999999999986
No reset possible 297105935Aleksei Shpilman challenge-aido_LF-baseline-IL-0226 aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.710742090096819 survival_time_median 14.950000000000076 deviation-center-line_median 1.0354357168802346 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.02361629088719686 agent_compute-ego_mean 0.022529141175423335 agent_compute-ego_median 0.022346533934275308 agent_compute-ego_min 0.021924982393594614 deviation-center-line_max 1.1613428028909332 deviation-center-line_mean 0.8890634726516492 deviation-center-line_min 0.31086011602887237 deviation-heading_max 4.592145413543442 deviation-heading_mean 3.701166192893127 deviation-heading_median 4.159561584524163 deviation-heading_min 1.3235474964983436 driven_any_max 5.256278773542554 driven_any_mean 4.327546919228729 driven_any_median 4.642137303368881 driven_any_min 2.3201294523776683 driven_lanedir_consec_max 4.865897444043866 driven_lanedir_consec_mean 3.556847465622338 driven_lanedir_consec_min 2.08324029587389 driven_lanedir_max 4.865897444043866 driven_lanedir_mean 3.7100247717289823 driven_lanedir_median 3.710742090096819 driven_lanedir_min 2.08324029587389 in-drivable-lane_max 3.7500000000000537 in-drivable-lane_mean 1.5700000000000165 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.642137303368881, "sim_physics": 0.07642164945602417, "survival_time": 14.950000000000076, "driven_lanedir": 3.710742090096819, "sim_render-ego": 0.00962524175643921, "in-drivable-lane": 2.9500000000000224, "agent_compute-ego": 0.02361629088719686, "deviation-heading": 4.514176883557677, "set_robot_commands": 0.006859023571014405, "deviation-center-line": 0.8539248040160408, "driven_lanedir_consec": 3.710742090096819, "sim_compute_sim_state": 0.004249884287516276, "sim_compute_performance-ego": 0.005927097797393799, "sim_compute_robot_state-ego": 0.007090961933135987}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.62258561739433, "sim_physics": 0.07284562667210896, "survival_time": 14.950000000000076, "driven_lanedir": 3.383103207911658, "sim_render-ego": 0.008494602044423422, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.021988756656646728, "deviation-heading": 4.592145413543442, "set_robot_commands": 0.006586031913757324, "deviation-center-line": 1.0354357168802346, "driven_lanedir_consec": 2.6172166773784356, "sim_compute_sim_state": 0.0035722827911376953, "sim_compute_performance-ego": 0.004731732209523519, "sim_compute_robot_state-ego": 0.006073822180430094}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3201294523776683, "sim_physics": 0.07628289723800401, "survival_time": 5.899999999999987, "driven_lanedir": 2.08324029587389, "sim_render-ego": 0.009910720889851198, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.022769142005403163, "deviation-heading": 1.3235474964983436, "set_robot_commands": 0.006984686447402178, "deviation-center-line": 0.31086011602887237, "driven_lanedir_consec": 2.08324029587389, "sim_compute_sim_state": 0.00433159682710292, "sim_compute_performance-ego": 0.0057446310075662905, "sim_compute_robot_state-ego": 0.00695190187227928}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.7966034494602106, "sim_physics": 0.0695370740460274, "survival_time": 13.300000000000054, "driven_lanedir": 4.507140820718679, "sim_render-ego": 0.007878132332536512, "in-drivable-lane": 0, "agent_compute-ego": 0.021924982393594614, "deviation-heading": 3.916399586342008, "set_robot_commands": 0.006208064860867378, "deviation-center-line": 1.0837539234421656, "driven_lanedir_consec": 4.507140820718679, "sim_compute_sim_state": 0.0034673438036352173, "sim_compute_performance-ego": 0.004488409013676464, "sim_compute_robot_state-ego": 0.005888582172250389}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.256278773542554, "sim_physics": 0.07387915054957071, "survival_time": 14.950000000000076, "driven_lanedir": 4.865897444043866, "sim_render-ego": 0.00823775053024292, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.022346533934275308, "deviation-heading": 4.159561584524163, "set_robot_commands": 0.0064582633972167965, "deviation-center-line": 1.1613428028909332, "driven_lanedir_consec": 4.865897444043866, "sim_compute_sim_state": 0.0035724743207295735, "sim_compute_performance-ego": 0.0046667353312174475, "sim_compute_robot_state-ego": 0.00606147845586141}}set_robot_commands_max 0.006984686447402178 set_robot_commands_mean 0.006619214038051616 set_robot_commands_median 0.006586031913757324 set_robot_commands_min 0.006208064860867378 sim_compute_performance-ego_max 0.005927097797393799 sim_compute_performance-ego_mean 0.005111721071875504 sim_compute_performance-ego_median 0.004731732209523519 sim_compute_performance-ego_min 0.004488409013676464 sim_compute_robot_state-ego_max 0.007090961933135987 sim_compute_robot_state-ego_mean 0.006413349322791431 sim_compute_robot_state-ego_median 0.006073822180430094 sim_compute_robot_state-ego_min 0.005888582172250389 sim_compute_sim_state_max 0.00433159682710292 sim_compute_sim_state_mean 0.003838716406024336 sim_compute_sim_state_median 0.0035724743207295735 sim_compute_sim_state_min 0.0034673438036352173 sim_physics_max 0.07642164945602417 sim_physics_mean 0.07379327959234705 sim_physics_median 0.07387915054957071 sim_physics_min 0.0695370740460274 sim_render-ego_max 0.009910720889851198 sim_render-ego_mean 0.00882928951069865 sim_render-ego_median 0.008494602044423422 sim_render-ego_min 0.007878132332536512 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.810000000000054 survival_time_min 5.899999999999987
No reset possible 296885924Aleksei Shpilman challenge-aido_LF-baseline-IL-0232 aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:22:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.171332760279622 survival_time_median 14.950000000000076 deviation-center-line_median 0.8413788567971601 in-drivable-lane_median 1.5499999999999958
other stats agent_compute-ego_max 0.02612040067712466 agent_compute-ego_mean 0.0201415277939962 agent_compute-ego_median 0.017978821595509845 agent_compute-ego_min 0.016673422696297627 deviation-center-line_max 1.3340848630380555 deviation-center-line_mean 0.8686459839403001 deviation-center-line_min 0.26105619398686536 deviation-heading_max 5.599510003299545 deviation-heading_mean 3.762564344512114 deviation-heading_median 3.865959694564377 deviation-heading_min 1.0304360458853636 driven_any_max 5.687204242115337 driven_any_mean 4.566242627094699 driven_any_median 4.874024926982581 driven_any_min 2.309168755974976 driven_lanedir_consec_max 5.104252071953122 driven_lanedir_consec_mean 3.890089300182704 driven_lanedir_consec_min 2.0877768978297264 driven_lanedir_max 5.104252071953122 driven_lanedir_mean 3.890089300182704 driven_lanedir_median 4.171332760279622 driven_lanedir_min 2.0877768978297264 in-drivable-lane_max 3.300000000000021 in-drivable-lane_mean 1.7100000000000106 in-drivable-lane_min 0.15000000000000213 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.551585142025367, "sim_physics": 0.057052419980367024, "survival_time": 14.950000000000076, "driven_lanedir": 3.559456395654186, "sim_render-ego": 0.00702959140141805, "in-drivable-lane": 3.300000000000021, "agent_compute-ego": 0.017978821595509845, "deviation-heading": 4.661711983849752, "set_robot_commands": 0.0051574977238972985, "deviation-center-line": 0.8413788567971601, "driven_lanedir_consec": 3.559456395654186, "sim_compute_sim_state": 0.0029549535115559896, "sim_compute_performance-ego": 0.0041309587160746255, "sim_compute_robot_state-ego": 0.005314522584279378}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.422452502287816, "sim_physics": 0.05421216824916021, "survival_time": 9.55, "driven_lanedir": 2.7941561517835027, "sim_render-ego": 0.008935309205379785, "in-drivable-lane": 1.4000000000000057, "agent_compute-ego": 0.017158514542105312, "deviation-heading": 2.6053138541901073, "set_robot_commands": 0.005220404470154128, "deviation-center-line": 0.5409633801901071, "driven_lanedir_consec": 2.7941561517835027, "sim_compute_sim_state": 0.002987063992085881, "sim_compute_performance-ego": 0.004035919748675761, "sim_compute_robot_state-ego": 0.005228876443433512}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.309168755974976, "sim_physics": 0.055839528117263525, "survival_time": 5.699999999999988, "driven_lanedir": 2.0877768978297264, "sim_render-ego": 0.007149947317023026, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.016673422696297627, "deviation-heading": 1.0304360458853636, "set_robot_commands": 0.0051510940518295556, "deviation-center-line": 0.26105619398686536, "driven_lanedir_consec": 2.0877768978297264, "sim_compute_sim_state": 0.0029047141995346337, "sim_compute_performance-ego": 0.003970643930267869, "sim_compute_robot_state-ego": 0.005137027355662563}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.376709355127525, "sim_physics": 0.05493392546971639, "survival_time": 14.950000000000076, "driven_lanedir": 4.784976256443076, "sim_render-ego": 0.0071934151649475095, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.01712049643198649, "deviation-heading": 3.865959694564377, "set_robot_commands": 0.00516305685043335, "deviation-center-line": 1.0561685621511387, "driven_lanedir_consec": 4.784976256443076, "sim_compute_sim_state": 0.002959554195404053, "sim_compute_performance-ego": 0.004056659539540609, "sim_compute_robot_state-ego": 0.005191663901011149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.687204242115337, "sim_physics": 0.05611475805441538, "survival_time": 14.40000000000007, "driven_lanedir": 5.104252071953122, "sim_render-ego": 0.00706204440858629, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.01718767649597592, "deviation-heading": 3.3925559674803787, "set_robot_commands": 0.005100596282217238, "deviation-center-line": 0.8281478371758906, "driven_lanedir_consec": 5.104252071953122, "sim_compute_sim_state": 0.0029356860452228123, "sim_compute_performance-ego": 0.003993168473243713, "sim_compute_robot_state-ego": 0.005173534154891968}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.8920464298144575, "sim_physics": 0.05416593154271443, "survival_time": 14.950000000000076, "driven_lanedir": 3.9219848537798807, "sim_render-ego": 0.007058703899383545, "in-drivable-lane": 3.1500000000000288, "agent_compute-ego": 0.017233845392862955, "deviation-heading": 4.040244812057303, "set_robot_commands": 0.005187350114186605, "deviation-center-line": 0.7117048465772992, "driven_lanedir_consec": 3.9219848537798807, "sim_compute_sim_state": 0.002999754746754964, "sim_compute_performance-ego": 0.003989736239115397, "sim_compute_robot_state-ego": 0.0051537370681762696}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.839290220860263, "sim_physics": 0.05629649077142987, "survival_time": 14.000000000000064, "driven_lanedir": 4.22715596723587, "sim_render-ego": 0.007133364677429199, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.017286694049835204, "deviation-heading": 4.394184005719771, "set_robot_commands": 0.0051321642739432195, "deviation-center-line": 1.0343485364986356, "driven_lanedir_consec": 4.22715596723587, "sim_compute_sim_state": 0.0030025533267429897, "sim_compute_performance-ego": 0.0040329694747924805, "sim_compute_robot_state-ego": 0.005193771634783064}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.781705610728926, "sim_physics": 0.05579039096832275, "survival_time": 14.950000000000076, "driven_lanedir": 3.954289801031922, "sim_render-ego": 0.007118436495463053, "in-drivable-lane": 1.8000000000000131, "agent_compute-ego": 0.017009304364522297, "deviation-heading": 5.599510003299545, "set_robot_commands": 0.005071489810943603, "deviation-center-line": 1.1713991920487328, "driven_lanedir_consec": 3.954289801031922, "sim_compute_sim_state": 0.0029305227597554526, "sim_compute_performance-ego": 0.003988971710205078, "sim_compute_robot_state-ego": 0.005157416661580404}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.962838554599553, "sim_physics": 0.06873546520868937, "survival_time": 14.950000000000076, "driven_lanedir": 4.171332760279622, "sim_render-ego": 0.00878756841023763, "in-drivable-lane": 2.350000000000012, "agent_compute-ego": 0.020613738695780436, "deviation-heading": 3.971194430691212, "set_robot_commands": 0.006971500714619955, "deviation-center-line": 0.9383671199561142, "driven_lanedir_consec": 4.171332760279622, "sim_compute_sim_state": 0.003729419708251953, "sim_compute_performance-ego": 0.005006377696990967, "sim_compute_robot_state-ego": 0.006469221909840902}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 5.011861145111794, "sim_physics": 0.07497494459152222, "survival_time": 14.950000000000076, "driven_lanedir": 4.360688360053001, "sim_render-ego": 0.009192306995391846, "in-drivable-lane": 1.9500000000000153, "agent_compute-ego": 0.023476717472076417, "deviation-heading": 4.198493431042938, "set_robot_commands": 0.007127367655436198, "deviation-center-line": 0.9681080223891878, "driven_lanedir_consec": 4.360688360053001, "sim_compute_sim_state": 0.0037569793065389, "sim_compute_performance-ego": 0.005296335220336914, "sim_compute_robot_state-ego": 0.006626815001169841}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.2327390567257055, "sim_physics": 0.07372804555025968, "survival_time": 11.00000000000002, "driven_lanedir": 3.976178260195739, "sim_render-ego": 0.009688919240778145, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.02242639498277144, "deviation-heading": 2.703447165844082, "set_robot_commands": 0.007021992856805975, "deviation-center-line": 0.8259930747425005, "driven_lanedir_consec": 3.976178260195739, "sim_compute_sim_state": 0.0040854323994029655, "sim_compute_performance-ego": 0.005706284262917258, "sim_compute_robot_state-ego": 0.007140568169680508}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.874024926982581, "sim_physics": 0.08279873132705688, "survival_time": 14.950000000000076, "driven_lanedir": 4.322782488103267, "sim_render-ego": 0.010153717199961344, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.025898543993632, "deviation-heading": 5.440205323468774, "set_robot_commands": 0.008017890453338623, "deviation-center-line": 1.3340848630380555, "driven_lanedir_consec": 4.322782488103267, "sim_compute_sim_state": 0.004231413205464681, "sim_compute_performance-ego": 0.00587287425994873, "sim_compute_robot_state-ego": 0.007428065141042073}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 5.2404762723808505, "sim_physics": 0.07555622895558675, "survival_time": 14.950000000000076, "driven_lanedir": 4.3562025863396485, "sim_render-ego": 0.00979700247446696, "in-drivable-lane": 3.150000000000019, "agent_compute-ego": 0.023251647154490154, "deviation-heading": 3.1727820095682886, "set_robot_commands": 0.008773335615793864, "deviation-center-line": 0.8035801594702676, "driven_lanedir_consec": 4.3562025863396485, "sim_compute_sim_state": 0.004353531201680501, "sim_compute_performance-ego": 0.00578649361928304, "sim_compute_robot_state-ego": 0.007090739409128825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.158989346347447, "sim_physics": 0.08559470002849896, "survival_time": 9.6, "driven_lanedir": 2.4453142069566365, "sim_render-ego": 0.009846419095993042, "in-drivable-lane": 1.5499999999999958, "agent_compute-ego": 0.02612040067712466, "deviation-heading": 3.7247254543058466, "set_robot_commands": 0.007995052884022394, "deviation-center-line": 0.81590225136734, "driven_lanedir_consec": 2.4453142069566365, "sim_compute_sim_state": 0.00419692446788152, "sim_compute_performance-ego": 0.005714672307173411, "sim_compute_robot_state-ego": 0.007305745035409927}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.152547845337891, "sim_physics": 0.07467341821727944, "survival_time": 14.950000000000076, "driven_lanedir": 4.284792445101349, "sim_render-ego": 0.009062858728262096, "in-drivable-lane": 2.45000000000001, "agent_compute-ego": 0.02268669836497227, "deviation-heading": 3.6377009857139697, "set_robot_commands": 0.006961232443717012, "deviation-center-line": 0.8984868627152036, "driven_lanedir_consec": 4.284792445101349, "sim_compute_sim_state": 0.0038698540882123353, "sim_compute_performance-ego": 0.005319715742283441, "sim_compute_robot_state-ego": 0.0066858310763253815}}set_robot_commands_max 0.008773335615793864 set_robot_commands_mean 0.006270135080089269 set_robot_commands_median 0.005220404470154128 set_robot_commands_min 0.005071489810943603 sim_compute_performance-ego_max 0.00587287425994873 sim_compute_performance-ego_mean 0.00472678539605662 sim_compute_performance-ego_median 0.0041309587160746255 sim_compute_performance-ego_min 0.003970643930267869 sim_compute_robot_state-ego_max 0.007428065141042073 sim_compute_robot_state-ego_mean 0.006019835703094384 sim_compute_robot_state-ego_median 0.005314522584279378 sim_compute_robot_state-ego_min 0.005137027355662563 sim_compute_sim_state_max 0.004353531201680501 sim_compute_sim_state_mean 0.0034598904769659756 sim_compute_sim_state_median 0.0030025533267429897 sim_compute_sim_state_min 0.0029047141995346337 sim_physics_max 0.08559470002849896 sim_physics_mean 0.06536447646881886 sim_physics_median 0.057052419980367024 sim_physics_min 0.05416593154271443 sim_render-ego_max 0.010153717199961344 sim_render-ego_mean 0.008347306980981434 sim_render-ego_median 0.00878756841023763 sim_render-ego_min 0.00702959140141805 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.253333333333387 survival_time_min 5.699999999999988
No reset possible 296825912Frank (Chude) Qian 2019-12-09|FrankNet|v3-Patch1 aido3-LFVI-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:36 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 296605899Robert Moni lzoltan-03 aido3-LFV-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.6529591654812288 survival_time_median 5.299999999999989 deviation-center-line_median 0.33588368096518756 in-drivable-lane_median 0.2499999999999991
other stats agent_compute-ego_max 0.02197163734795912 agent_compute-ego_mean 0.02171737738953768 agent_compute-ego_median 0.021746997038523355 agent_compute-ego_min 0.02130853562127976 deviation-center-line_max 0.9278054635273412 deviation-center-line_mean 0.5079976947797051 deviation-center-line_min 0.22132646419875476 deviation-heading_max 3.8388783715851607 deviation-heading_mean 2.2780681942989274 deviation-heading_median 1.8168752530596344 deviation-heading_min 1.2001039182334978 driven_any_max 4.914657002176221 driven_any_mean 2.8971499735459423 driven_any_median 1.9712859866343544 driven_any_min 1.320398432400858 driven_lanedir_consec_max 4.693616018993309 driven_lanedir_consec_mean 2.635843908986529 driven_lanedir_consec_min 0.9115376078434584 driven_lanedir_max 4.693616018993309 driven_lanedir_mean 2.635843908986529 driven_lanedir_median 1.6529591654812288 driven_lanedir_min 0.9115376078434584 in-drivable-lane_max 0.6499999999999977 in-drivable-lane_mean 0.289999999999999 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.83759278146583, "sim_physics": 0.09605163097381592, "survival_time": 14.950000000000076, "driven_lanedir": 4.686055627608194, "sim_render-ego": 0.006929936408996582, "in-drivable-lane": 0, "agent_compute-ego": 0.02174076318740845, "deviation-heading": 3.1133745153921004, "set_robot_commands": 0.0049763290087382, "deviation-center-line": 0.7980766711709955, "driven_lanedir_consec": 4.686055627608194, "sim_compute_sim_state": 0.0027978181838989257, "sim_compute_performance-ego": 0.00392139196395874, "sim_compute_robot_state-ego": 0.00512523889541626, "sim_compute_robot_state-npc0": 0.00482636292775472, "sim_compute_robot_state-npc1": 0.004555223782857259, "sim_compute_robot_state-npc2": 0.004529694716135661, "sim_compute_robot_state-npc3": 0.004525078932444255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4418156650524498, "sim_physics": 0.10861034989356996, "survival_time": 3.999999999999994, "driven_lanedir": 1.2350511250064542, "sim_render-ego": 0.007231804728507996, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.0218189537525177, "deviation-heading": 1.2001039182334978, "set_robot_commands": 0.005023187398910523, "deviation-center-line": 0.25689619403624636, "driven_lanedir_consec": 1.2350511250064542, "sim_compute_sim_state": 0.0028190016746520996, "sim_compute_performance-ego": 0.003958195447921753, "sim_compute_robot_state-ego": 0.00517306923866272, "sim_compute_robot_state-npc0": 0.004895880818367004, "sim_compute_robot_state-npc1": 0.004619571566581726, "sim_compute_robot_state-npc2": 0.004582679271697998, "sim_compute_robot_state-npc3": 0.004548662900924682}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9712859866343544, "sim_physics": 0.1066136270199182, "survival_time": 5.299999999999989, "driven_lanedir": 1.6529591654812288, "sim_render-ego": 0.007189793406792407, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02197163734795912, "deviation-heading": 1.4211089132242416, "set_robot_commands": 0.004959749725629699, "deviation-center-line": 0.33588368096518756, "driven_lanedir_consec": 1.6529591654812288, "sim_compute_sim_state": 0.002793581980579304, "sim_compute_performance-ego": 0.0039408791739985625, "sim_compute_robot_state-ego": 0.00515522596971044, "sim_compute_robot_state-npc0": 0.004908021890892173, "sim_compute_robot_state-npc1": 0.004604656741304218, "sim_compute_robot_state-npc2": 0.004549845209661519, "sim_compute_robot_state-npc3": 0.004498828132197542}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.914657002176221, "sim_physics": 0.10048626025517782, "survival_time": 14.950000000000076, "driven_lanedir": 4.693616018993309, "sim_render-ego": 0.006970336437225342, "in-drivable-lane": 0, "agent_compute-ego": 0.021746997038523355, "deviation-heading": 3.8388783715851607, "set_robot_commands": 0.004984056154886882, "deviation-center-line": 0.9278054635273412, "driven_lanedir_consec": 4.693616018993309, "sim_compute_sim_state": 0.0027974104881286622, "sim_compute_performance-ego": 0.003918900489807129, "sim_compute_robot_state-ego": 0.00515396515528361, "sim_compute_robot_state-npc0": 0.004881566365559896, "sim_compute_robot_state-npc1": 0.004532261689503988, "sim_compute_robot_state-npc2": 0.004510623613993327, "sim_compute_robot_state-npc3": 0.004506826400756836}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.320398432400858, "sim_physics": 0.1091064243089585, "survival_time": 4.199999999999993, "driven_lanedir": 0.9115376078434584, "sim_render-ego": 0.007219053450084868, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02130853562127976, "deviation-heading": 1.8168752530596344, "set_robot_commands": 0.004974981149037679, "deviation-center-line": 0.22132646419875476, "driven_lanedir_consec": 0.9115376078434584, "sim_compute_sim_state": 0.0028434310640607563, "sim_compute_performance-ego": 0.0039249516668773835, "sim_compute_robot_state-ego": 0.005181741146814255, "sim_compute_robot_state-npc0": 0.004887314069838751, "sim_compute_robot_state-npc1": 0.004566825571514312, "sim_compute_robot_state-npc2": 0.004546997093019031, "sim_compute_robot_state-npc3": 0.004566919235956101}}set_robot_commands_max 0.005023187398910523 set_robot_commands_mean 0.004983660687440597 set_robot_commands_median 0.0049763290087382 set_robot_commands_min 0.004959749725629699 sim_compute_performance-ego_max 0.003958195447921753 sim_compute_performance-ego_mean 0.003932863748512714 sim_compute_performance-ego_median 0.0039249516668773835 sim_compute_performance-ego_min 0.003918900489807129 sim_compute_robot_state-ego_max 0.005181741146814255 sim_compute_robot_state-ego_mean 0.005157848081177457 sim_compute_robot_state-ego_median 0.00515522596971044 sim_compute_robot_state-ego_min 0.00512523889541626 sim_compute_robot_state-npc0_max 0.004908021890892173 sim_compute_robot_state-npc0_mean 0.004879829214482509 sim_compute_robot_state-npc0_median 0.004887314069838751 sim_compute_robot_state-npc0_min 0.00482636292775472 sim_compute_robot_state-npc1_max 0.004619571566581726 sim_compute_robot_state-npc1_mean 0.004575707870352301 sim_compute_robot_state-npc1_median 0.004566825571514312 sim_compute_robot_state-npc1_min 0.004532261689503988 sim_compute_robot_state-npc2_max 0.004582679271697998 sim_compute_robot_state-npc2_mean 0.004543967980901507 sim_compute_robot_state-npc2_median 0.004546997093019031 sim_compute_robot_state-npc2_min 0.004510623613993327 sim_compute_robot_state-npc3_max 0.004566919235956101 sim_compute_robot_state-npc3_mean 0.004529263120455883 sim_compute_robot_state-npc3_median 0.004525078932444255 sim_compute_robot_state-npc3_min 0.004498828132197542 sim_compute_sim_state_max 0.0028434310640607563 sim_compute_sim_state_mean 0.0028102486782639498 sim_compute_sim_state_median 0.0027978181838989257 sim_compute_sim_state_min 0.002793581980579304 sim_physics_max 0.1091064243089585 sim_physics_mean 0.10417365849028806 sim_physics_median 0.1066136270199182 sim_physics_min 0.09605163097381592 sim_render-ego_max 0.007231804728507996 sim_render-ego_mean 0.007108184886321439 sim_render-ego_median 0.007189793406792407 sim_render-ego_min 0.006929936408996582 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.680000000000026 survival_time_min 3.999999999999994
No reset possible 296195870Aleksei Shpilman challenge-aido_LF-baseline-IL aido3-LFV-sim-testingstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:18:17 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 296005863Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:18:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1782975976568428 survival_time_median 6.399999999999985 deviation-center-line_median 0.27427290530421494 in-drivable-lane_median 0.9500000000000136
other stats agent_compute-ego_max 0.04572430998086929 agent_compute-ego_mean 0.03980456135600377 agent_compute-ego_median 0.038298977745903864 agent_compute-ego_min 0.03153328895568848 deviation-center-line_max 0.9470953787856472 deviation-center-line_mean 0.4154484257802734 deviation-center-line_min 0.10512560911783302 deviation-heading_max 4.007958198700659 deviation-heading_mean 2.004570992346068 deviation-heading_median 1.626283954500886 deviation-heading_min 0.36867739239365194 driven_any_max 4.085223933885625 driven_any_mean 2.0318751265967667 driven_any_median 1.6955531153838292 driven_any_min 0.5075761744492557 driven_lanedir_consec_max 3.603200173280275 driven_lanedir_consec_mean 1.541454327140836 driven_lanedir_consec_min 0.1825734813571381 driven_lanedir_max 3.603200173280275 driven_lanedir_mean 1.5499044080922744 driven_lanedir_median 1.2274585249418235 driven_lanedir_min 0.1825734813571381 in-drivable-lane_max 2.6999999999999953 in-drivable-lane_mean 1.213333333333335 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0812819907879123, "sim_physics": 0.11817298215978286, "survival_time": 4.249999999999993, "driven_lanedir": 0.6864766268079123, "sim_render-ego": 0.013670169605928309, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.03153328895568848, "deviation-heading": 1.626283954500886, "set_robot_commands": 0.011481899373671589, "deviation-center-line": 0.19687643362530044, "driven_lanedir_consec": 0.6840544058949349, "sim_compute_sim_state": 0.005945733014275046, "sim_compute_performance-ego": 0.008295538846184225, "sim_compute_robot_state-ego": 0.009400070414823644}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3243549782984245, "sim_physics": 0.10045368133941827, "survival_time": 8.649999999999988, "driven_lanedir": 1.8961339087789963, "sim_render-ego": 0.012044023227140394, "in-drivable-lane": 0.6000000000000023, "agent_compute-ego": 0.04273472769412002, "deviation-heading": 3.1841114291550245, "set_robot_commands": 0.009176345229837936, "deviation-center-line": 0.45294514318860135, "driven_lanedir_consec": 1.8739416961624265, "sim_compute_sim_state": 0.0051630273719743495, "sim_compute_performance-ego": 0.00709411312389925, "sim_compute_robot_state-ego": 0.008708104921903225}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.085223933885625, "sim_physics": 0.12303283532460532, "survival_time": 14.950000000000076, "driven_lanedir": 3.603200173280275, "sim_render-ego": 0.013721097310384114, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.04382717529932658, "deviation-heading": 4.007958198700659, "set_robot_commands": 0.010925222237904866, "deviation-center-line": 0.9470953787856472, "driven_lanedir_consec": 3.603200173280275, "sim_compute_sim_state": 0.00550007422765096, "sim_compute_performance-ego": 0.007905619144439697, "sim_compute_robot_state-ego": 0.010033673445383707}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5075761744492557, "sim_physics": 0.10054210174915404, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2413493869654144, "sim_render-ego": 0.013341920320377794, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.043746765269789586, "deviation-heading": 1.0756958244970092, "set_robot_commands": 0.009292536003645076, "deviation-center-line": 0.10512560911783302, "driven_lanedir_consec": 0.19403535530933125, "sim_compute_sim_state": 0.004885795504547829, "sim_compute_performance-ego": 0.007877832235291947, "sim_compute_robot_state-ego": 0.009010048799736554}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6955531153838292, "sim_physics": 0.12083556316792964, "survival_time": 6.399999999999985, "driven_lanedir": 1.650785292479614, "sim_render-ego": 0.013743674382567406, "in-drivable-lane": 0, "agent_compute-ego": 0.04572430998086929, "deviation-heading": 1.2789449493521368, "set_robot_commands": 0.01017511449754238, "deviation-center-line": 0.42314009065815, "driven_lanedir_consec": 1.650785292479614, "sim_compute_sim_state": 0.005699755623936653, "sim_compute_performance-ego": 0.007612202316522598, "sim_compute_robot_state-ego": 0.009544285014271736}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.737455686407739, "sim_physics": 0.103177523794975, "survival_time": 6.549999999999985, "driven_lanedir": 1.0011439315944006, "sim_render-ego": 0.012474500495968883, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.04479408264160156, "deviation-heading": 0.6919058343741675, "set_robot_commands": 0.009701432162568769, "deviation-center-line": 0.1884898921358066, "driven_lanedir_consec": 1.0011439315944006, "sim_compute_sim_state": 0.004969494943400376, "sim_compute_performance-ego": 0.0071947574615478516, "sim_compute_robot_state-ego": 0.008756133436246682}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.470271632052536, "sim_physics": 0.07459165161731196, "survival_time": 12.750000000000046, "driven_lanedir": 2.676795403736095, "sim_render-ego": 0.00920110870810116, "in-drivable-lane": 1.9000000000000077, "agent_compute-ego": 0.03706119948742436, "deviation-heading": 3.8764979889011295, "set_robot_commands": 0.007028891058529125, "deviation-center-line": 0.9278180709651488, "driven_lanedir_consec": 2.676795403736095, "sim_compute_sim_state": 0.003910620072308709, "sim_compute_performance-ego": 0.005256695840872971, "sim_compute_robot_state-ego": 0.0066391253003887105}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.541740478774961, "sim_physics": 0.07752145049918412, "survival_time": 5.849999999999987, "driven_lanedir": 1.2274585249418235, "sim_render-ego": 0.00967213027497642, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.038298977745903864, "deviation-heading": 1.7602799933218498, "set_robot_commands": 0.007090105969681699, "deviation-center-line": 0.27427290530421494, "driven_lanedir_consec": 1.1782975976568428, "sim_compute_sim_state": 0.004036106614985018, "sim_compute_performance-ego": 0.00578359253386147, "sim_compute_robot_state-ego": 0.0070053389948657434}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.402026619978156, "sim_physics": 0.08918223871248905, "survival_time": 5.349999999999989, "driven_lanedir": 0.9175268441549196, "sim_render-ego": 0.01080111699683644, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.04153425671229853, "deviation-heading": 1.5857950137339103, "set_robot_commands": 0.008507528037668388, "deviation-center-line": 0.2645421265398052, "driven_lanedir_consec": 0.9175268441549196, "sim_compute_sim_state": 0.004568884305864851, "sim_compute_performance-ego": 0.006188165361636153, "sim_compute_robot_state-ego": 0.007807187944929177}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.330572495977486, "sim_physics": 0.07587734241874851, "survival_time": 12.25000000000004, "driven_lanedir": 2.8754204163410573, "sim_render-ego": 0.008827099508168746, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.03702542149290747, "deviation-heading": 3.073929775670317, "set_robot_commands": 0.006817187095174984, "deviation-center-line": 0.5283964866825125, "driven_lanedir_consec": 2.8754204163410573, "sim_compute_sim_state": 0.003761887063785475, "sim_compute_performance-ego": 0.005038068732436823, "sim_compute_robot_state-ego": 0.006567327343687719}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.122511871718682, "sim_physics": 0.07851022139362905, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1825734813571381, "sim_render-ego": 0.01014700155148561, "in-drivable-lane": 2.6999999999999953, "agent_compute-ego": 0.0377809782137816, "deviation-heading": 1.3980439330674557, "set_robot_commands": 0.007247028679683291, "deviation-center-line": 0.16656839470895798, "driven_lanedir_consec": 0.1825734813571381, "sim_compute_sim_state": 0.003980647558453439, "sim_compute_performance-ego": 0.005750595838174053, "sim_compute_robot_state-ego": 0.007174620683165802}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5215727718631517, "sim_physics": 0.07127708196640015, "survival_time": 2.2, "driven_lanedir": 0.21030790428460588, "sim_render-ego": 0.009127242998643354, "in-drivable-lane": 1, "agent_compute-ego": 0.03536272048950195, "deviation-heading": 0.36867739239365194, "set_robot_commands": 0.0068725076588717375, "deviation-center-line": 0.12483405616644148, "driven_lanedir_consec": 0.2097071464300708, "sim_compute_sim_state": 0.003674263303930109, "sim_compute_performance-ego": 0.005083100362257524, "sim_compute_robot_state-ego": 0.006490035490556197}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.2343628019014348, "sim_physics": 0.1029265930778102, "survival_time": 4.749999999999991, "driven_lanedir": 0.6512593139833449, "sim_render-ego": 0.011718381078619706, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.04448094618947882, "deviation-heading": 0.6794705775451251, "set_robot_commands": 0.009294271469116213, "deviation-center-line": 0.11663715948873606, "driven_lanedir_consec": 0.6512593139833449, "sim_compute_sim_state": 0.004817802027652138, "sim_compute_performance-ego": 0.006749650051719264, "sim_compute_robot_state-ego": 0.00844310208370811}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.6100506302834026, "sim_physics": 0.0756980059281835, "survival_time": 13.250000000000052, "driven_lanedir": 3.024950345360356, "sim_render-ego": 0.009067791812824752, "in-drivable-lane": 1.5500000000000178, "agent_compute-ego": 0.03695825090948141, "deviation-heading": 3.1857703003958746, "set_robot_commands": 0.007168874200784935, "deviation-center-line": 0.9160914227652616, "driven_lanedir_consec": 3.024950345360356, "sim_compute_sim_state": 0.003960335929438753, "sim_compute_performance-ego": 0.005226740747127893, "sim_compute_robot_state-ego": 0.006585073471069336}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.813571717188908, "sim_physics": 0.07349189542807065, "survival_time": 10.400000000000013, "driven_lanedir": 2.4031845673181618, "sim_render-ego": 0.009314767443216763, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.03620531925788292, "deviation-heading": 2.275199719581822, "set_robot_commands": 0.0068421489917314966, "deviation-center-line": 0.5988932165716839, "driven_lanedir_consec": 2.398123503371731, "sim_compute_sim_state": 0.0038533279528984656, "sim_compute_performance-ego": 0.005384701948899489, "sim_compute_robot_state-ego": 0.006846723648218008}}set_robot_commands_max 0.011481899373671589 set_robot_commands_mean 0.008508072844427499 set_robot_commands_median 0.008507528037668388 set_robot_commands_min 0.006817187095174984 sim_compute_performance-ego_max 0.008295538846184225 sim_compute_performance-ego_mean 0.006429424969658081 sim_compute_performance-ego_median 0.006188165361636153 sim_compute_performance-ego_min 0.005038068732436823 sim_compute_robot_state-ego_max 0.010033673445383707 sim_compute_robot_state-ego_mean 0.007934056732863624 sim_compute_robot_state-ego_median 0.007807187944929177 sim_compute_robot_state-ego_min 0.006490035490556197 sim_compute_sim_state_max 0.005945733014275046 sim_compute_sim_state_mean 0.004581850367673479 sim_compute_sim_state_median 0.004568884305864851 sim_compute_sim_state_min 0.003674263303930109 sim_physics_max 0.12303283532460532 sim_physics_mean 0.09235274457184615 sim_physics_median 0.08918223871248905 sim_physics_min 0.07127708196640015 sim_render-ego_max 0.013743674382567406 sim_render-ego_mean 0.011124801714349325 sim_render-ego_median 0.01080111699683644 sim_render-ego_min 0.008827099508168746 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.606666666666678 survival_time_min 2.1500000000000004
No reset possible 295905865Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4965542747724463 survival_time_median 2.1500000000000004 deviation-center-line_median 0.13482365392345216 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.19111251597310985 agent_compute-ego_mean 0.1765738148766684 agent_compute-ego_median 0.17124281058440338 agent_compute-ego_min 0.1623040693146842 deviation-center-line_max 0.1794719126592736 deviation-center-line_mean 0.14333140814262174 deviation-center-line_min 0.124743559524868 deviation-heading_max 0.562270894956663 deviation-heading_mean 0.4655415774107695 deviation-heading_median 0.4631456275033427 deviation-heading_min 0.3393227538703061 driven_any_max 1.3322401258919594 driven_any_mean 0.7117146709747907 driven_any_median 0.5076438998075673 driven_any_min 0.2980848970679523 driven_lanedir_consec_max 0.7351035180464107 driven_lanedir_consec_mean 0.4987472980801946 driven_lanedir_consec_min 0.28968009655459315 driven_lanedir_max 0.7351035180464107 driven_lanedir_mean 0.4987472980801946 driven_lanedir_median 0.4965542747724463 driven_lanedir_min 0.28968009655459315 in-drivable-lane_max 2.6999999999999904 in-drivable-lane_mean 0.7099999999999975 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5076438998075673, "sim_physics": 0.08172712215157442, "survival_time": 2.1500000000000004, "driven_lanedir": 0.4965542747724463, "sim_render-ego": 0.009407775346622913, "in-drivable-lane": 0, "agent_compute-ego": 0.1874179119287535, "deviation-heading": 0.4631456275033427, "set_robot_commands": 0.007366612900135129, "deviation-center-line": 0.15065232046717966, "driven_lanedir_consec": 0.4965542747724463, "sim_compute_sim_state": 0.003761019817618437, "sim_compute_performance-ego": 0.005586690680925236, "sim_compute_robot_state-ego": 0.006660117659457895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2980848970679523, "sim_physics": 0.07322249242237636, "survival_time": 1.4000000000000006, "driven_lanedir": 0.28968009655459315, "sim_render-ego": 0.0082047666822161, "in-drivable-lane": 0, "agent_compute-ego": 0.1623040693146842, "deviation-heading": 0.3393227538703061, "set_robot_commands": 0.006514975002833775, "deviation-center-line": 0.1269655941383352, "driven_lanedir_consec": 0.28968009655459315, "sim_compute_sim_state": 0.00345012971333095, "sim_compute_performance-ego": 0.004486492701939174, "sim_compute_robot_state-ego": 0.0060154540198189875}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.996810832863133, "sim_physics": 0.06982234502450013, "survival_time": 3.899999999999994, "driven_lanedir": 0.7351035180464107, "sim_render-ego": 0.008398783512604542, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1707917665823912, "deviation-heading": 0.5448139661901679, "set_robot_commands": 0.0066583492817022865, "deviation-center-line": 0.13482365392345216, "driven_lanedir_consec": 0.7351035180464107, "sim_compute_sim_state": 0.0035509115610367213, "sim_compute_performance-ego": 0.004730126796624599, "sim_compute_robot_state-ego": 0.006293526062598595}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3322401258919594, "sim_physics": 0.07280933389476701, "survival_time": 5.09999999999999, "driven_lanedir": 0.5673356185472183, "sim_render-ego": 0.009586932612400428, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.19111251597310985, "deviation-heading": 0.4181546445333675, "set_robot_commands": 0.007116546817854339, "deviation-center-line": 0.1794719126592736, "driven_lanedir_consec": 0.5673356185472183, "sim_compute_sim_state": 0.003915071487426758, "sim_compute_performance-ego": 0.005512754122416179, "sim_compute_robot_state-ego": 0.006949602388868145}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.423793599243341, "sim_physics": 0.08347761308824694, "survival_time": 1.850000000000001, "driven_lanedir": 0.4050629824803047, "sim_render-ego": 0.009660089338147965, "in-drivable-lane": 0, "agent_compute-ego": 0.17124281058440338, "deviation-heading": 0.562270894956663, "set_robot_commands": 0.007017670450983821, "deviation-center-line": 0.124743559524868, "driven_lanedir_consec": 0.4050629824803047, "sim_compute_sim_state": 0.004084947946909312, "sim_compute_performance-ego": 0.005571275144009976, "sim_compute_robot_state-ego": 0.007083377322635135}}set_robot_commands_max 0.007366612900135129 set_robot_commands_mean 0.006934830890701869 set_robot_commands_median 0.007017670450983821 set_robot_commands_min 0.006514975002833775 sim_compute_performance-ego_max 0.005586690680925236 sim_compute_performance-ego_mean 0.005177467889183033 sim_compute_performance-ego_median 0.005512754122416179 sim_compute_performance-ego_min 0.004486492701939174 sim_compute_robot_state-ego_max 0.007083377322635135 sim_compute_robot_state-ego_mean 0.006600415490675751 sim_compute_robot_state-ego_median 0.006660117659457895 sim_compute_robot_state-ego_min 0.0060154540198189875 sim_compute_sim_state_max 0.004084947946909312 sim_compute_sim_state_mean 0.0037524161052644354 sim_compute_sim_state_median 0.003761019817618437 sim_compute_sim_state_min 0.00345012971333095 sim_physics_max 0.08347761308824694 sim_physics_mean 0.07621178131629298 sim_physics_median 0.07322249242237636 sim_physics_min 0.06982234502450013 sim_render-ego_max 0.009660089338147965 sim_render-ego_mean 0.009051669498398389 sim_render-ego_median 0.009407775346622913 sim_render-ego_min 0.0082047666822161 simulation-passed 1 survival_time_max 5.09999999999999 survival_time_mean 2.8799999999999972 survival_time_min 1.4000000000000006
No reset possible 295835774Mikita Sazanovich chameleon-10-jjlu aido3-LF-real-validationeval0-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 295705783Robert Moni kaland-225210 aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0.40299991607665975 survival_time 4.6667 deviation-center-line 0.1579566023932099 in-drivable-lane 2.6665999999999994
other stats deviation-heading 0.8937374573692229 driven_any 1.4024942935697156 driven_lanedir 0.40299991607665975 visualized-eval0-passed 1
No reset possible 295635841Anastasiya Nikolskaya challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-testingstep1-simulation aborted no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:13 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 295335831Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:21:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1648055945443017 survival_time_median 5.749999999999988 deviation-center-line_median 0.2847438416516555 in-drivable-lane_median 1.0499999999999965
other stats agent_compute-ego_max 0.04921433210372925 agent_compute-ego_mean 0.04565669901231163 agent_compute-ego_median 0.04633348416059445 agent_compute-ego_min 0.033399886863176215 deviation-center-line_max 0.7390384981010589 deviation-center-line_mean 0.3560697881105119 deviation-center-line_min 0.09218343274831048 deviation-heading_max 4.639330593824434 deviation-heading_mean 1.804857145364953 deviation-heading_median 1.7396079707240577 deviation-heading_min 0.3162496062392856 driven_any_max 4.085245541729273 driven_any_mean 1.7588900764312383 driven_any_median 1.5138346268764653 driven_any_min 0.4517104110725771 driven_lanedir_consec_max 3.3702755736514085 driven_lanedir_consec_mean 1.306939075717355 driven_lanedir_consec_min 0.13022647592146364 driven_lanedir_max 3.3702755736514085 driven_lanedir_mean 1.3248826206800814 driven_lanedir_median 1.1648055945443017 driven_lanedir_min 0.13022647592146364 in-drivable-lane_max 2.699999999999992 in-drivable-lane_mean 1.0800000000000007 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0952475061341782, "sim_physics": 0.12629408337349116, "survival_time": 4.299999999999993, "driven_lanedir": 0.7045440828708325, "sim_render-ego": 0.01405913330787836, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.033399886863176215, "deviation-heading": 2.4375423836314183, "set_robot_commands": 0.012393671412800634, "deviation-center-line": 0.23826216948107323, "driven_lanedir_consec": 0.6314701226623061, "sim_compute_sim_state": 0.0055863968161649485, "sim_compute_performance-ego": 0.008080138716586801, "sim_compute_robot_state-ego": 0.010023627170296602}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5758904782490495, "sim_physics": 0.10608649503498176, "survival_time": 9.55, "driven_lanedir": 2.0866831205807, "sim_render-ego": 0.012437358576589857, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.04576644098571458, "deviation-heading": 2.9110491239757903, "set_robot_commands": 0.009569242986709036, "deviation-center-line": 0.5205127980946622, "driven_lanedir_consec": 2.0866831205807, "sim_compute_sim_state": 0.005421121707137343, "sim_compute_performance-ego": 0.007201290879574122, "sim_compute_robot_state-ego": 0.009176426533005}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.122495694275615, "sim_physics": 0.13090332623185785, "survival_time": 4.3499999999999925, "driven_lanedir": 0.5014015811682375, "sim_render-ego": 0.0140891266965318, "in-drivable-lane": 1.849999999999996, "agent_compute-ego": 0.046035517221209646, "deviation-heading": 1.2079699060279856, "set_robot_commands": 0.011252238832671069, "deviation-center-line": 0.2385417753492002, "driven_lanedir_consec": 0.5014015811682375, "sim_compute_sim_state": 0.005676946420779173, "sim_compute_performance-ego": 0.008235506627751493, "sim_compute_robot_state-ego": 0.011017610286844188}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.400486808649908, "sim_physics": 0.11193879318237304, "survival_time": 12.500000000000044, "driven_lanedir": 2.4870620430750003, "sim_render-ego": 0.012610236167907714, "in-drivable-lane": 2.6500000000000155, "agent_compute-ego": 0.045942339897155765, "deviation-heading": 2.8542544575669275, "set_robot_commands": 0.010093460083007813, "deviation-center-line": 0.7390384981010589, "driven_lanedir_consec": 2.4870620430750003, "sim_compute_sim_state": 0.005334693908691407, "sim_compute_performance-ego": 0.007541614532470703, "sim_compute_robot_state-ego": 0.009429482460021971}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.023061970455546, "sim_physics": 0.12204962781726512, "survival_time": 11.150000000000023, "driven_lanedir": 2.58165540715068, "sim_render-ego": 0.01310280299507449, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.046508644728382606, "deviation-heading": 4.639330593824434, "set_robot_commands": 0.010660437725050032, "deviation-center-line": 0.6848791740333682, "driven_lanedir_consec": 2.4465606477122837, "sim_compute_sim_state": 0.005375236673739994, "sim_compute_performance-ego": 0.007703066941333993, "sim_compute_robot_state-ego": 0.009947583279802124}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.085245541729273, "sim_physics": 0.11790444056193032, "survival_time": 14.950000000000076, "driven_lanedir": 3.3702755736514085, "sim_render-ego": 0.01316932201385498, "in-drivable-lane": 2.0999999999999988, "agent_compute-ego": 0.04921433210372925, "deviation-heading": 2.744285520512713, "set_robot_commands": 0.010219225883483889, "deviation-center-line": 0.6692954497521802, "driven_lanedir_consec": 3.3702755736514085, "sim_compute_sim_state": 0.005643433729807536, "sim_compute_performance-ego": 0.007673580646514893, "sim_compute_robot_state-ego": 0.010027246475219726}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.086779797942569, "sim_physics": 0.1205058067272871, "survival_time": 7.79999999999998, "driven_lanedir": 1.9445438108169169, "sim_render-ego": 0.01655910259638077, "in-drivable-lane": 0, "agent_compute-ego": 0.04638541967440874, "deviation-heading": 2.4198176295745712, "set_robot_commands": 0.010844820585006324, "deviation-center-line": 0.6405515704554282, "driven_lanedir_consec": 1.9445438108169169, "sim_compute_sim_state": 0.00546030967663496, "sim_compute_performance-ego": 0.007943315383715507, "sim_compute_robot_state-ego": 0.010069049321688138}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5557000604649152, "sim_physics": 0.12722908844382075, "survival_time": 5.899999999999987, "driven_lanedir": 1.229632533514569, "sim_render-ego": 0.013428134433293746, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04631580740718518, "deviation-heading": 1.926826797766436, "set_robot_commands": 0.010380425695645608, "deviation-center-line": 0.2847438416516555, "driven_lanedir_consec": 1.185202564151044, "sim_compute_sim_state": 0.0055482266312938625, "sim_compute_performance-ego": 0.008195713414984235, "sim_compute_robot_state-ego": 0.010188116865643}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3600908926586743, "sim_physics": 0.10873528168751644, "survival_time": 5.1999999999999895, "driven_lanedir": 0.997755082656005, "sim_render-ego": 0.012569510019742526, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.046859110777194686, "deviation-heading": 1.7396079707240577, "set_robot_commands": 0.009344694706109852, "deviation-center-line": 0.29165913965544504, "driven_lanedir_consec": 0.997755082656005, "sim_compute_sim_state": 0.0050749709972968465, "sim_compute_performance-ego": 0.007653321211154644, "sim_compute_robot_state-ego": 0.009669001285846416}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.5138346268764653, "sim_physics": 0.11412496774092964, "survival_time": 5.749999999999988, "driven_lanedir": 1.1648055945443017, "sim_render-ego": 0.011925094023994776, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.043781925284344214, "deviation-heading": 1.0853205012041196, "set_robot_commands": 0.009205459511798362, "deviation-center-line": 0.18725572365788984, "driven_lanedir_consec": 1.1648055945443017, "sim_compute_sim_state": 0.004879406224126401, "sim_compute_performance-ego": 0.0068941655366317085, "sim_compute_robot_state-ego": 0.008696419259776239}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.4517104110725771, "sim_physics": 0.11420457791059443, "survival_time": 1.950000000000001, "driven_lanedir": 0.13022647592146364, "sim_render-ego": 0.012063295413286258, "in-drivable-lane": 1.100000000000001, "agent_compute-ego": 0.04633348416059445, "deviation-heading": 0.3162496062392856, "set_robot_commands": 0.009521282636202298, "deviation-center-line": 0.09218343274831048, "driven_lanedir_consec": 0.13022647592146364, "sim_compute_sim_state": 0.005213596881964268, "sim_compute_performance-ego": 0.007093099447397085, "sim_compute_robot_state-ego": 0.009108824607653497}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4936044986674479, "sim_physics": 0.12781667141687303, "survival_time": 2.1000000000000005, "driven_lanedir": 0.227088784316684, "sim_render-ego": 0.013844881738935198, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.04797003950391497, "deviation-heading": 0.7045881552955515, "set_robot_commands": 0.01061641602289109, "deviation-center-line": 0.14511273663335508, "driven_lanedir_consec": 0.21053429888623376, "sim_compute_sim_state": 0.005323796045212518, "sim_compute_performance-ego": 0.007706136930556525, "sim_compute_robot_state-ego": 0.0100423949105399}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.8989320319313391, "sim_physics": 0.15021622684639943, "survival_time": 3.5499999999999954, "driven_lanedir": 0.536739278641489, "sim_render-ego": 0.014594084779981156, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.04853591113023355, "deviation-heading": 0.6182346992648056, "set_robot_commands": 0.01061941536379532, "deviation-center-line": 0.09466798484132571, "driven_lanedir_consec": 0.536739278641489, "sim_compute_sim_state": 0.0057700687730816045, "sim_compute_performance-ego": 0.008155829469922563, "sim_compute_robot_state-ego": 0.01073320147017358}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0945812579732592, "sim_physics": 0.1181384339052088, "survival_time": 4.249999999999993, "driven_lanedir": 0.32153656372503425, "sim_render-ego": 0.01290735356947955, "in-drivable-lane": 2.699999999999992, "agent_compute-ego": 0.044729086932014016, "deviation-heading": 0.4379544332430448, "set_robot_commands": 0.009869022930369658, "deviation-center-line": 0.13499898126371612, "driven_lanedir_consec": 0.32153656372503425, "sim_compute_sim_state": 0.005424286337459789, "sim_compute_performance-ego": 0.007938379399916705, "sim_compute_robot_state-ego": 0.009891327689675725}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.625689569387761, "sim_physics": 0.13039293715624306, "survival_time": 6.149999999999986, "driven_lanedir": 1.5892893775679025, "sim_render-ego": 0.014090057311019278, "in-drivable-lane": 0, "agent_compute-ego": 0.04707253851541659, "deviation-heading": 1.0298254016231492, "set_robot_commands": 0.010716500321054846, "deviation-center-line": 0.3793435459390094, "driven_lanedir_consec": 1.5892893775679025, "sim_compute_sim_state": 0.005404986017118625, "sim_compute_performance-ego": 0.008400599161783854, "sim_compute_robot_state-ego": 0.010140403499448204}}set_robot_commands_max 0.012393671412800634 set_robot_commands_mean 0.010353754313106388 set_robot_commands_median 0.010380425695645608 set_robot_commands_min 0.009205459511798362 sim_compute_performance-ego_max 0.008400599161783854 sim_compute_performance-ego_mean 0.007761050553352989 sim_compute_performance-ego_median 0.007706136930556525 sim_compute_performance-ego_min 0.0068941655366317085 sim_compute_robot_state-ego_max 0.011017610286844188 sim_compute_robot_state-ego_mean 0.009877381007708954 sim_compute_robot_state-ego_median 0.010023627170296602 sim_compute_robot_state-ego_min 0.008696419259776239 sim_compute_sim_state_max 0.0057700687730816045 sim_compute_sim_state_mean 0.0054091651227006175 sim_compute_sim_state_median 0.005421121707137343 sim_compute_sim_state_min 0.004879406224126401 sim_physics_max 0.15021622684639943 sim_physics_mean 0.12176938386911812 sim_physics_median 0.1205058067272871 sim_physics_min 0.10608649503498176 sim_render-ego_max 0.01655910259638077 sim_render-ego_mean 0.013429966242930032 sim_render-ego_median 0.01316932201385498 sim_render-ego_min 0.011925094023994776 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.630000000000004 survival_time_min 1.950000000000001
No reset possible 295145763Philippe Marcotte original pp aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:10:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 294995817Robert Moni kaland-227007 aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:10:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.221074604908525 survival_time_median 14.950000000000076 deviation-center-line_median 0.39596157181885766 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.033417360770269994 agent_compute-ego_mean 0.03234618822486495 agent_compute-ego_median 0.03220669428507487 agent_compute-ego_min 0.031553622086842856 deviation-center-line_max 0.6745119227685957 deviation-center-line_mean 0.48212619195473894 deviation-center-line_min 0.31225728358772187 deviation-heading_max 3.6620465139287006 deviation-heading_mean 2.7372682831575146 deviation-heading_median 2.767169857384757 deviation-heading_min 1.7914020688036634 driven_any_max 3.832857392580124 driven_any_mean 3.1250354930896656 driven_any_median 3.5998294781668108 driven_any_min 2.103424797475947 driven_lanedir_consec_max 3.5108567202338383 driven_lanedir_consec_mean 2.91655083750039 driven_lanedir_consec_min 1.99205231176314 driven_lanedir_max 3.5108567202338383 driven_lanedir_mean 2.91655083750039 driven_lanedir_median 3.221074604908525 driven_lanedir_min 1.99205231176314 in-drivable-lane_max 1.5499999999999945 in-drivable-lane_mean 0.31999999999999906 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.832857392580124, "sim_physics": 0.07808826128641765, "survival_time": 14.950000000000076, "driven_lanedir": 3.221074604908525, "sim_render-ego": 0.009242109457651774, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.032158865133921306, "deviation-heading": 3.16135033460004, "set_robot_commands": 0.007018253008524577, "deviation-center-line": 0.6488643008309487, "driven_lanedir_consec": 3.221074604908525, "sim_compute_sim_state": 0.004140919844309489, "sim_compute_performance-ego": 0.00541539986928304, "sim_compute_robot_state-ego": 0.0068642822901407875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.103424797475947, "sim_physics": 0.07944373024834527, "survival_time": 8.999999999999993, "driven_lanedir": 1.99205231176314, "sim_render-ego": 0.00966566138797336, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.031553622086842856, "deviation-heading": 2.3043726410704117, "set_robot_commands": 0.006820893287658692, "deviation-center-line": 0.31225728358772187, "driven_lanedir_consec": 1.99205231176314, "sim_compute_sim_state": 0.0043192015753851995, "sim_compute_performance-ego": 0.005243558353847927, "sim_compute_robot_state-ego": 0.006800790627797444}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6721155621826536, "sim_physics": 0.07611462831497193, "survival_time": 14.950000000000076, "driven_lanedir": 3.5079840492212684, "sim_render-ego": 0.008817334175109864, "in-drivable-lane": 0, "agent_compute-ego": 0.03239439884821574, "deviation-heading": 3.6620465139287006, "set_robot_commands": 0.006706015268961588, "deviation-center-line": 0.6745119227685957, "driven_lanedir_consec": 3.5079840492212684, "sim_compute_sim_state": 0.003813495635986328, "sim_compute_performance-ego": 0.0049924015998840336, "sim_compute_robot_state-ego": 0.00642851988474528}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5998294781668108, "sim_physics": 0.07547358512878417, "survival_time": 14.950000000000076, "driven_lanedir": 3.5108567202338383, "sim_render-ego": 0.008737712701161703, "in-drivable-lane": 0, "agent_compute-ego": 0.03220669428507487, "deviation-heading": 2.767169857384757, "set_robot_commands": 0.006607391039530436, "deviation-center-line": 0.39596157181885766, "driven_lanedir_consec": 3.5108567202338383, "sim_compute_sim_state": 0.003773126602172851, "sim_compute_performance-ego": 0.004992076555887858, "sim_compute_robot_state-ego": 0.006419547398885091}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.416950235042792, "sim_physics": 0.07448107220348299, "survival_time": 9.650000000000002, "driven_lanedir": 2.3507865013751776, "sim_render-ego": 0.008690216380697459, "in-drivable-lane": 0, "agent_compute-ego": 0.033417360770269994, "deviation-heading": 1.7914020688036634, "set_robot_commands": 0.0066161625125865245, "deviation-center-line": 0.3790358807675704, "driven_lanedir_consec": 2.3507865013751776, "sim_compute_sim_state": 0.0037368233339774176, "sim_compute_performance-ego": 0.004890987910137276, "sim_compute_robot_state-ego": 0.006266748349283644}}set_robot_commands_max 0.007018253008524577 set_robot_commands_mean 0.006753743023452363 set_robot_commands_median 0.006706015268961588 set_robot_commands_min 0.006607391039530436 sim_compute_performance-ego_max 0.00541539986928304 sim_compute_performance-ego_mean 0.005106884857808027 sim_compute_performance-ego_median 0.0049924015998840336 sim_compute_performance-ego_min 0.004890987910137276 sim_compute_robot_state-ego_max 0.0068642822901407875 sim_compute_robot_state-ego_mean 0.00655597771017045 sim_compute_robot_state-ego_median 0.00642851988474528 sim_compute_robot_state-ego_min 0.006266748349283644 sim_compute_sim_state_max 0.0043192015753851995 sim_compute_sim_state_mean 0.003956713398366258 sim_compute_sim_state_median 0.003813495635986328 sim_compute_sim_state_min 0.0037368233339774176 sim_physics_max 0.07944373024834527 sim_physics_mean 0.0767202554364004 sim_physics_median 0.07611462831497193 sim_physics_min 0.07448107220348299 sim_render-ego_max 0.00966566138797336 sim_render-ego_mean 0.009030606820518832 sim_render-ego_median 0.008817334175109864 sim_render-ego_min 0.008690216380697459 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.700000000000044 survival_time_min 8.999999999999993
No reset possible 294485779Robert Moni lzoltan aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:22:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.585349584140983 survival_time_median 14.950000000000076 deviation-center-line_median 0.7874744561119545 in-drivable-lane_median 0.9999999999999982
other stats agent_compute-ego_max 0.022795055707295737 agent_compute-ego_mean 0.021919704147455497 agent_compute-ego_median 0.021824622948964437 agent_compute-ego_min 0.02157444121853617 deviation-center-line_max 0.9658397419009396 deviation-center-line_mean 0.781627388185068 deviation-center-line_min 0.35997530836016967 deviation-heading_max 4.155241501463268 deviation-heading_mean 3.2971565906790397 deviation-heading_median 3.624341930920933 deviation-heading_min 1.3982228649054018 driven_any_max 6.024867750922212 driven_any_mean 5.14176763681162 driven_any_median 5.145834853899559 driven_any_min 3.1645203359522545 driven_lanedir_consec_max 5.5473839948961245 driven_lanedir_consec_mean 4.517327941210266 driven_lanedir_consec_min 3.094239883123583 driven_lanedir_max 5.5473839948961245 driven_lanedir_mean 4.517327941210266 driven_lanedir_median 4.585349584140983 driven_lanedir_min 3.094239883123583 in-drivable-lane_max 2.25 in-drivable-lane_mean 0.9466666666666684 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.069774111268645, "sim_physics": 0.054590312639872234, "survival_time": 14.950000000000076, "driven_lanedir": 4.760219061548694, "sim_render-ego": 0.0071119562784830725, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.02231647729873657, "deviation-heading": 3.682806087437353, "set_robot_commands": 0.005058600107828776, "deviation-center-line": 0.9096507999495064, "driven_lanedir_consec": 4.760219061548694, "sim_compute_sim_state": 0.00289823849995931, "sim_compute_performance-ego": 0.0040608819325764975, "sim_compute_robot_state-ego": 0.005107974211374919}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.145834853899559, "sim_physics": 0.056316421031951905, "survival_time": 14.950000000000076, "driven_lanedir": 4.377608569115607, "sim_render-ego": 0.007061487833658855, "in-drivable-lane": 1.2500000000000036, "agent_compute-ego": 0.021996065775553384, "deviation-heading": 3.664524019948132, "set_robot_commands": 0.004888419310251872, "deviation-center-line": 0.8793794375444808, "driven_lanedir_consec": 4.377608569115607, "sim_compute_sim_state": 0.00289413849512736, "sim_compute_performance-ego": 0.003968882560729981, "sim_compute_robot_state-ego": 0.0050978875160217286}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.902636778331092, "sim_physics": 0.05569093704223633, "survival_time": 14.950000000000076, "driven_lanedir": 4.686260437298914, "sim_render-ego": 0.007112816174825032, "in-drivable-lane": 2.25, "agent_compute-ego": 0.021717689832051596, "deviation-heading": 2.547545143888183, "set_robot_commands": 0.005005387465159098, "deviation-center-line": 0.7874744561119545, "driven_lanedir_consec": 4.686260437298914, "sim_compute_sim_state": 0.0029630311330159503, "sim_compute_performance-ego": 0.004020602703094483, "sim_compute_robot_state-ego": 0.005173482894897461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.93415881992696, "sim_physics": 0.05654664119084677, "survival_time": 14.950000000000076, "driven_lanedir": 5.353509870113778, "sim_render-ego": 0.007092022101084392, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.02187440554300944, "deviation-heading": 3.334892985942255, "set_robot_commands": 0.004998683134714762, "deviation-center-line": 0.7434832750999835, "driven_lanedir_consec": 5.353509870113778, "sim_compute_sim_state": 0.0029634936650594075, "sim_compute_performance-ego": 0.003990514278411865, "sim_compute_robot_state-ego": 0.0051502283414204915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1645203359522545, "sim_physics": 0.0578715929248989, "survival_time": 7.449999999999981, "driven_lanedir": 3.094239883123583, "sim_render-ego": 0.007144454341606806, "in-drivable-lane": 0, "agent_compute-ego": 0.02157444121853617, "deviation-heading": 1.3982228649054018, "set_robot_commands": 0.004892554059124633, "deviation-center-line": 0.35997530836016967, "driven_lanedir_consec": 3.094239883123583, "sim_compute_sim_state": 0.002925824798993616, "sim_compute_performance-ego": 0.003970142978949835, "sim_compute_robot_state-ego": 0.005138710841236498}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.568838793698206, "sim_physics": 0.05367976744969686, "survival_time": 14.950000000000076, "driven_lanedir": 4.069899839881579, "sim_render-ego": 0.0070647056897481285, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.021923959255218502, "deviation-heading": 4.155241501463268, "set_robot_commands": 0.004930890401204427, "deviation-center-line": 0.8370898762712594, "driven_lanedir_consec": 4.069899839881579, "sim_compute_sim_state": 0.0028936171531677244, "sim_compute_performance-ego": 0.003956676324208578, "sim_compute_robot_state-ego": 0.005075197219848632}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 6.024867750922212, "sim_physics": 0.05506681124369303, "survival_time": 14.950000000000076, "driven_lanedir": 5.231668316935216, "sim_render-ego": 0.007117037773132324, "in-drivable-lane": 1.1000000000000094, "agent_compute-ego": 0.02199835220972697, "deviation-heading": 3.8629854192125057, "set_robot_commands": 0.004998588562011718, "deviation-center-line": 0.9199554642182676, "driven_lanedir_consec": 5.231668316935216, "sim_compute_sim_state": 0.002948743502298991, "sim_compute_performance-ego": 0.003991829554239909, "sim_compute_robot_state-ego": 0.005127635796864828}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.283130433969009, "sim_physics": 0.057188481489817304, "survival_time": 14.950000000000076, "driven_lanedir": 3.9458756362587706, "sim_render-ego": 0.007167398929595947, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.02220933437347412, "deviation-heading": 3.029854158077881, "set_robot_commands": 0.004944198926289876, "deviation-center-line": 0.6895149593595629, "driven_lanedir_consec": 3.9458756362587706, "sim_compute_sim_state": 0.00299521525700887, "sim_compute_performance-ego": 0.0040130178133646645, "sim_compute_robot_state-ego": 0.005161158243815104}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.752478400074352, "sim_physics": 0.05600746393203735, "survival_time": 14.950000000000076, "driven_lanedir": 3.895310780639891, "sim_render-ego": 0.0070915031433105465, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.021649059454600016, "deviation-heading": 3.80057678717506, "set_robot_commands": 0.004935576915740967, "deviation-center-line": 0.8528299880385777, "driven_lanedir_consec": 3.895310780639891, "sim_compute_sim_state": 0.0029333996772766113, "sim_compute_performance-ego": 0.004007369677225749, "sim_compute_robot_state-ego": 0.005116275946299235}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.402351457840595, "sim_physics": 0.05518551826477051, "survival_time": 14.950000000000076, "driven_lanedir": 3.772892465467981, "sim_render-ego": 0.007037022908528646, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.021807926495869955, "deviation-heading": 3.6928218389028222, "set_robot_commands": 0.00491376797358195, "deviation-center-line": 0.7268322068071594, "driven_lanedir_consec": 3.772892465467981, "sim_compute_sim_state": 0.0029540125528971354, "sim_compute_performance-ego": 0.0039441219965616866, "sim_compute_robot_state-ego": 0.005093278090159099}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.864012338325121, "sim_physics": 0.05654444456100464, "survival_time": 14.950000000000076, "driven_lanedir": 5.5473839948961245, "sim_render-ego": 0.007041812737782796, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.021693673133850094, "deviation-heading": 2.468798986756028, "set_robot_commands": 0.0049451669057210285, "deviation-center-line": 0.9658397419009396, "driven_lanedir_consec": 5.5473839948961245, "sim_compute_sim_state": 0.0029604355494181316, "sim_compute_performance-ego": 0.003944152196248372, "sim_compute_robot_state-ego": 0.0051227720578511556}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 5.8361060636151665, "sim_physics": 0.05378562609354655, "survival_time": 14.950000000000076, "driven_lanedir": 5.090534561568489, "sim_render-ego": 0.007035095691680909, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.021824622948964437, "deviation-heading": 4.119701522443011, "set_robot_commands": 0.004844663937886556, "deviation-center-line": 0.8951996968579099, "driven_lanedir_consec": 5.090534561568489, "sim_compute_sim_state": 0.0029272953669230144, "sim_compute_performance-ego": 0.0039406132698059084, "sim_compute_robot_state-ego": 0.005090587933858235}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 5.002307251431642, "sim_physics": 0.05658790906270345, "survival_time": 14.950000000000076, "driven_lanedir": 4.278441564315639, "sim_render-ego": 0.00711517333984375, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.021775834560394287, "deviation-heading": 3.250271446921132, "set_robot_commands": 0.005022640228271484, "deviation-center-line": 0.7588064579597698, "driven_lanedir_consec": 4.278441564315639, "sim_compute_sim_state": 0.0029716165860493977, "sim_compute_performance-ego": 0.003982958793640137, "sim_compute_robot_state-ego": 0.005171794096628825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.801358099757878, "sim_physics": 0.058155200481414794, "survival_time": 14.950000000000076, "driven_lanedir": 5.070724552848743, "sim_render-ego": 0.007350496451059977, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.022795055707295737, "deviation-heading": 3.624341930920933, "set_robot_commands": 0.008955997625986735, "deviation-center-line": 0.7660690613362396, "driven_lanedir_consec": 5.070724552848743, "sim_compute_sim_state": 0.003067162831624349, "sim_compute_performance-ego": 0.004302659034729004, "sim_compute_robot_state-ego": 0.005361433029174805}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.3741390631616115, "sim_physics": 0.05584019899368286, "survival_time": 14.950000000000076, "driven_lanedir": 4.585349584140983, "sim_render-ego": 0.00698811928431193, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02163866440455119, "deviation-heading": 2.8247641661916303, "set_robot_commands": 0.0048695810635884604, "deviation-center-line": 0.6323100929602415, "driven_lanedir_consec": 4.585349584140983, "sim_compute_sim_state": 0.002931978702545166, "sim_compute_performance-ego": 0.003920032978057862, "sim_compute_robot_state-ego": 0.005064501762390137}}set_robot_commands_max 0.008955997625986735 set_robot_commands_mean 0.005213647774490823 set_robot_commands_median 0.004944198926289876 set_robot_commands_min 0.004844663937886556 sim_compute_performance-ego_max 0.004302659034729004 sim_compute_performance-ego_mean 0.004000963739456302 sim_compute_performance-ego_median 0.003982958793640137 sim_compute_performance-ego_min 0.003920032978057862 sim_compute_robot_state-ego_max 0.005361433029174805 sim_compute_robot_state-ego_mean 0.005136861198789409 sim_compute_robot_state-ego_median 0.0051227720578511556 sim_compute_robot_state-ego_min 0.005064501762390137 sim_compute_sim_state_max 0.003067162831624349 sim_compute_sim_state_mean 0.002948546918091003 sim_compute_sim_state_median 0.002948743502298991 sim_compute_sim_state_min 0.0028936171531677244 sim_physics_max 0.058155200481414794 sim_physics_mean 0.05593715509347823 sim_physics_median 0.05600746393203735 sim_physics_min 0.05367976744969686 sim_render-ego_max 0.007350496451059977 sim_render-ego_mean 0.007102073511910209 sim_render-ego_median 0.007092022101084392 sim_render-ego_min 0.00698811928431193 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.45000000000007 survival_time_min 7.449999999999981
No reset possible 294445746Robert Moni almasip-6824 aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 294385771Mikita Sazanovich chameleon-10-jjlu aido3-LFVI-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:13:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.589804188174193 survival_time_median 11.950000000000037 deviation-center-line_median 0.9479569389384084 in-drivable-lane_median 1.2499999999999956
other stats agent_compute-ego_max 0.017428650516845192 agent_compute-ego_mean 0.016745656121727445 agent_compute-ego_median 0.016605164553668048 agent_compute-ego_min 0.016481548150380453 deviation-center-line_max 1.013669293859267 deviation-center-line_mean 0.8908118707536765 deviation-center-line_min 0.6553366846763365 deviation-heading_max 4.750516718928447 deviation-heading_mean 4.007346954249698 deviation-heading_median 4.508018101155984 deviation-heading_min 1.8599469014059056 driven_any_max 5.314533450851405 driven_any_mean 4.4072530097817 driven_any_median 3.8675624506592303 driven_any_min 3.7369974488041615 driven_lanedir_consec_max 4.694484198295185 driven_lanedir_consec_mean 3.750791332688835 driven_lanedir_consec_min 2.6828444882309457 driven_lanedir_max 4.694484198295185 driven_lanedir_mean 3.769396071392118 driven_lanedir_median 3.589804188174193 driven_lanedir_min 2.7744009838303487 in-drivable-lane_max 1.9500000000000035 in-drivable-lane_mean 1.0500000000000005 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 3.8675624506592303, "sim_physics": 0.13215611968579152, "survival_time": 11.950000000000037, "driven_lanedir": 3.4104305799415915, "sim_render-ego": 0.0071818359726143685, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.017428650516845192, "deviation-heading": 4.532520804859888, "set_robot_commands": 0.0051592593412519, "deviation-center-line": 0.9479569389384084, "driven_lanedir_consec": 3.4098588541050825, "sim_compute_sim_state": 0.0028976177071926485, "sim_compute_performance-ego": 0.00399750545932658, "sim_compute_robot_state-ego": 0.0052624666541191325, "sim_compute_robot_state-npc0": 0.0050509305179867285, "sim_compute_robot_state-npc1": 0.004705980731852384, "sim_compute_robot_state-npc2": 0.004666106970240382, "sim_compute_robot_state-npc3": 0.00460055981719843}, "udem1-1-0": {"driven_any": 5.314533450851405, "sim_physics": 0.11884551525115966, "survival_time": 14.950000000000076, "driven_lanedir": 4.694484198295185, "sim_render-ego": 0.007113355000813802, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.01649959643681844, "deviation-heading": 4.385732244898267, "set_robot_commands": 0.005105112393697103, "deviation-center-line": 1.013669293859267, "driven_lanedir_consec": 4.694484198295185, "sim_compute_sim_state": 0.0029077967007954913, "sim_compute_performance-ego": 0.003966100215911865, "sim_compute_robot_state-ego": 0.005200376510620117, "sim_compute_robot_state-npc0": 0.005063541730244954, "sim_compute_robot_state-npc1": 0.004714783827463786, "sim_compute_robot_state-npc2": 0.004687578678131104, "sim_compute_robot_state-npc3": 0.004630202452341715}, "udem1-2-0": {"driven_any": 5.277905252840931, "sim_physics": 0.10743414958318076, "survival_time": 14.950000000000076, "driven_lanedir": 4.3778604067192735, "sim_render-ego": 0.0070586045583089195, "in-drivable-lane": 1.799999999999998, "agent_compute-ego": 0.016481548150380453, "deviation-heading": 4.508018101155984, "set_robot_commands": 0.005070094267527262, "deviation-center-line": 0.983217113589942, "driven_lanedir_consec": 4.376964934638771, "sim_compute_sim_state": 0.002875028451283773, "sim_compute_performance-ego": 0.003948125839233398, "sim_compute_robot_state-ego": 0.005190945466359456, "sim_compute_robot_state-npc0": 0.004968210061391195, "sim_compute_robot_state-npc1": 0.004665476481119792, "sim_compute_robot_state-npc2": 0.00463029146194458, "sim_compute_robot_state-npc3": 0.004600419998168946}, "udem1-3-0": {"driven_any": 3.8392664457527688, "sim_physics": 0.1133109356933858, "survival_time": 11.55000000000003, "driven_lanedir": 2.7744009838303487, "sim_render-ego": 0.007156035600802599, "in-drivable-lane": 1.9500000000000035, "agent_compute-ego": 0.016713320950925092, "deviation-heading": 4.750516718928447, "set_robot_commands": 0.0050841915659058145, "deviation-center-line": 0.8538793227044285, "driven_lanedir_consec": 2.6828444882309457, "sim_compute_sim_state": 0.002927674875630961, "sim_compute_performance-ego": 0.003972138161267037, "sim_compute_robot_state-ego": 0.0052072506446342965, "sim_compute_robot_state-npc0": 0.005161360744790081, "sim_compute_robot_state-npc1": 0.004723169070817691, "sim_compute_robot_state-npc2": 0.0046799317066803636, "sim_compute_robot_state-npc3": 0.004632109687441871}, "udem1-4-0": {"driven_any": 3.7369974488041615, "sim_physics": 0.12525098903759105, "survival_time": 9.249999999999996, "driven_lanedir": 3.589804188174193, "sim_render-ego": 0.007256773355844858, "in-drivable-lane": 0, "agent_compute-ego": 0.016605164553668048, "deviation-heading": 1.8599469014059056, "set_robot_commands": 0.005164739247914907, "deviation-center-line": 0.6553366846763365, "driven_lanedir_consec": 3.589804188174193, "sim_compute_sim_state": 0.0029528063696783943, "sim_compute_performance-ego": 0.004011031743642446, "sim_compute_robot_state-ego": 0.0052436570863466005, "sim_compute_robot_state-npc0": 0.00511247274037954, "sim_compute_robot_state-npc1": 0.004830231537690034, "sim_compute_robot_state-npc2": 0.004801476968301309, "sim_compute_robot_state-npc3": 0.004736389984955658}}set_robot_commands_max 0.005164739247914907 set_robot_commands_mean 0.005116679363259396 set_robot_commands_median 0.005105112393697103 set_robot_commands_min 0.005070094267527262 sim_compute_performance-ego_max 0.004011031743642446 sim_compute_performance-ego_mean 0.003978980283876265 sim_compute_performance-ego_median 0.003972138161267037 sim_compute_performance-ego_min 0.003948125839233398 sim_compute_robot_state-ego_max 0.0052624666541191325 sim_compute_robot_state-ego_mean 0.005220939272415921 sim_compute_robot_state-ego_median 0.0052072506446342965 sim_compute_robot_state-ego_min 0.005190945466359456 sim_compute_robot_state-npc0_max 0.005161360744790081 sim_compute_robot_state-npc0_mean 0.0050713031589585 sim_compute_robot_state-npc0_median 0.005063541730244954 sim_compute_robot_state-npc0_min 0.004968210061391195 sim_compute_robot_state-npc1_max 0.004830231537690034 sim_compute_robot_state-npc1_mean 0.004727928329788737 sim_compute_robot_state-npc1_median 0.004714783827463786 sim_compute_robot_state-npc1_min 0.004665476481119792 sim_compute_robot_state-npc2_max 0.004801476968301309 sim_compute_robot_state-npc2_mean 0.004693077157059548 sim_compute_robot_state-npc2_median 0.0046799317066803636 sim_compute_robot_state-npc2_min 0.00463029146194458 sim_compute_robot_state-npc3_max 0.004736389984955658 sim_compute_robot_state-npc3_mean 0.004639936388021325 sim_compute_robot_state-npc3_median 0.004630202452341715 sim_compute_robot_state-npc3_min 0.004600419998168946 sim_compute_sim_state_max 0.0029528063696783943 sim_compute_sim_state_mean 0.0029121848209162533 sim_compute_sim_state_median 0.0029077967007954913 sim_compute_sim_state_min 0.002875028451283773 sim_physics_max 0.13215611968579152 sim_physics_mean 0.11939954185022177 sim_physics_median 0.11884551525115966 sim_physics_min 0.10743414958318076 sim_render-ego_max 0.007256773355844858 sim_render-ego_mean 0.00715332089767691 sim_render-ego_median 0.007156035600802599 sim_render-ego_min 0.0070586045583089195 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.530000000000044 survival_time_min 9.249999999999996
No reset possible 294325776Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:59 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 294105762Philippe Marcotte original pp aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:20:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.444217112294023 survival_time_median 14.950000000000076 deviation-center-line_median 0.5186592085349638 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.017979864346779 agent_compute-ego_mean 0.0169309910183348 agent_compute-ego_median 0.01684175173441569 agent_compute-ego_min 0.016392868359883628 deviation-center-line_max 0.9133110415208768 deviation-center-line_mean 0.5309127574879293 deviation-center-line_min 0.2102310011215064 deviation-heading_max 4.103285598214212 deviation-heading_mean 2.5090461511777034 deviation-heading_median 2.53616773118876 deviation-heading_min 0.8805842024187627 driven_any_max 2.5360648936650816 driven_any_mean 2.385265824885609 driven_any_median 2.515992860204811 driven_any_min 0.5057368685495109 driven_lanedir_consec_max 2.5088322632604876 driven_lanedir_consec_mean 2.2997310532377915 driven_lanedir_consec_min 0.20045208166553097 driven_lanedir_max 2.5088322632604876 driven_lanedir_mean 2.3002086558819204 driven_lanedir_median 2.444217112294023 driven_lanedir_min 0.2076161213274702 in-drivable-lane_max 1.149999999999998 in-drivable-lane_mean 0.09333333333333343 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.517923909230294, "sim_physics": 0.061060423056284584, "survival_time": 14.950000000000076, "driven_lanedir": 2.4572204384909595, "sim_render-ego": 0.007360394795735677, "in-drivable-lane": 0, "agent_compute-ego": 0.017173593839009602, "deviation-heading": 2.6910522012508435, "set_robot_commands": 0.007422983646392822, "deviation-center-line": 0.5351736843206828, "driven_lanedir_consec": 2.4572204384909595, "sim_compute_sim_state": 0.003857276439666748, "sim_compute_performance-ego": 0.004365344047546387, "sim_compute_robot_state-ego": 0.005445175170898438}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5050854473396473, "sim_physics": 0.06024333318074544, "survival_time": 14.950000000000076, "driven_lanedir": 2.449421628269846, "sim_render-ego": 0.00748669942220052, "in-drivable-lane": 0, "agent_compute-ego": 0.016766449610392253, "deviation-heading": 2.2084238834493464, "set_robot_commands": 0.007309581438700358, "deviation-center-line": 0.36409083560281413, "driven_lanedir_consec": 2.449421628269846, "sim_compute_sim_state": 0.003828359444936117, "sim_compute_performance-ego": 0.004232569535573324, "sim_compute_robot_state-ego": 0.005412879784901937}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5360648936650816, "sim_physics": 0.06056642929712931, "survival_time": 14.950000000000076, "driven_lanedir": 2.404173113101667, "sim_render-ego": 0.007543990612030029, "in-drivable-lane": 0, "agent_compute-ego": 0.016392868359883628, "deviation-heading": 4.043877319254618, "set_robot_commands": 0.007195463975270589, "deviation-center-line": 0.7901226651801886, "driven_lanedir_consec": 2.404173113101667, "sim_compute_sim_state": 0.0037256630261739095, "sim_compute_performance-ego": 0.004307523568471272, "sim_compute_robot_state-ego": 0.005475290616353353}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.514670378765257, "sim_physics": 0.0603339155515035, "survival_time": 14.950000000000076, "driven_lanedir": 2.4803790233892977, "sim_render-ego": 0.00758837620417277, "in-drivable-lane": 0, "agent_compute-ego": 0.016907566388448078, "deviation-heading": 2.1059594066345975, "set_robot_commands": 0.00727711280186971, "deviation-center-line": 0.353650564414246, "driven_lanedir_consec": 2.4803790233892977, "sim_compute_sim_state": 0.003954281012217203, "sim_compute_performance-ego": 0.004329209327697754, "sim_compute_robot_state-ego": 0.005464046001434326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.513958301129265, "sim_physics": 0.061500558853149416, "survival_time": 14.950000000000076, "driven_lanedir": 2.5035581588710025, "sim_render-ego": 0.007650392850240072, "in-drivable-lane": 0, "agent_compute-ego": 0.01717625856399536, "deviation-heading": 1.1557674817029329, "set_robot_commands": 0.007420987288157145, "deviation-center-line": 0.21689958786666333, "driven_lanedir_consec": 2.5035581588710025, "sim_compute_sim_state": 0.004090518156687419, "sim_compute_performance-ego": 0.004371898969014486, "sim_compute_robot_state-ego": 0.005541329383850098}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.5117077919530053, "sim_physics": 0.060999898115793864, "survival_time": 14.950000000000076, "driven_lanedir": 2.4065111914727737, "sim_render-ego": 0.007570335865020752, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.016810136636098226, "deviation-heading": 2.720168306230174, "set_robot_commands": 0.007293252944946289, "deviation-center-line": 0.564728341528601, "driven_lanedir_consec": 2.4065111914727737, "sim_compute_sim_state": 0.003955695629119873, "sim_compute_performance-ego": 0.004320574601491292, "sim_compute_robot_state-ego": 0.00550037145614624}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.533108832057874, "sim_physics": 0.06080371697743734, "survival_time": 14.950000000000076, "driven_lanedir": 2.5088322632604876, "sim_render-ego": 0.007526661554972331, "in-drivable-lane": 0, "agent_compute-ego": 0.01684175173441569, "deviation-heading": 1.7829966315176695, "set_robot_commands": 0.007277390162150065, "deviation-center-line": 0.4707485512562106, "driven_lanedir_consec": 2.5088322632604876, "sim_compute_sim_state": 0.003924203713734945, "sim_compute_performance-ego": 0.0043249281247456865, "sim_compute_robot_state-ego": 0.005580434004465739}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.526752461719851, "sim_physics": 0.06138592720031738, "survival_time": 14.950000000000076, "driven_lanedir": 2.392095009270306, "sim_render-ego": 0.007645547389984131, "in-drivable-lane": 0, "agent_compute-ego": 0.016849235693613688, "deviation-heading": 4.103285598214212, "set_robot_commands": 0.007372651100158691, "deviation-center-line": 0.9133110415208768, "driven_lanedir_consec": 2.392095009270306, "sim_compute_sim_state": 0.004017683664957682, "sim_compute_performance-ego": 0.004340681234995524, "sim_compute_robot_state-ego": 0.00555322011311849}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.515992860204811, "sim_physics": 0.06009037574132284, "survival_time": 14.950000000000076, "driven_lanedir": 2.444217112294023, "sim_render-ego": 0.007678840160369873, "in-drivable-lane": 0, "agent_compute-ego": 0.016713654994964598, "deviation-heading": 2.6779629282382063, "set_robot_commands": 0.007369573911031087, "deviation-center-line": 0.6543421713506062, "driven_lanedir_consec": 2.444217112294023, "sim_compute_sim_state": 0.003961071968078613, "sim_compute_performance-ego": 0.004375018278757731, "sim_compute_robot_state-ego": 0.005517325401306152}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.527913389369012, "sim_physics": 0.058405284881591794, "survival_time": 14.950000000000076, "driven_lanedir": 2.408586257998105, "sim_render-ego": 0.007585912545522054, "in-drivable-lane": 0, "agent_compute-ego": 0.016729732354482014, "deviation-heading": 3.82523503070158, "set_robot_commands": 0.007252359390258789, "deviation-center-line": 0.8846544069630535, "driven_lanedir_consec": 2.408586257998105, "sim_compute_sim_state": 0.003856681982676188, "sim_compute_performance-ego": 0.004300821622212728, "sim_compute_robot_state-ego": 0.0054326526323954264}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5057368685495109, "sim_physics": 0.06206620749780687, "survival_time": 2.9499999999999975, "driven_lanedir": 0.2076161213274702, "sim_render-ego": 0.007884344812166892, "in-drivable-lane": 1.149999999999998, "agent_compute-ego": 0.017979864346779, "deviation-heading": 0.8805842024187627, "set_robot_commands": 0.0074142803580073986, "deviation-center-line": 0.2102310011215064, "driven_lanedir_consec": 0.20045208166553097, "sim_compute_sim_state": 0.004027528277898239, "sim_compute_performance-ego": 0.004311173649157508, "sim_compute_robot_state-ego": 0.005630153720661745}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.524930527214456, "sim_physics": 0.061438554128011066, "survival_time": 14.950000000000076, "driven_lanedir": 2.42939078919282, "sim_render-ego": 0.007583816051483155, "in-drivable-lane": 0, "agent_compute-ego": 0.017097131411234538, "deviation-heading": 3.2363173069701916, "set_robot_commands": 0.007442519664764404, "deviation-center-line": 0.6592103660462808, "driven_lanedir_consec": 2.42939078919282, "sim_compute_sim_state": 0.003970868587493896, "sim_compute_performance-ego": 0.0043146030108133955, "sim_compute_robot_state-ego": 0.005500511328379313}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.5134338281966744, "sim_physics": 0.06092638889948527, "survival_time": 14.950000000000076, "driven_lanedir": 2.443470409356691, "sim_render-ego": 0.007536117235819499, "in-drivable-lane": 0, "agent_compute-ego": 0.016786832014719644, "deviation-heading": 2.53616773118876, "set_robot_commands": 0.007170832951863606, "deviation-center-line": 0.5134950548214159, "driven_lanedir_consec": 2.443470409356691, "sim_compute_sim_state": 0.004014943440755208, "sim_compute_performance-ego": 0.004298973878224691, "sim_compute_robot_state-ego": 0.005541013081868489}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.5183252591645284, "sim_physics": 0.06199709335962931, "survival_time": 14.950000000000076, "driven_lanedir": 2.471028298084491, "sim_render-ego": 0.007557449340820313, "in-drivable-lane": 0, "agent_compute-ego": 0.016961901187896727, "deviation-heading": 2.2507911484699603, "set_robot_commands": 0.007276644706726074, "deviation-center-line": 0.5186592085349638, "driven_lanedir_consec": 2.471028298084491, "sim_compute_sim_state": 0.003918898105621338, "sim_compute_performance-ego": 0.004284025033315023, "sim_compute_robot_state-ego": 0.005500388145446777}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.5133826247248696, "sim_physics": 0.06061951478322347, "survival_time": 14.950000000000076, "driven_lanedir": 2.4966300238488697, "sim_render-ego": 0.0075760610898335775, "in-drivable-lane": 0, "agent_compute-ego": 0.01677788813908895, "deviation-heading": 1.4171030914236906, "set_robot_commands": 0.007291471163431804, "deviation-center-line": 0.3143738817908283, "driven_lanedir_consec": 2.4966300238488697, "sim_compute_sim_state": 0.004016839663187663, "sim_compute_performance-ego": 0.004317053953806559, "sim_compute_robot_state-ego": 0.005545626481374105}}set_robot_commands_max 0.007442519664764404 set_robot_commands_mean 0.007319140366915255 set_robot_commands_median 0.007293252944946289 set_robot_commands_min 0.007170832951863606 sim_compute_performance-ego_max 0.004375018278757731 sim_compute_performance-ego_mean 0.004319626589054892 sim_compute_performance-ego_median 0.004317053953806559 sim_compute_performance-ego_min 0.004232569535573324 sim_compute_robot_state-ego_max 0.005630153720661745 sim_compute_robot_state-ego_mean 0.005509361154840042 sim_compute_robot_state-ego_median 0.005500511328379313 sim_compute_robot_state-ego_min 0.005412879784901937 sim_compute_sim_state_max 0.004090518156687419 sim_compute_sim_state_mean 0.0039413675408803365 sim_compute_sim_state_median 0.003955695629119873 sim_compute_sim_state_min 0.0037256630261739095 sim_physics_max 0.06206620749780687 sim_physics_mean 0.060829174768228765 sim_physics_median 0.06092638889948527 sim_physics_min 0.058405284881591794 sim_render-ego_max 0.007884344812166892 sim_render-ego_mean 0.00758499599535811 sim_render-ego_median 0.0075760610898335775 sim_render-ego_min 0.007360394795735677 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.15000000000007 survival_time_min 2.9499999999999975
No reset possible 293875759Robert Moni lzoltan aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.51524658081191 survival_time_median 14.950000000000076 deviation-center-line_median 0.7580175442396552 in-drivable-lane_median 0.15000000000000213
other stats agent_compute-ego_max 0.0223884916305542 agent_compute-ego_mean 0.02181393361952251 agent_compute-ego_median 0.021689917618062073 agent_compute-ego_min 0.021470024585723876 deviation-center-line_max 0.9102747782165334 deviation-center-line_mean 0.6792622892033771 deviation-center-line_min 0.3566987575565425 deviation-heading_max 4.457784043312591 deviation-heading_mean 2.9445749903530354 deviation-heading_median 2.9755096291417047 deviation-heading_min 1.1417832489666089 driven_any_max 5.884765512917982 driven_any_mean 4.619826981339044 driven_any_median 4.677665452995689 driven_any_min 2.5963092622615926 driven_lanedir_consec_max 4.814897904621585 driven_lanedir_consec_mean 4.133679852733063 driven_lanedir_consec_min 2.543301144867004 driven_lanedir_max 4.814897904621585 driven_lanedir_mean 4.133679852733063 driven_lanedir_median 4.51524658081191 driven_lanedir_min 2.543301144867004 in-drivable-lane_max 2.500000000000001 in-drivable-lane_mean 0.6800000000000027 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.550801666622697, "sim_physics": 0.05484736363093058, "survival_time": 14.950000000000076, "driven_lanedir": 4.247699669939509, "sim_render-ego": 0.007089645862579346, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.0223884916305542, "deviation-heading": 4.457784043312591, "set_robot_commands": 0.005185361703236898, "deviation-center-line": 0.9102747782165334, "driven_lanedir_consec": 4.247699669939509, "sim_compute_sim_state": 0.0029853494962056477, "sim_compute_performance-ego": 0.004101423422495524, "sim_compute_robot_state-ego": 0.005181873639424642}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5963092622615926, "sim_physics": 0.056390850562748944, "survival_time": 6.349999999999985, "driven_lanedir": 2.543301144867004, "sim_render-ego": 0.007141588241096557, "in-drivable-lane": 0, "agent_compute-ego": 0.021682029634010135, "deviation-heading": 1.1417832489666089, "set_robot_commands": 0.004886064003771684, "deviation-center-line": 0.3566987575565425, "driven_lanedir_consec": 2.543301144867004, "sim_compute_sim_state": 0.002937759940079817, "sim_compute_performance-ego": 0.003951981311707984, "sim_compute_robot_state-ego": 0.005104738896287333}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.884765512917982, "sim_physics": 0.05666672468185425, "survival_time": 14.950000000000076, "driven_lanedir": 4.51524658081191, "sim_render-ego": 0.007075014114379882, "in-drivable-lane": 2.500000000000001, "agent_compute-ego": 0.021470024585723876, "deviation-heading": 2.9755096291417047, "set_robot_commands": 0.00493444045384725, "deviation-center-line": 0.7764770733515626, "driven_lanedir_consec": 4.51524658081191, "sim_compute_sim_state": 0.002965553601582845, "sim_compute_performance-ego": 0.003997389475504557, "sim_compute_robot_state-ego": 0.005119217236836751}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.677665452995689, "sim_physics": 0.055676512903981394, "survival_time": 11.55000000000003, "driven_lanedir": 4.547253963425306, "sim_render-ego": 0.0070482487286324105, "in-drivable-lane": 0, "agent_compute-ego": 0.021689917618062073, "deviation-heading": 2.33834031489583, "set_robot_commands": 0.004921254657563709, "deviation-center-line": 0.5948432926525915, "driven_lanedir_consec": 4.547253963425306, "sim_compute_sim_state": 0.0029405556715928114, "sim_compute_performance-ego": 0.003979996685341839, "sim_compute_robot_state-ego": 0.005123165262725962}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.389593011897254, "sim_physics": 0.05570461829503377, "survival_time": 14.950000000000076, "driven_lanedir": 4.814897904621585, "sim_render-ego": 0.007069822152455648, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.02183920462926229, "deviation-heading": 3.8094577154484406, "set_robot_commands": 0.004949270089467366, "deviation-center-line": 0.7580175442396552, "driven_lanedir_consec": 4.814897904621585, "sim_compute_sim_state": 0.002989918390909831, "sim_compute_performance-ego": 0.003982468446095785, "sim_compute_robot_state-ego": 0.005162075360616048}}set_robot_commands_max 0.005185361703236898 set_robot_commands_mean 0.004975278181577381 set_robot_commands_median 0.00493444045384725 set_robot_commands_min 0.004886064003771684 sim_compute_performance-ego_max 0.004101423422495524 sim_compute_performance-ego_mean 0.004002651868229137 sim_compute_performance-ego_median 0.003982468446095785 sim_compute_performance-ego_min 0.003951981311707984 sim_compute_robot_state-ego_max 0.005181873639424642 sim_compute_robot_state-ego_mean 0.005138214079178147 sim_compute_robot_state-ego_median 0.005123165262725962 sim_compute_robot_state-ego_min 0.005104738896287333 sim_compute_sim_state_max 0.002989918390909831 sim_compute_sim_state_mean 0.0029638274200741903 sim_compute_sim_state_median 0.002965553601582845 sim_compute_sim_state_min 0.002937759940079817 sim_physics_max 0.05666672468185425 sim_physics_mean 0.055857214014909784 sim_physics_median 0.05570461829503377 sim_physics_min 0.05484736363093058 sim_render-ego_max 0.007141588241096557 sim_render-ego_mean 0.0070848638198287685 sim_render-ego_median 0.007075014114379882 sim_render-ego_min 0.0070482487286324105 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.550000000000049 survival_time_min 6.349999999999985
No reset possible 293835757Robert Moni lzoltan aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:35 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 293685742Robert Moni almasip-6824 aido3-LFVI-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6087559704554368 survival_time_median 14.950000000000076 deviation-center-line_median 0.8603937706350694 in-drivable-lane_median 1.100000000000005
other stats agent_compute-ego_max 0.026971948246995944 agent_compute-ego_mean 0.026658934354949065 agent_compute-ego_median 0.026680298149585724 agent_compute-ego_min 0.026296533743540445 deviation-center-line_max 1.2476394099954824 deviation-center-line_mean 0.9328555492259076 deviation-center-line_min 0.7312299648364345 deviation-heading_max 9.912753064910511 deviation-heading_mean 6.923140573299435 deviation-heading_median 7.111586343197389 deviation-heading_min 4.060589884277789 driven_any_max 1.9484426902425156 driven_any_mean 1.7568876399311812 driven_any_median 1.9340278474116144 driven_any_min 1.4413576041493144 driven_lanedir_consec_max 1.0172126809807505 driven_lanedir_consec_mean 0.6775608033577007 driven_lanedir_consec_min 0.5105716727749727 driven_lanedir_max 1.5577423585651888 driven_lanedir_mean 1.0953610481442582 driven_lanedir_median 1.041768372190302 driven_lanedir_min 0.7681341550824539 in-drivable-lane_max 4.850000000000053 in-drivable-lane_mean 2.210000000000016 in-drivable-lane_min 0.5000000000000071 per-episodes details {"udem1-0-0": {"driven_any": 1.9484426902425156, "sim_physics": 0.12401778697967528, "survival_time": 14.950000000000076, "driven_lanedir": 1.2157122055228526, "sim_render-ego": 0.007050373554229736, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.02676873524983724, "deviation-heading": 9.912753064910511, "set_robot_commands": 0.0051229206720987954, "deviation-center-line": 0.8603937706350694, "driven_lanedir_consec": 0.6539882670101234, "sim_compute_sim_state": 0.002868499755859375, "sim_compute_performance-ego": 0.003943397998809815, "sim_compute_robot_state-ego": 0.005152916113535563, "sim_compute_robot_state-npc0": 0.004991560777028402, "sim_compute_robot_state-npc1": 0.004703011512756348, "sim_compute_robot_state-npc2": 0.004676342805226644, "sim_compute_robot_state-npc3": 0.004583750565846761}, "udem1-1-0": {"driven_any": 1.934043158407555, "sim_physics": 0.12579853455225626, "survival_time": 14.950000000000076, "driven_lanedir": 1.5577423585651888, "sim_render-ego": 0.007165685494740804, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.026296533743540445, "deviation-heading": 7.111586343197389, "set_robot_commands": 0.005185963312784831, "deviation-center-line": 1.2476394099954824, "driven_lanedir_consec": 1.0172126809807505, "sim_compute_sim_state": 0.0029069177309672036, "sim_compute_performance-ego": 0.003960433801015218, "sim_compute_robot_state-ego": 0.005188472270965576, "sim_compute_robot_state-npc0": 0.0050896159807840985, "sim_compute_robot_state-npc1": 0.004731690088907878, "sim_compute_robot_state-npc2": 0.00469886302947998, "sim_compute_robot_state-npc3": 0.004647226333618164}, "udem1-2-0": {"driven_any": 1.4413576041493144, "sim_physics": 0.12075777990477424, "survival_time": 11.200000000000024, "driven_lanedir": 0.7681341550824539, "sim_render-ego": 0.007181081388677869, "in-drivable-lane": 3.5500000000000123, "agent_compute-ego": 0.026680298149585724, "deviation-heading": 4.060589884277789, "set_robot_commands": 0.00520506181887218, "deviation-center-line": 0.8191356738096499, "driven_lanedir_consec": 0.6087559704554368, "sim_compute_sim_state": 0.002900002258164542, "sim_compute_performance-ego": 0.0039357585566384455, "sim_compute_robot_state-ego": 0.005184153360979897, "sim_compute_robot_state-npc0": 0.00509277731180191, "sim_compute_robot_state-npc1": 0.004708166633333478, "sim_compute_robot_state-npc2": 0.004689841398171016, "sim_compute_robot_state-npc3": 0.004655001418931144}, "udem1-3-0": {"driven_any": 1.526566899444907, "sim_physics": 0.12345278663795536, "survival_time": 11.900000000000034, "driven_lanedir": 0.8934481493604935, "sim_render-ego": 0.007178568038619867, "in-drivable-lane": 1.0500000000000034, "agent_compute-ego": 0.026971948246995944, "deviation-heading": 8.31232410904368, "set_robot_commands": 0.0051931323123579265, "deviation-center-line": 0.7312299648364345, "driven_lanedir_consec": 0.5105716727749727, "sim_compute_sim_state": 0.0028816591791745996, "sim_compute_performance-ego": 0.003981678425764837, "sim_compute_robot_state-ego": 0.005240446379204758, "sim_compute_robot_state-npc0": 0.005009769391612846, "sim_compute_robot_state-npc1": 0.00471991250494949, "sim_compute_robot_state-npc2": 0.0046851484715437685, "sim_compute_robot_state-npc3": 0.0046661921909877235}, "udem1-4-0": {"driven_any": 1.9340278474116144, "sim_physics": 0.12008056004842124, "survival_time": 14.950000000000076, "driven_lanedir": 1.041768372190302, "sim_render-ego": 0.007133627732594808, "in-drivable-lane": 4.850000000000053, "agent_compute-ego": 0.02657715638478597, "deviation-heading": 5.218449465067808, "set_robot_commands": 0.005218202273050944, "deviation-center-line": 1.005878926852903, "driven_lanedir_consec": 0.5972754255672206, "sim_compute_sim_state": 0.002887865702311198, "sim_compute_performance-ego": 0.0039407833417256675, "sim_compute_robot_state-ego": 0.005183133284250895, "sim_compute_robot_state-npc0": 0.00510427713394165, "sim_compute_robot_state-npc1": 0.0047227255503336585, "sim_compute_robot_state-npc2": 0.004626329739888509, "sim_compute_robot_state-npc3": 0.0045997357368469235}}set_robot_commands_max 0.005218202273050944 set_robot_commands_mean 0.005185056077832936 set_robot_commands_median 0.0051931323123579265 set_robot_commands_min 0.0051229206720987954 sim_compute_performance-ego_max 0.003981678425764837 sim_compute_performance-ego_mean 0.003952410424790797 sim_compute_performance-ego_median 0.003943397998809815 sim_compute_performance-ego_min 0.0039357585566384455 sim_compute_robot_state-ego_max 0.005240446379204758 sim_compute_robot_state-ego_mean 0.005189824281787337 sim_compute_robot_state-ego_median 0.005184153360979897 sim_compute_robot_state-ego_min 0.005152916113535563 sim_compute_robot_state-npc0_max 0.00510427713394165 sim_compute_robot_state-npc0_mean 0.005057600119033782 sim_compute_robot_state-npc0_median 0.0050896159807840985 sim_compute_robot_state-npc0_min 0.004991560777028402 sim_compute_robot_state-npc1_max 0.004731690088907878 sim_compute_robot_state-npc1_mean 0.004717101258056171 sim_compute_robot_state-npc1_median 0.00471991250494949 sim_compute_robot_state-npc1_min 0.004703011512756348 sim_compute_robot_state-npc2_max 0.00469886302947998 sim_compute_robot_state-npc2_mean 0.004675305088861984 sim_compute_robot_state-npc2_median 0.0046851484715437685 sim_compute_robot_state-npc2_min 0.004626329739888509 sim_compute_robot_state-npc3_max 0.0046661921909877235 sim_compute_robot_state-npc3_mean 0.004630381249246143 sim_compute_robot_state-npc3_median 0.004647226333618164 sim_compute_robot_state-npc3_min 0.004583750565846761 sim_compute_sim_state_max 0.0029069177309672036 sim_compute_sim_state_mean 0.002888988925295384 sim_compute_sim_state_median 0.002887865702311198 sim_compute_sim_state_min 0.002868499755859375 sim_physics_max 0.12579853455225626 sim_physics_mean 0.12282148962461648 sim_physics_median 0.12345278663795536 sim_physics_min 0.12008056004842124 sim_render-ego_max 0.007181081388677869 sim_render-ego_mean 0.007141867241772617 sim_render-ego_median 0.007165685494740804 sim_render-ego_min 0.007050373554229736 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.590000000000057 survival_time_min 11.200000000000024
No reset possible 293645738Mikita Sazanovich chameleon-10-jlu aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:26:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6691303085342537 survival_time_median 8.699999999999989 deviation-center-line_median 0.5844114821331404 in-drivable-lane_median 1.0499999999999978
other stats agent_compute-ego_max 0.20815388202667237 agent_compute-ego_mean 0.18979994784889345 agent_compute-ego_median 0.1951400998197956 agent_compute-ego_min 0.16237033088252228 deviation-center-line_max 1.3422232118862183 deviation-center-line_mean 0.6743281366408851 deviation-center-line_min 0.12202912808538292 deviation-heading_max 5.3268625785133406 deviation-heading_mean 3.0559707763416197 deviation-heading_median 2.920439249584766 deviation-heading_min 0.5385104524049504 driven_any_max 5.372190288533872 driven_any_mean 3.4918893051084927 driven_any_median 3.021893361537187 driven_any_min 1.038911312058822 driven_lanedir_consec_max 4.910755923859886 driven_lanedir_consec_mean 2.9932993240626584 driven_lanedir_consec_min 0.8894805613013244 driven_lanedir_max 4.910755923859886 driven_lanedir_mean 2.9932993240626584 driven_lanedir_median 2.6691303085342537 driven_lanedir_min 0.8894805613013244 in-drivable-lane_max 2.450000000000019 in-drivable-lane_mean 1.046666666666668 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.615161961165576, "sim_physics": 0.07481950362523397, "survival_time": 14.950000000000076, "driven_lanedir": 3.677609660796671, "sim_render-ego": 0.009178929328918456, "in-drivable-lane": 2.450000000000019, "agent_compute-ego": 0.19874575932820637, "deviation-heading": 5.067845846343179, "set_robot_commands": 0.0069025166829427085, "deviation-center-line": 0.953542925259287, "driven_lanedir_consec": 3.677609660796671, "sim_compute_sim_state": 0.0038351988792419433, "sim_compute_performance-ego": 0.0054377516110738116, "sim_compute_robot_state-ego": 0.006670871575673421}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8341120017318553, "sim_physics": 0.07185432844072859, "survival_time": 5.349999999999989, "driven_lanedir": 1.6823890132632424, "sim_render-ego": 0.00857922072722533, "in-drivable-lane": 0, "agent_compute-ego": 0.1995233731849171, "deviation-heading": 1.7748570819464915, "set_robot_commands": 0.006754360466359932, "deviation-center-line": 0.4815107044016259, "driven_lanedir_consec": 1.6823890132632424, "sim_compute_sim_state": 0.003613971104131681, "sim_compute_performance-ego": 0.004922563784590391, "sim_compute_robot_state-ego": 0.006363866485167887}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3102400059076595, "sim_physics": 0.07155755587986537, "survival_time": 5.249999999999989, "driven_lanedir": 2.138683443308056, "sim_render-ego": 0.009227400734311058, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.203902800877889, "deviation-heading": 1.133621853824513, "set_robot_commands": 0.007284834271385556, "deviation-center-line": 0.27427324753541116, "driven_lanedir_consec": 2.138683443308056, "sim_compute_sim_state": 0.003843012310209728, "sim_compute_performance-ego": 0.0053676468985421315, "sim_compute_robot_state-ego": 0.006705320449102493}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.943505349998446, "sim_physics": 0.07290911912918091, "survival_time": 14.950000000000076, "driven_lanedir": 3.844786598146936, "sim_render-ego": 0.008561446666717529, "in-drivable-lane": 2.4000000000000172, "agent_compute-ego": 0.19530256191889445, "deviation-heading": 5.3268625785133406, "set_robot_commands": 0.006826957861582438, "deviation-center-line": 1.0911305212653477, "driven_lanedir_consec": 3.844786598146936, "sim_compute_sim_state": 0.003735756874084473, "sim_compute_performance-ego": 0.004983391761779785, "sim_compute_robot_state-ego": 0.006377609570821127}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.291256638987573, "sim_physics": 0.07129851659138997, "survival_time": 14.950000000000076, "driven_lanedir": 4.6260840461943005, "sim_render-ego": 0.00841172695159912, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.19274006605148317, "deviation-heading": 4.576724416058851, "set_robot_commands": 0.006632378896077474, "deviation-center-line": 1.0422233737054296, "driven_lanedir_consec": 4.6260840461943005, "sim_compute_sim_state": 0.003623009522755941, "sim_compute_performance-ego": 0.004798838297526042, "sim_compute_robot_state-ego": 0.006197084585825602}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.021893361537187, "sim_physics": 0.0744690806777389, "survival_time": 8.09999999999998, "driven_lanedir": 2.6691303085342537, "sim_render-ego": 0.009040558779681173, "in-drivable-lane": 1.0499999999999978, "agent_compute-ego": 0.1951400998197956, "deviation-heading": 1.8556139146360289, "set_robot_commands": 0.006547483397118839, "deviation-center-line": 0.4183495190717355, "driven_lanedir_consec": 2.6691303085342537, "sim_compute_sim_state": 0.003964702288309733, "sim_compute_performance-ego": 0.005143066983164093, "sim_compute_robot_state-ego": 0.006503406866097156}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.1298235411786894, "sim_physics": 0.06840116580327352, "survival_time": 2.9999999999999973, "driven_lanedir": 1.0530075407812252, "sim_render-ego": 0.008195888996124268, "in-drivable-lane": 0, "agent_compute-ego": 0.1756865421930949, "deviation-heading": 0.8889569347424481, "set_robot_commands": 0.005966460704803467, "deviation-center-line": 0.2883796037256994, "driven_lanedir_consec": 1.0530075407812252, "sim_compute_sim_state": 0.0034079790115356446, "sim_compute_performance-ego": 0.004513808091481527, "sim_compute_robot_state-ego": 0.005779031912485758}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.574775791942596, "sim_physics": 0.07368128525244223, "survival_time": 7.399999999999982, "driven_lanedir": 1.9226192256234511, "sim_render-ego": 0.009337320521071151, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.2011214526923927, "deviation-heading": 2.7978226860434123, "set_robot_commands": 0.006891490639867009, "deviation-center-line": 0.5334657605858211, "driven_lanedir_consec": 1.9226192256234511, "sim_compute_sim_state": 0.003829395448839342, "sim_compute_performance-ego": 0.005407161003834492, "sim_compute_robot_state-ego": 0.006829113573641391}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.757882482662839, "sim_physics": 0.05631640022748137, "survival_time": 7.299999999999982, "driven_lanedir": 2.3454627443909217, "sim_render-ego": 0.007170976024784454, "in-drivable-lane": 1.4499999999999962, "agent_compute-ego": 0.1629465589784596, "deviation-heading": 1.6060802429737095, "set_robot_commands": 0.005086048008644418, "deviation-center-line": 0.2797824064527186, "driven_lanedir_consec": 2.3454627443909217, "sim_compute_sim_state": 0.0029862204643145, "sim_compute_performance-ego": 0.004028949019027083, "sim_compute_robot_state-ego": 0.0051328727643783776}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.038911312058822, "sim_physics": 0.0575774795604202, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8894805613013244, "sim_render-ego": 0.007187325999421894, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16237033088252228, "deviation-heading": 0.5385104524049504, "set_robot_commands": 0.004919443490370264, "deviation-center-line": 0.12202912808538292, "driven_lanedir_consec": 0.8894805613013244, "sim_compute_sim_state": 0.002987681694750516, "sim_compute_performance-ego": 0.004040844035598467, "sim_compute_robot_state-ego": 0.005170345306396484}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.372190288533872, "sim_physics": 0.06154272715250651, "survival_time": 14.950000000000076, "driven_lanedir": 4.910755923859886, "sim_render-ego": 0.007806671460469564, "in-drivable-lane": 0.850000000000005, "agent_compute-ego": 0.1771789558728536, "deviation-heading": 3.826008777245096, "set_robot_commands": 0.005569224357604981, "deviation-center-line": 0.9557259374863472, "driven_lanedir_consec": 4.910755923859886, "sim_compute_sim_state": 0.00324829896291097, "sim_compute_performance-ego": 0.004474914073944092, "sim_compute_robot_state-ego": 0.005698843002319336}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.940120048680387, "sim_physics": 0.07461443980534871, "survival_time": 14.950000000000076, "driven_lanedir": 4.31452300705241, "sim_render-ego": 0.009197592735290527, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.20815388202667237, "deviation-heading": 5.2696100084288915, "set_robot_commands": 0.006896684169769287, "deviation-center-line": 1.3422232118862183, "driven_lanedir_consec": 4.31452300705241, "sim_compute_sim_state": 0.003892879486083984, "sim_compute_performance-ego": 0.005374051729838053, "sim_compute_robot_state-ego": 0.006776721477508545}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.675945759495382, "sim_physics": 0.07166581673006858, "survival_time": 12.40000000000004, "driven_lanedir": 4.1119282598634594, "sim_render-ego": 0.009397867225831556, "in-drivable-lane": 1.6000000000000032, "agent_compute-ego": 0.197231589786468, "deviation-heading": 2.920439249584766, "set_robot_commands": 0.006870173638866794, "deviation-center-line": 0.5923584765093666, "driven_lanedir_consec": 4.1119282598634594, "sim_compute_sim_state": 0.003819746355856618, "sim_compute_performance-ego": 0.005428580507155388, "sim_compute_robot_state-ego": 0.00668052896376579}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.973178579230671, "sim_physics": 0.06970232519610174, "survival_time": 8.699999999999989, "driven_lanedir": 2.3703983181043413, "sim_render-ego": 0.008264925288057876, "in-drivable-lane": 1.4499999999999964, "agent_compute-ego": 0.18291049990160713, "deviation-heading": 3.0718825570804476, "set_robot_commands": 0.0063919842928305435, "deviation-center-line": 0.5844114821331404, "driven_lanedir_consec": 2.3703983181043413, "sim_compute_sim_state": 0.0035430795844944045, "sim_compute_performance-ego": 0.004742223640968059, "sim_compute_robot_state-ego": 0.005943962897377452}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.899342453515834, "sim_physics": 0.0728689065346351, "survival_time": 14.300000000000068, "driven_lanedir": 4.342631209719394, "sim_render-ego": 0.008662479740756375, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.19404474421814605, "deviation-heading": 5.1847250452981735, "set_robot_commands": 0.006776521255919984, "deviation-center-line": 1.1555157515097465, "driven_lanedir_consec": 4.342631209719394, "sim_compute_sim_state": 0.003663829156568834, "sim_compute_performance-ego": 0.004955422628175962, "sim_compute_robot_state-ego": 0.006356828696244246}}set_robot_commands_max 0.007284834271385556 set_robot_commands_mean 0.006421104142276247 set_robot_commands_median 0.006754360466359932 set_robot_commands_min 0.004919443490370264 sim_compute_performance-ego_max 0.0054377516110738116 sim_compute_performance-ego_mean 0.004907947604446625 sim_compute_performance-ego_median 0.004955422628175962 sim_compute_performance-ego_min 0.004028949019027083 sim_compute_robot_state-ego_max 0.006829113573641391 sim_compute_robot_state-ego_mean 0.006212427208453671 sim_compute_robot_state-ego_median 0.006363866485167887 sim_compute_robot_state-ego_min 0.0051328727643783776 sim_compute_sim_state_max 0.003964702288309733 sim_compute_sim_state_mean 0.003599650742939221 sim_compute_sim_state_median 0.003663829156568834 sim_compute_sim_state_min 0.0029862204643145 sim_physics_max 0.07481950362523397 sim_physics_mean 0.0695519100404277 sim_physics_median 0.07166581673006858 sim_physics_min 0.05631640022748137 sim_render-ego_max 0.009397867225831556 sim_render-ego_mean 0.008548022078684023 sim_render-ego_median 0.00857922072722533 sim_render-ego_min 0.007170976024784454 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.946666666666692 survival_time_min 2.6499999999999986
No reset possible 293575749Robert Moni lzoltan aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.637880768039085 survival_time_median 14.950000000000076 deviation-center-line_median 0.8088482001224524 in-drivable-lane_median 0.9500000000000136
other stats agent_compute-ego_max 0.022031346162160237 agent_compute-ego_mean 0.02187119722366333 agent_compute-ego_median 0.021943384806315105 agent_compute-ego_min 0.021456406116485596 deviation-center-line_max 0.8861043483686573 deviation-center-line_mean 0.7955676073943028 deviation-center-line_min 0.7008351472086309 deviation-heading_max 3.675295754710025 deviation-heading_mean 3.302957879705229 deviation-heading_median 3.5486361310031276 deviation-heading_min 2.4381742564116435 driven_any_max 5.9626394828953915 driven_any_mean 5.4746697653181675 driven_any_median 5.305497457847927 driven_any_min 4.9398536726606075 driven_lanedir_consec_max 5.222781879565523 driven_lanedir_consec_mean 4.7287346170769 driven_lanedir_consec_min 4.4972377521999505 driven_lanedir_max 5.222781879565523 driven_lanedir_mean 4.7287346170769 driven_lanedir_median 4.637880768039085 driven_lanedir_min 4.4972377521999505 in-drivable-lane_max 2.700000000000002 in-drivable-lane_mean 1.1800000000000064 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.9398536726606075, "sim_physics": 0.056613997618357344, "survival_time": 14.950000000000076, "driven_lanedir": 4.746237335709406, "sim_render-ego": 0.00700146198272705, "in-drivable-lane": 0, "agent_compute-ego": 0.022031346162160237, "deviation-heading": 3.5984420654392157, "set_robot_commands": 0.0049791057904561365, "deviation-center-line": 0.8861043483686573, "driven_lanedir_consec": 4.746237335709406, "sim_compute_sim_state": 0.002915960947672526, "sim_compute_performance-ego": 0.004059197107950847, "sim_compute_robot_state-ego": 0.005165235201517741}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.2476455813895475, "sim_physics": 0.0563905922571818, "survival_time": 14.950000000000076, "driven_lanedir": 4.637880768039085, "sim_render-ego": 0.007054521242777507, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.021456406116485596, "deviation-heading": 3.5486361310031276, "set_robot_commands": 0.004959668318430583, "deviation-center-line": 0.8631668552311675, "driven_lanedir_consec": 4.637880768039085, "sim_compute_sim_state": 0.0029009111722310384, "sim_compute_performance-ego": 0.003946363131205241, "sim_compute_robot_state-ego": 0.005076651573181152}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.9626394828953915, "sim_physics": 0.05485713640848795, "survival_time": 14.950000000000076, "driven_lanedir": 4.4972377521999505, "sim_render-ego": 0.007053651809692383, "in-drivable-lane": 2.700000000000002, "agent_compute-ego": 0.021912827491760253, "deviation-heading": 2.4381742564116435, "set_robot_commands": 0.005007822513580323, "deviation-center-line": 0.7188834860406061, "driven_lanedir_consec": 4.4972377521999505, "sim_compute_sim_state": 0.002925285498301188, "sim_compute_performance-ego": 0.003961927096048991, "sim_compute_robot_state-ego": 0.00509142796198527}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.917712631797365, "sim_physics": 0.05515565156936646, "survival_time": 14.950000000000076, "driven_lanedir": 5.222781879565523, "sim_render-ego": 0.007109456857045491, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.02201202154159546, "deviation-heading": 3.675295754710025, "set_robot_commands": 0.004978962739308675, "deviation-center-line": 0.8088482001224524, "driven_lanedir_consec": 5.222781879565523, "sim_compute_sim_state": 0.0029728953043619793, "sim_compute_performance-ego": 0.0039641022682189945, "sim_compute_robot_state-ego": 0.0051339546839396155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.305497457847927, "sim_physics": 0.0567781138420105, "survival_time": 14.950000000000076, "driven_lanedir": 4.539535349870532, "sim_render-ego": 0.007036786079406738, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.021943384806315105, "deviation-heading": 3.254241190962132, "set_robot_commands": 0.00492081880569458, "deviation-center-line": 0.7008351472086309, "driven_lanedir_consec": 4.539535349870532, "sim_compute_sim_state": 0.00295682430267334, "sim_compute_performance-ego": 0.003951501051584879, "sim_compute_robot_state-ego": 0.005107597510019938}}set_robot_commands_max 0.005007822513580323 set_robot_commands_mean 0.00496927563349406 set_robot_commands_median 0.004978962739308675 set_robot_commands_min 0.00492081880569458 sim_compute_performance-ego_max 0.004059197107950847 sim_compute_performance-ego_mean 0.00397661813100179 sim_compute_performance-ego_median 0.003961927096048991 sim_compute_performance-ego_min 0.003946363131205241 sim_compute_robot_state-ego_max 0.005165235201517741 sim_compute_robot_state-ego_mean 0.005114973386128744 sim_compute_robot_state-ego_median 0.005107597510019938 sim_compute_robot_state-ego_min 0.005076651573181152 sim_compute_sim_state_max 0.0029728953043619793 sim_compute_sim_state_mean 0.0029343754450480144 sim_compute_sim_state_median 0.002925285498301188 sim_compute_sim_state_min 0.0029009111722310384 sim_physics_max 0.0567781138420105 sim_physics_mean 0.0559590983390808 sim_physics_median 0.0563905922571818 sim_physics_min 0.05485713640848795 sim_render-ego_max 0.007109456857045491 sim_render-ego_mean 0.007051175594329833 sim_render-ego_median 0.007053651809692383 sim_render-ego_min 0.00700146198272705 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 293505733Robert Moni almasip-6824 aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:09 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 293365723Robert Moni almasip-6824 aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:13:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4441746397873265 survival_time_median 5.549999999999988 deviation-center-line_median 0.3351723270882624 in-drivable-lane_median 1.6499999999999946
other stats agent_compute-ego_max 0.03703355339338195 agent_compute-ego_mean 0.03106977763120321 agent_compute-ego_median 0.03252959450085958 agent_compute-ego_min 0.025210768211888904 deviation-center-line_max 1.0988125847742642 deviation-center-line_mean 0.4941394140186024 deviation-center-line_min 0.2550374286568644 deviation-heading_max 6.7533419427329475 deviation-heading_mean 2.513047700079424 deviation-heading_median 1.9457028159515553 deviation-heading_min 1.127776918461493 driven_any_max 1.9578250767587135 driven_any_mean 0.998816362022108 driven_any_median 0.762869081102321 driven_any_min 0.5118562334185612 driven_lanedir_consec_max 1.5490907726979068 driven_lanedir_consec_mean 0.5754247270778395 driven_lanedir_consec_min 0.18515810260457757 driven_lanedir_max 1.581485784208213 driven_lanedir_mean 0.6379940192943196 driven_lanedir_median 0.4441746397873265 driven_lanedir_min 0.2071776901039718 in-drivable-lane_max 3.70000000000005 in-drivable-lane_mean 1.7766666666666715 in-drivable-lane_min 0.8999999999999968 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5235959480711467, "sim_physics": 0.0767846444867692, "survival_time": 10.600000000000016, "driven_lanedir": 1.1498322288899108, "sim_render-ego": 0.008880878394504762, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.03703355339338195, "deviation-heading": 2.9885394822061833, "set_robot_commands": 0.007425363333720081, "deviation-center-line": 0.763027552836178, "driven_lanedir_consec": 1.1178882945747632, "sim_compute_sim_state": 0.003819157492439702, "sim_compute_performance-ego": 0.005298515535750479, "sim_compute_robot_state-ego": 0.006608013836842663}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9578250767587135, "sim_physics": 0.07442566450091376, "survival_time": 13.80000000000006, "driven_lanedir": 1.581485784208213, "sim_render-ego": 0.00886962638385054, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.03302020611970321, "deviation-heading": 4.255578168165709, "set_robot_commands": 0.006896684999051301, "deviation-center-line": 0.8239970043938926, "driven_lanedir_consec": 1.5490907726979068, "sim_compute_sim_state": 0.003809192906255307, "sim_compute_performance-ego": 0.005031780920166901, "sim_compute_robot_state-ego": 0.006370854550513668}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5609142595219896, "sim_physics": 0.07872653281551668, "survival_time": 4.3499999999999925, "driven_lanedir": 0.25302777645841834, "sim_render-ego": 0.00928191206921106, "in-drivable-lane": 1.6499999999999948, "agent_compute-ego": 0.034986942663960074, "deviation-heading": 1.5134632519181384, "set_robot_commands": 0.007644417642176837, "deviation-center-line": 0.28538676012099745, "driven_lanedir_consec": 0.1927639634335545, "sim_compute_sim_state": 0.003978312700644307, "sim_compute_performance-ego": 0.005283805145614448, "sim_compute_robot_state-ego": 0.0068496260149725555}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.762869081102321, "sim_physics": 0.07636581240473567, "survival_time": 5.549999999999988, "driven_lanedir": 0.4441746397873265, "sim_render-ego": 0.009202235453837629, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.03520692146576203, "deviation-heading": 1.427198596923399, "set_robot_commands": 0.007259813514915672, "deviation-center-line": 0.4211383072494332, "driven_lanedir_consec": 0.4441746397873265, "sim_compute_sim_state": 0.004043912028407192, "sim_compute_performance-ego": 0.0052085524206762915, "sim_compute_robot_state-ego": 0.007024719908430769}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5785487073259747, "sim_physics": 0.06971423625946045, "survival_time": 4.499999999999992, "driven_lanedir": 0.3255852314243348, "sim_render-ego": 0.008887243270874024, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.03228907850053575, "deviation-heading": 1.7211075615639797, "set_robot_commands": 0.0065431965721978085, "deviation-center-line": 0.2558045807527748, "driven_lanedir_consec": 0.25993586495042353, "sim_compute_sim_state": 0.003906019528706869, "sim_compute_performance-ego": 0.004957442813449436, "sim_compute_robot_state-ego": 0.006415772438049317}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.5118562334185612, "sim_physics": 0.07102399696538478, "survival_time": 4.049999999999994, "driven_lanedir": 0.22431184209595137, "sim_render-ego": 0.008194926344318154, "in-drivable-lane": 1.6499999999999946, "agent_compute-ego": 0.0329261385364297, "deviation-heading": 1.2962557215629644, "set_robot_commands": 0.006208263797524535, "deviation-center-line": 0.2550374286568644, "driven_lanedir_consec": 0.20091860455855184, "sim_compute_sim_state": 0.003645496603883343, "sim_compute_performance-ego": 0.004605143158524124, "sim_compute_robot_state-ego": 0.006003044269703052}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.6150408431878155, "sim_physics": 0.0770241550563537, "survival_time": 4.849999999999991, "driven_lanedir": 0.2943229789741635, "sim_render-ego": 0.009136128671390494, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.033150822845930905, "deviation-heading": 1.9457028159515553, "set_robot_commands": 0.006916970321812581, "deviation-center-line": 0.2926230999060933, "driven_lanedir_consec": 0.26899558105754195, "sim_compute_sim_state": 0.003914171887427261, "sim_compute_performance-ego": 0.005257768729298385, "sim_compute_robot_state-ego": 0.006719466337223643}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.783798317081237, "sim_physics": 0.07412797609965006, "survival_time": 5.999999999999987, "driven_lanedir": 0.533836637643812, "sim_render-ego": 0.009811222553253174, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.03252959450085958, "deviation-heading": 2.732653427786552, "set_robot_commands": 0.007155416409174601, "deviation-center-line": 0.3351723270882624, "driven_lanedir_consec": 0.44581474743475713, "sim_compute_sim_state": 0.004064385096232096, "sim_compute_performance-ego": 0.005728369951248169, "sim_compute_robot_state-ego": 0.007024792830149332}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.6425335430672017, "sim_physics": 0.07538339457934416, "survival_time": 11.850000000000032, "driven_lanedir": 1.217185216368097, "sim_render-ego": 0.008863345480166407, "in-drivable-lane": 2.3000000000000274, "agent_compute-ego": 0.03468895863883103, "deviation-heading": 3.130036451399654, "set_robot_commands": 0.007261506615811763, "deviation-center-line": 1.0988125847742642, "driven_lanedir_consec": 1.217185216368097, "sim_compute_sim_state": 0.0038841112756527927, "sim_compute_performance-ego": 0.0051147786876823325, "sim_compute_robot_state-ego": 0.006523663484597508}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6837322030241713, "sim_physics": 0.07242730356031848, "survival_time": 12.40000000000004, "driven_lanedir": 0.987862686202314, "sim_render-ego": 0.008768129733300978, "in-drivable-lane": 2.3000000000000025, "agent_compute-ego": 0.0316026181943955, "deviation-heading": 6.7533419427329475, "set_robot_commands": 0.006798526933116298, "deviation-center-line": 0.8068579400944977, "driven_lanedir_consec": 0.6035198270584394, "sim_compute_sim_state": 0.003778543203107773, "sim_compute_performance-ego": 0.005023424663851338, "sim_compute_robot_state-ego": 0.006320725525579145}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.534271029767111, "sim_physics": 0.05887715873264131, "survival_time": 4.199999999999993, "driven_lanedir": 0.291536972847787, "sim_render-ego": 0.007223049799601237, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.026213203157697405, "deviation-heading": 1.621185192707186, "set_robot_commands": 0.005126987184797015, "deviation-center-line": 0.3013364297362756, "driven_lanedir_consec": 0.22258103016884043, "sim_compute_sim_state": 0.003093086537860689, "sim_compute_performance-ego": 0.003962641670590355, "sim_compute_robot_state-ego": 0.005122193268367222}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5623667376322803, "sim_physics": 0.05344066191255377, "survival_time": 4.449999999999992, "driven_lanedir": 0.2071776901039718, "sim_render-ego": 0.007198124789120106, "in-drivable-lane": 2.199999999999993, "agent_compute-ego": 0.025387466623542018, "deviation-heading": 1.127776918461493, "set_robot_commands": 0.00520063518138414, "deviation-center-line": 0.27236900891835, "driven_lanedir_consec": 0.18515810260457757, "sim_compute_sim_state": 0.003066547800985615, "sim_compute_performance-ego": 0.004009214679846603, "sim_compute_robot_state-ego": 0.005172879508372103}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5548011661592155, "sim_physics": 0.058164582696071894, "survival_time": 4.299999999999993, "driven_lanedir": 0.2764806575017369, "sim_render-ego": 0.007210132687590843, "in-drivable-lane": 1.449999999999995, "agent_compute-ego": 0.02576148787210154, "deviation-heading": 1.629747319213324, "set_robot_commands": 0.005170212235561637, "deviation-center-line": 0.26239817524176073, "driven_lanedir_consec": 0.21183383081615637, "sim_compute_sim_state": 0.003090780834818995, "sim_compute_performance-ego": 0.0039827823638916016, "sim_compute_robot_state-ego": 0.005159208940905194}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.8419349660501791, "sim_physics": 0.0570524912327528, "survival_time": 12.800000000000049, "driven_lanedir": 1.2016932613851463, "sim_render-ego": 0.007131438702344894, "in-drivable-lane": 3.70000000000005, "agent_compute-ego": 0.02603890374302864, "deviation-heading": 2.995129382770093, "set_robot_commands": 0.00516081415116787, "deviation-center-line": 0.8697620360716843, "driven_lanedir_consec": 1.1899328671968623, "sim_compute_sim_state": 0.0031071361154317856, "sim_compute_performance-ego": 0.003973715007305145, "sim_compute_robot_state-ego": 0.005185137502849102}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.8681573181637003, "sim_physics": 0.055458547504803606, "survival_time": 6.549999999999985, "driven_lanedir": 0.5813966855236108, "sim_render-ego": 0.007110266285088226, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.025210768211888904, "deviation-heading": 2.557999267828177, "set_robot_commands": 0.005023080884045317, "deviation-center-line": 0.3683679744377085, "driven_lanedir_consec": 0.5215775634597934, "sim_compute_sim_state": 0.0030431874835764178, "sim_compute_performance-ego": 0.003965306828040203, "sim_compute_robot_state-ego": 0.005090020085109099}}set_robot_commands_max 0.007644417642176837 set_robot_commands_mean 0.006386125985097163 set_robot_commands_median 0.006798526933116298 set_robot_commands_min 0.005023080884045317 sim_compute_performance-ego_max 0.005728369951248169 sim_compute_performance-ego_mean 0.004760216171729055 sim_compute_performance-ego_median 0.005023424663851338 sim_compute_performance-ego_min 0.003962641670590355 sim_compute_robot_state-ego_max 0.007024792830149332 sim_compute_robot_state-ego_mean 0.006106007900110959 sim_compute_robot_state-ego_median 0.006370854550513668 sim_compute_robot_state-ego_min 0.005090020085109099 sim_compute_sim_state_max 0.004064385096232096 sim_compute_sim_state_mean 0.003616269433028676 sim_compute_sim_state_median 0.003809192906255307 sim_compute_sim_state_min 0.0030431874835764178 sim_physics_max 0.07872653281551668 sim_physics_mean 0.06859981058715135 sim_physics_median 0.07242730356031848 sim_physics_min 0.05344066191255377 sim_render-ego_max 0.009811222553253174 sim_render-ego_mean 0.0083845773745635 sim_render-ego_median 0.008863345480166407 sim_render-ego_min 0.007110266285088226 simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 7.350000000000008 survival_time_min 4.049999999999994
No reset possible 292625692Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LFV-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7004448075937277 survival_time_median 4.249999999999993 deviation-center-line_median 0.14600299209904846 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.01977978112562647 agent_compute-ego_mean 0.019585197694087265 agent_compute-ego_median 0.019621437246149235 agent_compute-ego_min 0.019398961464564005 deviation-center-line_max 0.2682148753857092 deviation-center-line_mean 0.1609597507553462 deviation-center-line_min 0.08518160039432815 deviation-heading_max 2.1033830606631714 deviation-heading_mean 1.0076293706754993 deviation-heading_median 0.9354462099336528 deviation-heading_min 0.3654531750202133 driven_any_max 1.6053146742525737 driven_any_mean 1.269971227851555 driven_any_median 1.0803054132580898 driven_any_min 1.050008052326899 driven_lanedir_consec_max 1.2211076804377292 driven_lanedir_consec_mean 0.8248130039333921 driven_lanedir_consec_min 0.6684427204800089 driven_lanedir_max 1.2211076804377292 driven_lanedir_mean 0.8248130039333921 driven_lanedir_median 0.7004448075937277 driven_lanedir_min 0.6684427204800089 in-drivable-lane_max 2.3499999999999917 in-drivable-lane_mean 1.719999999999994 in-drivable-lane_min 1.2999999999999954 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0803054132580898, "sim_physics": 0.11232941533312384, "survival_time": 4.049999999999994, "driven_lanedir": 0.6684427204800089, "sim_render-ego": 0.007294301633481626, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.019631238631260248, "deviation-heading": 0.6778583069068357, "set_robot_commands": 0.004935408815925504, "deviation-center-line": 0.08921299804090185, "driven_lanedir_consec": 0.6684427204800089, "sim_compute_sim_state": 0.0028584945349045742, "sim_compute_performance-ego": 0.004087960278546369, "sim_compute_robot_state-ego": 0.005254036114539629, "sim_compute_robot_state-npc0": 0.004795501261581609, "sim_compute_robot_state-npc1": 0.004554142186671127, "sim_compute_robot_state-npc2": 0.004610615012086468, "sim_compute_robot_state-npc3": 0.004596716091956621}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.050008052326899, "sim_physics": 0.11024224396907922, "survival_time": 3.2999999999999963, "driven_lanedir": 0.7004448075937277, "sim_render-ego": 0.00711163246270382, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.019621437246149235, "deviation-heading": 0.3654531750202133, "set_robot_commands": 0.005026354934229996, "deviation-center-line": 0.08518160039432815, "driven_lanedir_consec": 0.7004448075937277, "sim_compute_sim_state": 0.0028289809371485853, "sim_compute_performance-ego": 0.003927285021001642, "sim_compute_robot_state-ego": 0.0051599885478164215, "sim_compute_robot_state-npc0": 0.004811843236287435, "sim_compute_robot_state-npc1": 0.004540468707229152, "sim_compute_robot_state-npc2": 0.004543969125458689, "sim_compute_robot_state-npc3": 0.004514950694459857}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6053146742525737, "sim_physics": 0.11879450870010087, "survival_time": 5.299999999999989, "driven_lanedir": 1.2211076804377292, "sim_render-ego": 0.007177930957866165, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01977978112562647, "deviation-heading": 0.9354462099336528, "set_robot_commands": 0.0049558000744513745, "deviation-center-line": 0.2682148753857092, "driven_lanedir_consec": 1.2211076804377292, "sim_compute_sim_state": 0.0028250757253394936, "sim_compute_performance-ego": 0.003923818750201531, "sim_compute_robot_state-ego": 0.005157625900124604, "sim_compute_robot_state-npc0": 0.004744889601221624, "sim_compute_robot_state-npc1": 0.004569478754727346, "sim_compute_robot_state-npc2": 0.004537865800677605, "sim_compute_robot_state-npc3": 0.004534887817670715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.063262988537486, "sim_physics": 0.12036763079026166, "survival_time": 4.249999999999993, "driven_lanedir": 0.6684757234596428, "sim_render-ego": 0.007167754453771254, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.019494570002836335, "deviation-heading": 0.956006100853623, "set_robot_commands": 0.004882229075712316, "deviation-center-line": 0.14600299209904846, "driven_lanedir_consec": 0.6684757234596428, "sim_compute_sim_state": 0.002843957788803998, "sim_compute_performance-ego": 0.003926911073572495, "sim_compute_robot_state-ego": 0.005130753797643325, "sim_compute_robot_state-npc0": 0.004840634850894704, "sim_compute_robot_state-npc1": 0.004568663765402401, "sim_compute_robot_state-npc2": 0.004522907032686122, "sim_compute_robot_state-npc3": 0.004499126883114085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.550965010882726, "sim_physics": 0.10810348192850748, "survival_time": 5.999999999999987, "driven_lanedir": 0.8655940876958516, "sim_render-ego": 0.007157584031422933, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.019398961464564005, "deviation-heading": 2.1033830606631714, "set_robot_commands": 0.004963143666585287, "deviation-center-line": 0.2161862878567434, "driven_lanedir_consec": 0.8655940876958516, "sim_compute_sim_state": 0.0028485278288523357, "sim_compute_performance-ego": 0.003951861461003622, "sim_compute_robot_state-ego": 0.0051608463128407795, "sim_compute_robot_state-npc0": 0.0047895451386769615, "sim_compute_robot_state-npc1": 0.004541820287704468, "sim_compute_robot_state-npc2": 0.004527475436528524, "sim_compute_robot_state-npc3": 0.0045468747615814206}}set_robot_commands_max 0.005026354934229996 set_robot_commands_mean 0.0049525873133808955 set_robot_commands_median 0.0049558000744513745 set_robot_commands_min 0.004882229075712316 sim_compute_performance-ego_max 0.004087960278546369 sim_compute_performance-ego_mean 0.003963567316865132 sim_compute_performance-ego_median 0.003927285021001642 sim_compute_performance-ego_min 0.003923818750201531 sim_compute_robot_state-ego_max 0.005254036114539629 sim_compute_robot_state-ego_mean 0.005172650134592951 sim_compute_robot_state-ego_median 0.0051599885478164215 sim_compute_robot_state-ego_min 0.005130753797643325 sim_compute_robot_state-npc0_max 0.004840634850894704 sim_compute_robot_state-npc0_mean 0.004796482817732466 sim_compute_robot_state-npc0_median 0.004795501261581609 sim_compute_robot_state-npc0_min 0.004744889601221624 sim_compute_robot_state-npc1_max 0.004569478754727346 sim_compute_robot_state-npc1_mean 0.004554914740346899 sim_compute_robot_state-npc1_median 0.004554142186671127 sim_compute_robot_state-npc1_min 0.004540468707229152 sim_compute_robot_state-npc2_max 0.004610615012086468 sim_compute_robot_state-npc2_mean 0.004548566481487481 sim_compute_robot_state-npc2_median 0.004537865800677605 sim_compute_robot_state-npc2_min 0.004522907032686122 sim_compute_robot_state-npc3_max 0.004596716091956621 sim_compute_robot_state-npc3_mean 0.0045385112497565395 sim_compute_robot_state-npc3_median 0.004534887817670715 sim_compute_robot_state-npc3_min 0.004499126883114085 sim_compute_sim_state_max 0.0028584945349045742 sim_compute_sim_state_mean 0.002841007363009797 sim_compute_sim_state_median 0.002843957788803998 sim_compute_sim_state_min 0.0028250757253394936 sim_physics_max 0.12036763079026166 sim_physics_mean 0.11396745614421462 sim_physics_median 0.11232941533312384 sim_physics_min 0.10810348192850748 sim_render-ego_max 0.007294301633481626 sim_render-ego_mean 0.0071818407078491605 sim_render-ego_median 0.007167754453771254 sim_render-ego_min 0.00711163246270382 simulation-passed 1 survival_time_max 5.999999999999987 survival_time_mean 4.579999999999991 survival_time_min 3.2999999999999963
No reset possible 292585689c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1340177321439595 survival_time_median 4.899999999999991 deviation-center-line_median 0.26159104171307546 in-drivable-lane_median 0.5499999999999989
other stats agent_compute-ego_max 0.016739193190876234 agent_compute-ego_mean 0.015828048085320606 agent_compute-ego_median 0.015809304492418155 agent_compute-ego_min 0.015245812279837472 deviation-center-line_max 0.5582805719007031 deviation-center-line_mean 0.31021392392258845 deviation-center-line_min 0.18919692921063355 deviation-heading_max 2.6365124597811884 deviation-heading_mean 1.5288263048598676 deviation-heading_median 1.491294588143928 deviation-heading_min 0.9903252867405172 driven_any_max 2.9016693406667775 driven_any_mean 1.738455252306225 driven_any_median 1.5876911487792216 driven_any_min 1.0856778413651 driven_lanedir_consec_max 2.48913092446663 driven_lanedir_consec_mean 1.4387585400083511 driven_lanedir_consec_min 0.8120044492001306 driven_lanedir_max 2.48913092446663 driven_lanedir_mean 1.4387585400083511 driven_lanedir_median 1.1340177321439595 driven_lanedir_min 0.8120044492001306 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.5599999999999982 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9218277088475817, "sim_physics": 0.059972261771177635, "survival_time": 5.849999999999987, "driven_lanedir": 1.7455260470656524, "sim_render-ego": 0.007050410295144105, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.016739193190876234, "deviation-heading": 1.5074785904904977, "set_robot_commands": 0.007418811830699953, "deviation-center-line": 0.2301953747235941, "driven_lanedir_consec": 1.7455260470656524, "sim_compute_sim_state": 0.0036714749458508617, "sim_compute_performance-ego": 0.004174426070645324, "sim_compute_robot_state-ego": 0.005206949690468291}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5876911487792216, "sim_physics": 0.057411955327403785, "survival_time": 4.899999999999991, "driven_lanedir": 1.1340177321439595, "sim_render-ego": 0.007156554533510792, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.015245812279837472, "deviation-heading": 1.491294588143928, "set_robot_commands": 0.006626574360594458, "deviation-center-line": 0.3118057020649359, "driven_lanedir_consec": 1.1340177321439595, "sim_compute_sim_state": 0.0032735454792879068, "sim_compute_performance-ego": 0.003966204974116112, "sim_compute_robot_state-ego": 0.005078101644710619}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9016693406667775, "sim_physics": 0.05362192281456881, "survival_time": 8.599999999999987, "driven_lanedir": 2.48913092446663, "sim_render-ego": 0.008046420507652814, "in-drivable-lane": 0.5499999999999989, "agent_compute-ego": 0.015809304492418155, "deviation-heading": 2.6365124597811884, "set_robot_commands": 0.007102163725121077, "deviation-center-line": 0.5582805719007031, "driven_lanedir_consec": 2.48913092446663, "sim_compute_sim_state": 0.0035696376201718354, "sim_compute_performance-ego": 0.004014562728793122, "sim_compute_robot_state-ego": 0.005207399989283362}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1954102218724445, "sim_physics": 0.05850981458832946, "survival_time": 3.949999999999994, "driven_lanedir": 0.8120044492001306, "sim_render-ego": 0.007195345963103862, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.015816489352455623, "deviation-heading": 1.0185205991432067, "set_robot_commands": 0.006904061836532399, "deviation-center-line": 0.18919692921063355, "driven_lanedir_consec": 0.8120044492001306, "sim_compute_sim_state": 0.003582537928714028, "sim_compute_performance-ego": 0.004014075556887856, "sim_compute_robot_state-ego": 0.005206340475927425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0856778413651, "sim_physics": 0.05705745292432381, "survival_time": 3.2999999999999963, "driven_lanedir": 1.013113547165385, "sim_render-ego": 0.00716963681307706, "in-drivable-lane": 0, "agent_compute-ego": 0.01552944111101555, "deviation-heading": 0.9903252867405172, "set_robot_commands": 0.0068858392310865, "deviation-center-line": 0.26159104171307546, "driven_lanedir_consec": 1.013113547165385, "sim_compute_sim_state": 0.0034249840360699277, "sim_compute_performance-ego": 0.0039933847658561936, "sim_compute_robot_state-ego": 0.005073879704330907}}set_robot_commands_max 0.007418811830699953 set_robot_commands_mean 0.006987490196806877 set_robot_commands_median 0.006904061836532399 set_robot_commands_min 0.006626574360594458 sim_compute_performance-ego_max 0.004174426070645324 sim_compute_performance-ego_mean 0.004032530819259722 sim_compute_performance-ego_median 0.004014075556887856 sim_compute_performance-ego_min 0.003966204974116112 sim_compute_robot_state-ego_max 0.005207399989283362 sim_compute_robot_state-ego_mean 0.005154534300944121 sim_compute_robot_state-ego_median 0.005206340475927425 sim_compute_robot_state-ego_min 0.005073879704330907 sim_compute_sim_state_max 0.0036714749458508617 sim_compute_sim_state_mean 0.0035044360020189116 sim_compute_sim_state_median 0.0035696376201718354 sim_compute_sim_state_min 0.0032735454792879068 sim_physics_max 0.059972261771177635 sim_physics_mean 0.0573146814851607 sim_physics_median 0.057411955327403785 sim_physics_min 0.05362192281456881 sim_render-ego_max 0.008046420507652814 sim_render-ego_mean 0.007323673622497727 sim_render-ego_median 0.00716963681307706 sim_render-ego_min 0.007050410295144105 simulation-passed 1 survival_time_max 8.599999999999987 survival_time_mean 5.319999999999991 survival_time_min 3.2999999999999963
No reset possible 292495683c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.4941684041389958 survival_time_median 14.950000000000076 deviation-center-line_median 0.4427941135381015 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.017007396489686934 agent_compute-ego_mean 0.01630032338108762 agent_compute-ego_median 0.016174422899882 agent_compute-ego_min 0.015616429646809897 deviation-center-line_max 1.0842817576573025 deviation-center-line_mean 0.5883942864288947 deviation-center-line_min 0.40303112938709335 deviation-heading_max 4.28355634549975 deviation-heading_mean 2.582396700676907 deviation-heading_median 2.146172647036988 deviation-heading_min 1.724012454291884 driven_any_max 2.514114612307685 driven_any_mean 1.8362708352622936 driven_any_median 1.6848812466880667 driven_any_min 1.4729459930718656 driven_lanedir_consec_max 2.4927383193805897 driven_lanedir_consec_mean 1.7509175649835769 driven_lanedir_consec_min 1.3617097224537216 driven_lanedir_max 2.4927383193805897 driven_lanedir_mean 1.7599286236175693 driven_lanedir_median 1.4941684041389958 driven_lanedir_min 1.406765015623685 in-drivable-lane_max 1.0000000000000142 in-drivable-lane_mean 0.20000000000000284 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5274549943444509, "sim_physics": 0.056937735080719, "survival_time": 14.950000000000076, "driven_lanedir": 1.4941684041389958, "sim_render-ego": 0.006998984813690185, "in-drivable-lane": 0, "agent_compute-ego": 0.016174422899882, "deviation-heading": 2.660185468300403, "set_robot_commands": 0.007067639032999675, "deviation-center-line": 0.5718555926459196, "driven_lanedir_consec": 1.4941684041389958, "sim_compute_sim_state": 0.003782846132914225, "sim_compute_performance-ego": 0.004095425605773926, "sim_compute_robot_state-ego": 0.005145435333251953}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9819573298993989, "sim_physics": 0.0556358003616333, "survival_time": 14.950000000000076, "driven_lanedir": 1.9520388319548616, "sim_render-ego": 0.007148789564768473, "in-drivable-lane": 0, "agent_compute-ego": 0.01578516880671183, "deviation-heading": 2.146172647036988, "set_robot_commands": 0.007091397444407145, "deviation-center-line": 0.40303112938709335, "driven_lanedir_consec": 1.9520388319548616, "sim_compute_sim_state": 0.0038009389241536458, "sim_compute_performance-ego": 0.004019593397776286, "sim_compute_robot_state-ego": 0.005147383213043213}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.4729459930718656, "sim_physics": 0.056300105253855384, "survival_time": 14.950000000000076, "driven_lanedir": 1.453932546989714, "sim_render-ego": 0.007086092631022135, "in-drivable-lane": 0, "agent_compute-ego": 0.015616429646809897, "deviation-heading": 2.0980565882555107, "set_robot_commands": 0.007198093732198079, "deviation-center-line": 1.0842817576573025, "driven_lanedir_consec": 1.453932546989714, "sim_compute_sim_state": 0.0037747804323832192, "sim_compute_performance-ego": 0.0040073808034261065, "sim_compute_robot_state-ego": 0.005182525316874186}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6848812466880667, "sim_physics": 0.058702210110609034, "survival_time": 14.650000000000071, "driven_lanedir": 1.406765015623685, "sim_render-ego": 0.007162243839823752, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.017007396489686934, "deviation-heading": 4.28355634549975, "set_robot_commands": 0.007173693627627637, "deviation-center-line": 0.4427941135381015, "driven_lanedir_consec": 1.3617097224537216, "sim_compute_sim_state": 0.0037584142066512905, "sim_compute_performance-ego": 0.0040461854316268765, "sim_compute_robot_state-ego": 0.0052227249731382815}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.514114612307685, "sim_physics": 0.057495386600494386, "survival_time": 14.950000000000076, "driven_lanedir": 2.4927383193805897, "sim_render-ego": 0.007102064291636149, "in-drivable-lane": 0, "agent_compute-ego": 0.016918199062347414, "deviation-heading": 1.724012454291884, "set_robot_commands": 0.007082783381144206, "deviation-center-line": 0.44000883891605685, "driven_lanedir_consec": 2.4927383193805897, "sim_compute_sim_state": 0.003749744097391765, "sim_compute_performance-ego": 0.0040299336115519205, "sim_compute_robot_state-ego": 0.005163600444793701}}set_robot_commands_max 0.007198093732198079 set_robot_commands_mean 0.007122721443675348 set_robot_commands_median 0.007091397444407145 set_robot_commands_min 0.007067639032999675 sim_compute_performance-ego_max 0.004095425605773926 sim_compute_performance-ego_mean 0.004039703770031023 sim_compute_performance-ego_median 0.0040299336115519205 sim_compute_performance-ego_min 0.0040073808034261065 sim_compute_robot_state-ego_max 0.0052227249731382815 sim_compute_robot_state-ego_mean 0.005172333856220267 sim_compute_robot_state-ego_median 0.005163600444793701 sim_compute_robot_state-ego_min 0.005145435333251953 sim_compute_sim_state_max 0.0038009389241536458 sim_compute_sim_state_mean 0.0037733447586988287 sim_compute_sim_state_median 0.0037747804323832192 sim_compute_sim_state_min 0.003749744097391765 sim_physics_max 0.058702210110609034 sim_physics_mean 0.05701424748146222 sim_physics_median 0.056937735080719 sim_physics_min 0.0556358003616333 sim_render-ego_max 0.007162243839823752 sim_render-ego_mean 0.007099635028188139 sim_render-ego_median 0.007102064291636149 sim_render-ego_min 0.006998984813690185 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.890000000000075 survival_time_min 14.650000000000071
No reset possible 292035645Frank (Chude) Qian 2019-12-05|FrankNet|v3 aido3-LF-real-validationeval1-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 4.470740341604036 survival_time 43.1333 deviation-center-line 1.437547289020481 in-drivable-lane 25.3332
other stats deviation-heading 5.601858677142141 driven_any 13.797444488627535 driven_lanedir 4.470740341604036 visualized-eval1-passed 1
No reset possible 292025639Frank (Chude) Qian 2019-12-05|FrankNet|v3 aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.641443583664446 survival_time_median 14.950000000000076 deviation-center-line_median 0.917481333798772 in-drivable-lane_median 2.4000000000000243
other stats agent_compute-ego_max 0.041635639667510986 agent_compute-ego_mean 0.04105823071797689 agent_compute-ego_median 0.040795571009318035 agent_compute-ego_min 0.040631224314371744 deviation-center-line_max 1.1315230562948178 deviation-center-line_mean 0.9655728855210638 deviation-center-line_min 0.8782760131011657 deviation-heading_max 3.93115484619445 deviation-heading_mean 3.2505139328978663 deviation-heading_median 3.379422575017064 deviation-heading_min 2.38139239669968 driven_any_max 6.504525269489982 driven_any_mean 5.606802522692976 driven_any_median 5.486532934456067 driven_any_min 4.910157621533325 driven_lanedir_consec_max 5.464541542965846 driven_lanedir_consec_mean 4.615322036551644 driven_lanedir_consec_min 3.7878417211458584 driven_lanedir_max 5.464541542965846 driven_lanedir_mean 4.615322036551644 driven_lanedir_median 4.641443583664446 driven_lanedir_min 3.7878417211458584 in-drivable-lane_max 4.000000000000034 in-drivable-lane_mean 2.3500000000000187 in-drivable-lane_min 0.5000000000000071 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.910157621533325, "sim_physics": 0.055040173530578614, "survival_time": 14.950000000000076, "driven_lanedir": 4.641443583664446, "sim_render-ego": 0.006981505552927653, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.041635639667510986, "deviation-heading": 2.8796864795704114, "set_robot_commands": 0.005027174949645996, "deviation-center-line": 1.1315230562948178, "driven_lanedir_consec": 4.641443583664446, "sim_compute_sim_state": 0.002940534750620524, "sim_compute_performance-ego": 0.004026469389597575, "sim_compute_robot_state-ego": 0.005139129161834717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.983684972565502, "sim_physics": 0.05678574482599894, "survival_time": 14.950000000000076, "driven_lanedir": 3.7878417211458584, "sim_render-ego": 0.0070185105005900065, "in-drivable-lane": 2.4000000000000243, "agent_compute-ego": 0.040795571009318035, "deviation-heading": 3.680913367007729, "set_robot_commands": 0.004917193253835043, "deviation-center-line": 1.0015159068179276, "driven_lanedir_consec": 3.7878417211458584, "sim_compute_sim_state": 0.0029239455858866372, "sim_compute_performance-ego": 0.003915825684865316, "sim_compute_robot_state-ego": 0.005066190560658773}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.504525269489982, "sim_physics": 0.05480610847473145, "survival_time": 14.950000000000076, "driven_lanedir": 5.0936476754268885, "sim_render-ego": 0.007080219586690267, "in-drivable-lane": 3.300000000000008, "agent_compute-ego": 0.04066149393717448, "deviation-heading": 2.38139239669968, "set_robot_commands": 0.005017760594685872, "deviation-center-line": 0.8782760131011657, "driven_lanedir_consec": 5.0936476754268885, "sim_compute_sim_state": 0.002969770431518555, "sim_compute_performance-ego": 0.003981726964314779, "sim_compute_robot_state-ego": 0.0051070491472880045}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 6.149111815420005, "sim_physics": 0.054378932317097985, "survival_time": 14.950000000000076, "driven_lanedir": 5.464541542965846, "sim_render-ego": 0.00710445245107015, "in-drivable-lane": 1.5500000000000211, "agent_compute-ego": 0.041567224661509194, "deviation-heading": 3.379422575017064, "set_robot_commands": 0.004953054587046305, "deviation-center-line": 0.8990681175926366, "driven_lanedir_consec": 5.464541542965846, "sim_compute_sim_state": 0.0029448533058166505, "sim_compute_performance-ego": 0.00395712931950887, "sim_compute_robot_state-ego": 0.005134981473286946}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.486532934456067, "sim_physics": 0.05654971996943156, "survival_time": 14.950000000000076, "driven_lanedir": 4.0891356595551835, "sim_render-ego": 0.007037247816721598, "in-drivable-lane": 4.000000000000034, "agent_compute-ego": 0.040631224314371744, "deviation-heading": 3.93115484619445, "set_robot_commands": 0.004968574047088623, "deviation-center-line": 0.917481333798772, "driven_lanedir_consec": 4.0891356595551835, "sim_compute_sim_state": 0.0029413151741027833, "sim_compute_performance-ego": 0.0039475758870442705, "sim_compute_robot_state-ego": 0.0051107311248779295}}set_robot_commands_max 0.005027174949645996 set_robot_commands_mean 0.004976751486460368 set_robot_commands_median 0.004968574047088623 set_robot_commands_min 0.004917193253835043 sim_compute_performance-ego_max 0.004026469389597575 sim_compute_performance-ego_mean 0.0039657454490661615 sim_compute_performance-ego_median 0.00395712931950887 sim_compute_performance-ego_min 0.003915825684865316 sim_compute_robot_state-ego_max 0.005139129161834717 sim_compute_robot_state-ego_mean 0.005111616293589273 sim_compute_robot_state-ego_median 0.0051107311248779295 sim_compute_robot_state-ego_min 0.005066190560658773 sim_compute_sim_state_max 0.002969770431518555 sim_compute_sim_state_mean 0.00294408384958903 sim_compute_sim_state_median 0.0029413151741027833 sim_compute_sim_state_min 0.0029239455858866372 sim_physics_max 0.05678574482599894 sim_physics_mean 0.05551213582356771 sim_physics_median 0.055040173530578614 sim_physics_min 0.054378932317097985 sim_render-ego_max 0.00710445245107015 sim_render-ego_mean 0.007044387181599936 sim_render-ego_median 0.007037247816721598 sim_render-ego_min 0.006981505552927653 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 291884185Liam Paull challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 291745555Mikita Sazanovich chameleon-4 aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 291585661Mikita Sazanovich chameleon-09-trio aido3-LFVI-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:11:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.9845529820155232 survival_time_median 7.149999999999983 deviation-center-line_median 0.35889462015546636 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.16479959207422593 agent_compute-ego_mean 0.16311912803916012 agent_compute-ego_median 0.16275497583242562 agent_compute-ego_min 0.16164252161979675 deviation-center-line_max 0.7848503217422887 deviation-center-line_mean 0.4312715654009483 deviation-center-line_min 0.24747886822034412 deviation-heading_max 5.237204355240986 deviation-heading_mean 2.3600016816810685 deviation-heading_median 1.7518379487237223 deviation-heading_min 1.0164810053249296 driven_any_max 3.741062511563668 driven_any_mean 2.566592828002855 driven_any_median 2.302155207495742 driven_any_min 1.1859979677040218 driven_lanedir_consec_max 3.4524935297863224 driven_lanedir_consec_mean 2.1372908759780844 driven_lanedir_consec_min 1.0658622058004024 driven_lanedir_max 3.455546553212058 driven_lanedir_mean 2.212840888838301 driven_lanedir_median 2.259156865767781 driven_lanedir_min 1.0658622058004024 in-drivable-lane_max 2.0500000000000087 in-drivable-lane_mean 0.8300000000000003 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 3.741062511563668, "sim_physics": 0.1284711631139119, "survival_time": 14.950000000000076, "driven_lanedir": 2.992833319586873, "sim_render-ego": 0.007100411256154378, "in-drivable-lane": 2.0500000000000087, "agent_compute-ego": 0.16274890343348186, "deviation-heading": 5.237204355240986, "set_robot_commands": 0.004988537629445394, "deviation-center-line": 0.7848503217422887, "driven_lanedir_consec": 2.892740162463785, "sim_compute_sim_state": 0.0028990864753723144, "sim_compute_performance-ego": 0.0039430324236551925, "sim_compute_robot_state-ego": 0.0051188453038533525, "sim_compute_robot_state-npc0": 0.004877534707387289, "sim_compute_robot_state-npc1": 0.004592961470286052, "sim_compute_robot_state-npc2": 0.004568827946980794, "sim_compute_robot_state-npc3": 0.004553398291269938}, "udem1-1-0": {"driven_any": 2.056560921400618, "sim_physics": 0.13097633848657142, "survival_time": 7.149999999999983, "driven_lanedir": 1.29080549982439, "sim_render-ego": 0.007186479501790933, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16275497583242562, "deviation-heading": 1.7518379487237223, "set_robot_commands": 0.0050022018539322005, "deviation-center-line": 0.24747886822034412, "driven_lanedir_consec": 1.29080549982439, "sim_compute_sim_state": 0.0028584453609439876, "sim_compute_performance-ego": 0.0039242431000396085, "sim_compute_robot_state-ego": 0.005118756861119837, "sim_compute_robot_state-npc0": 0.004870609803633256, "sim_compute_robot_state-npc1": 0.0045906797155633675, "sim_compute_robot_state-npc2": 0.0045582281126009, "sim_compute_robot_state-npc3": 0.004525202971238356}, "udem1-2-0": {"driven_any": 1.1859979677040218, "sim_physics": 0.105986174609926, "survival_time": 3.599999999999995, "driven_lanedir": 1.0658622058004024, "sim_render-ego": 0.007194280624389648, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.16164252161979675, "deviation-heading": 1.0164810053249296, "set_robot_commands": 0.004962368143929375, "deviation-center-line": 0.2880546252081092, "driven_lanedir_consec": 1.0658622058004024, "sim_compute_sim_state": 0.00288633836640252, "sim_compute_performance-ego": 0.003951284620496962, "sim_compute_robot_state-ego": 0.005159748925103081, "sim_compute_robot_state-npc0": 0.0048288073804643415, "sim_compute_robot_state-npc1": 0.004560013612111409, "sim_compute_robot_state-npc2": 0.004534721374511719, "sim_compute_robot_state-npc3": 0.004531519280539619}, "udem1-3-0": {"driven_any": 2.302155207495742, "sim_physics": 0.11493294379290411, "survival_time": 6.799999999999984, "driven_lanedir": 2.259156865767781, "sim_render-ego": 0.007265133016249712, "in-drivable-lane": 0, "agent_compute-ego": 0.16479959207422593, "deviation-heading": 1.0253130057123052, "set_robot_commands": 0.005024494493708891, "deviation-center-line": 0.35889462015546636, "driven_lanedir_consec": 1.9845529820155232, "sim_compute_sim_state": 0.002914681154138902, "sim_compute_performance-ego": 0.004014064283931956, "sim_compute_robot_state-ego": 0.00520292275092181, "sim_compute_robot_state-npc0": 0.004903048276901245, "sim_compute_robot_state-npc1": 0.004606648403055528, "sim_compute_robot_state-npc2": 0.0045937737997840435, "sim_compute_robot_state-npc3": 0.0045835305662716135}, "udem1-4-0": {"driven_any": 3.5471875318502253, "sim_physics": 0.12877174933751423, "survival_time": 14.950000000000076, "driven_lanedir": 3.455546553212058, "sim_render-ego": 0.007086371580759684, "in-drivable-lane": 0, "agent_compute-ego": 0.16364964723587036, "deviation-heading": 2.7691720934033968, "set_robot_commands": 0.00504069725672404, "deviation-center-line": 0.4770793916785331, "driven_lanedir_consec": 3.4524935297863224, "sim_compute_sim_state": 0.0028762261072794596, "sim_compute_performance-ego": 0.003948423067728678, "sim_compute_robot_state-ego": 0.005161686738332113, "sim_compute_robot_state-npc0": 0.004899333318074545, "sim_compute_robot_state-npc1": 0.004586126804351807, "sim_compute_robot_state-npc2": 0.004559847513834635, "sim_compute_robot_state-npc3": 0.004555095831553141}}set_robot_commands_max 0.00504069725672404 set_robot_commands_mean 0.00500365987554798 set_robot_commands_median 0.0050022018539322005 set_robot_commands_min 0.004962368143929375 sim_compute_performance-ego_max 0.004014064283931956 sim_compute_performance-ego_mean 0.00395620949917048 sim_compute_performance-ego_median 0.003948423067728678 sim_compute_performance-ego_min 0.0039242431000396085 sim_compute_robot_state-ego_max 0.00520292275092181 sim_compute_robot_state-ego_mean 0.005152392115866039 sim_compute_robot_state-ego_median 0.005159748925103081 sim_compute_robot_state-ego_min 0.005118756861119837 sim_compute_robot_state-npc0_max 0.004903048276901245 sim_compute_robot_state-npc0_mean 0.004875866697292135 sim_compute_robot_state-npc0_median 0.004877534707387289 sim_compute_robot_state-npc0_min 0.0048288073804643415 sim_compute_robot_state-npc1_max 0.004606648403055528 sim_compute_robot_state-npc1_mean 0.004587286001073632 sim_compute_robot_state-npc1_median 0.0045906797155633675 sim_compute_robot_state-npc1_min 0.004560013612111409 sim_compute_robot_state-npc2_max 0.0045937737997840435 sim_compute_robot_state-npc2_mean 0.004563079749542419 sim_compute_robot_state-npc2_median 0.004559847513834635 sim_compute_robot_state-npc2_min 0.004534721374511719 sim_compute_robot_state-npc3_max 0.0045835305662716135 sim_compute_robot_state-npc3_mean 0.004549749388174534 sim_compute_robot_state-npc3_median 0.004553398291269938 sim_compute_robot_state-npc3_min 0.004525202971238356 sim_compute_sim_state_max 0.002914681154138902 sim_compute_sim_state_mean 0.0028869554928274365 sim_compute_sim_state_median 0.00288633836640252 sim_compute_sim_state_min 0.0028584453609439876 sim_physics_max 0.13097633848657142 sim_physics_mean 0.12182767386816554 sim_physics_median 0.1284711631139119 sim_physics_min 0.105986174609926 sim_render-ego_max 0.007265133016249712 sim_render-ego_mean 0.007166535195868871 sim_render-ego_median 0.007186479501790933 sim_render-ego_min 0.007086371580759684 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.490000000000023 survival_time_min 3.599999999999995
No reset possible 291505659Mikita Sazanovich chameleon-09-trio aido3-LFV-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:16:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.1902330209762324 survival_time_median 14.950000000000076 deviation-center-line_median 0.808087721634713 in-drivable-lane_median 2.750000000000039
other stats agent_compute-ego_max 0.1651125939687093 agent_compute-ego_mean 0.16431344048182167 agent_compute-ego_median 0.16402190764745075 agent_compute-ego_min 0.1634572164217631 deviation-center-line_max 0.91526796079117 deviation-center-line_mean 0.775600667806456 deviation-center-line_min 0.5027068126061878 deviation-heading_max 4.716086646809328 deviation-heading_mean 4.079779818633889 deviation-heading_median 4.20333253210602 deviation-heading_min 3.286357989647771 driven_any_max 4.2486196288703875 driven_any_mean 3.8494197712660982 driven_any_median 3.9155114577676815 driven_any_min 3.3619813298880006 driven_lanedir_consec_max 3.311992405566879 driven_lanedir_consec_mean 2.7882873502538046 driven_lanedir_consec_min 1.229981769048592 driven_lanedir_max 3.311992405566879 driven_lanedir_mean 2.9696574077028144 driven_lanedir_median 3.1902330209762324 driven_lanedir_min 2.136832056293639 in-drivable-lane_max 4.499999999999984 in-drivable-lane_mean 2.5600000000000103 in-drivable-lane_min 1.0000000000000142 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.1592414176291665, "sim_physics": 0.10099427143732707, "survival_time": 14.950000000000076, "driven_lanedir": 3.0080796327183377, "sim_render-ego": 0.006987346013387044, "in-drivable-lane": 3.450000000000017, "agent_compute-ego": 0.16498272895812988, "deviation-heading": 4.20333253210602, "set_robot_commands": 0.0050616788864135745, "deviation-center-line": 0.808087721634713, "driven_lanedir_consec": 3.0080796327183377, "sim_compute_sim_state": 0.0028534928957621255, "sim_compute_performance-ego": 0.003968955675760905, "sim_compute_robot_state-ego": 0.005174171129862467, "sim_compute_robot_state-npc0": 0.004952410856882731, "sim_compute_robot_state-npc1": 0.004598756631215413, "sim_compute_robot_state-npc2": 0.004581829706827799, "sim_compute_robot_state-npc3": 0.0045673505465189616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3619813298880006, "sim_physics": 0.1130646808942159, "survival_time": 14.950000000000076, "driven_lanedir": 2.136832056293639, "sim_render-ego": 0.0069807823499043785, "in-drivable-lane": 4.499999999999984, "agent_compute-ego": 0.1634572164217631, "deviation-heading": 3.286357989647771, "set_robot_commands": 0.005048455397288005, "deviation-center-line": 0.5027068126061878, "driven_lanedir_consec": 1.229981769048592, "sim_compute_sim_state": 0.002844603061676025, "sim_compute_performance-ego": 0.0039446226755777995, "sim_compute_robot_state-ego": 0.00514509121576945, "sim_compute_robot_state-npc0": 0.004940959612528483, "sim_compute_robot_state-npc1": 0.004598140716552734, "sim_compute_robot_state-npc2": 0.00457820971806844, "sim_compute_robot_state-npc3": 0.004544643561045328}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.561745022175257, "sim_physics": 0.09972687562306722, "survival_time": 14.950000000000076, "driven_lanedir": 3.1902330209762324, "sim_render-ego": 0.007010055383046468, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.16402190764745075, "deviation-heading": 3.7448168804338895, "set_robot_commands": 0.005136447747548421, "deviation-center-line": 0.91526796079117, "driven_lanedir_consec": 3.1902330209762324, "sim_compute_sim_state": 0.002870926062266032, "sim_compute_performance-ego": 0.003954433600107829, "sim_compute_robot_state-ego": 0.005183298587799073, "sim_compute_robot_state-npc0": 0.004986662069956462, "sim_compute_robot_state-npc1": 0.0046340060234069825, "sim_compute_robot_state-npc2": 0.004606475035349528, "sim_compute_robot_state-npc3": 0.004611167907714844}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.2486196288703875, "sim_physics": 0.10555543820063272, "survival_time": 14.950000000000076, "driven_lanedir": 3.201149922958984, "sim_render-ego": 0.0069742091496785485, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.1639927554130554, "deviation-heading": 4.448305044172435, "set_robot_commands": 0.005032491683959961, "deviation-center-line": 0.7486747397862863, "driven_lanedir_consec": 3.201149922958984, "sim_compute_sim_state": 0.00285566250483195, "sim_compute_performance-ego": 0.003924562931060791, "sim_compute_robot_state-ego": 0.005164912541707357, "sim_compute_robot_state-npc0": 0.004973693688710531, "sim_compute_robot_state-npc1": 0.0046057581901550295, "sim_compute_robot_state-npc2": 0.004568227926890055, "sim_compute_robot_state-npc3": 0.0045804468790690105}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.9155114577676815, "sim_physics": 0.10401578187942503, "survival_time": 14.950000000000076, "driven_lanedir": 3.311992405566879, "sim_render-ego": 0.007119571367899577, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1651125939687093, "deviation-heading": 4.716086646809328, "set_robot_commands": 0.005104668935139974, "deviation-center-line": 0.9032661042139224, "driven_lanedir_consec": 3.311992405566879, "sim_compute_sim_state": 0.0028612907727559407, "sim_compute_performance-ego": 0.004006948471069336, "sim_compute_robot_state-ego": 0.005219927628835042, "sim_compute_robot_state-npc0": 0.0050126926104227705, "sim_compute_robot_state-npc1": 0.0046601208051045735, "sim_compute_robot_state-npc2": 0.004610830942789713, "sim_compute_robot_state-npc3": 0.004592963059743245}}set_robot_commands_max 0.005136447747548421 set_robot_commands_mean 0.005076748530069987 set_robot_commands_median 0.0050616788864135745 set_robot_commands_min 0.005032491683959961 sim_compute_performance-ego_max 0.004006948471069336 sim_compute_performance-ego_mean 0.0039599046707153324 sim_compute_performance-ego_median 0.003954433600107829 sim_compute_performance-ego_min 0.003924562931060791 sim_compute_robot_state-ego_max 0.005219927628835042 sim_compute_robot_state-ego_mean 0.005177480220794678 sim_compute_robot_state-ego_median 0.005174171129862467 sim_compute_robot_state-ego_min 0.00514509121576945 sim_compute_robot_state-npc0_max 0.0050126926104227705 sim_compute_robot_state-npc0_mean 0.004973283767700195 sim_compute_robot_state-npc0_median 0.004973693688710531 sim_compute_robot_state-npc0_min 0.004940959612528483 sim_compute_robot_state-npc1_max 0.0046601208051045735 sim_compute_robot_state-npc1_mean 0.004619356473286947 sim_compute_robot_state-npc1_median 0.0046057581901550295 sim_compute_robot_state-npc1_min 0.004598140716552734 sim_compute_robot_state-npc2_max 0.004610830942789713 sim_compute_robot_state-npc2_mean 0.004589114665985107 sim_compute_robot_state-npc2_median 0.004581829706827799 sim_compute_robot_state-npc2_min 0.004568227926890055 sim_compute_robot_state-npc3_max 0.004611167907714844 sim_compute_robot_state-npc3_mean 0.004579314390818277 sim_compute_robot_state-npc3_median 0.0045804468790690105 sim_compute_robot_state-npc3_min 0.004544643561045328 sim_compute_sim_state_max 0.002870926062266032 sim_compute_sim_state_mean 0.002857195059458414 sim_compute_sim_state_median 0.00285566250483195 sim_compute_sim_state_min 0.002844603061676025 sim_physics_max 0.1130646808942159 sim_physics_mean 0.1046714096069336 sim_physics_median 0.10401578187942503 sim_physics_min 0.09972687562306722 sim_render-ego_max 0.007119571367899577 sim_render-ego_mean 0.007014392852783204 sim_render-ego_median 0.006987346013387044 sim_render-ego_min 0.0069742091496785485 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 291375637Mikita Sazanovich chameleon-09 aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:26:21 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 291235640Frank (Chude) Qian 2019-12-05|FrankNet|v3 aido3-LFV-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:16:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.116310457025076 survival_time_median 5.799999999999987 deviation-center-line_median 0.24705605770444788 in-drivable-lane_median 1.8999999999999932
other stats agent_compute-ego_max 0.08217922290166219 agent_compute-ego_mean 0.07614296901412829 agent_compute-ego_median 0.07782080781226065 agent_compute-ego_min 0.0680030091603597 deviation-center-line_max 0.9527793504933192 deviation-center-line_mean 0.4613533372890486 deviation-center-line_min 0.06808781145969384 deviation-heading_max 3.185698072827735 deviation-heading_mean 1.5186937959028404 deviation-heading_median 1.214580322721336 deviation-heading_min 0.3559430973407145 driven_any_max 5.705788338387051 driven_any_mean 2.8708727376679057 driven_any_median 1.9506906803550632 driven_any_min 1.0053730501914406 driven_lanedir_consec_max 4.643754389688036 driven_lanedir_consec_mean 2.203581017275468 driven_lanedir_consec_min 0.35028496111657104 driven_lanedir_max 4.643754389688036 driven_lanedir_mean 2.203581017275468 driven_lanedir_median 1.116310457025076 driven_lanedir_min 0.35028496111657104 in-drivable-lane_max 2.400000000000028 in-drivable-lane_mean 1.8000000000000014 in-drivable-lane_min 0.6499999999999977 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9506906803550632, "sim_physics": 0.1998840406023223, "survival_time": 5.799999999999987, "driven_lanedir": 1.116310457025076, "sim_render-ego": 0.012877595835718614, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.07473645950185842, "deviation-heading": 1.214580322721336, "set_robot_commands": 0.009172445741193047, "deviation-center-line": 0.24705605770444788, "driven_lanedir_consec": 1.116310457025076, "sim_compute_sim_state": 0.005227976831896552, "sim_compute_performance-ego": 0.007369769030603869, "sim_compute_robot_state-ego": 0.009794876493256667, "sim_compute_robot_state-npc0": 0.00858836132904579, "sim_compute_robot_state-npc1": 0.008558053394843793, "sim_compute_robot_state-npc2": 0.00852641771579611, "sim_compute_robot_state-npc3": 0.008459066522532496}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0053730501914406, "sim_physics": 0.17373220443725587, "survival_time": 3.7499999999999942, "driven_lanedir": 0.615610933617333, "sim_render-ego": 0.01199941635131836, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0680030091603597, "deviation-heading": 0.3559430973407145, "set_robot_commands": 0.009648316701253256, "deviation-center-line": 0.15295894273967686, "driven_lanedir_consec": 0.615610933617333, "sim_compute_sim_state": 0.005010433197021484, "sim_compute_performance-ego": 0.007055273056030273, "sim_compute_robot_state-ego": 0.009104992548624674, "sim_compute_robot_state-npc0": 0.008806438446044921, "sim_compute_robot_state-npc1": 0.008307113647460937, "sim_compute_robot_state-npc2": 0.008757979075113932, "sim_compute_robot_state-npc3": 0.008447958628336588}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.705788338387051, "sim_physics": 0.2187339989344279, "survival_time": 14.950000000000076, "driven_lanedir": 4.643754389688036, "sim_render-ego": 0.012487343152364097, "in-drivable-lane": 2.400000000000028, "agent_compute-ego": 0.08217922290166219, "deviation-heading": 3.185698072827735, "set_robot_commands": 0.009990300337473551, "deviation-center-line": 0.8858845240481051, "driven_lanedir_consec": 4.643754389688036, "sim_compute_sim_state": 0.005354405244191488, "sim_compute_performance-ego": 0.00738250732421875, "sim_compute_robot_state-ego": 0.009260031382242838, "sim_compute_robot_state-npc0": 0.008969523111979167, "sim_compute_robot_state-npc1": 0.008939711252848308, "sim_compute_robot_state-npc2": 0.008832518259684246, "sim_compute_robot_state-npc3": 0.008757127920786539}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.659028185925578, "sim_physics": 0.19824528226665425, "survival_time": 12.750000000000046, "driven_lanedir": 4.291944344930324, "sim_render-ego": 0.012112223868276558, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.07782080781226065, "deviation-heading": 2.4387083412320267, "set_robot_commands": 0.009806898528454353, "deviation-center-line": 0.9527793504933192, "driven_lanedir_consec": 4.291944344930324, "sim_compute_sim_state": 0.00515137279734892, "sim_compute_performance-ego": 0.0071788918738271675, "sim_compute_robot_state-ego": 0.009231074651082355, "sim_compute_robot_state-npc0": 0.00869903564453125, "sim_compute_robot_state-npc1": 0.008605318443447935, "sim_compute_robot_state-npc2": 0.008837251102223116, "sim_compute_robot_state-npc3": 0.008731628866756663}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0334834334803944, "sim_physics": 0.2284691022789997, "survival_time": 3.4499999999999957, "driven_lanedir": 0.35028496111657104, "sim_render-ego": 0.013011002886122553, "in-drivable-lane": 2.1999999999999953, "agent_compute-ego": 0.07797534569450047, "deviation-heading": 0.39853914539238894, "set_robot_commands": 0.010310010633606842, "deviation-center-line": 0.06808781145969384, "driven_lanedir_consec": 0.35028496111657104, "sim_compute_sim_state": 0.005250916964765908, "sim_compute_performance-ego": 0.007169650948565939, "sim_compute_robot_state-ego": 0.009720076685366424, "sim_compute_robot_state-npc0": 0.009051222732101662, "sim_compute_robot_state-npc1": 0.008649055508599766, "sim_compute_robot_state-npc2": 0.008698263030121292, "sim_compute_robot_state-npc3": 0.008408847062484077}}set_robot_commands_max 0.010310010633606842 set_robot_commands_mean 0.00978559438839621 set_robot_commands_median 0.009806898528454353 set_robot_commands_min 0.009172445741193047 sim_compute_performance-ego_max 0.00738250732421875 sim_compute_performance-ego_mean 0.0072312184466492 sim_compute_performance-ego_median 0.0071788918738271675 sim_compute_performance-ego_min 0.007055273056030273 sim_compute_robot_state-ego_max 0.009794876493256667 sim_compute_robot_state-ego_mean 0.009422210352114591 sim_compute_robot_state-ego_median 0.009260031382242838 sim_compute_robot_state-ego_min 0.009104992548624674 sim_compute_robot_state-npc0_max 0.009051222732101662 sim_compute_robot_state-npc0_mean 0.008822916252740558 sim_compute_robot_state-npc0_median 0.008806438446044921 sim_compute_robot_state-npc0_min 0.00858836132904579 sim_compute_robot_state-npc1_max 0.008939711252848308 sim_compute_robot_state-npc1_mean 0.008611850449440147 sim_compute_robot_state-npc1_median 0.008605318443447935 sim_compute_robot_state-npc1_min 0.008307113647460937 sim_compute_robot_state-npc2_max 0.008837251102223116 sim_compute_robot_state-npc2_mean 0.008730485836587738 sim_compute_robot_state-npc2_median 0.008757979075113932 sim_compute_robot_state-npc2_min 0.00852641771579611 sim_compute_robot_state-npc3_max 0.008757127920786539 sim_compute_robot_state-npc3_mean 0.008560925800179272 sim_compute_robot_state-npc3_median 0.008459066522532496 sim_compute_robot_state-npc3_min 0.008408847062484077 sim_compute_sim_state_max 0.005354405244191488 sim_compute_sim_state_mean 0.005199021007044871 sim_compute_sim_state_median 0.005227976831896552 sim_compute_sim_state_min 0.005010433197021484 sim_physics_max 0.2284691022789997 sim_physics_mean 0.203812925703932 sim_physics_median 0.1998840406023223 sim_physics_min 0.17373220443725587 sim_render-ego_max 0.013011002886122553 sim_render-ego_mean 0.012497516418760036 sim_render-ego_median 0.012487343152364097 sim_render-ego_min 0.01199941635131836 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.14000000000002 survival_time_min 3.4499999999999957
No reset possible 290955624Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.3682134816411382 survival_time_median 3.1999999999999966 deviation-center-line_median 0.2043726914757423 in-drivable-lane_median 0.7499999999999973
other stats agent_compute-ego_max 0.022083955898619535 agent_compute-ego_mean 0.021084054235038573 agent_compute-ego_median 0.02078969404101372 agent_compute-ego_min 0.02064530125686101 deviation-center-line_max 0.421367441263161 deviation-center-line_mean 0.2223503688622008 deviation-center-line_min 0.09226651968687638 deviation-heading_max 1.6037483114689044 deviation-heading_mean 0.8496173807138714 deviation-heading_median 0.7397046836028262 deviation-heading_min 0.433575196474389 driven_any_max 2.485835701675572 driven_any_mean 1.696976841737457 driven_any_median 1.4813437243359655 driven_any_min 1.0224744840282902 driven_lanedir_consec_max 1.675824627438466 driven_lanedir_consec_mean 1.3012779135676995 driven_lanedir_consec_min 0.6874301264260654 driven_lanedir_max 1.675824627438466 driven_lanedir_mean 1.3012779135676995 driven_lanedir_median 1.3682134816411382 driven_lanedir_min 0.6874301264260654 in-drivable-lane_max 2.249999999999992 in-drivable-lane_mean 0.8999999999999968 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0224744840282902, "sim_physics": 0.05782244916547809, "survival_time": 2.849999999999998, "driven_lanedir": 0.6874301264260654, "sim_render-ego": 0.007275798864531936, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.022083955898619535, "deviation-heading": 0.6271325191335355, "set_robot_commands": 0.005079888460928933, "deviation-center-line": 0.09226651968687638, "driven_lanedir_consec": 0.6874301264260654, "sim_compute_sim_state": 0.002901679591128701, "sim_compute_performance-ego": 0.004003031211986877, "sim_compute_robot_state-ego": 0.00529102693524277}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4412188765754632, "sim_physics": 0.056082302524197485, "survival_time": 3.099999999999997, "driven_lanedir": 1.3682134816411382, "sim_render-ego": 0.007067588067823841, "in-drivable-lane": 0, "agent_compute-ego": 0.021126143393977996, "deviation-heading": 0.8439261928897014, "set_robot_commands": 0.005162796666545253, "deviation-center-line": 0.27085414742208935, "driven_lanedir_consec": 1.3682134816411382, "sim_compute_sim_state": 0.0029732334998346143, "sim_compute_performance-ego": 0.003905638571708433, "sim_compute_robot_state-ego": 0.005238275374135663}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.485835701675572, "sim_physics": 0.05389885604381561, "survival_time": 6.399999999999985, "driven_lanedir": 1.675824627438466, "sim_render-ego": 0.007117161527276039, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.02077517658472061, "deviation-heading": 1.6037483114689044, "set_robot_commands": 0.005178950726985931, "deviation-center-line": 0.421367441263161, "driven_lanedir_consec": 1.675824627438466, "sim_compute_sim_state": 0.0029988419264554977, "sim_compute_performance-ego": 0.003956528380513191, "sim_compute_robot_state-ego": 0.005139188840985298}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.054011422071996, "sim_physics": 0.05489608858312879, "survival_time": 5.599999999999988, "driven_lanedir": 1.339531097823213, "sim_render-ego": 0.007063701748847961, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.02064530125686101, "deviation-heading": 0.433575196474389, "set_robot_commands": 0.0051303889070238385, "deviation-center-line": 0.12289104446313492, "driven_lanedir_consec": 1.339531097823213, "sim_compute_sim_state": 0.0029238483735493253, "sim_compute_performance-ego": 0.003927937575748989, "sim_compute_robot_state-ego": 0.0050575775759560725}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4813437243359655, "sim_physics": 0.05810457095503807, "survival_time": 3.1999999999999966, "driven_lanedir": 1.435390234509615, "sim_render-ego": 0.007227804511785507, "in-drivable-lane": 0, "agent_compute-ego": 0.02078969404101372, "deviation-heading": 0.7397046836028262, "set_robot_commands": 0.005148947238922119, "deviation-center-line": 0.2043726914757423, "driven_lanedir_consec": 1.435390234509615, "sim_compute_sim_state": 0.003035161644220352, "sim_compute_performance-ego": 0.00395747646689415, "sim_compute_robot_state-ego": 0.0051286481320858}}set_robot_commands_max 0.005178950726985931 set_robot_commands_mean 0.0051401944000812145 set_robot_commands_median 0.005148947238922119 set_robot_commands_min 0.005079888460928933 sim_compute_performance-ego_max 0.004003031211986877 sim_compute_performance-ego_mean 0.003950122441370328 sim_compute_performance-ego_median 0.003956528380513191 sim_compute_performance-ego_min 0.003905638571708433 sim_compute_robot_state-ego_max 0.00529102693524277 sim_compute_robot_state-ego_mean 0.005170943371681121 sim_compute_robot_state-ego_median 0.005139188840985298 sim_compute_robot_state-ego_min 0.0050575775759560725 sim_compute_sim_state_max 0.003035161644220352 sim_compute_sim_state_mean 0.002966553007037698 sim_compute_sim_state_median 0.0029732334998346143 sim_compute_sim_state_min 0.002901679591128701 sim_physics_max 0.05810457095503807 sim_physics_mean 0.0561608534543316 sim_physics_median 0.056082302524197485 sim_physics_min 0.05389885604381561 sim_render-ego_max 0.007275798864531936 sim_render-ego_mean 0.0071504109440530565 sim_render-ego_median 0.007117161527276039 sim_render-ego_min 0.007063701748847961 simulation-passed 1 survival_time_max 6.399999999999985 survival_time_mean 4.229999999999992 survival_time_min 2.849999999999998
No reset possible 290495598c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8710634644839377 survival_time_median 14.950000000000076 deviation-center-line_median 0.4409380333181966 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.016602240057073087 agent_compute-ego_mean 0.016099948972718325 agent_compute-ego_median 0.015953481992085773 agent_compute-ego_min 0.015700225830078126 deviation-center-line_max 0.5898483061579239 deviation-center-line_mean 0.447316376980423 deviation-center-line_min 0.3266099074672072 deviation-heading_max 3.623973394071103 deviation-heading_mean 2.298639637907306 deviation-heading_median 2.2679791013581756 deviation-heading_min 0.9799812073475084 driven_any_max 2.4057089251629113 driven_any_mean 1.8437500377924252 driven_any_median 1.9007824853630864 driven_any_min 1.109273811089794 driven_lanedir_consec_max 2.399089680010563 driven_lanedir_consec_mean 1.7069517691869058 driven_lanedir_consec_min 0.8042518238943521 driven_lanedir_max 2.399089680010563 driven_lanedir_mean 1.716927314414546 driven_lanedir_median 1.8710634644839377 driven_lanedir_min 0.8098943032119781 in-drivable-lane_max 1.7000000000000242 in-drivable-lane_mean 0.5800000000000083 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.109273811089794, "sim_physics": 0.05990199655549139, "survival_time": 11.700000000000031, "driven_lanedir": 0.8098943032119781, "sim_render-ego": 0.006993866374350002, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.016602240057073087, "deviation-heading": 3.439745916055433, "set_robot_commands": 0.0070408154756594924, "deviation-center-line": 0.3266099074672072, "driven_lanedir_consec": 0.8042518238943521, "sim_compute_sim_state": 0.0037453174591064457, "sim_compute_performance-ego": 0.004117774148272653, "sim_compute_robot_state-ego": 0.005144206886617546}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.124022300057447, "sim_physics": 0.05718207756678263, "survival_time": 14.950000000000076, "driven_lanedir": 2.1110655480343414, "sim_render-ego": 0.007060920397440593, "in-drivable-lane": 0, "agent_compute-ego": 0.015953481992085773, "deviation-heading": 1.1815185707043128, "set_robot_commands": 0.00721432367960612, "deviation-center-line": 0.4409380333181966, "driven_lanedir_consec": 2.1110655480343414, "sim_compute_sim_state": 0.003909389177958171, "sim_compute_performance-ego": 0.003979790210723877, "sim_compute_robot_state-ego": 0.005158663590749105}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9007824853630864, "sim_physics": 0.05588064273198445, "survival_time": 14.950000000000076, "driven_lanedir": 1.8710634644839377, "sim_render-ego": 0.007084372838338216, "in-drivable-lane": 0, "agent_compute-ego": 0.015700225830078126, "deviation-heading": 2.2679791013581756, "set_robot_commands": 0.007129270235697429, "deviation-center-line": 0.5898483061579239, "driven_lanedir_consec": 1.8710634644839377, "sim_compute_sim_state": 0.00365656057993571, "sim_compute_performance-ego": 0.003977232774098714, "sim_compute_robot_state-ego": 0.005135696729024251}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6789626672888875, "sim_physics": 0.05458675463994344, "survival_time": 14.950000000000076, "driven_lanedir": 1.3935235763319098, "sim_render-ego": 0.007017300923665364, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.01639999548594157, "deviation-heading": 3.623973394071103, "set_robot_commands": 0.00703740119934082, "deviation-center-line": 0.39540681101029, "driven_lanedir_consec": 1.3492883295113351, "sim_compute_sim_state": 0.003605518341064453, "sim_compute_performance-ego": 0.003960289160410563, "sim_compute_robot_state-ego": 0.005064884026845296}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4057089251629113, "sim_physics": 0.05621195554733276, "survival_time": 14.950000000000076, "driven_lanedir": 2.399089680010563, "sim_render-ego": 0.006947250366210938, "in-drivable-lane": 0, "agent_compute-ego": 0.015843801498413086, "deviation-heading": 0.9799812073475084, "set_robot_commands": 0.00722865104675293, "deviation-center-line": 0.4837788269484973, "driven_lanedir_consec": 2.399089680010563, "sim_compute_sim_state": 0.003617026011149088, "sim_compute_performance-ego": 0.003943882783253988, "sim_compute_robot_state-ego": 0.005025118986765544}}set_robot_commands_max 0.00722865104675293 set_robot_commands_mean 0.007130092327411358 set_robot_commands_median 0.007129270235697429 set_robot_commands_min 0.00703740119934082 sim_compute_performance-ego_max 0.004117774148272653 sim_compute_performance-ego_mean 0.003995793815351959 sim_compute_performance-ego_median 0.003977232774098714 sim_compute_performance-ego_min 0.003943882783253988 sim_compute_robot_state-ego_max 0.005158663590749105 sim_compute_robot_state-ego_mean 0.005105714044000348 sim_compute_robot_state-ego_median 0.005135696729024251 sim_compute_robot_state-ego_min 0.005025118986765544 sim_compute_sim_state_max 0.003909389177958171 sim_compute_sim_state_mean 0.0037067623138427735 sim_compute_sim_state_median 0.00365656057993571 sim_compute_sim_state_min 0.003605518341064453 sim_physics_max 0.05990199655549139 sim_physics_mean 0.056752685408306934 sim_physics_median 0.05621195554733276 sim_physics_min 0.05458675463994344 sim_render-ego_max 0.007084372838338216 sim_render-ego_mean 0.007020742180001022 sim_render-ego_median 0.007017300923665364 sim_render-ego_min 0.006947250366210938 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.300000000000068 survival_time_min 11.700000000000031
No reset possible 290175575Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.415300404469748 survival_time_median 1.0500000000000005 deviation-center-line_median 0.06528162699891357 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.023758207048688616 agent_compute-ego_mean 0.02098815844172523 agent_compute-ego_median 0.02027340332667033 agent_compute-ego_min 0.01988942623138428 deviation-center-line_max 0.15652714823361255 deviation-center-line_mean 0.08485546452346285 deviation-center-line_min 0.060680576551180435 deviation-heading_max 0.3288103798068405 deviation-heading_mean 0.26512819425077916 deviation-heading_median 0.28217974079465513 deviation-heading_min 0.2047531117605221 driven_any_max 1.599654688730024 driven_any_mean 0.7429584200327175 driven_any_median 0.4307612897755801 driven_any_min 0.2836294060063822 driven_lanedir_consec_max 0.933358306057232 driven_lanedir_consec_mean 0.5419980405976785 driven_lanedir_consec_min 0.2743915476157708 driven_lanedir_max 0.933358306057232 driven_lanedir_mean 0.5419980405976785 driven_lanedir_median 0.415300404469748 driven_lanedir_min 0.2743915476157708 in-drivable-lane_max 1.0999999999999963 in-drivable-lane_mean 0.3099999999999993 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4307612897755801, "sim_physics": 0.06554730733235677, "survival_time": 1.0500000000000005, "driven_lanedir": 0.415300404469748, "sim_render-ego": 0.007677543730962844, "in-drivable-lane": 0, "agent_compute-ego": 0.023758207048688616, "deviation-heading": 0.28217974079465513, "set_robot_commands": 0.005621637616838727, "deviation-center-line": 0.06119413751278363, "driven_lanedir_consec": 0.415300404469748, "sim_compute_sim_state": 0.003080106916881743, "sim_compute_performance-ego": 0.0044730163755871, "sim_compute_robot_state-ego": 0.005879765465146019}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2836294060063822, "sim_physics": 0.0626603364944458, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2743915476157708, "sim_render-ego": 0.00739133358001709, "in-drivable-lane": 0, "agent_compute-ego": 0.02097681164741516, "deviation-heading": 0.2047531117605221, "set_robot_commands": 0.005003258585929871, "deviation-center-line": 0.06528162699891357, "driven_lanedir_consec": 0.2743915476157708, "sim_compute_sim_state": 0.0029686391353607178, "sim_compute_performance-ego": 0.003998905420303345, "sim_compute_robot_state-ego": 0.005385592579841614}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9996632207705768, "sim_physics": 0.05604389905929565, "survival_time": 2.000000000000001, "driven_lanedir": 0.7073435611552017, "sim_render-ego": 0.007133162021636963, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.01988942623138428, "deviation-heading": 0.2895873372755112, "set_robot_commands": 0.005079048871994019, "deviation-center-line": 0.08059383332082407, "driven_lanedir_consec": 0.7073435611552017, "sim_compute_sim_state": 0.002923661470413208, "sim_compute_performance-ego": 0.003966999053955078, "sim_compute_robot_state-ego": 0.005270731449127197}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.599654688730024, "sim_physics": 0.05868759552637736, "survival_time": 2.9999999999999973, "driven_lanedir": 0.933358306057232, "sim_render-ego": 0.007216787338256836, "in-drivable-lane": 1.0999999999999963, "agent_compute-ego": 0.02027340332667033, "deviation-heading": 0.22031040161636695, "set_robot_commands": 0.0051560640335083004, "deviation-center-line": 0.15652714823361255, "driven_lanedir_consec": 0.933358306057232, "sim_compute_sim_state": 0.0029315670331319173, "sim_compute_performance-ego": 0.003977072238922119, "sim_compute_robot_state-ego": 0.005261711279551188}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810239, "sim_physics": 0.06111177206039429, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3795963836904402, "sim_render-ego": 0.007224380970001221, "in-drivable-lane": 0, "agent_compute-ego": 0.020042943954467773, "deviation-heading": 0.3288103798068405, "set_robot_commands": 0.0049988746643066405, "deviation-center-line": 0.060680576551180435, "driven_lanedir_consec": 0.3795963836904402, "sim_compute_sim_state": 0.002973949909210205, "sim_compute_performance-ego": 0.003942322731018066, "sim_compute_robot_state-ego": 0.0051745414733886715}}set_robot_commands_max 0.005621637616838727 set_robot_commands_mean 0.005171776754515512 set_robot_commands_median 0.005079048871994019 set_robot_commands_min 0.0049988746643066405 sim_compute_performance-ego_max 0.0044730163755871 sim_compute_performance-ego_mean 0.004071663163957142 sim_compute_performance-ego_median 0.003977072238922119 sim_compute_performance-ego_min 0.003942322731018066 sim_compute_robot_state-ego_max 0.005879765465146019 sim_compute_robot_state-ego_mean 0.0053944684494109385 sim_compute_robot_state-ego_median 0.005270731449127197 sim_compute_robot_state-ego_min 0.0051745414733886715 sim_compute_sim_state_max 0.003080106916881743 sim_compute_sim_state_mean 0.0029755848929995583 sim_compute_sim_state_median 0.0029686391353607178 sim_compute_sim_state_min 0.002923661470413208 sim_physics_max 0.06554730733235677 sim_physics_mean 0.06081018209457397 sim_physics_median 0.06111177206039429 sim_physics_min 0.05604389905929565 sim_render-ego_max 0.007677543730962844 sim_render-ego_mean 0.007328641528174991 sim_render-ego_median 0.007224380970001221 sim_render-ego_min 0.007133162021636963 simulation-passed 1 survival_time_max 2.9999999999999973 survival_time_mean 1.5699999999999998 survival_time_min 0.8000000000000002
No reset possible 290025569Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.415300404469748 survival_time_median 1.0500000000000005 deviation-center-line_median 0.06528162699891357 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.023542052223568873 agent_compute-ego_mean 0.020788849734124683 agent_compute-ego_median 0.020011350512504578 agent_compute-ego_min 0.01982837915420532 deviation-center-line_max 0.15652714823361255 deviation-center-line_mean 0.08485546452346285 deviation-center-line_min 0.060680576551180435 deviation-heading_max 0.3288103798068405 deviation-heading_mean 0.26512819425077916 deviation-heading_median 0.28217974079465513 deviation-heading_min 0.2047531117605221 driven_any_max 1.599654688730024 driven_any_mean 0.7429584200327175 driven_any_median 0.4307612897755801 driven_any_min 0.2836294060063822 driven_lanedir_consec_max 0.933358306057232 driven_lanedir_consec_mean 0.5419980405976785 driven_lanedir_consec_min 0.2743915476157708 driven_lanedir_max 0.933358306057232 driven_lanedir_mean 0.5419980405976785 driven_lanedir_median 0.415300404469748 driven_lanedir_min 0.2743915476157708 in-drivable-lane_max 1.0999999999999963 in-drivable-lane_mean 0.3099999999999993 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4307612897755801, "sim_physics": 0.06370571681431361, "survival_time": 1.0500000000000005, "driven_lanedir": 0.415300404469748, "sim_render-ego": 0.007175150371733166, "in-drivable-lane": 0, "agent_compute-ego": 0.023542052223568873, "deviation-heading": 0.28217974079465513, "set_robot_commands": 0.00531134151277088, "deviation-center-line": 0.06119413751278363, "driven_lanedir_consec": 0.415300404469748, "sim_compute_sim_state": 0.0030856018974667505, "sim_compute_performance-ego": 0.004185790107363746, "sim_compute_robot_state-ego": 0.005101805641537621}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2836294060063822, "sim_physics": 0.06341762840747833, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2743915476157708, "sim_render-ego": 0.007260918617248535, "in-drivable-lane": 0, "agent_compute-ego": 0.020011350512504578, "deviation-heading": 0.2047531117605221, "set_robot_commands": 0.005146905779838562, "deviation-center-line": 0.06528162699891357, "driven_lanedir_consec": 0.2743915476157708, "sim_compute_sim_state": 0.00303862988948822, "sim_compute_performance-ego": 0.003907144069671631, "sim_compute_robot_state-ego": 0.005088105797767639}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9996632207705768, "sim_physics": 0.055981791019439696, "survival_time": 2.000000000000001, "driven_lanedir": 0.7073435611552017, "sim_render-ego": 0.007103043794631958, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.019901764392852784, "deviation-heading": 0.2895873372755112, "set_robot_commands": 0.0053254663944244385, "deviation-center-line": 0.08059383332082407, "driven_lanedir_consec": 0.7073435611552017, "sim_compute_sim_state": 0.0029650747776031492, "sim_compute_performance-ego": 0.003924423456192016, "sim_compute_robot_state-ego": 0.005182558298110962}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.599654688730024, "sim_physics": 0.05545467933019002, "survival_time": 2.9999999999999973, "driven_lanedir": 0.933358306057232, "sim_render-ego": 0.007136074701944987, "in-drivable-lane": 1.0999999999999963, "agent_compute-ego": 0.02066070238749186, "deviation-heading": 0.22031040161636695, "set_robot_commands": 0.005267385641733805, "deviation-center-line": 0.15652714823361255, "driven_lanedir_consec": 0.933358306057232, "sim_compute_sim_state": 0.002888158957163493, "sim_compute_performance-ego": 0.003937244415283203, "sim_compute_robot_state-ego": 0.005124195416768392}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810239, "sim_physics": 0.05926259756088257, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3795963836904402, "sim_render-ego": 0.007137370109558105, "in-drivable-lane": 0, "agent_compute-ego": 0.01982837915420532, "deviation-heading": 0.3288103798068405, "set_robot_commands": 0.00527191162109375, "deviation-center-line": 0.060680576551180435, "driven_lanedir_consec": 0.3795963836904402, "sim_compute_sim_state": 0.0028638958930969237, "sim_compute_performance-ego": 0.003966820240020752, "sim_compute_robot_state-ego": 0.005133676528930664}}set_robot_commands_max 0.0053254663944244385 set_robot_commands_mean 0.005264602189972286 set_robot_commands_median 0.00527191162109375 set_robot_commands_min 0.005146905779838562 sim_compute_performance-ego_max 0.004185790107363746 sim_compute_performance-ego_mean 0.00398428445770627 sim_compute_performance-ego_median 0.003937244415283203 sim_compute_performance-ego_min 0.003907144069671631 sim_compute_robot_state-ego_max 0.005182558298110962 sim_compute_robot_state-ego_mean 0.005126068336623055 sim_compute_robot_state-ego_median 0.005124195416768392 sim_compute_robot_state-ego_min 0.005088105797767639 sim_compute_sim_state_max 0.0030856018974667505 sim_compute_sim_state_mean 0.0029682722829637077 sim_compute_sim_state_median 0.0029650747776031492 sim_compute_sim_state_min 0.0028638958930969237 sim_physics_max 0.06370571681431361 sim_physics_mean 0.05956448262646084 sim_physics_median 0.05926259756088257 sim_physics_min 0.05545467933019002 sim_render-ego_max 0.007260918617248535 sim_render-ego_mean 0.00716251151902335 sim_render-ego_median 0.007137370109558105 sim_render-ego_min 0.007103043794631958 simulation-passed 1 survival_time_max 2.9999999999999973 survival_time_mean 1.5699999999999998 survival_time_min 0.8000000000000002
No reset possible 289685546Mikita Sazanovich chameleon-4 aido3-LFV-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.6003730077731415 survival_time_median 6.499999999999985 deviation-center-line_median 0.35586765670267106 in-drivable-lane_median 1.099999999999996
other stats agent_compute-ego_max 0.17051565885543823 agent_compute-ego_mean 0.1673159216075666 agent_compute-ego_median 0.1670711425634531 agent_compute-ego_min 0.16552540758153894 deviation-center-line_max 0.7976560159612236 deviation-center-line_mean 0.3721866912585011 deviation-center-line_min 0.08384951375012295 deviation-heading_max 4.531160286966286 deviation-heading_mean 2.065519999626781 deviation-heading_median 1.5939919862890108 deviation-heading_min 0.498817494355778 driven_any_max 4.156196162951872 driven_any_mean 2.089326055389165 driven_any_median 1.9098010097971436 driven_any_min 1.0540895656497244 driven_lanedir_consec_max 3.159964257263894 driven_lanedir_consec_mean 1.640190169028814 driven_lanedir_consec_min 0.6815938120965326 driven_lanedir_max 3.159964257263894 driven_lanedir_mean 1.640190169028814 driven_lanedir_median 1.6003730077731415 driven_lanedir_min 0.6815938120965326 in-drivable-lane_max 3.3000000000000274 in-drivable-lane_mean 1.5100000000000025 in-drivable-lane_min 0.6499999999999977 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.156196162951872, "sim_physics": 0.10081731557846069, "survival_time": 14.950000000000076, "driven_lanedir": 3.159964257263894, "sim_render-ego": 0.00705059289932251, "in-drivable-lane": 3.3000000000000274, "agent_compute-ego": 0.17051565885543823, "deviation-heading": 4.531160286966286, "set_robot_commands": 0.005041494369506836, "deviation-center-line": 0.7976560159612236, "driven_lanedir_consec": 3.159964257263894, "sim_compute_sim_state": 0.002843321959177653, "sim_compute_performance-ego": 0.003980452219645182, "sim_compute_robot_state-ego": 0.00512563149134318, "sim_compute_robot_state-npc0": 0.004964706897735596, "sim_compute_robot_state-npc1": 0.004658815066019694, "sim_compute_robot_state-npc2": 0.004627896149953206, "sim_compute_robot_state-npc3": 0.0046109644571940105}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0540895656497244, "sim_physics": 0.10472001545671104, "survival_time": 3.4499999999999957, "driven_lanedir": 0.6815938120965326, "sim_render-ego": 0.0071801171786543255, "in-drivable-lane": 1.5499999999999947, "agent_compute-ego": 0.1676410903101382, "deviation-heading": 0.498817494355778, "set_robot_commands": 0.004949839218803074, "deviation-center-line": 0.08384951375012295, "driven_lanedir_consec": 0.6815938120965326, "sim_compute_sim_state": 0.002846990806469019, "sim_compute_performance-ego": 0.003926681435626486, "sim_compute_robot_state-ego": 0.005070143851681032, "sim_compute_robot_state-npc0": 0.004896778991256935, "sim_compute_robot_state-npc1": 0.004627493844516035, "sim_compute_robot_state-npc2": 0.0046327943387238875, "sim_compute_robot_state-npc3": 0.004600448884825775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9098010097971436, "sim_physics": 0.10220530373709542, "survival_time": 6.999999999999983, "driven_lanedir": 1.6003730077731415, "sim_render-ego": 0.007075989246368408, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1658263087272644, "deviation-heading": 2.15725575284137, "set_robot_commands": 0.005172935553959437, "deviation-center-line": 0.40475648332828, "driven_lanedir_consec": 1.6003730077731415, "sim_compute_sim_state": 0.0028288841247558595, "sim_compute_performance-ego": 0.003933055060250419, "sim_compute_robot_state-ego": 0.005053028038569859, "sim_compute_robot_state-npc0": 0.004985341003962925, "sim_compute_robot_state-npc1": 0.004681006499699184, "sim_compute_robot_state-npc2": 0.004679865496499198, "sim_compute_robot_state-npc3": 0.004638755321502685}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9843747472693984, "sim_physics": 0.10910744483654317, "survival_time": 6.499999999999985, "driven_lanedir": 1.77350911268552, "sim_render-ego": 0.007064641438997709, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1670711425634531, "deviation-heading": 1.5939919862890108, "set_robot_commands": 0.005098159496600811, "deviation-center-line": 0.35586765670267106, "driven_lanedir_consec": 1.77350911268552, "sim_compute_sim_state": 0.00281525025000939, "sim_compute_performance-ego": 0.003930321106543908, "sim_compute_robot_state-ego": 0.00512229662675124, "sim_compute_robot_state-npc0": 0.0049688467612633335, "sim_compute_robot_state-npc1": 0.004693288069504958, "sim_compute_robot_state-npc2": 0.0046582882220928485, "sim_compute_robot_state-npc3": 0.004636126298170823}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3421687912776854, "sim_physics": 0.10537968101082268, "survival_time": 4.549999999999992, "driven_lanedir": 0.98551065532498, "sim_render-ego": 0.007070735260680481, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.16552540758153894, "deviation-heading": 1.546374477681459, "set_robot_commands": 0.0048904549944531785, "deviation-center-line": 0.21880378655020785, "driven_lanedir_consec": 0.98551065532498, "sim_compute_sim_state": 0.0027820487598796467, "sim_compute_performance-ego": 0.0039017986465286424, "sim_compute_robot_state-ego": 0.005061825553139487, "sim_compute_robot_state-npc0": 0.004880944451132974, "sim_compute_robot_state-npc1": 0.004603113446916852, "sim_compute_robot_state-npc2": 0.004574980054582868, "sim_compute_robot_state-npc3": 0.004535405190436394}}set_robot_commands_max 0.005172935553959437 set_robot_commands_mean 0.005030576726664667 set_robot_commands_median 0.005041494369506836 set_robot_commands_min 0.0048904549944531785 sim_compute_performance-ego_max 0.003980452219645182 sim_compute_performance-ego_mean 0.003934461693718927 sim_compute_performance-ego_median 0.003930321106543908 sim_compute_performance-ego_min 0.0039017986465286424 sim_compute_robot_state-ego_max 0.00512563149134318 sim_compute_robot_state-ego_mean 0.005086585112296959 sim_compute_robot_state-ego_median 0.005070143851681032 sim_compute_robot_state-ego_min 0.005053028038569859 sim_compute_robot_state-npc0_max 0.004985341003962925 sim_compute_robot_state-npc0_mean 0.004939323621070352 sim_compute_robot_state-npc0_median 0.004964706897735596 sim_compute_robot_state-npc0_min 0.004880944451132974 sim_compute_robot_state-npc1_max 0.004693288069504958 sim_compute_robot_state-npc1_mean 0.004652743385331345 sim_compute_robot_state-npc1_median 0.004658815066019694 sim_compute_robot_state-npc1_min 0.004603113446916852 sim_compute_robot_state-npc2_max 0.004679865496499198 sim_compute_robot_state-npc2_mean 0.004634764852370401 sim_compute_robot_state-npc2_median 0.0046327943387238875 sim_compute_robot_state-npc2_min 0.004574980054582868 sim_compute_robot_state-npc3_max 0.004638755321502685 sim_compute_robot_state-npc3_mean 0.004604340030425938 sim_compute_robot_state-npc3_median 0.0046109644571940105 sim_compute_robot_state-npc3_min 0.004535405190436394 sim_compute_sim_state_max 0.002846990806469019 sim_compute_sim_state_mean 0.002823299180058314 sim_compute_sim_state_median 0.0028288841247558595 sim_compute_sim_state_min 0.0027820487598796467 sim_physics_max 0.10910744483654317 sim_physics_mean 0.1044459521239266 sim_physics_median 0.10472001545671104 sim_physics_min 0.10081731557846069 sim_render-ego_max 0.0071801171786543255 sim_render-ego_mean 0.007088415204804686 sim_render-ego_median 0.007070735260680481 sim_render-ego_min 0.00705059289932251 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.290000000000006 survival_time_min 3.4499999999999957
No reset possible 289484389Jeick Hincapie Barrera challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 288725527Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1065775548168977 survival_time_median 9.049999999999994 deviation-center-line_median 0.3735306035988732 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.01995372640493825 agent_compute-ego_mean 0.01925294930616158 agent_compute-ego_median 0.018904661337534587 agent_compute-ego_min 0.01867598604272913 deviation-center-line_max 1.0985622657383942 deviation-center-line_mean 0.5019315638242212 deviation-center-line_min 0.2340866827095402 deviation-heading_max 1.6956439651620083 deviation-heading_mean 1.518012735452983 deviation-heading_median 1.4555860206029323 deviation-heading_min 1.3919873609039344 driven_any_max 2.984174186834139 driven_any_mean 1.51815735943931 driven_any_median 1.134746592619825 driven_any_min 0.7005907169361316 driven_lanedir_consec_max 1.9626451868158177 driven_lanedir_consec_mean 1.2358539388516898 driven_lanedir_consec_min 0.6108616688224981 driven_lanedir_max 1.9626451868158177 driven_lanedir_mean 1.2358539388516898 driven_lanedir_median 1.1065775548168977 driven_lanedir_min 0.6108616688224981 in-drivable-lane_max 6.950000000000068 in-drivable-lane_mean 1.4400000000000133 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.134746592619825, "sim_physics": 0.057784591590501984, "survival_time": 9.049999999999994, "driven_lanedir": 1.1065775548168977, "sim_render-ego": 0.007051311145171276, "in-drivable-lane": 0, "agent_compute-ego": 0.01995372640493825, "deviation-heading": 1.5975992623730713, "set_robot_commands": 0.005017337219491189, "deviation-center-line": 0.3735306035988732, "driven_lanedir_consec": 1.1065775548168977, "sim_compute_sim_state": 0.0028469114672413187, "sim_compute_performance-ego": 0.0040658574077964485, "sim_compute_robot_state-ego": 0.005056462893828503}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9851164704924456, "sim_physics": 0.055147801746021616, "survival_time": 11.00000000000002, "driven_lanedir": 1.9626451868158177, "sim_render-ego": 0.007098195769570091, "in-drivable-lane": 0, "agent_compute-ego": 0.018902345137162643, "deviation-heading": 1.3919873609039344, "set_robot_commands": 0.004889857769012451, "deviation-center-line": 1.0985622657383942, "driven_lanedir_consec": 1.9626451868158177, "sim_compute_sim_state": 0.0028691519390452993, "sim_compute_performance-ego": 0.0039316578344865275, "sim_compute_robot_state-ego": 0.005070169405503706}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7005907169361316, "sim_physics": 0.05524507098727756, "survival_time": 6.749999999999984, "driven_lanedir": 0.6108616688224981, "sim_render-ego": 0.007094916590937862, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.01867598604272913, "deviation-heading": 1.4555860206029323, "set_robot_commands": 0.004901938968234592, "deviation-center-line": 0.2738407437962372, "driven_lanedir_consec": 0.6108616688224981, "sim_compute_sim_state": 0.0027700300569887515, "sim_compute_performance-ego": 0.0039050685034857854, "sim_compute_robot_state-ego": 0.004967776051274052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7861588303140079, "sim_physics": 0.05926333398235088, "survival_time": 4.899999999999991, "driven_lanedir": 0.7492552335868001, "sim_render-ego": 0.007088079744455766, "in-drivable-lane": 0, "agent_compute-ego": 0.01982802760844328, "deviation-heading": 1.44924706822297, "set_robot_commands": 0.004864989494790836, "deviation-center-line": 0.2340866827095402, "driven_lanedir_consec": 0.7492552335868001, "sim_compute_sim_state": 0.002881307991183534, "sim_compute_performance-ego": 0.003928201539175851, "sim_compute_robot_state-ego": 0.005106967322680415}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.984174186834139, "sim_physics": 0.0567924443880717, "survival_time": 14.950000000000076, "driven_lanedir": 1.749930050216436, "sim_render-ego": 0.006945862770080567, "in-drivable-lane": 6.950000000000068, "agent_compute-ego": 0.018904661337534587, "deviation-heading": 1.6956439651620083, "set_robot_commands": 0.004852253595987956, "deviation-center-line": 0.5296375232780608, "driven_lanedir_consec": 1.749930050216436, "sim_compute_sim_state": 0.0027748266855875652, "sim_compute_performance-ego": 0.003931946754455566, "sim_compute_robot_state-ego": 0.004989080429077149}}set_robot_commands_max 0.005017337219491189 set_robot_commands_mean 0.004905275409503406 set_robot_commands_median 0.004889857769012451 set_robot_commands_min 0.004852253595987956 sim_compute_performance-ego_max 0.0040658574077964485 sim_compute_performance-ego_mean 0.003952546407880035 sim_compute_performance-ego_median 0.0039316578344865275 sim_compute_performance-ego_min 0.0039050685034857854 sim_compute_robot_state-ego_max 0.005106967322680415 sim_compute_robot_state-ego_mean 0.005038091220472765 sim_compute_robot_state-ego_median 0.005056462893828503 sim_compute_robot_state-ego_min 0.004967776051274052 sim_compute_sim_state_max 0.002881307991183534 sim_compute_sim_state_mean 0.0028284456280092936 sim_compute_sim_state_median 0.0028469114672413187 sim_compute_sim_state_min 0.0027700300569887515 sim_physics_max 0.05926333398235088 sim_physics_mean 0.056846648538844746 sim_physics_median 0.0567924443880717 sim_physics_min 0.055147801746021616 sim_render-ego_max 0.007098195769570091 sim_render-ego_mean 0.007055673204043112 sim_render-ego_median 0.007088079744455766 sim_render-ego_min 0.006945862770080567 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.330000000000013 survival_time_min 4.899999999999991
No reset possible 288625521Frank (Chude) Qian 2019-12-05|FrankNet|Frozen2 aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:15:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.1154146823406257 survival_time_median 8.549999999999986 deviation-center-line_median 0.4022488401775489 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.03182714863827354 agent_compute-ego_mean 0.03042653347380792 agent_compute-ego_median 0.0302549147605896 agent_compute-ego_min 0.02986265128513552 deviation-center-line_max 0.8808565213661739 deviation-center-line_mean 0.45785356430540336 deviation-center-line_min 0.15662957563438148 deviation-heading_max 3.19642431631427 deviation-heading_mean 1.6894327245792766 deviation-heading_median 1.6677531090453372 deviation-heading_min 0.5681707923338937 driven_any_max 5.934585495505424 driven_any_mean 3.2603292172795837 driven_any_median 3.1751353761319954 driven_any_min 1.0075241277783589 driven_lanedir_consec_max 4.729539727789804 driven_lanedir_consec_mean 2.795612717888148 driven_lanedir_consec_min 0.8128491002253091 driven_lanedir_max 4.729539727789804 driven_lanedir_mean 2.795612717888148 driven_lanedir_median 3.1154146823406257 driven_lanedir_min 0.8128491002253091 in-drivable-lane_max 2.8500000000000405 in-drivable-lane_mean 1.1333333333333404 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8285182720200472, "sim_physics": 0.06068598038968984, "survival_time": 8.549999999999986, "driven_lanedir": 2.018010715736835, "sim_render-ego": 0.006983871348420082, "in-drivable-lane": 2.55, "agent_compute-ego": 0.03182714863827354, "deviation-heading": 1.6677531090453372, "set_robot_commands": 0.004904890618129083, "deviation-center-line": 0.4022488401775489, "driven_lanedir_consec": 2.018010715736835, "sim_compute_sim_state": 0.0029546921713310375, "sim_compute_performance-ego": 0.004075306897972062, "sim_compute_robot_state-ego": 0.00518996813143903}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.863928228210072, "sim_physics": 0.0555762080519412, "survival_time": 10.650000000000016, "driven_lanedir": 3.436939926554021, "sim_render-ego": 0.007151307074676657, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.03058222425935414, "deviation-heading": 1.8348673131708149, "set_robot_commands": 0.004980342488893321, "deviation-center-line": 0.5546416472948895, "driven_lanedir_consec": 3.436939926554021, "sim_compute_sim_state": 0.0030195858556899668, "sim_compute_performance-ego": 0.0040120283762613935, "sim_compute_robot_state-ego": 0.005164511326892835}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.5310777883725, "sim_physics": 0.05620721534446434, "survival_time": 10.800000000000018, "driven_lanedir": 4.443874703283201, "sim_render-ego": 0.007105774349636502, "in-drivable-lane": 0, "agent_compute-ego": 0.030483102356946023, "deviation-heading": 1.8165381279706427, "set_robot_commands": 0.004986705603422942, "deviation-center-line": 0.6955021238449784, "driven_lanedir_consec": 4.443874703283201, "sim_compute_sim_state": 0.0029927856392330593, "sim_compute_performance-ego": 0.003989895184834798, "sim_compute_robot_state-ego": 0.0051290348724082665}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.638810707631523, "sim_physics": 0.05481697718302409, "survival_time": 4.499999999999992, "driven_lanedir": 1.2702929161261691, "sim_render-ego": 0.0071030484305487735, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02993844085269504, "deviation-heading": 0.8671628231280598, "set_robot_commands": 0.005025151040818956, "deviation-center-line": 0.17864275344072203, "driven_lanedir_consec": 1.2702929161261691, "sim_compute_sim_state": 0.002994627422756619, "sim_compute_performance-ego": 0.003942770428127713, "sim_compute_robot_state-ego": 0.00513054264916314}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1751353761319954, "sim_physics": 0.05661117796804391, "survival_time": 7.649999999999981, "driven_lanedir": 3.1154146823406257, "sim_render-ego": 0.00832990104076909, "in-drivable-lane": 0, "agent_compute-ego": 0.03042060876983443, "deviation-heading": 1.2486734274022404, "set_robot_commands": 0.004962606367722056, "deviation-center-line": 0.3306558092879687, "driven_lanedir_consec": 3.1154146823406257, "sim_compute_sim_state": 0.002989985584433562, "sim_compute_performance-ego": 0.003970077614379085, "sim_compute_robot_state-ego": 0.0051414919834510955}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.876214584651064, "sim_physics": 0.056920390923817954, "survival_time": 14.950000000000076, "driven_lanedir": 3.982136519218914, "sim_render-ego": 0.007022616863250733, "in-drivable-lane": 2.350000000000022, "agent_compute-ego": 0.0313400141398112, "deviation-heading": 3.1806228940842294, "set_robot_commands": 0.004992664655049642, "deviation-center-line": 0.7858058657351223, "driven_lanedir_consec": 3.982136519218914, "sim_compute_sim_state": 0.002955900033315022, "sim_compute_performance-ego": 0.003951230843861898, "sim_compute_robot_state-ego": 0.005108480453491211}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.482617995000265, "sim_physics": 0.05575522883185025, "survival_time": 11.60000000000003, "driven_lanedir": 4.422887803242915, "sim_render-ego": 0.006989371159981037, "in-drivable-lane": 0, "agent_compute-ego": 0.030217116249018704, "deviation-heading": 1.741195288726601, "set_robot_commands": 0.004941695723040351, "deviation-center-line": 0.590593470387971, "driven_lanedir_consec": 4.422887803242915, "sim_compute_sim_state": 0.0029710469574763857, "sim_compute_performance-ego": 0.003933401971027769, "sim_compute_robot_state-ego": 0.005084723234176636}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.1201268728448812, "sim_physics": 0.05557119006841955, "survival_time": 3.5499999999999954, "driven_lanedir": 0.9977162971737056, "sim_render-ego": 0.007082680581321179, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.03013764972418127, "deviation-heading": 0.5681707923338937, "set_robot_commands": 0.004951792703547948, "deviation-center-line": 0.2168235383898564, "driven_lanedir_consec": 0.9977162971737056, "sim_compute_sim_state": 0.0029453828301228267, "sim_compute_performance-ego": 0.0039403438568115234, "sim_compute_robot_state-ego": 0.00503046411863515}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.308240817728617, "sim_physics": 0.056005087243505274, "survival_time": 4.149999999999993, "driven_lanedir": 1.1871418814405337, "sim_render-ego": 0.007168864629354821, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.03032477792487087, "deviation-heading": 1.0037640485579986, "set_robot_commands": 0.005147155508937606, "deviation-center-line": 0.22977033941442793, "driven_lanedir_consec": 1.1871418814405337, "sim_compute_sim_state": 0.00296713070697095, "sim_compute_performance-ego": 0.003987869584416768, "sim_compute_robot_state-ego": 0.005110757896699101}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0075241277783589, "sim_physics": 0.055470697085062665, "survival_time": 2.9999999999999973, "driven_lanedir": 0.8367820259503502, "sim_render-ego": 0.007104635238647461, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.03023253679275513, "deviation-heading": 0.7043065862909443, "set_robot_commands": 0.004828910032908122, "deviation-center-line": 0.15662957563438148, "driven_lanedir_consec": 0.8367820259503502, "sim_compute_sim_state": 0.002924187978108724, "sim_compute_performance-ego": 0.003894416491190593, "sim_compute_robot_state-ego": 0.005059385299682617}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.1156756565418064, "sim_physics": 0.05486532052357992, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8128491002253091, "sim_render-ego": 0.007101759766087387, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0299519444956924, "deviation-heading": 0.6279067883270484, "set_robot_commands": 0.004973209265506629, "deviation-center-line": 0.23526141020693905, "driven_lanedir_consec": 0.8128491002253091, "sim_compute_sim_state": 0.002978053959933194, "sim_compute_performance-ego": 0.003912524743513627, "sim_compute_robot_state-ego": 0.005096471670902137}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 5.647577429969953, "sim_physics": 0.05505601565043131, "survival_time": 14.950000000000076, "driven_lanedir": 4.643555801043358, "sim_render-ego": 0.007035785516103108, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.0302549147605896, "deviation-heading": 3.05140712824374, "set_robot_commands": 0.004995567798614502, "deviation-center-line": 0.7383313532462132, "driven_lanedir_consec": 4.643555801043358, "sim_compute_sim_state": 0.002958970069885254, "sim_compute_performance-ego": 0.003964932759602865, "sim_compute_robot_state-ego": 0.005099400679270427}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8722796537241748, "sim_physics": 0.055389860890946295, "survival_time": 5.299999999999989, "driven_lanedir": 1.7192646281818695, "sim_render-ego": 0.007067403703365686, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02986265128513552, "deviation-heading": 0.8615840597199848, "set_robot_commands": 0.0049783688671184035, "deviation-center-line": 0.22112896266257623, "driven_lanedir_consec": 1.7192646281818695, "sim_compute_sim_state": 0.0029351036503629862, "sim_compute_performance-ego": 0.003916461512727558, "sim_compute_robot_state-ego": 0.005057505841525096}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.5026252530830675, "sim_physics": 0.05543397426605225, "survival_time": 14.950000000000076, "driven_lanedir": 4.317784040014602, "sim_render-ego": 0.0069768269856770836, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.030141767660776773, "deviation-heading": 2.971114165373348, "set_robot_commands": 0.004987321694691976, "deviation-center-line": 0.6509112534912812, "driven_lanedir_consec": 4.317784040014602, "sim_compute_sim_state": 0.002952405611673991, "sim_compute_performance-ego": 0.003939634164174398, "sim_compute_robot_state-ego": 0.005079889297485351}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.934585495505424, "sim_physics": 0.05529632012049357, "survival_time": 14.950000000000076, "driven_lanedir": 4.729539727789804, "sim_render-ego": 0.008020814259847004, "in-drivable-lane": 2.5500000000000167, "agent_compute-ego": 0.030683104197184244, "deviation-heading": 3.19642431631427, "set_robot_commands": 0.005051812330881754, "deviation-center-line": 0.8808565213661739, "driven_lanedir_consec": 4.729539727789804, "sim_compute_sim_state": 0.002972566286722819, "sim_compute_performance-ego": 0.0039931408564249675, "sim_compute_robot_state-ego": 0.005148325761159261}}set_robot_commands_max 0.005147155508937606 set_robot_commands_mean 0.004980546313285553 set_robot_commands_median 0.004980342488893321 set_robot_commands_min 0.004828910032908122 sim_compute_performance-ego_max 0.004075306897972062 sim_compute_performance-ego_mean 0.0039616023523551345 sim_compute_performance-ego_median 0.003951230843861898 sim_compute_performance-ego_min 0.003894416491190593 sim_compute_robot_state-ego_max 0.00518996813143903 sim_compute_robot_state-ego_mean 0.005108730214425423 sim_compute_robot_state-ego_median 0.005108480453491211 sim_compute_robot_state-ego_min 0.00503046411863515 sim_compute_sim_state_max 0.0030195858556899668 sim_compute_sim_state_mean 0.0029674949838677605 sim_compute_sim_state_median 0.00296713070697095 sim_compute_sim_state_min 0.002924187978108724 sim_physics_max 0.06068598038968984 sim_physics_mean 0.055977442969421504 sim_physics_median 0.05557119006841955 sim_physics_min 0.05481697718302409 sim_render-ego_max 0.00832990104076909 sim_render-ego_mean 0.007216310729845773 sim_render-ego_median 0.007101759766087387 sim_render-ego_min 0.0069768269856770836 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.856666666666687 survival_time_min 2.9999999999999973
No reset possible 288595520Frank (Chude) Qian 2019-12-05|FrankNet|Frozen2 aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.010418884814367 survival_time_median 7.599999999999981 deviation-center-line_median 0.4642928175068356 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03155948922914617 agent_compute-ego_mean 0.030332833093613436 agent_compute-ego_median 0.030100300312042236 agent_compute-ego_min 0.029861748218536377 deviation-center-line_max 0.8895584787110358 deviation-center-line_mean 0.5326490155779597 deviation-center-line_min 0.0813501291116537 deviation-heading_max 3.662921143213104 deviation-heading_mean 1.9203286546312357 deviation-heading_median 1.1350438786596062 deviation-heading_min 0.25384741833810254 driven_any_max 5.404885747289994 driven_any_mean 3.214927639032067 driven_any_median 3.04922537846604 driven_any_min 0.5961544875602448 driven_lanedir_consec_max 4.693392977239134 driven_lanedir_consec_mean 2.9333734735727557 driven_lanedir_consec_min 0.5849921457630103 driven_lanedir_max 4.693392977239134 driven_lanedir_mean 2.9333734735727557 driven_lanedir_median 3.010418884814367 driven_lanedir_min 0.5849921457630103 in-drivable-lane_max 1.500000000000021 in-drivable-lane_mean 0.480000000000004 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.594799535464532, "sim_physics": 0.059094735804726094, "survival_time": 13.600000000000058, "driven_lanedir": 4.005671760440995, "sim_render-ego": 0.006989519385730519, "in-drivable-lane": 0.8999999999999986, "agent_compute-ego": 0.03155948922914617, "deviation-heading": 3.662921143213104, "set_robot_commands": 0.005002734415671404, "deviation-center-line": 0.8643812035419124, "driven_lanedir_consec": 4.005671760440995, "sim_compute_sim_state": 0.0029420090072295245, "sim_compute_performance-ego": 0.004041259779649622, "sim_compute_robot_state-ego": 0.00515641359721913}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.404885747289994, "sim_physics": 0.0567235533396403, "survival_time": 14.950000000000076, "driven_lanedir": 4.693392977239134, "sim_render-ego": 0.007101486523946127, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.030100300312042236, "deviation-heading": 3.435769289756883, "set_robot_commands": 0.0049771261215209965, "deviation-center-line": 0.8895584787110358, "driven_lanedir_consec": 4.693392977239134, "sim_compute_sim_state": 0.002956369717915853, "sim_compute_performance-ego": 0.0039578564961751305, "sim_compute_robot_state-ego": 0.0051255202293396}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4295730463795233, "sim_physics": 0.05600156050461989, "survival_time": 6.499999999999985, "driven_lanedir": 2.372391599606272, "sim_render-ego": 0.007137069335350623, "in-drivable-lane": 0, "agent_compute-ego": 0.029898540790264425, "deviation-heading": 1.1350438786596062, "set_robot_commands": 0.004953703513512244, "deviation-center-line": 0.4642928175068356, "driven_lanedir_consec": 2.372391599606272, "sim_compute_sim_state": 0.0029309786283052883, "sim_compute_performance-ego": 0.003969124647287222, "sim_compute_robot_state-ego": 0.005127506989699143}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5961544875602448, "sim_physics": 0.06158590316772461, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5849921457630103, "sim_render-ego": 0.007421329617500305, "in-drivable-lane": 0, "agent_compute-ego": 0.029861748218536377, "deviation-heading": 0.25384741833810254, "set_robot_commands": 0.0049920454621315, "deviation-center-line": 0.0813501291116537, "driven_lanedir_consec": 0.5849921457630103, "sim_compute_sim_state": 0.003026828169822693, "sim_compute_performance-ego": 0.004059106111526489, "sim_compute_robot_state-ego": 0.0051195621490478516}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.04922537846604, "sim_physics": 0.057730061443228474, "survival_time": 7.599999999999981, "driven_lanedir": 3.010418884814367, "sim_render-ego": 0.008214323144210013, "in-drivable-lane": 0, "agent_compute-ego": 0.03024408691807797, "deviation-heading": 1.1140615431884806, "set_robot_commands": 0.0049937210584941666, "deviation-center-line": 0.36366244901836087, "driven_lanedir_consec": 3.010418884814367, "sim_compute_sim_state": 0.00296029762217873, "sim_compute_performance-ego": 0.00402258414971201, "sim_compute_robot_state-ego": 0.005169393200623362}}set_robot_commands_max 0.005002734415671404 set_robot_commands_mean 0.004983866114266063 set_robot_commands_median 0.0049920454621315 set_robot_commands_min 0.004953703513512244 sim_compute_performance-ego_max 0.004059106111526489 sim_compute_performance-ego_mean 0.004009986236870095 sim_compute_performance-ego_median 0.00402258414971201 sim_compute_performance-ego_min 0.0039578564961751305 sim_compute_robot_state-ego_max 0.005169393200623362 sim_compute_robot_state-ego_mean 0.005139679233185817 sim_compute_robot_state-ego_median 0.005127506989699143 sim_compute_robot_state-ego_min 0.0051195621490478516 sim_compute_sim_state_max 0.003026828169822693 sim_compute_sim_state_mean 0.002963296629090418 sim_compute_sim_state_median 0.002956369717915853 sim_compute_sim_state_min 0.0029309786283052883 sim_physics_max 0.06158590316772461 sim_physics_mean 0.05822716285198787 sim_physics_median 0.057730061443228474 sim_physics_min 0.05600156050461989 sim_render-ego_max 0.008214323144210013 sim_render-ego_mean 0.007372745601347518 sim_render-ego_median 0.007137069335350623 sim_render-ego_min 0.006989519385730519 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.85000000000002 survival_time_min 1.6000000000000008
No reset possible 288374401Alex Deliyannis challenge-aido_LF-template-tensorflow aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 288284401Alex Deliyannis challenge-aido_LF-template-tensorflow aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0.2789987106323233 survival_time 6 deviation-center-line 0.19076987254694697 in-drivable-lane 2
other stats deviation-heading 1.1529658561787417 driven_any 0.4713006510199544 driven_lanedir 0.2789987106323233 visualized-eval0-passed 1
No reset possible 288205174Robert Moni almasip-6824 aido3-LF-real-validationeval2-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 1.1290000667572024 survival_time 10 deviation-center-line 0.29970875517999984 in-drivable-lane 4.6667
other stats deviation-heading 0.4589142328227396 driven_any 2.2216377165223973 driven_lanedir 1.1290000667572024 visualized-eval2-passed 1
No reset possible 288155181Robert Moni almasip-6824 aido3-LF-real-validationeval2-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 288095181Robert Moni almasip-6824 aido3-LF-real-validationeval1-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 287125496Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5283214962192135 survival_time_median 2.0500000000000007 deviation-center-line_median 0.14586640654511 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.02284918228785197 agent_compute-ego_mean 0.02095330467225013 agent_compute-ego_median 0.020928301462313025 agent_compute-ego_min 0.01989163292778863 deviation-center-line_max 0.18757182847138293 deviation-center-line_mean 0.12786802052151355 deviation-center-line_min 0.052981160190656296 deviation-heading_max 0.7212501311901875 deviation-heading_mean 0.4904848241399176 deviation-heading_median 0.4063477528773738 deviation-heading_min 0.25884921447976494 driven_any_max 1.167768326777642 driven_any_mean 0.7356915134990485 driven_any_median 0.5484555599069014 driven_any_min 0.3546480219710406 driven_lanedir_consec_max 1.1446320423625218 driven_lanedir_consec_mean 0.7122082254397835 driven_lanedir_consec_min 0.33727360545652907 driven_lanedir_max 1.1446320423625218 driven_lanedir_mean 0.7122082254397835 driven_lanedir_median 0.5283214962192135 driven_lanedir_min 0.33727360545652907 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3546480219710406, "sim_physics": 0.0627187689145406, "survival_time": 1.2000000000000004, "driven_lanedir": 0.33727360545652907, "sim_render-ego": 0.007549991210301717, "in-drivable-lane": 0, "agent_compute-ego": 0.02284918228785197, "deviation-heading": 0.36337063051051127, "set_robot_commands": 0.00539049506187439, "deviation-center-line": 0.08540817761442435, "driven_lanedir_consec": 0.33727360545652907, "sim_compute_sim_state": 0.0029747585455576577, "sim_compute_performance-ego": 0.004278004169464111, "sim_compute_robot_state-ego": 0.005315611759821574}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.167768326777642, "sim_physics": 0.06031017878959919, "survival_time": 2.8999999999999977, "driven_lanedir": 1.1305054501164211, "sim_render-ego": 0.007139682769775391, "in-drivable-lane": 0, "agent_compute-ego": 0.021034483251900507, "deviation-heading": 0.7212501311901875, "set_robot_commands": 0.00519684676466317, "deviation-center-line": 0.18757182847138293, "driven_lanedir_consec": 1.1305054501164211, "sim_compute_sim_state": 0.0029986973466544315, "sim_compute_performance-ego": 0.003905727945525071, "sim_compute_robot_state-ego": 0.005312097483667834}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4468160643749566, "sim_physics": 0.05975647670466725, "survival_time": 2.0500000000000007, "driven_lanedir": 0.42030853304423177, "sim_render-ego": 0.007078577832477849, "in-drivable-lane": 0, "agent_compute-ego": 0.020928301462313025, "deviation-heading": 0.7026063916417498, "set_robot_commands": 0.005075251183858732, "deviation-center-line": 0.16751252978599424, "driven_lanedir_consec": 0.42030853304423177, "sim_compute_sim_state": 0.002962304324638553, "sim_compute_performance-ego": 0.003884780697706269, "sim_compute_robot_state-ego": 0.005180591490210556}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5484555599069014, "sim_physics": 0.05761792041637279, "survival_time": 1.3500000000000003, "driven_lanedir": 0.5283214962192135, "sim_render-ego": 0.007214713979650427, "in-drivable-lane": 0, "agent_compute-ego": 0.01989163292778863, "deviation-heading": 0.25884921447976494, "set_robot_commands": 0.005104356341891819, "deviation-center-line": 0.052981160190656296, "driven_lanedir_consec": 0.5283214962192135, "sim_compute_sim_state": 0.0028723610772026908, "sim_compute_performance-ego": 0.0039057201809353298, "sim_compute_robot_state-ego": 0.0050098631117079}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1607695944647016, "sim_physics": 0.057467524821941667, "survival_time": 2.5999999999999988, "driven_lanedir": 1.1446320423625218, "sim_render-ego": 0.007092659290020282, "in-drivable-lane": 0, "agent_compute-ego": 0.020062923431396484, "deviation-heading": 0.4063477528773738, "set_robot_commands": 0.005045404801001916, "deviation-center-line": 0.14586640654511, "driven_lanedir_consec": 1.1446320423625218, "sim_compute_sim_state": 0.002828845610985389, "sim_compute_performance-ego": 0.003918143419119028, "sim_compute_robot_state-ego": 0.005007808025066669}}set_robot_commands_max 0.00539049506187439 set_robot_commands_mean 0.005162470830658006 set_robot_commands_median 0.005104356341891819 set_robot_commands_min 0.005045404801001916 sim_compute_performance-ego_max 0.004278004169464111 sim_compute_performance-ego_mean 0.003978475282549962 sim_compute_performance-ego_median 0.003905727945525071 sim_compute_performance-ego_min 0.003884780697706269 sim_compute_robot_state-ego_max 0.005315611759821574 sim_compute_robot_state-ego_mean 0.0051651943740949075 sim_compute_robot_state-ego_median 0.005180591490210556 sim_compute_robot_state-ego_min 0.005007808025066669 sim_compute_sim_state_max 0.0029986973466544315 sim_compute_sim_state_mean 0.0029273933810077444 sim_compute_sim_state_median 0.002962304324638553 sim_compute_sim_state_min 0.002828845610985389 sim_physics_max 0.0627187689145406 sim_physics_mean 0.0595741739294243 sim_physics_median 0.05975647670466725 sim_physics_min 0.057467524821941667 sim_render-ego_max 0.007549991210301717 sim_render-ego_mean 0.007215125016445133 sim_render-ego_median 0.007139682769775391 sim_render-ego_min 0.007078577832477849 simulation-passed 1 survival_time_max 2.8999999999999977 survival_time_mean 2.0199999999999996 survival_time_min 1.2000000000000004
No reset possible 286895484Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6041200233031945 survival_time_median 1.800000000000001 deviation-center-line_median 0.11331501274026196 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0259130597114563 agent_compute-ego_mean 0.023965037404543383 agent_compute-ego_median 0.023852984110514324 agent_compute-ego_min 0.021262250048048954 deviation-center-line_max 0.2710743451585486 deviation-center-line_mean 0.14956009223592376 deviation-center-line_min 0.07693227978885112 deviation-heading_max 0.5723672814447918 deviation-heading_mean 0.4072234736793008 deviation-heading_median 0.40479952323598895 deviation-heading_min 0.25545540327454147 driven_any_max 1.8731459802100516 driven_any_mean 0.8142328431427004 driven_any_median 0.641388773078116 driven_any_min 0.35813594485264955 driven_lanedir_consec_max 1.8533746126151824 driven_lanedir_consec_mean 0.7958744590672782 driven_lanedir_consec_min 0.351201137583941 driven_lanedir_max 1.8533746126151824 driven_lanedir_mean 0.7958744590672782 driven_lanedir_median 0.6041200233031945 driven_lanedir_min 0.351201137583941 in-drivable-lane_max 0.09999999999999964 in-drivable-lane_mean 0.019999999999999928 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3879564348036008, "sim_physics": 0.07633067821634226, "survival_time": 1.4500000000000006, "driven_lanedir": 0.372515528691166, "sim_render-ego": 0.009727058739497745, "in-drivable-lane": 0, "agent_compute-ego": 0.02497642615745807, "deviation-heading": 0.40479952323598895, "set_robot_commands": 0.007051640543444404, "deviation-center-line": 0.11331501274026196, "driven_lanedir_consec": 0.372515528691166, "sim_compute_sim_state": 0.00381326675415039, "sim_compute_performance-ego": 0.005572845195901805, "sim_compute_robot_state-ego": 0.0069803533882930365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35813594485264955, "sim_physics": 0.07661061485608418, "survival_time": 1.2000000000000004, "driven_lanedir": 0.351201137583941, "sim_render-ego": 0.01876707871754964, "in-drivable-lane": 0, "agent_compute-ego": 0.0259130597114563, "deviation-heading": 0.2631595718983262, "set_robot_commands": 0.007484982411066691, "deviation-center-line": 0.10064845540437016, "driven_lanedir_consec": 0.351201137583941, "sim_compute_sim_state": 0.003728806972503662, "sim_compute_performance-ego": 0.005319615205128987, "sim_compute_robot_state-ego": 0.006813178459803264}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.641388773078116, "sim_physics": 0.06908409646216859, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6041200233031945, "sim_render-ego": 0.007942088106845288, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.021262250048048954, "deviation-heading": 0.5723672814447918, "set_robot_commands": 0.00585026943937261, "deviation-center-line": 0.18583036808758696, "driven_lanedir_consec": 0.6041200233031945, "sim_compute_sim_state": 0.0033276233267276844, "sim_compute_performance-ego": 0.004292538825501787, "sim_compute_robot_state-ego": 0.005783004963651616}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8105370827690834, "sim_physics": 0.06721248891618517, "survival_time": 1.800000000000001, "driven_lanedir": 0.7981609931429068, "sim_render-ego": 0.007845110363430448, "in-drivable-lane": 0, "agent_compute-ego": 0.023852984110514324, "deviation-heading": 0.25545540327454147, "set_robot_commands": 0.005536039670308431, "deviation-center-line": 0.07693227978885112, "driven_lanedir_consec": 0.7981609931429068, "sim_compute_sim_state": 0.003377642896440294, "sim_compute_performance-ego": 0.004389696651034885, "sim_compute_robot_state-ego": 0.005665818850199382}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8731459802100516, "sim_physics": 0.07179573059082031, "survival_time": 3.7499999999999942, "driven_lanedir": 1.8533746126151824, "sim_render-ego": 0.009509725570678713, "in-drivable-lane": 0, "agent_compute-ego": 0.023820466995239258, "deviation-heading": 0.5403355885428557, "set_robot_commands": 0.006389236450195313, "deviation-center-line": 0.2710743451585486, "driven_lanedir_consec": 1.8533746126151824, "sim_compute_sim_state": 0.0037504259745279943, "sim_compute_performance-ego": 0.005215005874633789, "sim_compute_robot_state-ego": 0.00646917978922526}}set_robot_commands_max 0.007484982411066691 set_robot_commands_mean 0.006462433702877489 set_robot_commands_median 0.006389236450195313 set_robot_commands_min 0.005536039670308431 sim_compute_performance-ego_max 0.005572845195901805 sim_compute_performance-ego_mean 0.00495794035044025 sim_compute_performance-ego_median 0.005215005874633789 sim_compute_performance-ego_min 0.004292538825501787 sim_compute_robot_state-ego_max 0.0069803533882930365 sim_compute_robot_state-ego_mean 0.006342307090234511 sim_compute_robot_state-ego_median 0.00646917978922526 sim_compute_robot_state-ego_min 0.005665818850199382 sim_compute_sim_state_max 0.00381326675415039 sim_compute_sim_state_mean 0.0035995531848700053 sim_compute_sim_state_median 0.003728806972503662 sim_compute_sim_state_min 0.0033276233267276844 sim_physics_max 0.07661061485608418 sim_physics_mean 0.0722067218083201 sim_physics_median 0.07179573059082031 sim_physics_min 0.06721248891618517 sim_render-ego_max 0.01876707871754964 sim_render-ego_mean 0.010758212299600363 sim_render-ego_median 0.009509725570678713 sim_render-ego_min 0.007845110363430448 simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 2.109999999999999 survival_time_min 1.2000000000000004
No reset possible 286745474Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:20 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 53, in on_received_get_commands
|| velocity, steering_angle = self.compute_action(self.current_image)
|| File "solution.py", line 49, in compute_action
|| action = self.model_lf.predict(observation)
|| File "/workspace/lf_model.py", line 92, in predict
|| v_tensor = self.torch.where(prob_corner>self.speed_threshold, self.max_speed, self.min_speed )
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 585, in __getattr__
|| type(self).__name__, name))
|| AttributeError: 'MonteCarloNet' object has no attribute 'torch'
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 286735473Basile Dura challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 29 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 286715472Basile Dura challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 286675469Frank (Chude) Qian 2019-12-04|FrankNet|Frozen1 aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:16:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.519105694135744 survival_time_median 7.99999999999998 deviation-center-line_median 0.4665722881026234 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.04248849391937256 agent_compute-ego_mean 0.03209126574310443 agent_compute-ego_median 0.02944301923116048 agent_compute-ego_min 0.02882351965274451 deviation-center-line_max 0.986089668619919 deviation-center-line_mean 0.5218827559388516 deviation-center-line_min 0.12261297413279754 deviation-heading_max 4.167715604102372 deviation-heading_mean 1.870107505300594 deviation-heading_median 1.6774139812098947 deviation-heading_min 0.4861561442026064 driven_any_max 6.3680663293079744 driven_any_mean 3.442970046787892 driven_any_median 2.9680125105947615 driven_any_min 1.0062326801217876 driven_lanedir_consec_max 6.237615399055478 driven_lanedir_consec_mean 2.923479067207917 driven_lanedir_consec_min 0.8172267288066604 driven_lanedir_max 6.237615399055478 driven_lanedir_mean 2.923479067207917 driven_lanedir_median 2.519105694135744 driven_lanedir_min 0.8172267288066604 in-drivable-lane_max 3.3500000000000174 in-drivable-lane_mean 1.0033333333333372 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.632569998042053, "sim_physics": 0.07472008398209495, "survival_time": 13.05000000000005, "driven_lanedir": 3.9316678990112055, "sim_render-ego": 0.008722925551549686, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.04126480895440697, "deviation-heading": 3.265157783696145, "set_robot_commands": 0.006714588837605327, "deviation-center-line": 0.986089668619919, "driven_lanedir_consec": 3.9316678990112055, "sim_compute_sim_state": 0.003706349266899957, "sim_compute_performance-ego": 0.005171935677071641, "sim_compute_robot_state-ego": 0.006562453120147588}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.949056555797103, "sim_physics": 0.06842033392718049, "survival_time": 7.349999999999982, "driven_lanedir": 2.0919420019037864, "sim_render-ego": 0.008051015892807318, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.037322333069885666, "deviation-heading": 1.6956778797403975, "set_robot_commands": 0.006158032384859461, "deviation-center-line": 0.39456619500564494, "driven_lanedir_consec": 2.0919420019037864, "sim_compute_sim_state": 0.003415844067424333, "sim_compute_performance-ego": 0.004456111363002232, "sim_compute_robot_state-ego": 0.005809814751553698}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.3680663293079744, "sim_physics": 0.08338335514068604, "survival_time": 14.950000000000076, "driven_lanedir": 6.237615399055478, "sim_render-ego": 0.00977790117263794, "in-drivable-lane": 0, "agent_compute-ego": 0.04248849391937256, "deviation-heading": 2.517155075760257, "set_robot_commands": 0.007378602822621663, "deviation-center-line": 0.9726378254397884, "driven_lanedir_consec": 6.237615399055478, "sim_compute_sim_state": 0.004133295218149821, "sim_compute_performance-ego": 0.005592343807220459, "sim_compute_robot_state-ego": 0.0071975310643514}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.731888579409897, "sim_physics": 0.07278687318166097, "survival_time": 14.950000000000076, "driven_lanedir": 4.759262303046476, "sim_render-ego": 0.008770102659861247, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.03747632185618083, "deviation-heading": 4.167715604102372, "set_robot_commands": 0.0068328205744425455, "deviation-center-line": 0.9406442547593056, "driven_lanedir_consec": 4.759262303046476, "sim_compute_sim_state": 0.003807641665140787, "sim_compute_performance-ego": 0.005083986123402913, "sim_compute_robot_state-ego": 0.0063883606592814125}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 6.114111228065316, "sim_physics": 0.055767869154612223, "survival_time": 14.950000000000076, "driven_lanedir": 4.505088722708315, "sim_render-ego": 0.006992401281992595, "in-drivable-lane": 3.3500000000000174, "agent_compute-ego": 0.02944301923116048, "deviation-heading": 2.9324012694371153, "set_robot_commands": 0.004904253482818604, "deviation-center-line": 0.6862554869410009, "driven_lanedir_consec": 4.505088722708315, "sim_compute_sim_state": 0.002933166821797689, "sim_compute_performance-ego": 0.003914674123128255, "sim_compute_robot_state-ego": 0.0050242439905802405}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.6089568318388, "sim_physics": 0.05594314183436983, "survival_time": 12.050000000000036, "driven_lanedir": 3.789332211988268, "sim_render-ego": 0.0070589874789922565, "in-drivable-lane": 1.6500000000000048, "agent_compute-ego": 0.029490945744811252, "deviation-heading": 3.251065427633388, "set_robot_commands": 0.004972631011266431, "deviation-center-line": 0.7320509167393489, "driven_lanedir_consec": 3.789332211988268, "sim_compute_sim_state": 0.0029572728263886636, "sim_compute_performance-ego": 0.003933177449396537, "sim_compute_robot_state-ego": 0.0050676591168795386}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.705242457426163, "sim_physics": 0.055327864103419805, "survival_time": 4.6499999999999915, "driven_lanedir": 1.680174411405568, "sim_render-ego": 0.007096554643364363, "in-drivable-lane": 0, "agent_compute-ego": 0.029393108942175426, "deviation-heading": 0.5526603449319876, "set_robot_commands": 0.0050344287708241455, "deviation-center-line": 0.19353231478436628, "driven_lanedir_consec": 1.680174411405568, "sim_compute_sim_state": 0.0029482969673730996, "sim_compute_performance-ego": 0.003942769060852707, "sim_compute_robot_state-ego": 0.005023825553155715}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0232227233490014, "sim_physics": 0.05662129060277399, "survival_time": 2.6499999999999986, "driven_lanedir": 0.907469319033246, "sim_render-ego": 0.007244537461478755, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.029212983149402547, "deviation-heading": 0.589352648608694, "set_robot_commands": 0.004991346935056291, "deviation-center-line": 0.12261297413279754, "driven_lanedir_consec": 0.907469319033246, "sim_compute_sim_state": 0.0029684057775533424, "sim_compute_performance-ego": 0.0040004613264551705, "sim_compute_robot_state-ego": 0.00517223466117427}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 5.555402273225273, "sim_physics": 0.05744594097137451, "survival_time": 14.950000000000076, "driven_lanedir": 4.586170760008287, "sim_render-ego": 0.00702977180480957, "in-drivable-lane": 1.850000000000012, "agent_compute-ego": 0.029642391204833984, "deviation-heading": 3.13379212628534, "set_robot_commands": 0.005069798628489177, "deviation-center-line": 0.9017585955386116, "driven_lanedir_consec": 4.586170760008287, "sim_compute_sim_state": 0.0029639474550882975, "sim_compute_performance-ego": 0.00396586020787557, "sim_compute_robot_state-ego": 0.005112772782643636}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.4884100735066736, "sim_physics": 0.05509040641784668, "survival_time": 6.249999999999986, "driven_lanedir": 2.0980866343518927, "sim_render-ego": 0.007096630096435547, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.029421451568603516, "deviation-heading": 1.1106221104072689, "set_robot_commands": 0.004989645004272461, "deviation-center-line": 0.4015848951090744, "driven_lanedir_consec": 2.0980866343518927, "sim_compute_sim_state": 0.002962881088256836, "sim_compute_performance-ego": 0.003938819885253906, "sim_compute_robot_state-ego": 0.0050775260925292965}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0062326801217876, "sim_physics": 0.05601568491953724, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8172267288066604, "sim_render-ego": 0.007147919456913786, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.02882351965274451, "deviation-heading": 0.4861561442026064, "set_robot_commands": 0.004956150954624392, "deviation-center-line": 0.1737653871309119, "driven_lanedir_consec": 0.8172267288066604, "sim_compute_sim_state": 0.002939417677105598, "sim_compute_performance-ego": 0.003958621115054724, "sim_compute_robot_state-ego": 0.004968638690012806}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.2057247905887798, "sim_physics": 0.05561465948400363, "survival_time": 3.5499999999999954, "driven_lanedir": 1.185424252501413, "sim_render-ego": 0.007156741451209699, "in-drivable-lane": 0, "agent_compute-ego": 0.02931271136646539, "deviation-heading": 0.5220288115424008, "set_robot_commands": 0.004988374844403334, "deviation-center-line": 0.15906692673865275, "driven_lanedir_consec": 1.185424252501413, "sim_compute_sim_state": 0.0029466320091569927, "sim_compute_performance-ego": 0.003966549752463757, "sim_compute_robot_state-ego": 0.005075031602886361}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.99002498471225, "sim_physics": 0.05709146994810838, "survival_time": 5.1999999999999895, "driven_lanedir": 1.8699194250434128, "sim_render-ego": 0.00717281148983882, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.029147122914974507, "deviation-heading": 0.5576255874891912, "set_robot_commands": 0.0049775449129251335, "deviation-center-line": 0.20127028496938248, "driven_lanedir_consec": 1.8699194250434128, "sim_compute_sim_state": 0.002937818949039166, "sim_compute_performance-ego": 0.003962796468001146, "sim_compute_robot_state-ego": 0.005093879424608671}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.2976286858325574, "sim_physics": 0.05585812303152951, "survival_time": 8.79999999999999, "driven_lanedir": 2.519105694135744, "sim_render-ego": 0.007030198519880121, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.029299910772930492, "deviation-heading": 1.5927877844618483, "set_robot_commands": 0.004951527172868902, "deviation-center-line": 0.4665722881026234, "driven_lanedir_consec": 2.519105694135744, "sim_compute_sim_state": 0.0029445927251469006, "sim_compute_performance-ego": 0.003922791643576188, "sim_compute_robot_state-ego": 0.004997703162106601}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.9680125105947615, "sim_physics": 0.05590431541204453, "survival_time": 7.99999999999998, "driven_lanedir": 2.873700245119007, "sim_render-ego": 0.007095623016357422, "in-drivable-lane": 0, "agent_compute-ego": 0.029629863798618317, "deviation-heading": 1.6774139812098947, "set_robot_commands": 0.004931624233722687, "deviation-center-line": 0.4958333250713447, "driven_lanedir_consec": 2.873700245119007, "sim_compute_sim_state": 0.002938723564147949, "sim_compute_performance-ego": 0.003947417438030243, "sim_compute_robot_state-ego": 0.005066965520381927}}set_robot_commands_max 0.007378602822621663 set_robot_commands_mean 0.00545675803805337 set_robot_commands_median 0.004989645004272461 set_robot_commands_min 0.004904253482818604 sim_compute_performance-ego_max 0.005592343807220459 sim_compute_performance-ego_mean 0.00425055436271903 sim_compute_performance-ego_median 0.003962796468001146 sim_compute_performance-ego_min 0.003914674123128255 sim_compute_robot_state-ego_max 0.0071975310643514 sim_compute_robot_state-ego_mean 0.005442576012819544 sim_compute_robot_state-ego_median 0.0050775260925292965 sim_compute_robot_state-ego_min 0.004968638690012806 sim_compute_sim_state_max 0.004133295218149821 sim_compute_sim_state_mean 0.0031669524052446293 sim_compute_sim_state_median 0.0029572728263886636 sim_compute_sim_state_min 0.002933166821797689 sim_physics_max 0.08338335514068604 sim_physics_mean 0.06106609414074952 sim_physics_median 0.05601568491953724 sim_physics_min 0.05509040641784668 sim_render-ego_max 0.00977790117263794 sim_render-ego_mean 0.00756294146520861 sim_render-ego_median 0.007147919456913786 sim_render-ego_min 0.006992401281992595 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.933333333333355 survival_time_min 2.6499999999999986
No reset possible 286575466Charles Cossette challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 50 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 286505462Charles Cossette challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.19708852874706 survival_time_median 8.09999999999998 deviation-center-line_median 0.4825191481961222 in-drivable-lane_median 1.3999999999999952
other stats agent_compute-ego_max 0.016678839921951294 agent_compute-ego_mean 0.01590951117277543 agent_compute-ego_median 0.015768433411916097 agent_compute-ego_min 0.015421654727007891 deviation-center-line_max 0.8904659920755716 deviation-center-line_mean 0.5592969775844884 deviation-center-line_min 0.24411723637195856 deviation-heading_max 4.086043013867648 deviation-heading_mean 2.158814614907397 deviation-heading_median 1.977202350146623 deviation-heading_min 0.5795077462770137 driven_any_max 5.140050306978217 driven_any_mean 3.1149970048840983 driven_any_median 2.766523179702839 driven_any_min 1.0837998317515447 driven_lanedir_consec_max 4.656947198394409 driven_lanedir_consec_mean 2.703521026916988 driven_lanedir_consec_min 1.0287538994746512 driven_lanedir_max 4.656947198394409 driven_lanedir_mean 2.703521026916988 driven_lanedir_median 2.19708852874706 driven_lanedir_min 1.0287538994746512 in-drivable-lane_max 2.400000000000005 in-drivable-lane_mean 1.069999999999999 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0837998317515447, "sim_physics": 0.05854799747467041, "survival_time": 3.999999999999994, "driven_lanedir": 1.0287538994746512, "sim_render-ego": 0.007189762592315674, "in-drivable-lane": 0, "agent_compute-ego": 0.016678839921951294, "deviation-heading": 1.0838346499234832, "set_robot_commands": 0.008101144433021545, "deviation-center-line": 0.24411723637195856, "driven_lanedir_consec": 1.0287538994746512, "sim_compute_sim_state": 0.003846976161003113, "sim_compute_performance-ego": 0.004202312231063843, "sim_compute_robot_state-ego": 0.005354791879653931}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.766523179702839, "sim_physics": 0.05640438898110095, "survival_time": 8.09999999999998, "driven_lanedir": 2.19708852874706, "sim_render-ego": 0.007070007147612395, "in-drivable-lane": 1.5499999999999954, "agent_compute-ego": 0.01575250831651099, "deviation-heading": 1.977202350146623, "set_robot_commands": 0.007565938396218382, "deviation-center-line": 0.33842166579688465, "driven_lanedir_consec": 2.19708852874706, "sim_compute_sim_state": 0.0037709356826028705, "sim_compute_performance-ego": 0.003983107613928524, "sim_compute_robot_state-ego": 0.005068655367250796}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.140050306978217, "sim_physics": 0.05662752628326416, "survival_time": 14.950000000000076, "driven_lanedir": 4.656947198394409, "sim_render-ego": 0.007114920616149902, "in-drivable-lane": 1.3999999999999952, "agent_compute-ego": 0.015768433411916097, "deviation-heading": 3.0674853143222176, "set_robot_commands": 0.007944811979929606, "deviation-center-line": 0.8409608454819043, "driven_lanedir_consec": 4.656947198394409, "sim_compute_sim_state": 0.004165260791778564, "sim_compute_performance-ego": 0.003997256755828857, "sim_compute_robot_state-ego": 0.005161367257436117}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.45145631202279, "sim_physics": 0.05773412068684896, "survival_time": 14.950000000000076, "driven_lanedir": 3.5146107919097886, "sim_render-ego": 0.007069494724273682, "in-drivable-lane": 2.400000000000005, "agent_compute-ego": 0.015926119486490885, "deviation-heading": 4.086043013867648, "set_robot_commands": 0.007944661776224772, "deviation-center-line": 0.8904659920755716, "driven_lanedir_consec": 3.5146107919097886, "sim_compute_sim_state": 0.004031654198964437, "sim_compute_performance-ego": 0.003986334800720215, "sim_compute_robot_state-ego": 0.005179581642150879}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.133155393965101, "sim_physics": 0.056042224437266856, "survival_time": 5.549999999999988, "driven_lanedir": 2.120204716059032, "sim_render-ego": 0.007110060872258367, "in-drivable-lane": 0, "agent_compute-ego": 0.015421654727007891, "deviation-heading": 0.5795077462770137, "set_robot_commands": 0.0075003284591812274, "deviation-center-line": 0.4825191481961222, "driven_lanedir_consec": 2.120204716059032, "sim_compute_sim_state": 0.004151851207286388, "sim_compute_performance-ego": 0.0039480205054755685, "sim_compute_robot_state-ego": 0.005007355062811224}}set_robot_commands_max 0.008101144433021545 set_robot_commands_mean 0.007811377008915106 set_robot_commands_median 0.007944661776224772 set_robot_commands_min 0.0075003284591812274 sim_compute_performance-ego_max 0.004202312231063843 sim_compute_performance-ego_mean 0.004023406381403401 sim_compute_performance-ego_median 0.003986334800720215 sim_compute_performance-ego_min 0.0039480205054755685 sim_compute_robot_state-ego_max 0.005354791879653931 sim_compute_robot_state-ego_mean 0.005154350241860589 sim_compute_robot_state-ego_median 0.005161367257436117 sim_compute_robot_state-ego_min 0.005007355062811224 sim_compute_sim_state_max 0.004165260791778564 sim_compute_sim_state_mean 0.003993335608327075 sim_compute_sim_state_median 0.004031654198964437 sim_compute_sim_state_min 0.0037709356826028705 sim_physics_max 0.05854799747467041 sim_physics_mean 0.057071251572630266 sim_physics_median 0.05662752628326416 sim_physics_min 0.056042224437266856 sim_render-ego_max 0.007189762592315674 sim_render-ego_mean 0.007110849190522003 sim_render-ego_median 0.007110060872258367 sim_render-ego_min 0.007069494724273682 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.510000000000025 survival_time_min 3.999999999999994
No reset possible 286204535Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LF-real-validationeval2-videos error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:40 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 285964543Robert Moni kaland-22401 aido3-LF-real-validationeval0-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 284745401Nikolaus Howe challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.109893876713289 survival_time_median 3.2999999999999963 deviation-center-line_median 0.15641385643982225 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.05423746426900228 agent_compute-ego_mean 0.046429803328397655 agent_compute-ego_median 0.05012281214604612 agent_compute-ego_min 0.02999974019599683 deviation-center-line_max 0.5527518525601613 deviation-center-line_mean 0.30115052592651886 deviation-center-line_min 0.13735162598390027 deviation-heading_max 2.401677542543428 deviation-heading_mean 1.3022944660348577 deviation-heading_median 0.8328538524529581 deviation-heading_min 0.5117164154446767 driven_any_max 4.397371027700517 driven_any_mean 2.144205431376903 driven_any_median 1.170626366756661 driven_any_min 1.0676445584863257 driven_lanedir_consec_max 3.8746615603368753 driven_lanedir_consec_mean 1.872416104636102 driven_lanedir_consec_min 0.8251637362144855 driven_lanedir_max 3.8746615603368753 driven_lanedir_mean 1.872416104636102 driven_lanedir_median 1.109893876713289 driven_lanedir_min 0.8251637362144855 in-drivable-lane_max 1.099999999999996 in-drivable-lane_mean 0.4900000000000011 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.170626366756661, "sim_physics": 0.14095213196494363, "survival_time": 3.2999999999999963, "driven_lanedir": 1.109893876713289, "sim_render-ego": 0.014287807724692604, "in-drivable-lane": 0, "agent_compute-ego": 0.02999974019599683, "deviation-heading": 0.8328538524529581, "set_robot_commands": 0.012526038921240604, "deviation-center-line": 0.15641385643982225, "driven_lanedir_consec": 1.109893876713289, "sim_compute_sim_state": 0.006111387050513065, "sim_compute_performance-ego": 0.008567239298964992, "sim_compute_robot_state-ego": 0.01036229639342337}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.117806377619479, "sim_physics": 0.10565956164214572, "survival_time": 2.9499999999999975, "driven_lanedir": 1.095292754192555, "sim_render-ego": 0.012214361611059156, "in-drivable-lane": 0, "agent_compute-ego": 0.04498733100244554, "deviation-heading": 0.5117164154446767, "set_robot_commands": 0.008984161635576669, "deviation-center-line": 0.13735162598390027, "driven_lanedir_consec": 1.095292754192555, "sim_compute_sim_state": 0.005035675178139897, "sim_compute_performance-ego": 0.0071821051128840045, "sim_compute_robot_state-ego": 0.009170912079891916}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0676445584863257, "sim_physics": 0.10920085672472345, "survival_time": 3.049999999999997, "driven_lanedir": 0.8251637362144855, "sim_render-ego": 0.011774211633400838, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05012281214604612, "deviation-heading": 0.6260859922706628, "set_robot_commands": 0.009375165720454982, "deviation-center-line": 0.14569522198509238, "driven_lanedir_consec": 0.8251637362144855, "sim_compute_sim_state": 0.004912098900216525, "sim_compute_performance-ego": 0.007006574849613378, "sim_compute_robot_state-ego": 0.009195456739331856}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.397371027700517, "sim_physics": 0.12710068596733942, "survival_time": 11.250000000000025, "driven_lanedir": 3.8746615603368753, "sim_render-ego": 0.014043063057793513, "in-drivable-lane": 0.8500000000000112, "agent_compute-ego": 0.05423746426900228, "deviation-heading": 2.401677542543428, "set_robot_commands": 0.011359120474921332, "deviation-center-line": 0.5527518525601613, "driven_lanedir_consec": 3.8746615603368753, "sim_compute_sim_state": 0.005728187561035156, "sim_compute_performance-ego": 0.008249715169270833, "sim_compute_robot_state-ego": 0.010793045891655816}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.967578826321533, "sim_physics": 0.12152047311106036, "survival_time": 7.7499999999999805, "driven_lanedir": 2.457068595723303, "sim_render-ego": 0.013516810632521106, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.05280166902849751, "deviation-heading": 2.1391385274625625, "set_robot_commands": 0.011108392284762474, "deviation-center-line": 0.5135400726636179, "driven_lanedir_consec": 2.457068595723303, "sim_compute_sim_state": 0.0056502726770216415, "sim_compute_performance-ego": 0.00786139888148154, "sim_compute_robot_state-ego": 0.009664354016703944}}set_robot_commands_max 0.012526038921240604 set_robot_commands_mean 0.010670575807391213 set_robot_commands_median 0.011108392284762474 set_robot_commands_min 0.008984161635576669 sim_compute_performance-ego_max 0.008567239298964992 sim_compute_performance-ego_mean 0.007773406662442949 sim_compute_performance-ego_median 0.00786139888148154 sim_compute_performance-ego_min 0.007006574849613378 sim_compute_robot_state-ego_max 0.010793045891655816 sim_compute_robot_state-ego_mean 0.00983721302420138 sim_compute_robot_state-ego_median 0.009664354016703944 sim_compute_robot_state-ego_min 0.009170912079891916 sim_compute_sim_state_max 0.006111387050513065 sim_compute_sim_state_mean 0.005487524273385257 sim_compute_sim_state_median 0.0056502726770216415 sim_compute_sim_state_min 0.004912098900216525 sim_physics_max 0.14095213196494363 sim_physics_mean 0.12088674188204251 sim_physics_median 0.12152047311106036 sim_physics_min 0.10565956164214572 sim_render-ego_max 0.014287807724692604 sim_render-ego_mean 0.013167250931893444 sim_render-ego_median 0.013516810632521106 sim_render-ego_min 0.011774211633400838 simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 5.659999999999999 survival_time_min 2.9499999999999975
No reset possible 284475391c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:31 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 283775347Charles Cossette challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.564603793614185 survival_time_median 14.950000000000076 deviation-center-line_median 0.877068685370026 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.016175700823465984 agent_compute-ego_mean 0.015805919799251833 agent_compute-ego_median 0.01590513146441916 agent_compute-ego_min 0.015422487258911132 deviation-center-line_max 0.9213088930237092 deviation-center-line_mean 0.6205715989315654 deviation-center-line_min 0.13468011253720932 deviation-heading_max 2.704039636240889 deviation-heading_mean 1.6191402356267062 deviation-heading_median 2.1670955876384124 deviation-heading_min 0.2966943299107952 driven_any_max 4.9029712540051555 driven_any_mean 2.9245742503077627 driven_any_median 3.0151107632932357 driven_any_min 0.7942133054425794 driven_lanedir_consec_max 4.453063791148464 driven_lanedir_consec_mean 2.6267647637843012 driven_lanedir_consec_min 0.7859732378151653 driven_lanedir_max 4.453063791148464 driven_lanedir_mean 2.6267647637843012 driven_lanedir_median 2.564603793614185 driven_lanedir_min 0.7859732378151653 in-drivable-lane_max 2.050000000000006 in-drivable-lane_mean 1.0400000000000025 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0151107632932357, "sim_physics": 0.059277746677398685, "survival_time": 14.950000000000076, "driven_lanedir": 2.564603793614185, "sim_render-ego": 0.0069538267453511556, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.016175700823465984, "deviation-heading": 2.704039636240889, "set_robot_commands": 0.0071522363026936845, "deviation-center-line": 0.8914375059918834, "driven_lanedir_consec": 2.564603793614185, "sim_compute_sim_state": 0.0037688112258911135, "sim_compute_performance-ego": 0.004063843886057536, "sim_compute_robot_state-ego": 0.005182513395945231}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6924430722701422, "sim_physics": 0.05593363205591838, "survival_time": 14.950000000000076, "driven_lanedir": 3.120309926394227, "sim_render-ego": 0.007146742343902588, "in-drivable-lane": 1.8000000000000096, "agent_compute-ego": 0.015989264647165935, "deviation-heading": 2.3715320498910253, "set_robot_commands": 0.007237913608551025, "deviation-center-line": 0.877068685370026, "driven_lanedir_consec": 3.120309926394227, "sim_compute_sim_state": 0.003868794441223144, "sim_compute_performance-ego": 0.004020435015360514, "sim_compute_robot_state-ego": 0.005196655591328939}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9029712540051555, "sim_physics": 0.05601897239685059, "survival_time": 14.950000000000076, "driven_lanedir": 4.453063791148464, "sim_render-ego": 0.007027186552683512, "in-drivable-lane": 2.050000000000006, "agent_compute-ego": 0.015537014802296956, "deviation-heading": 2.1670955876384124, "set_robot_commands": 0.006842056115468343, "deviation-center-line": 0.9213088930237092, "driven_lanedir_consec": 4.453063791148464, "sim_compute_sim_state": 0.0037387339274088543, "sim_compute_performance-ego": 0.003982621828715007, "sim_compute_robot_state-ego": 0.005055872599283854}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7942133054425794, "sim_physics": 0.05839896720388661, "survival_time": 2.3, "driven_lanedir": 0.7859732378151653, "sim_render-ego": 0.0072165831275608225, "in-drivable-lane": 0, "agent_compute-ego": 0.01590513146441916, "deviation-heading": 0.2966943299107952, "set_robot_commands": 0.007267060487166695, "deviation-center-line": 0.13468011253720932, "driven_lanedir_consec": 0.7859732378151653, "sim_compute_sim_state": 0.0037999930589095406, "sim_compute_performance-ego": 0.004007282464400581, "sim_compute_robot_state-ego": 0.005133457805799401}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2181328565277028, "sim_physics": 0.05915441720382027, "survival_time": 5.749999999999988, "driven_lanedir": 2.2098730699494644, "sim_render-ego": 0.0071781324303668475, "in-drivable-lane": 0, "agent_compute-ego": 0.015422487258911132, "deviation-heading": 0.5563395744524103, "set_robot_commands": 0.006896728018055792, "deviation-center-line": 0.2783627977349993, "driven_lanedir_consec": 2.2098730699494644, "sim_compute_sim_state": 0.003796631356944209, "sim_compute_performance-ego": 0.0039978752965512485, "sim_compute_robot_state-ego": 0.005061746680218241}}set_robot_commands_max 0.007267060487166695 set_robot_commands_mean 0.007079198906387108 set_robot_commands_median 0.0071522363026936845 set_robot_commands_min 0.006842056115468343 sim_compute_performance-ego_max 0.004063843886057536 sim_compute_performance-ego_mean 0.004014411698216977 sim_compute_performance-ego_median 0.004007282464400581 sim_compute_performance-ego_min 0.003982621828715007 sim_compute_robot_state-ego_max 0.005196655591328939 sim_compute_robot_state-ego_mean 0.005126049214515134 sim_compute_robot_state-ego_median 0.005133457805799401 sim_compute_robot_state-ego_min 0.005055872599283854 sim_compute_sim_state_max 0.003868794441223144 sim_compute_sim_state_mean 0.003794592802075372 sim_compute_sim_state_median 0.003796631356944209 sim_compute_sim_state_min 0.0037387339274088543 sim_physics_max 0.059277746677398685 sim_physics_mean 0.057756747107574904 sim_physics_median 0.05839896720388661 sim_physics_min 0.05593363205591838 sim_render-ego_max 0.0072165831275608225 sim_render-ego_mean 0.0071044942399729845 sim_render-ego_median 0.007146742343902588 sim_render-ego_min 0.0069538267453511556 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.580000000000044 survival_time_min 2.3
No reset possible 283545336Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.2586648048992704 survival_time_median 14.950000000000076 deviation-center-line_median 0.809628930719978 in-drivable-lane_median 1.3000000000000185
other stats agent_compute-ego_max 0.01635107119878133 agent_compute-ego_mean 0.01589619384773474 agent_compute-ego_median 0.01587965408960978 agent_compute-ego_min 0.015517955621083575 deviation-center-line_max 1.036210024583842 deviation-center-line_mean 0.8139317780580736 deviation-center-line_min 0.6087381298062428 deviation-heading_max 5.3622219530446795 deviation-heading_mean 3.805079473479356 deviation-heading_median 3.720178072453094 deviation-heading_min 2.2535432268317375 driven_any_max 3.969252682946914 driven_any_mean 3.4554236086108787 driven_any_median 3.553831177200358 driven_any_min 2.8678041844063142 driven_lanedir_consec_max 3.8529962388611327 driven_lanedir_consec_mean 3.1652765567024597 driven_lanedir_consec_min 2.3946255065295072 driven_lanedir_max 3.8529962388611327 driven_lanedir_mean 3.1659593388168523 driven_lanedir_median 3.2620787154712327 driven_lanedir_min 2.3946255065295072 in-drivable-lane_max 1.900000000000027 in-drivable-lane_mean 1.1900000000000168 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8678041844063142, "sim_physics": 0.055976564884185794, "survival_time": 14.950000000000076, "driven_lanedir": 2.3946255065295072, "sim_render-ego": 0.006957437992095947, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.01635107119878133, "deviation-heading": 4.647256868838484, "set_robot_commands": 0.007265555063883464, "deviation-center-line": 0.9870237468558646, "driven_lanedir_consec": 2.3946255065295072, "sim_compute_sim_state": 0.0036018713315327964, "sim_compute_performance-ego": 0.0040997950236002605, "sim_compute_robot_state-ego": 0.005123799641927084}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.053309970469099, "sim_physics": 0.05670751651128133, "survival_time": 14.950000000000076, "driven_lanedir": 2.7043031474773973, "sim_render-ego": 0.007065291404724121, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.01584421157836914, "deviation-heading": 5.3622219530446795, "set_robot_commands": 0.007176233927408854, "deviation-center-line": 0.809628930719978, "driven_lanedir_consec": 2.7043031474773973, "sim_compute_sim_state": 0.0036557475725809735, "sim_compute_performance-ego": 0.003991055488586426, "sim_compute_robot_state-ego": 0.005153706868489583}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.832920028031711, "sim_physics": 0.05480601628621419, "survival_time": 14.950000000000076, "driven_lanedir": 3.615793085744991, "sim_render-ego": 0.007071479956309001, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.015517955621083575, "deviation-heading": 3.042197246228786, "set_robot_commands": 0.007058383623758952, "deviation-center-line": 1.036210024583842, "driven_lanedir_consec": 3.615793085744991, "sim_compute_sim_state": 0.0034744962056477867, "sim_compute_performance-ego": 0.003973416487375895, "sim_compute_robot_state-ego": 0.0050950837135314946}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.969252682946914, "sim_physics": 0.05789172109753016, "survival_time": 12.150000000000038, "driven_lanedir": 3.8529962388611327, "sim_render-ego": 0.007099366482393241, "in-drivable-lane": 0, "agent_compute-ego": 0.01588807675082988, "deviation-heading": 2.2535432268317375, "set_robot_commands": 0.007224149664733635, "deviation-center-line": 0.6087381298062428, "driven_lanedir_consec": 3.8529962388611327, "sim_compute_sim_state": 0.0038581914862487543, "sim_compute_performance-ego": 0.004017712157449604, "sim_compute_robot_state-ego": 0.005194613962997625}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.553831177200358, "sim_physics": 0.05664733409881592, "survival_time": 14.950000000000076, "driven_lanedir": 3.2620787154712327, "sim_render-ego": 0.007075838247934977, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01587965408960978, "deviation-heading": 3.720178072453094, "set_robot_commands": 0.007065423329671224, "deviation-center-line": 0.6280580583244406, "driven_lanedir_consec": 3.2586648048992704, "sim_compute_sim_state": 0.003693025112152099, "sim_compute_performance-ego": 0.003980721632639567, "sim_compute_robot_state-ego": 0.005145529905954997}}set_robot_commands_max 0.007265555063883464 set_robot_commands_mean 0.007157949121891226 set_robot_commands_median 0.007176233927408854 set_robot_commands_min 0.007058383623758952 sim_compute_performance-ego_max 0.0040997950236002605 sim_compute_performance-ego_mean 0.0040125401579303496 sim_compute_performance-ego_median 0.003991055488586426 sim_compute_performance-ego_min 0.003973416487375895 sim_compute_robot_state-ego_max 0.005194613962997625 sim_compute_robot_state-ego_mean 0.005142546818580156 sim_compute_robot_state-ego_median 0.005145529905954997 sim_compute_robot_state-ego_min 0.0050950837135314946 sim_compute_sim_state_max 0.0038581914862487543 sim_compute_sim_state_mean 0.003656666341632482 sim_compute_sim_state_median 0.0036557475725809735 sim_compute_sim_state_min 0.0034744962056477867 sim_physics_max 0.05789172109753016 sim_physics_mean 0.05640583057560549 sim_physics_median 0.05664733409881592 sim_physics_min 0.05480601628621419 sim_render-ego_max 0.007099366482393241 sim_render-ego_mean 0.0070538828166914576 sim_render-ego_median 0.007071479956309001 sim_render-ego_min 0.006957437992095947 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.390000000000068 survival_time_min 12.150000000000038
No reset possible 283485332c reddy challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.8173208100951994 survival_time_median 14.950000000000076 deviation-center-line_median 0.8470184837467428 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03584259033203125 agent_compute-ego_mean 0.03463196524114556 agent_compute-ego_median 0.035342180338062225 agent_compute-ego_min 0.031189534664154053 deviation-center-line_max 0.9360247144600496 deviation-center-line_mean 0.6954822871797747 deviation-center-line_min 0.1567339689645989 deviation-heading_max 6.425496051893608 deviation-heading_mean 3.907956577565217 deviation-heading_median 3.938875300901029 deviation-heading_min 0.932989193873238 driven_any_max 3.883089929523551 driven_any_mean 2.9583936479281987 driven_any_median 3.1122672083689262 driven_any_min 1.5358170165461027 driven_lanedir_consec_max 3.5604806800723057 driven_lanedir_consec_mean 2.735013066184736 driven_lanedir_consec_min 1.5014872327704616 driven_lanedir_max 3.5604806800723057 driven_lanedir_mean 2.735013066184736 driven_lanedir_median 2.8173208100951994 driven_lanedir_min 1.5014872327704616 in-drivable-lane_max 0.70000000000001 in-drivable-lane_mean 0.14000000000000198 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.058158733487681, "sim_physics": 0.05881115357081095, "survival_time": 14.950000000000076, "driven_lanedir": 2.8173208100951994, "sim_render-ego": 0.006984116236368815, "in-drivable-lane": 0, "agent_compute-ego": 0.031189534664154053, "deviation-heading": 4.877478829239719, "set_robot_commands": 0.005627933343251546, "deviation-center-line": 0.9360247144600496, "driven_lanedir_consec": 2.8173208100951994, "sim_compute_sim_state": 0.0032204763094584145, "sim_compute_performance-ego": 0.004084526697794596, "sim_compute_robot_state-ego": 0.005146856307983398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1122672083689262, "sim_physics": 0.05682123025258382, "survival_time": 14.950000000000076, "driven_lanedir": 2.750544773105928, "sim_render-ego": 0.007156272729237874, "in-drivable-lane": 0, "agent_compute-ego": 0.035612899462382, "deviation-heading": 6.425496051893608, "set_robot_commands": 0.005067819754282633, "deviation-center-line": 0.8470184837467428, "driven_lanedir_consec": 2.750544773105928, "sim_compute_sim_state": 0.0030368614196777345, "sim_compute_performance-ego": 0.004002563158671061, "sim_compute_robot_state-ego": 0.005180654525756836}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.202635351714732, "sim_physics": 0.0559540078288219, "survival_time": 12.200000000000038, "driven_lanedir": 3.045231834879784, "sim_render-ego": 0.00706789532645804, "in-drivable-lane": 0, "agent_compute-ego": 0.035342180338062225, "deviation-heading": 3.364943511918489, "set_robot_commands": 0.005040337804888115, "deviation-center-line": 0.915445010242963, "driven_lanedir_consec": 3.045231834879784, "sim_compute_sim_state": 0.0029893322069136823, "sim_compute_performance-ego": 0.0039898274374789875, "sim_compute_robot_state-ego": 0.005089908349709433}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5358170165461027, "sim_physics": 0.0588477534106654, "survival_time": 5.849999999999987, "driven_lanedir": 1.5014872327704616, "sim_render-ego": 0.007380571120824569, "in-drivable-lane": 0, "agent_compute-ego": 0.035172621409098305, "deviation-heading": 0.932989193873238, "set_robot_commands": 0.005079929645244892, "deviation-center-line": 0.1567339689645989, "driven_lanedir_consec": 1.5014872327704616, "sim_compute_sim_state": 0.0031447838514279095, "sim_compute_performance-ego": 0.004076546073978783, "sim_compute_robot_state-ego": 0.005213916811168703}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.883089929523551, "sim_physics": 0.058703707059224446, "survival_time": 14.950000000000076, "driven_lanedir": 3.5604806800723057, "sim_render-ego": 0.007132774988810222, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.03584259033203125, "deviation-heading": 3.938875300901029, "set_robot_commands": 0.005066683292388916, "deviation-center-line": 0.6221892584845193, "driven_lanedir_consec": 3.5604806800723057, "sim_compute_sim_state": 0.0030773011843363445, "sim_compute_performance-ego": 0.003995853265126546, "sim_compute_robot_state-ego": 0.005187146663665772}}set_robot_commands_max 0.005627933343251546 set_robot_commands_mean 0.00517654076801122 set_robot_commands_median 0.005067819754282633 set_robot_commands_min 0.005040337804888115 sim_compute_performance-ego_max 0.004084526697794596 sim_compute_performance-ego_mean 0.004029863326609995 sim_compute_performance-ego_median 0.004002563158671061 sim_compute_performance-ego_min 0.0039898274374789875 sim_compute_robot_state-ego_max 0.005213916811168703 sim_compute_robot_state-ego_mean 0.0051636965316568285 sim_compute_robot_state-ego_median 0.005180654525756836 sim_compute_robot_state-ego_min 0.005089908349709433 sim_compute_sim_state_max 0.0032204763094584145 sim_compute_sim_state_mean 0.0030937509943628166 sim_compute_sim_state_median 0.0030773011843363445 sim_compute_sim_state_min 0.0029893322069136823 sim_physics_max 0.0588477534106654 sim_physics_mean 0.057827570424421305 sim_physics_median 0.058703707059224446 sim_physics_min 0.0559540078288219 sim_render-ego_max 0.007380571120824569 sim_render-ego_mean 0.0071443260803399035 sim_render-ego_median 0.007132774988810222 sim_render-ego_min 0.006984116236368815 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.580000000000052 survival_time_min 5.849999999999987
No reset possible 283325322Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8589941397459824 survival_time_median 14.950000000000076 deviation-center-line_median 0.7427704458126069 in-drivable-lane_median 2.800000000000024
other stats agent_compute-ego_max 0.016839582125345864 agent_compute-ego_mean 0.015838511166749177 agent_compute-ego_median 0.015566836992899576 agent_compute-ego_min 0.015409334500630697 deviation-center-line_max 0.9727945710764068 deviation-center-line_mean 0.6815589461280493 deviation-center-line_min 0.1558230108586479 deviation-heading_max 5.751668727684617 deviation-heading_mean 3.2199921358676753 deviation-heading_median 3.45180745659764 deviation-heading_min 0.640430616964467 driven_any_max 4.617339714351755 driven_any_mean 3.567737829188971 driven_any_median 3.4492882726807728 driven_any_min 2.753405802871878 driven_lanedir_consec_max 4.179409544867277 driven_lanedir_consec_mean 2.335446626771586 driven_lanedir_consec_min 1.3874583548132826 driven_lanedir_max 4.179409544867277 driven_lanedir_mean 3.1440827708954604 driven_lanedir_median 2.9447172259671586 driven_lanedir_min 2.4102637845373676 in-drivable-lane_max 3.0500000000000034 in-drivable-lane_mean 2.570000000000013 in-drivable-lane_min 1.2499999999999956 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1598120750254632, "sim_physics": 0.05516417900721232, "survival_time": 14.950000000000076, "driven_lanedir": 2.756773921179662, "sim_render-ego": 0.006979682445526123, "in-drivable-lane": 2.800000000000024, "agent_compute-ego": 0.015951445102691652, "deviation-heading": 3.9892580881825217, "set_robot_commands": 0.006984367370605469, "deviation-center-line": 0.9727945710764068, "driven_lanedir_consec": 1.8411073098940207, "sim_compute_sim_state": 0.0037076099713643394, "sim_compute_performance-ego": 0.004067356586456299, "sim_compute_robot_state-ego": 0.005213724772135417}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.858843281014983, "sim_physics": 0.055477933883666994, "survival_time": 14.950000000000076, "driven_lanedir": 3.4292493779258386, "sim_render-ego": 0.007096993128458659, "in-drivable-lane": 2.800000000000013, "agent_compute-ego": 0.015409334500630697, "deviation-heading": 3.45180745659764, "set_robot_commands": 0.0070738005638122554, "deviation-center-line": 0.7427704458126069, "driven_lanedir_consec": 1.8589941397459824, "sim_compute_sim_state": 0.0036781883239746095, "sim_compute_performance-ego": 0.003959085941314697, "sim_compute_robot_state-ego": 0.005077337423960368}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.617339714351755, "sim_physics": 0.05572023550669352, "survival_time": 14.950000000000076, "driven_lanedir": 4.179409544867277, "sim_render-ego": 0.007069738705952963, "in-drivable-lane": 3.0500000000000034, "agent_compute-ego": 0.015566836992899576, "deviation-heading": 2.266795789909133, "set_robot_commands": 0.007185064951578776, "deviation-center-line": 0.6907728659334719, "driven_lanedir_consec": 4.179409544867277, "sim_compute_sim_state": 0.003664344946543376, "sim_compute_performance-ego": 0.003951768080393474, "sim_compute_robot_state-ego": 0.005092397530873616}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4492882726807728, "sim_physics": 0.05484108845392863, "survival_time": 14.950000000000076, "driven_lanedir": 2.9447172259671586, "sim_render-ego": 0.0070195627212524415, "in-drivable-lane": 2.950000000000027, "agent_compute-ego": 0.016839582125345864, "deviation-heading": 5.751668727684617, "set_robot_commands": 0.007153049310048421, "deviation-center-line": 0.8456338369591131, "driven_lanedir_consec": 1.3874583548132826, "sim_compute_sim_state": 0.003723181883494059, "sim_compute_performance-ego": 0.003973323504130046, "sim_compute_robot_state-ego": 0.005052158037821452}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.753405802871878, "sim_physics": 0.05626310065940574, "survival_time": 6.749999999999984, "driven_lanedir": 2.4102637845373676, "sim_render-ego": 0.007086305265073423, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.015425357112178096, "deviation-heading": 0.640430616964467, "set_robot_commands": 0.007064285984745732, "deviation-center-line": 0.1558230108586479, "driven_lanedir_consec": 2.4102637845373676, "sim_compute_sim_state": 0.003729262175383391, "sim_compute_performance-ego": 0.003937270906236436, "sim_compute_robot_state-ego": 0.005116058278966833}}set_robot_commands_max 0.007185064951578776 set_robot_commands_mean 0.00709211363615813 set_robot_commands_median 0.0070738005638122554 set_robot_commands_min 0.006984367370605469 sim_compute_performance-ego_max 0.004067356586456299 sim_compute_performance-ego_mean 0.0039777610037061905 sim_compute_performance-ego_median 0.003959085941314697 sim_compute_performance-ego_min 0.003937270906236436 sim_compute_robot_state-ego_max 0.005213724772135417 sim_compute_robot_state-ego_mean 0.005110335208751537 sim_compute_robot_state-ego_median 0.005092397530873616 sim_compute_robot_state-ego_min 0.005052158037821452 sim_compute_sim_state_max 0.003729262175383391 sim_compute_sim_state_mean 0.003700517460151955 sim_compute_sim_state_median 0.0037076099713643394 sim_compute_sim_state_min 0.003664344946543376 sim_physics_max 0.05626310065940574 sim_physics_mean 0.05549330750218144 sim_physics_median 0.055477933883666994 sim_physics_min 0.05484108845392863 sim_render-ego_max 0.007096993128458659 sim_render-ego_mean 0.007050456453252722 sim_render-ego_median 0.007069738705952963 sim_render-ego_min 0.006979682445526123 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.31000000000006 survival_time_min 6.749999999999984
No reset possible 283055304Basile Dura challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8869438545503503 survival_time_median 12.25000000000004 deviation-center-line_median 0.6863670586688001 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.02446659309108083 agent_compute-ego_mean 0.0235391434149401 agent_compute-ego_median 0.023600743741405257 agent_compute-ego_min 0.0227187180519104 deviation-center-line_max 0.977404964247134 deviation-center-line_mean 0.6109645168237362 deviation-center-line_min 0.2480249183382526 deviation-heading_max 3.417932502132546 deviation-heading_mean 1.8305342003702996 deviation-heading_median 1.4160855775733956 deviation-heading_min 0.8666034312886817 driven_any_max 2.349143649883529 driven_any_mean 1.7127380042554072 driven_any_median 1.9151594270825356 driven_any_min 0.6860267423530599 driven_lanedir_consec_max 2.3183791285197453 driven_lanedir_consec_mean 1.6455059371651977 driven_lanedir_consec_min 0.6686754820401247 driven_lanedir_max 2.3183791285197453 driven_lanedir_mean 1.6455059371651977 driven_lanedir_median 1.8869438545503503 driven_lanedir_min 0.6686754820401247 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.15999999999999942 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6860267423530599, "sim_physics": 0.08433102792309176, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6686754820401247, "sim_render-ego": 0.010226467604278236, "in-drivable-lane": 0, "agent_compute-ego": 0.023185345434373426, "deviation-heading": 0.8666034312886817, "set_robot_commands": 0.009023666381835938, "deviation-center-line": 0.2480249183382526, "driven_lanedir_consec": 0.6686754820401247, "sim_compute_sim_state": 0.004693336384270781, "sim_compute_performance-ego": 0.006113826587635983, "sim_compute_robot_state-ego": 0.007517978709231141}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9151594270825356, "sim_physics": 0.09032365740561972, "survival_time": 12.25000000000004, "driven_lanedir": 1.8869438545503503, "sim_render-ego": 0.010921442265413243, "in-drivable-lane": 0, "agent_compute-ego": 0.023600743741405257, "deviation-heading": 1.3579439495145469, "set_robot_commands": 0.009674712589808872, "deviation-center-line": 0.6863670586688001, "driven_lanedir_consec": 1.8869438545503503, "sim_compute_sim_state": 0.004825017890151666, "sim_compute_performance-ego": 0.0062532347075793205, "sim_compute_robot_state-ego": 0.007938081391003667}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.349116624583627, "sim_physics": 0.08844005107879639, "survival_time": 14.950000000000076, "driven_lanedir": 2.11983860899386, "sim_render-ego": 0.010781849225362142, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.023724316755930584, "deviation-heading": 3.417932502132546, "set_robot_commands": 0.00978731075922648, "deviation-center-line": 0.977404964247134, "driven_lanedir_consec": 2.11983860899386, "sim_compute_sim_state": 0.0048798076311747235, "sim_compute_performance-ego": 0.0064116636912028, "sim_compute_robot_state-ego": 0.008096021016438802}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.264243577374284, "sim_physics": 0.09473115496519136, "survival_time": 8.199999999999982, "driven_lanedir": 1.2336926117219071, "sim_render-ego": 0.011481476993095584, "in-drivable-lane": 0, "agent_compute-ego": 0.02446659309108083, "deviation-heading": 1.4160855775733956, "set_robot_commands": 0.010150253772735596, "deviation-center-line": 0.3745109323100098, "driven_lanedir_consec": 1.2336926117219071, "sim_compute_sim_state": 0.004903540378663598, "sim_compute_performance-ego": 0.006760777496710056, "sim_compute_robot_state-ego": 0.008336171871278344}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349143649883529, "sim_physics": 0.08281798362731933, "survival_time": 14.950000000000076, "driven_lanedir": 2.3183791285197453, "sim_render-ego": 0.010159173011779786, "in-drivable-lane": 0, "agent_compute-ego": 0.0227187180519104, "deviation-heading": 2.094105541342329, "set_robot_commands": 0.009163246949513754, "deviation-center-line": 0.7685147105544844, "driven_lanedir_consec": 2.3183791285197453, "sim_compute_sim_state": 0.004813872178395589, "sim_compute_performance-ego": 0.005941906770070394, "sim_compute_robot_state-ego": 0.00753495454788208}}set_robot_commands_max 0.010150253772735596 set_robot_commands_mean 0.009559838090624127 set_robot_commands_median 0.009674712589808872 set_robot_commands_min 0.009023666381835938 sim_compute_performance-ego_max 0.006760777496710056 sim_compute_performance-ego_mean 0.0062962818506397105 sim_compute_performance-ego_median 0.0062532347075793205 sim_compute_performance-ego_min 0.005941906770070394 sim_compute_robot_state-ego_max 0.008336171871278344 sim_compute_robot_state-ego_mean 0.007884641507166806 sim_compute_robot_state-ego_median 0.007938081391003667 sim_compute_robot_state-ego_min 0.007517978709231141 sim_compute_sim_state_max 0.004903540378663598 sim_compute_sim_state_mean 0.004823114892531272 sim_compute_sim_state_median 0.004825017890151666 sim_compute_sim_state_min 0.004693336384270781 sim_physics_max 0.09473115496519136 sim_physics_mean 0.08812877500000371 sim_physics_median 0.08844005107879639 sim_physics_min 0.08281798362731933 sim_render-ego_max 0.011481476993095584 sim_render-ego_mean 0.010714081819985798 sim_render-ego_median 0.010781849225362142 sim_render-ego_min 0.010159173011779786 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.000000000000034 survival_time_min 4.6499999999999915
No reset possible 282885295Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:29 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 282525275Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.3901181189686524 survival_time_median 14.950000000000076 deviation-center-line_median 0.720328405498351 in-drivable-lane_median 2.3500000000000334
other stats agent_compute-ego_max 0.023472979863484705 agent_compute-ego_mean 0.018021795908610028 agent_compute-ego_median 0.01608800172805786 agent_compute-ego_min 0.015413599809010824 deviation-center-line_max 1.0810543118073097 deviation-center-line_mean 0.8228723672709034 deviation-center-line_min 0.5812259150226049 deviation-heading_max 4.369637386862289 deviation-heading_mean 3.9448181469129566 deviation-heading_median 3.847684822534841 deviation-heading_min 3.799084373281556 driven_any_max 4.692169365380107 driven_any_mean 4.195624710925332 driven_any_median 4.2343266649688465 driven_any_min 3.8511592267054207 driven_lanedir_consec_max 3.828773291100217 driven_lanedir_consec_mean 2.69027474478934 driven_lanedir_consec_min 1.7974627978655062 driven_lanedir_max 4.111621964870009 driven_lanedir_mean 3.647229982089123 driven_lanedir_median 3.787418324068056 driven_lanedir_min 3.1333263730738103 in-drivable-lane_max 3.3500000000000236 in-drivable-lane_mean 2.16000000000001 in-drivable-lane_min 1.100000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.861598818482959, "sim_physics": 0.07613611698150635, "survival_time": 14.950000000000076, "driven_lanedir": 3.1333263730738103, "sim_render-ego": 0.008499980767567953, "in-drivable-lane": 3.3500000000000236, "agent_compute-ego": 0.0194418740272522, "deviation-heading": 3.8438944762248015, "set_robot_commands": 0.00871821641921997, "deviation-center-line": 0.6906391855701094, "driven_lanedir_consec": 2.0396650334001043, "sim_compute_sim_state": 0.004709602991739909, "sim_compute_performance-ego": 0.004993282159169515, "sim_compute_robot_state-ego": 0.00641305685043335}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.33886947908933, "sim_physics": 0.09098265568415324, "survival_time": 14.950000000000076, "driven_lanedir": 3.787418324068056, "sim_render-ego": 0.011326065063476562, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.023472979863484705, "deviation-heading": 3.847684822534841, "set_robot_commands": 0.009636308352152506, "deviation-center-line": 0.720328405498351, "driven_lanedir_consec": 1.7974627978655062, "sim_compute_sim_state": 0.004859926700592041, "sim_compute_performance-ego": 0.006582085291544596, "sim_compute_robot_state-ego": 0.008437229792277018}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8511592267054207, "sim_physics": 0.06101282835006714, "survival_time": 14.950000000000076, "driven_lanedir": 3.39535448261222, "sim_render-ego": 0.007416612307230632, "in-drivable-lane": 1.5499999999999956, "agent_compute-ego": 0.01608800172805786, "deviation-heading": 3.799084373281556, "set_robot_commands": 0.007458597819010417, "deviation-center-line": 1.0810543118073097, "driven_lanedir_consec": 3.39535448261222, "sim_compute_sim_state": 0.003889451026916504, "sim_compute_performance-ego": 0.004214084943135579, "sim_compute_robot_state-ego": 0.005401333173116048}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.692169365380107, "sim_physics": 0.058493237495422366, "survival_time": 14.950000000000076, "driven_lanedir": 4.111621964870009, "sim_render-ego": 0.007252705891927083, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.015692524115244546, "deviation-heading": 3.8637896756612977, "set_robot_commands": 0.007029937903086344, "deviation-center-line": 0.5812259150226049, "driven_lanedir_consec": 3.828773291100217, "sim_compute_sim_state": 0.003763206799825032, "sim_compute_performance-ego": 0.0040769441922505695, "sim_compute_robot_state-ego": 0.005182431538899739}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.2343266649688465, "sim_physics": 0.05641687870025635, "survival_time": 14.950000000000076, "driven_lanedir": 3.808428765821519, "sim_render-ego": 0.007096956570943197, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.015413599809010824, "deviation-heading": 4.369637386862289, "set_robot_commands": 0.006969449520111084, "deviation-center-line": 1.0411140184561418, "driven_lanedir_consec": 2.3901181189686524, "sim_compute_sim_state": 0.003627601464589437, "sim_compute_performance-ego": 0.004025867780049642, "sim_compute_robot_state-ego": 0.005131240685780843}}set_robot_commands_max 0.009636308352152506 set_robot_commands_mean 0.007962502002716063 set_robot_commands_median 0.007458597819010417 set_robot_commands_min 0.006969449520111084 sim_compute_performance-ego_max 0.006582085291544596 sim_compute_performance-ego_mean 0.00477845287322998 sim_compute_performance-ego_median 0.004214084943135579 sim_compute_performance-ego_min 0.004025867780049642 sim_compute_robot_state-ego_max 0.008437229792277018 sim_compute_robot_state-ego_mean 0.006113058408101399 sim_compute_robot_state-ego_median 0.005401333173116048 sim_compute_robot_state-ego_min 0.005131240685780843 sim_compute_sim_state_max 0.004859926700592041 sim_compute_sim_state_mean 0.004169957796732585 sim_compute_sim_state_median 0.003889451026916504 sim_compute_sim_state_min 0.003627601464589437 sim_physics_max 0.09098265568415324 sim_physics_mean 0.06860834344228109 sim_physics_median 0.06101282835006714 sim_physics_min 0.05641687870025635 sim_render-ego_max 0.011326065063476562 sim_render-ego_mean 0.008318464120229085 sim_render-ego_median 0.007416612307230632 sim_render-ego_min 0.007096956570943197 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 282115253Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:21 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 53, in on_received_get_commands
|| velocity, omega = self.compute_action(self.current_image)
|| File "solution.py", line 49, in compute_action
|| action = self.model_lf.predict(observation)
|| File "/workspace/lf_model.py", line 92, in predict
|| v_tensor = self.torch.where(prob_corner>self.speed_threshold, self.max_speed, self.min_speed )
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 585, in __getattr__
|| type(self).__name__, name))
|| AttributeError: 'MonteCarloNet' object has no attribute 'torch'
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 282095251Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.938197285609042 survival_time_median 14.950000000000076 deviation-center-line_median 0.6542451476259076 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.016445732116699217 agent_compute-ego_mean 0.015869728088378908 agent_compute-ego_median 0.015762530167897543 agent_compute-ego_min 0.015537749926249188 deviation-center-line_max 0.7433683951446879 deviation-center-line_mean 0.6616678126960933 deviation-center-line_min 0.5875091095450102 deviation-heading_max 4.20980808188313 deviation-heading_mean 3.738844916185579 deviation-heading_median 3.663992759937949 deviation-heading_min 3.4105709834251714 driven_any_max 3.9045486257828106 driven_any_mean 3.2811076737801934 driven_any_median 3.1665194203572957 driven_any_min 3.022486485494088 driven_lanedir_consec_max 3.7759460316288105 driven_lanedir_consec_mean 3.086443014488053 driven_lanedir_consec_min 2.7366630784887183 driven_lanedir_max 3.7759460316288105 driven_lanedir_mean 3.086443014488053 driven_lanedir_median 2.938197285609042 driven_lanedir_min 2.7366630784887183 in-drivable-lane_max 1.3499999999999952 in-drivable-lane_mean 0.4699999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2276306824148455, "sim_physics": 0.05892182032267253, "survival_time": 14.950000000000076, "driven_lanedir": 2.937340259402012, "sim_render-ego": 0.007014563083648681, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.016445732116699217, "deviation-heading": 4.20980808188313, "set_robot_commands": 0.007292633851369222, "deviation-center-line": 0.7101702658580404, "driven_lanedir_consec": 2.937340259402012, "sim_compute_sim_state": 0.003816985289255778, "sim_compute_performance-ego": 0.004137655893961588, "sim_compute_robot_state-ego": 0.0052225176493326825}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0843531548519283, "sim_physics": 0.05542843023935954, "survival_time": 14.950000000000076, "driven_lanedir": 2.938197285609042, "sim_render-ego": 0.007022485733032226, "in-drivable-lane": 0, "agent_compute-ego": 0.015537749926249188, "deviation-heading": 3.746662759857964, "set_robot_commands": 0.007005066871643067, "deviation-center-line": 0.6542451476259076, "driven_lanedir_consec": 2.938197285609042, "sim_compute_sim_state": 0.003534971078236898, "sim_compute_performance-ego": 0.0039577937126159665, "sim_compute_robot_state-ego": 0.0049858196576436364}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.022486485494088, "sim_physics": 0.05574689388275147, "survival_time": 14.950000000000076, "driven_lanedir": 2.7366630784887183, "sim_render-ego": 0.0070663038889567055, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.015585898558298748, "deviation-heading": 3.663189995823682, "set_robot_commands": 0.007007380326588948, "deviation-center-line": 0.7433683951446879, "driven_lanedir_consec": 2.7366630784887183, "sim_compute_sim_state": 0.003634055455525716, "sim_compute_performance-ego": 0.0039822522799173995, "sim_compute_robot_state-ego": 0.005105538368225098}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9045486257828106, "sim_physics": 0.055915350119272865, "survival_time": 14.950000000000076, "driven_lanedir": 3.7759460316288105, "sim_render-ego": 0.007050567468007405, "in-drivable-lane": 0, "agent_compute-ego": 0.01601672967274984, "deviation-heading": 3.4105709834251714, "set_robot_commands": 0.007118073304494222, "deviation-center-line": 0.5875091095450102, "driven_lanedir_consec": 3.7759460316288105, "sim_compute_sim_state": 0.003524274031321208, "sim_compute_performance-ego": 0.003986744085947672, "sim_compute_robot_state-ego": 0.0051008987426757815}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1665194203572957, "sim_physics": 0.05647069295247396, "survival_time": 14.950000000000076, "driven_lanedir": 3.0440684173116823, "sim_render-ego": 0.007029428482055664, "in-drivable-lane": 0, "agent_compute-ego": 0.015762530167897543, "deviation-heading": 3.663992759937949, "set_robot_commands": 0.0071205838521321615, "deviation-center-line": 0.6130461453068202, "driven_lanedir_consec": 3.0440684173116823, "sim_compute_sim_state": 0.003626392682393392, "sim_compute_performance-ego": 0.0039774847030639646, "sim_compute_robot_state-ego": 0.005033707618713379}}set_robot_commands_max 0.007292633851369222 set_robot_commands_mean 0.007108747641245525 set_robot_commands_median 0.007118073304494222 set_robot_commands_min 0.007005066871643067 sim_compute_performance-ego_max 0.004137655893961588 sim_compute_performance-ego_mean 0.004008386135101318 sim_compute_performance-ego_median 0.0039822522799173995 sim_compute_performance-ego_min 0.0039577937126159665 sim_compute_robot_state-ego_max 0.0052225176493326825 sim_compute_robot_state-ego_mean 0.005089696407318116 sim_compute_robot_state-ego_median 0.0051008987426757815 sim_compute_robot_state-ego_min 0.0049858196576436364 sim_compute_sim_state_max 0.003816985289255778 sim_compute_sim_state_mean 0.003627335707346598 sim_compute_sim_state_median 0.003626392682393392 sim_compute_sim_state_min 0.003524274031321208 sim_physics_max 0.05892182032267253 sim_physics_mean 0.05649663750330608 sim_physics_median 0.055915350119272865 sim_physics_min 0.05542843023935954 sim_render-ego_max 0.0070663038889567055 sim_render-ego_mean 0.007036669731140137 sim_render-ego_median 0.007029428482055664 sim_render-ego_min 0.007014563083648681 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 282055250Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.0206678952594226 survival_time_median 14.950000000000076 deviation-center-line_median 0.5928635006232349 in-drivable-lane_median 1.9500000000000275
other stats agent_compute-ego_max 0.03532101392745972 agent_compute-ego_mean 0.03419362719853719 agent_compute-ego_median 0.03493276834487915 agent_compute-ego_min 0.030902719497680663 deviation-center-line_max 0.8873877066406735 deviation-center-line_mean 0.6798071246308753 deviation-center-line_min 0.5330104282863 deviation-heading_max 4.690319222516626 deviation-heading_mean 4.029575930082962 deviation-heading_median 4.323450282707122 deviation-heading_min 3.009152571466082 driven_any_max 4.031885223658371 driven_any_mean 3.589169462549303 driven_any_median 3.4615937585510426 driven_any_min 3.2411138265833253 driven_lanedir_consec_max 3.585736830657547 driven_lanedir_consec_mean 2.8123194577571295 driven_lanedir_consec_min 1.503886816425421 driven_lanedir_max 3.610779713609499 driven_lanedir_mean 3.2253732189775564 driven_lanedir_median 3.0880923599058 driven_lanedir_min 2.82158929545551 in-drivable-lane_max 2.600000000000037 in-drivable-lane_mean 1.680000000000016 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2411138265833253, "sim_physics": 0.056232588291168215, "survival_time": 14.950000000000076, "driven_lanedir": 3.0206678952594226, "sim_render-ego": 0.006985969543457031, "in-drivable-lane": 0, "agent_compute-ego": 0.030902719497680663, "deviation-heading": 4.690319222516626, "set_robot_commands": 0.005650552908579508, "deviation-center-line": 0.8873877066406735, "driven_lanedir_consec": 3.0206678952594226, "sim_compute_sim_state": 0.0031230958302815755, "sim_compute_performance-ego": 0.0040754365921020505, "sim_compute_robot_state-ego": 0.00510722557703654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.296710136133724, "sim_physics": 0.05548796733220418, "survival_time": 14.950000000000076, "driven_lanedir": 2.82158929545551, "sim_render-ego": 0.0070807099342346195, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.03493276834487915, "deviation-heading": 3.784173436701858, "set_robot_commands": 0.005091812610626221, "deviation-center-line": 0.5726633429010969, "driven_lanedir_consec": 2.680594731817188, "sim_compute_sim_state": 0.002951592604319254, "sim_compute_performance-ego": 0.003952866395314535, "sim_compute_robot_state-ego": 0.005039237340291341}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.9145443678200538, "sim_physics": 0.05621341784795125, "survival_time": 14.950000000000076, "driven_lanedir": 3.585736830657547, "sim_render-ego": 0.006957022349039713, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.034537875652313234, "deviation-heading": 3.009152571466082, "set_robot_commands": 0.005047619342803955, "deviation-center-line": 0.8131106447030717, "driven_lanedir_consec": 3.585736830657547, "sim_compute_sim_state": 0.0029703251520792643, "sim_compute_performance-ego": 0.003966507116953532, "sim_compute_robot_state-ego": 0.005071962674458821}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4615937585510426, "sim_physics": 0.05610977729161581, "survival_time": 14.950000000000076, "driven_lanedir": 3.0880923599058, "sim_render-ego": 0.007042972246805826, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.03527375857035319, "deviation-heading": 4.340784137023125, "set_robot_commands": 0.005068521499633789, "deviation-center-line": 0.5330104282863, "driven_lanedir_consec": 1.503886816425421, "sim_compute_sim_state": 0.0029973371823628745, "sim_compute_performance-ego": 0.003949698607126872, "sim_compute_robot_state-ego": 0.00507661501566569}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.031885223658371, "sim_physics": 0.056353429158528645, "survival_time": 14.950000000000076, "driven_lanedir": 3.610779713609499, "sim_render-ego": 0.0070654471715291345, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.03532101392745972, "deviation-heading": 4.323450282707122, "set_robot_commands": 0.005188477039337158, "deviation-center-line": 0.5928635006232349, "driven_lanedir_consec": 3.27071101462607, "sim_compute_sim_state": 0.0030248395601908365, "sim_compute_performance-ego": 0.003988192081451416, "sim_compute_robot_state-ego": 0.00511401653289795}}set_robot_commands_max 0.005650552908579508 set_robot_commands_mean 0.005209396680196127 set_robot_commands_median 0.005091812610626221 set_robot_commands_min 0.005047619342803955 sim_compute_performance-ego_max 0.0040754365921020505 sim_compute_performance-ego_mean 0.0039865401585896815 sim_compute_performance-ego_median 0.003966507116953532 sim_compute_performance-ego_min 0.003949698607126872 sim_compute_robot_state-ego_max 0.00511401653289795 sim_compute_robot_state-ego_mean 0.005081811428070069 sim_compute_robot_state-ego_median 0.00507661501566569 sim_compute_robot_state-ego_min 0.005039237340291341 sim_compute_sim_state_max 0.0031230958302815755 sim_compute_sim_state_mean 0.003013438065846761 sim_compute_sim_state_median 0.0029973371823628745 sim_compute_sim_state_min 0.002951592604319254 sim_physics_max 0.056353429158528645 sim_physics_mean 0.05607943598429362 sim_physics_median 0.05621341784795125 sim_physics_min 0.05548796733220418 sim_render-ego_max 0.0070807099342346195 sim_render-ego_mean 0.007026424249013265 sim_render-ego_median 0.007042972246805826 sim_render-ego_min 0.006957022349039713 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 281955243Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.425158023037036 survival_time_median 14.950000000000076 deviation-center-line_median 0.8932718397964737 in-drivable-lane_median 0.7500000000000107
other stats agent_compute-ego_max 0.01685330311457316 agent_compute-ego_mean 0.016027710451596025 agent_compute-ego_median 0.015809890429178873 agent_compute-ego_min 0.015676278273264566 deviation-center-line_max 1.2084636781446576 deviation-center-line_mean 0.8032663176955939 deviation-center-line_min 0.2050827926976057 deviation-heading_max 7.4791979075377215 deviation-heading_mean 5.244323891251618 deviation-heading_median 5.792712280467846 deviation-heading_min 1.4229396731855442 driven_any_max 3.607015214366903 driven_any_mean 2.534213374367296 driven_any_median 2.804003612172907 driven_any_min 1.2107819385727614 driven_lanedir_consec_max 1.8446754139561503 driven_lanedir_consec_mean 1.3492879194498504 driven_lanedir_consec_min 0.7964341421694761 driven_lanedir_max 2.918596672330525 driven_lanedir_mean 2.039149065372379 driven_lanedir_median 2.206153914815427 driven_lanedir_min 1.0623652719948171 in-drivable-lane_max 3.300000000000022 in-drivable-lane_mean 1.3000000000000085 in-drivable-lane_min 0.4999999999999982 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.607015214366903, "sim_physics": 0.05574334541956583, "survival_time": 14.950000000000076, "driven_lanedir": 2.918596672330525, "sim_render-ego": 0.006966179211934408, "in-drivable-lane": 3.300000000000022, "agent_compute-ego": 0.016054910024007163, "deviation-heading": 4.0758945643859334, "set_robot_commands": 0.006993958950042725, "deviation-center-line": 0.7635293609363007, "driven_lanedir_consec": 1.8446754139561503, "sim_compute_sim_state": 0.003536396821339925, "sim_compute_performance-ego": 0.004103024005889893, "sim_compute_robot_state-ego": 0.0051193173726399735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.941947248326251, "sim_physics": 0.05828195333480835, "survival_time": 14.950000000000076, "driven_lanedir": 1.4420875352694005, "sim_render-ego": 0.007054604689280192, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.015809890429178873, "deviation-heading": 7.450875030681043, "set_robot_commands": 0.006959679921468099, "deviation-center-line": 1.2084636781446576, "driven_lanedir_consec": 0.7964341421694761, "sim_compute_sim_state": 0.0035611454645792643, "sim_compute_performance-ego": 0.004027792612711589, "sim_compute_robot_state-ego": 0.005154933134714762}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.804003612172907, "sim_physics": 0.05611512422561646, "survival_time": 14.950000000000076, "driven_lanedir": 2.206153914815427, "sim_render-ego": 0.007071773211161296, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01685330311457316, "deviation-heading": 7.4791979075377215, "set_robot_commands": 0.007117047309875489, "deviation-center-line": 0.9459839169029316, "driven_lanedir_consec": 1.425158023037036, "sim_compute_sim_state": 0.003574259281158447, "sim_compute_performance-ego": 0.0040346924463907875, "sim_compute_robot_state-ego": 0.005195415019989014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2107819385727614, "sim_physics": 0.05686942390773608, "survival_time": 4.599999999999992, "driven_lanedir": 1.0623652719948171, "sim_render-ego": 0.007143707379050877, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.015744170416956364, "deviation-heading": 1.4229396731855442, "set_robot_commands": 0.007053611071213432, "deviation-center-line": 0.2050827926976057, "driven_lanedir_consec": 1.0623652719948171, "sim_compute_sim_state": 0.003670998241590417, "sim_compute_performance-ego": 0.0039789780326511546, "sim_compute_robot_state-ego": 0.005046974057736604}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1073188583976585, "sim_physics": 0.05461723566055298, "survival_time": 14.950000000000076, "driven_lanedir": 2.5665419324517256, "sim_render-ego": 0.00707406759262085, "in-drivable-lane": 1.300000000000014, "agent_compute-ego": 0.015676278273264566, "deviation-heading": 5.792712280467846, "set_robot_commands": 0.0071383984883626305, "deviation-center-line": 0.8932718397964737, "driven_lanedir_consec": 1.617806746091771, "sim_compute_sim_state": 0.003446051279703776, "sim_compute_performance-ego": 0.003976821104685465, "sim_compute_robot_state-ego": 0.005075304508209228}}set_robot_commands_max 0.0071383984883626305 set_robot_commands_mean 0.007052539148192474 set_robot_commands_median 0.007053611071213432 set_robot_commands_min 0.006959679921468099 sim_compute_performance-ego_max 0.004103024005889893 sim_compute_performance-ego_mean 0.004024261640465777 sim_compute_performance-ego_median 0.004027792612711589 sim_compute_performance-ego_min 0.003976821104685465 sim_compute_robot_state-ego_max 0.005195415019989014 sim_compute_robot_state-ego_mean 0.005118388818657916 sim_compute_robot_state-ego_median 0.0051193173726399735 sim_compute_robot_state-ego_min 0.005046974057736604 sim_compute_sim_state_max 0.003670998241590417 sim_compute_sim_state_mean 0.0035577702176743655 sim_compute_sim_state_median 0.0035611454645792643 sim_compute_sim_state_min 0.003446051279703776 sim_physics_max 0.05828195333480835 sim_physics_mean 0.056325416509655946 sim_physics_median 0.05611512422561646 sim_physics_min 0.05461723566055298 sim_render-ego_max 0.007143707379050877 sim_render-ego_mean 0.007062066416809525 sim_render-ego_median 0.007071773211161296 sim_render-ego_min 0.006966179211934408 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.88000000000006 survival_time_min 4.599999999999992
No reset possible 281425212Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:11:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.877412414539024 survival_time_median 14.950000000000076 deviation-center-line_median 0.890599903452594 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.028793738683064778 agent_compute-ego_mean 0.025250101991858613 agent_compute-ego_median 0.026009742957187363 agent_compute-ego_min 0.02150582234064738 deviation-center-line_max 0.996799872477696 deviation-center-line_mean 0.8098310986396069 deviation-center-line_min 0.6059888019160699 deviation-heading_max 3.3510477492690063 deviation-heading_mean 2.841783322632071 deviation-heading_median 2.9493599429915283 deviation-heading_min 2.077652063841928 driven_any_max 4.446106266139739 driven_any_mean 4.142874210548807 driven_any_median 4.279037942834928 driven_any_min 3.622881318817488 driven_lanedir_consec_max 4.3952876938082355 driven_lanedir_consec_mean 3.94332957938852 driven_lanedir_consec_min 3.315223583336123 driven_lanedir_max 4.3952876938082355 driven_lanedir_mean 3.9522143064640223 driven_lanedir_median 3.921836049916536 driven_lanedir_min 3.315223583336123 in-drivable-lane_max 1.050000000000015 in-drivable-lane_mean 0.4100000000000058 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.622881318817488, "sim_physics": 0.13029181718826294, "survival_time": 14.950000000000076, "driven_lanedir": 3.315223583336123, "sim_render-ego": 0.013689478238423666, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.028793738683064778, "deviation-heading": 3.186377394152325, "set_robot_commands": 0.012515559196472167, "deviation-center-line": 0.890599903452594, "driven_lanedir_consec": 3.315223583336123, "sim_compute_sim_state": 0.006366831461588542, "sim_compute_performance-ego": 0.008311597506205241, "sim_compute_robot_state-ego": 0.010300522645314534}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.942982867216765, "sim_physics": 0.13140247662862142, "survival_time": 14.950000000000076, "driven_lanedir": 3.867218800059467, "sim_render-ego": 0.013678159713745116, "in-drivable-lane": 0, "agent_compute-ego": 0.028389303684234615, "deviation-heading": 2.644479462905567, "set_robot_commands": 0.012109315395355223, "deviation-center-line": 0.927714508345082, "driven_lanedir_consec": 3.867218800059467, "sim_compute_sim_state": 0.00575023094813029, "sim_compute_performance-ego": 0.007677497863769531, "sim_compute_robot_state-ego": 0.01022377888361613}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.4233626577351135, "sim_physics": 0.07972017208735148, "survival_time": 14.950000000000076, "driven_lanedir": 4.261505405199751, "sim_render-ego": 0.009536286195119224, "in-drivable-lane": 0, "agent_compute-ego": 0.02150582234064738, "deviation-heading": 3.3510477492690063, "set_robot_commands": 0.009161187807718912, "deviation-center-line": 0.996799872477696, "driven_lanedir_consec": 4.261505405199751, "sim_compute_sim_state": 0.004498456319173177, "sim_compute_performance-ego": 0.005586675008138021, "sim_compute_robot_state-ego": 0.0071026452382405595}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.279037942834928, "sim_physics": 0.09113243186616328, "survival_time": 12.550000000000043, "driven_lanedir": 3.921836049916536, "sim_render-ego": 0.010952287461178236, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.026009742957187363, "deviation-heading": 2.9493599429915283, "set_robot_commands": 0.010435595455397647, "deviation-center-line": 0.6059888019160699, "driven_lanedir_consec": 3.877412414539024, "sim_compute_sim_state": 0.00540743216100442, "sim_compute_performance-ego": 0.00650230156947892, "sim_compute_robot_state-ego": 0.008221260579933684}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.446106266139739, "sim_physics": 0.08023454030354818, "survival_time": 14.950000000000076, "driven_lanedir": 4.3952876938082355, "sim_render-ego": 0.009504084587097167, "in-drivable-lane": 0, "agent_compute-ego": 0.021551902294158935, "deviation-heading": 2.077652063841928, "set_robot_commands": 0.009639705022176108, "deviation-center-line": 0.6280524070065929, "driven_lanedir_consec": 4.3952876938082355, "sim_compute_sim_state": 0.0048827314376831054, "sim_compute_performance-ego": 0.005553882916768392, "sim_compute_robot_state-ego": 0.007123252550760905}}set_robot_commands_max 0.012515559196472167 set_robot_commands_mean 0.010772272575424012 set_robot_commands_median 0.010435595455397647 set_robot_commands_min 0.009161187807718912 sim_compute_performance-ego_max 0.008311597506205241 sim_compute_performance-ego_mean 0.00672639097287202 sim_compute_performance-ego_median 0.00650230156947892 sim_compute_performance-ego_min 0.005553882916768392 sim_compute_robot_state-ego_max 0.010300522645314534 sim_compute_robot_state-ego_mean 0.008594291979573163 sim_compute_robot_state-ego_median 0.008221260579933684 sim_compute_robot_state-ego_min 0.0071026452382405595 sim_compute_sim_state_max 0.006366831461588542 sim_compute_sim_state_mean 0.005381136465515907 sim_compute_sim_state_median 0.00540743216100442 sim_compute_sim_state_min 0.004498456319173177 sim_physics_max 0.13140247662862142 sim_physics_mean 0.10255628761478944 sim_physics_median 0.09113243186616328 sim_physics_min 0.07972017208735148 sim_render-ego_max 0.013689478238423666 sim_render-ego_mean 0.011472059239112684 sim_render-ego_median 0.010952287461178236 sim_render-ego_min 0.009504084587097167 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.47000000000007 survival_time_min 12.550000000000043
No reset possible 280425142Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.854649169636712 survival_time_median 14.950000000000076 deviation-center-line_median 0.6121398910174594 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03671882390975952 agent_compute-ego_mean 0.03554595438639323 agent_compute-ego_median 0.035410946210225426 agent_compute-ego_min 0.0348144261042277 deviation-center-line_max 0.8316697425940556 deviation-center-line_mean 0.6821773037143956 deviation-center-line_min 0.5669877851426665 deviation-heading_max 4.751669566712778 deviation-heading_mean 3.2244608056770345 deviation-heading_median 2.9539779925332823 deviation-heading_min 2.3933684886361988 driven_any_max 4.646852013552235 driven_any_mean 3.9797979201556055 driven_any_median 4.002602544043455 driven_any_min 3.078919638419362 driven_lanedir_consec_max 4.5547777611933 driven_lanedir_consec_mean 3.5336151594084386 driven_lanedir_consec_min 1.3098620741412257 driven_lanedir_max 4.5547777611933 driven_lanedir_mean 3.7584159243234567 driven_lanedir_median 3.854649169636712 driven_lanedir_min 2.433865898716312 in-drivable-lane_max 3.9500000000000153 in-drivable-lane_mean 0.8700000000000042 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.078919638419362, "sim_physics": 0.08003133694330851, "survival_time": 14.950000000000076, "driven_lanedir": 2.433865898716312, "sim_render-ego": 0.00980653444925944, "in-drivable-lane": 3.9500000000000153, "agent_compute-ego": 0.03671882390975952, "deviation-heading": 4.751669566712778, "set_robot_commands": 0.008066230614980062, "deviation-center-line": 0.5669877851426665, "driven_lanedir_consec": 1.3098620741412257, "sim_compute_sim_state": 0.004215176900227865, "sim_compute_performance-ego": 0.005825381278991699, "sim_compute_robot_state-ego": 0.007283508777618408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.765276133645264, "sim_physics": 0.0546214763323466, "survival_time": 14.950000000000076, "driven_lanedir": 3.6248860534617906, "sim_render-ego": 0.007110023498535156, "in-drivable-lane": 0, "agent_compute-ego": 0.035410946210225426, "deviation-heading": 3.448227453997813, "set_robot_commands": 0.005081390539805095, "deviation-center-line": 0.8288663759554736, "driven_lanedir_consec": 3.6248860534617906, "sim_compute_sim_state": 0.002987968921661377, "sim_compute_performance-ego": 0.003997038205464681, "sim_compute_robot_state-ego": 0.005131596724192301}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.646852013552235, "sim_physics": 0.05475941816965739, "survival_time": 14.950000000000076, "driven_lanedir": 4.5547777611933, "sim_render-ego": 0.00708358367284139, "in-drivable-lane": 0, "agent_compute-ego": 0.03509942611058553, "deviation-heading": 2.3933684886361988, "set_robot_commands": 0.004989977677663167, "deviation-center-line": 0.8316697425940556, "driven_lanedir_consec": 4.5547777611933, "sim_compute_sim_state": 0.0030349000295003255, "sim_compute_performance-ego": 0.003981054623921712, "sim_compute_robot_state-ego": 0.005097486972808838}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.002602544043455, "sim_physics": 0.05518657366434733, "survival_time": 14.950000000000076, "driven_lanedir": 3.854649169636712, "sim_render-ego": 0.006973191897074382, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.0348144261042277, "deviation-heading": 2.9539779925332823, "set_robot_commands": 0.004997532367706298, "deviation-center-line": 0.5712227238623232, "driven_lanedir_consec": 3.854649169636712, "sim_compute_sim_state": 0.002989561557769775, "sim_compute_performance-ego": 0.00396726926167806, "sim_compute_robot_state-ego": 0.005070914427439371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.40533927111771, "sim_physics": 0.0566994047164917, "survival_time": 14.950000000000076, "driven_lanedir": 4.323900738609167, "sim_render-ego": 0.0070990705490112304, "in-drivable-lane": 0, "agent_compute-ego": 0.03568614959716797, "deviation-heading": 2.5750605265051, "set_robot_commands": 0.00502417246500651, "deviation-center-line": 0.6121398910174594, "driven_lanedir_consec": 4.323900738609167, "sim_compute_sim_state": 0.002973284721374512, "sim_compute_performance-ego": 0.003991274833679199, "sim_compute_robot_state-ego": 0.005112451712290446}}set_robot_commands_max 0.008066230614980062 set_robot_commands_mean 0.005631860733032226 set_robot_commands_median 0.00502417246500651 set_robot_commands_min 0.004989977677663167 sim_compute_performance-ego_max 0.005825381278991699 sim_compute_performance-ego_mean 0.0043524036407470695 sim_compute_performance-ego_median 0.003991274833679199 sim_compute_performance-ego_min 0.00396726926167806 sim_compute_robot_state-ego_max 0.007283508777618408 sim_compute_robot_state-ego_mean 0.005539191722869873 sim_compute_robot_state-ego_median 0.005112451712290446 sim_compute_robot_state-ego_min 0.005070914427439371 sim_compute_sim_state_max 0.004215176900227865 sim_compute_sim_state_mean 0.003240178426106771 sim_compute_sim_state_median 0.002989561557769775 sim_compute_sim_state_min 0.002973284721374512 sim_physics_max 0.08003133694330851 sim_physics_mean 0.0602596419652303 sim_physics_median 0.05518657366434733 sim_physics_min 0.0546214763323466 sim_render-ego_max 0.00980653444925944 sim_render-ego_mean 0.007614480813344321 sim_render-ego_median 0.0070990705490112304 sim_render-ego_min 0.006973191897074382 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 280335139Ramon Emiliani challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:04:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6027973887225941 survival_time_median 4.049999999999994 deviation-center-line_median 0.1263315521841463 in-drivable-lane_median 1.2499999999999956
other stats agent_compute-ego_max 0.10443152383316397 agent_compute-ego_mean 0.10154012124821428 agent_compute-ego_median 0.10088665861832467 agent_compute-ego_min 0.10032289410814826 deviation-center-line_max 0.38685774309193216 deviation-center-line_mean 0.1772492792196812 deviation-center-line_min 0.09412758878765616 deviation-heading_max 0.9797895777714308 deviation-heading_mean 0.7349038041705876 deviation-heading_median 0.7503092029046007 deviation-heading_min 0.4287831483855265 driven_any_max 1.2204184952589057 driven_any_mean 1.0135700845477893 driven_any_median 1.0387247695502109 driven_any_min 0.7312547026752254 driven_lanedir_consec_max 1.1778448375438069 driven_lanedir_consec_mean 0.6707675987422652 driven_lanedir_consec_min 0.31996167193687564 driven_lanedir_max 1.1778448375438069 driven_lanedir_mean 0.6707675987422652 driven_lanedir_median 0.6027973887225941 driven_lanedir_min 0.31996167193687564 in-drivable-lane_max 1.649999999999994 in-drivable-lane_mean 1.0899999999999963 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.108608275139156, "sim_physics": 0.05347491142361663, "survival_time": 4.299999999999993, "driven_lanedir": 0.5964997448703211, "sim_render-ego": 0.0070473510165547214, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10443152383316397, "deviation-heading": 0.7305452871811776, "set_robot_commands": 0.005026864451031352, "deviation-center-line": 0.09412758878765616, "driven_lanedir_consec": 0.5964997448703211, "sim_compute_sim_state": 0.0029054602911305983, "sim_compute_performance-ego": 0.004133565481318984, "sim_compute_robot_state-ego": 0.005079726840174476}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9688441801154476, "sim_physics": 0.05802402684563085, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6027973887225941, "sim_render-ego": 0.00720740933167307, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.10088665861832467, "deviation-heading": 0.7850918046102023, "set_robot_commands": 0.005077616164558812, "deviation-center-line": 0.18247328748247849, "driven_lanedir_consec": 0.6027973887225941, "sim_compute_sim_state": 0.002966595323462235, "sim_compute_performance-ego": 0.003909641190579063, "sim_compute_robot_state-ego": 0.005034663175281726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2204184952589057, "sim_physics": 0.054713251742910834, "survival_time": 4.699999999999991, "driven_lanedir": 1.1778448375438069, "sim_render-ego": 0.007032044390414624, "in-drivable-lane": 0, "agent_compute-ego": 0.1008523905530889, "deviation-heading": 0.9797895777714308, "set_robot_commands": 0.004887727980918073, "deviation-center-line": 0.38685774309193216, "driven_lanedir_consec": 1.1778448375438069, "sim_compute_sim_state": 0.0028933438848941883, "sim_compute_performance-ego": 0.0039111451899751706, "sim_compute_robot_state-ego": 0.0048957581215716426}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7312547026752254, "sim_physics": 0.055259979377358645, "survival_time": 2.9499999999999975, "driven_lanedir": 0.31996167193687564, "sim_render-ego": 0.00704300605644614, "in-drivable-lane": 1.3999999999999968, "agent_compute-ego": 0.10120713912834556, "deviation-heading": 0.4287831483855265, "set_robot_commands": 0.004906593743017164, "deviation-center-line": 0.0964562245521928, "driven_lanedir_consec": 0.31996167193687564, "sim_compute_sim_state": 0.002915750115604724, "sim_compute_performance-ego": 0.003899048950712559, "sim_compute_robot_state-ego": 0.004940477468199649}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0387247695502109, "sim_physics": 0.053832201310146, "survival_time": 4.049999999999994, "driven_lanedir": 0.6567343506377283, "sim_render-ego": 0.0071070518022702065, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.10032289410814826, "deviation-heading": 0.7503092029046007, "set_robot_commands": 0.005012376808825834, "deviation-center-line": 0.1263315521841463, "driven_lanedir_consec": 0.6567343506377283, "sim_compute_sim_state": 0.0029306411743164062, "sim_compute_performance-ego": 0.003926868791933413, "sim_compute_robot_state-ego": 0.0050629156607168695}}set_robot_commands_max 0.005077616164558812 set_robot_commands_mean 0.004982235829670247 set_robot_commands_median 0.005012376808825834 set_robot_commands_min 0.004887727980918073 sim_compute_performance-ego_max 0.004133565481318984 sim_compute_performance-ego_mean 0.003956053920903839 sim_compute_performance-ego_median 0.0039111451899751706 sim_compute_performance-ego_min 0.003899048950712559 sim_compute_robot_state-ego_max 0.005079726840174476 sim_compute_robot_state-ego_mean 0.0050027082531888725 sim_compute_robot_state-ego_median 0.005034663175281726 sim_compute_robot_state-ego_min 0.0048957581215716426 sim_compute_sim_state_max 0.002966595323462235 sim_compute_sim_state_mean 0.0029223581578816304 sim_compute_sim_state_median 0.002915750115604724 sim_compute_sim_state_min 0.0028933438848941883 sim_physics_max 0.05802402684563085 sim_physics_mean 0.05506087413993259 sim_physics_median 0.054713251742910834 sim_physics_min 0.05347491142361663 sim_render-ego_max 0.00720740933167307 sim_render-ego_mean 0.007087372519471754 sim_render-ego_median 0.0070473510165547214 sim_render-ego_min 0.007032044390414624 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.9599999999999937 survival_time_min 2.9499999999999975
No reset possible 280295137Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation aborted yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:08 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 280215127Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:41 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 53, in on_received_get_commands
|| velocity, omega = self.compute_action(self.current_image)
|| File "solution.py", line 50, in compute_action
|| return action.astype(float)
|| AttributeError: 'tuple' object has no attribute 'astype'
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 279835103Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.665500359648875 survival_time_median 6.449999999999985 deviation-center-line_median 0.46191482475117673 in-drivable-lane_median 0.7500000000000007
other stats agent_compute-ego_max 0.03637378572303558 agent_compute-ego_mean 0.0274228531247782 agent_compute-ego_median 0.02426658550898234 agent_compute-ego_min 0.020820748898410055 deviation-center-line_max 1.0593305244617677 deviation-center-line_mean 0.47348335352022985 deviation-center-line_min 0.09373686501181568 deviation-heading_max 4.2268960718191115 deviation-heading_mean 1.8751463911858903 deviation-heading_median 1.2595975264216768 deviation-heading_min 0.6832308774997039 driven_any_max 4.085222041310763 driven_any_mean 1.9527914572272465 driven_any_median 1.7095293466841397 driven_any_min 0.5075999382200055 driven_lanedir_consec_max 3.2947200030730364 driven_lanedir_consec_mean 1.6309852299102154 driven_lanedir_consec_min 0.2068843453123033 driven_lanedir_max 3.2947200030730364 driven_lanedir_mean 1.6323720015218233 driven_lanedir_median 1.665500359648875 driven_lanedir_min 0.2138182033703413 in-drivable-lane_max 1.7999999999999956 in-drivable-lane_mean 0.7300000000000024 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5641905555668493, "sim_physics": 0.07996860643227895, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5269496638341453, "sim_render-ego": 0.009379342198371887, "in-drivable-lane": 0, "agent_compute-ego": 0.021287009119987488, "deviation-heading": 0.6832308774997039, "set_robot_commands": 0.009282161792119345, "deviation-center-line": 0.1053688823127231, "driven_lanedir_consec": 0.5269496638341453, "sim_compute_sim_state": 0.004413872957229614, "sim_compute_performance-ego": 0.006049017111460368, "sim_compute_robot_state-ego": 0.006902476151784261}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7095293466841397, "sim_physics": 0.07505319469658904, "survival_time": 6.449999999999985, "driven_lanedir": 1.665500359648875, "sim_render-ego": 0.009563215019166932, "in-drivable-lane": 0, "agent_compute-ego": 0.020820748898410055, "deviation-heading": 1.2595975264216768, "set_robot_commands": 0.008678101754003718, "deviation-center-line": 0.46191482475117673, "driven_lanedir_consec": 1.665500359648875, "sim_compute_sim_state": 0.004482041957766511, "sim_compute_performance-ego": 0.005478566931199658, "sim_compute_robot_state-ego": 0.00707779374233512}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.085222041310763, "sim_physics": 0.0988272213935852, "survival_time": 14.950000000000076, "driven_lanedir": 3.2947200030730364, "sim_render-ego": 0.011128050486246745, "in-drivable-lane": 1.7999999999999956, "agent_compute-ego": 0.02426658550898234, "deviation-heading": 4.2268960718191115, "set_robot_commands": 0.01045813004175822, "deviation-center-line": 1.0593305244617677, "driven_lanedir_consec": 3.2947200030730364, "sim_compute_sim_state": 0.004883525371551514, "sim_compute_performance-ego": 0.006467010974884033, "sim_compute_robot_state-ego": 0.008433427810668945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5075999382200055, "sim_physics": 0.07421259547388831, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2138182033703413, "sim_render-ego": 0.008971047955890035, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.03436613637347554, "deviation-heading": 0.7665235177783813, "set_robot_commands": 0.006544845048771348, "deviation-center-line": 0.09373686501181568, "driven_lanedir_consec": 0.2068843453123033, "sim_compute_sim_state": 0.003621029299358989, "sim_compute_performance-ego": 0.005200047825658044, "sim_compute_robot_state-ego": 0.006507879079774369}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8974154043544753, "sim_physics": 0.07595588670712765, "survival_time": 10.700000000000015, "driven_lanedir": 2.460871777682718, "sim_render-ego": 0.009468584417182707, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.03637378572303558, "deviation-heading": 2.439483962410579, "set_robot_commands": 0.007401708130524537, "deviation-center-line": 0.6470656710636664, "driven_lanedir_consec": 2.460871777682718, "sim_compute_sim_state": 0.003937778071822407, "sim_compute_performance-ego": 0.00540136288259631, "sim_compute_robot_state-ego": 0.006916280104735187}}set_robot_commands_max 0.01045813004175822 set_robot_commands_mean 0.008472989353435432 set_robot_commands_median 0.008678101754003718 set_robot_commands_min 0.006544845048771348 sim_compute_performance-ego_max 0.006467010974884033 sim_compute_performance-ego_mean 0.005719201145159683 sim_compute_performance-ego_median 0.005478566931199658 sim_compute_performance-ego_min 0.005200047825658044 sim_compute_robot_state-ego_max 0.008433427810668945 sim_compute_robot_state-ego_mean 0.007167571377859577 sim_compute_robot_state-ego_median 0.006916280104735187 sim_compute_robot_state-ego_min 0.006507879079774369 sim_compute_sim_state_max 0.004883525371551514 sim_compute_sim_state_mean 0.0042676495315458075 sim_compute_sim_state_median 0.004413872957229614 sim_compute_sim_state_min 0.003621029299358989 sim_physics_max 0.0988272213935852 sim_physics_mean 0.08080350094069383 sim_physics_median 0.07595588670712765 sim_physics_min 0.07421259547388831 sim_render-ego_max 0.011128050486246745 sim_render-ego_mean 0.009702048015371662 sim_render-ego_median 0.009468584417182707 sim_render-ego_min 0.008971047955890035 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.330000000000015 survival_time_min 2.1500000000000004
No reset possible 279665096Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.4161741737022213 survival_time_median 11.100000000000025 deviation-center-line_median 0.583600772056052 in-drivable-lane_median 1.999999999999993
other stats agent_compute-ego_max 0.01585439089182261 agent_compute-ego_mean 0.01544949322150934 agent_compute-ego_median 0.01552184263865153 agent_compute-ego_min 0.014899126318998116 deviation-center-line_max 1.185898161944522 deviation-center-line_mean 0.6526570778471982 deviation-center-line_min 0.16848831702053457 deviation-heading_max 3.49808704203296 deviation-heading_mean 2.217256080838733 deviation-heading_median 2.7603830884803244 deviation-heading_min 0.816263193068414 driven_any_max 4.085393156649133 driven_any_mean 2.660008200233707 driven_any_median 2.9959232672067473 driven_any_min 1.0247393324173824 driven_lanedir_consec_max 3.3697093910646174 driven_lanedir_consec_mean 2.004749089375349 driven_lanedir_consec_min 0.5004291073070364 driven_lanedir_max 3.3697093910646174 driven_lanedir_mean 2.004749089375349 driven_lanedir_median 2.4161741737022213 driven_lanedir_min 0.5004291073070364 in-drivable-lane_max 3.050000000000036 in-drivable-lane_mean 1.8600000000000076 in-drivable-lane_min 0.7499999999999973 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9959232672067473, "sim_physics": 0.0547586507625408, "survival_time": 11.100000000000025, "driven_lanedir": 2.4161741737022213, "sim_render-ego": 0.006937584361514529, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.01585439089182261, "deviation-heading": 2.7603830884803244, "set_robot_commands": 0.006974954862852354, "deviation-center-line": 0.583600772056052, "driven_lanedir_consec": 2.4161741737022213, "sim_compute_sim_state": 0.0036571960191468934, "sim_compute_performance-ego": 0.004050498610144263, "sim_compute_robot_state-ego": 0.005056630383740674}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.108599818385621, "sim_physics": 0.05455248300419297, "survival_time": 4.299999999999993, "driven_lanedir": 0.5004291073070364, "sim_render-ego": 0.007116694783055505, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.014899126318998116, "deviation-heading": 0.816263193068414, "set_robot_commands": 0.006791599961214288, "deviation-center-line": 0.16848831702053457, "driven_lanedir_consec": 0.5004291073070364, "sim_compute_sim_state": 0.0031613250111424645, "sim_compute_performance-ego": 0.00394974475683168, "sim_compute_robot_state-ego": 0.004901764004729515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0247393324173824, "sim_physics": 0.05376860499382019, "survival_time": 3.999999999999994, "driven_lanedir": 0.7168369821512361, "sim_render-ego": 0.007163003087043762, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.015259364247322082, "deviation-heading": 1.2375402293976654, "set_robot_commands": 0.00696200430393219, "deviation-center-line": 0.29522963384981615, "driven_lanedir_consec": 0.7168369821512361, "sim_compute_sim_state": 0.003305959701538086, "sim_compute_performance-ego": 0.003944554924964904, "sim_compute_robot_state-ego": 0.004957941174507141}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.085393156649133, "sim_physics": 0.054128487110137936, "survival_time": 14.950000000000076, "driven_lanedir": 3.3697093910646174, "sim_render-ego": 0.007030090490976969, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.01571274201075236, "deviation-heading": 2.774006851214302, "set_robot_commands": 0.006896168390909831, "deviation-center-line": 1.030068504365066, "driven_lanedir_consec": 3.3697093910646174, "sim_compute_sim_state": 0.003638251622517903, "sim_compute_performance-ego": 0.003977421919504801, "sim_compute_robot_state-ego": 0.005076701641082764}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.085385426509651, "sim_physics": 0.05458050807317098, "survival_time": 14.950000000000076, "driven_lanedir": 3.020595792651632, "sim_render-ego": 0.007043190002441406, "in-drivable-lane": 3.050000000000036, "agent_compute-ego": 0.01552184263865153, "deviation-heading": 3.49808704203296, "set_robot_commands": 0.006958576043446859, "deviation-center-line": 1.185898161944522, "driven_lanedir_consec": 3.020595792651632, "sim_compute_sim_state": 0.003599189122517904, "sim_compute_performance-ego": 0.003982643286387126, "sim_compute_robot_state-ego": 0.005056693553924561}}set_robot_commands_max 0.006974954862852354 set_robot_commands_mean 0.006916660712471104 set_robot_commands_median 0.006958576043446859 set_robot_commands_min 0.006791599961214288 sim_compute_performance-ego_max 0.004050498610144263 sim_compute_performance-ego_mean 0.003980972699566555 sim_compute_performance-ego_median 0.003977421919504801 sim_compute_performance-ego_min 0.003944554924964904 sim_compute_robot_state-ego_max 0.005076701641082764 sim_compute_robot_state-ego_mean 0.005009946151596931 sim_compute_robot_state-ego_median 0.005056630383740674 sim_compute_robot_state-ego_min 0.004901764004729515 sim_compute_sim_state_max 0.0036571960191468934 sim_compute_sim_state_mean 0.00347238429537265 sim_compute_sim_state_median 0.003599189122517904 sim_compute_sim_state_min 0.0031613250111424645 sim_physics_max 0.0547586507625408 sim_physics_mean 0.054357746788772573 sim_physics_median 0.05455248300419297 sim_physics_min 0.05376860499382019 sim_render-ego_max 0.007163003087043762 sim_render-ego_mean 0.007058112545006434 sim_render-ego_median 0.007043190002441406 sim_render-ego_min 0.006937584361514529 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.860000000000031 survival_time_min 3.999999999999994
No reset possible 279655095Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.124442530259547 survival_time_median 8.79999999999999 deviation-center-line_median 0.3642765395378222 in-drivable-lane_median 2.1499999999999924
other stats agent_compute-ego_max 0.016278261973940094 agent_compute-ego_mean 0.015590060005481002 agent_compute-ego_median 0.01542350243438374 agent_compute-ego_min 0.015236207842826845 deviation-center-line_max 0.5900337250436128 deviation-center-line_mean 0.4207385319246618 deviation-center-line_min 0.27373807605806544 deviation-heading_max 2.4941878191406306 deviation-heading_mean 1.7723333363836613 deviation-heading_median 1.7889980958981175 deviation-heading_min 1.121572692526681 driven_any_max 3.051214886036785 driven_any_mean 2.2379570552318007 driven_any_median 2.36640658094911 driven_any_min 1.024745710893678 driven_lanedir_consec_max 2.5062587183856064 driven_lanedir_consec_mean 1.54094093439396 driven_lanedir_consec_min 0.8625299665388667 driven_lanedir_max 2.5062587183856064 driven_lanedir_mean 1.54094093439396 driven_lanedir_median 1.124442530259547 driven_lanedir_min 0.8625299665388667 in-drivable-lane_max 4.25 in-drivable-lane_mean 2.130000000000001 in-drivable-lane_min 0.29999999999999893 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9198578987601027, "sim_physics": 0.057596408909764786, "survival_time": 7.249999999999982, "driven_lanedir": 1.1073944034320402, "sim_render-ego": 0.007128980241972825, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.016278261973940094, "deviation-heading": 1.7889980958981175, "set_robot_commands": 0.007322827700910897, "deviation-center-line": 0.27373807605806544, "driven_lanedir_consec": 1.1073944034320402, "sim_compute_sim_state": 0.003745176052225047, "sim_compute_performance-ego": 0.004203676355296167, "sim_compute_robot_state-ego": 0.00523545659821609}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.827560199519328, "sim_physics": 0.05701253174594715, "survival_time": 10.450000000000014, "driven_lanedir": 2.1040790533537392, "sim_render-ego": 0.0070471501236326955, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.015309920151267895, "deviation-heading": 2.2202199052749325, "set_robot_commands": 0.006782644673397667, "deviation-center-line": 0.5900337250436128, "driven_lanedir_consec": 2.1040790533537392, "sim_compute_sim_state": 0.0035685625943270597, "sim_compute_performance-ego": 0.0039671459836822945, "sim_compute_robot_state-ego": 0.004990618765068967}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.024745710893678, "sim_physics": 0.05700535476207733, "survival_time": 3.999999999999994, "driven_lanedir": 0.8625299665388667, "sim_render-ego": 0.007092788815498352, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.015236207842826845, "deviation-heading": 1.121572692526681, "set_robot_commands": 0.006687954068183899, "deviation-center-line": 0.3642765395378222, "driven_lanedir_consec": 0.8625299665388667, "sim_compute_sim_state": 0.003559055924415589, "sim_compute_performance-ego": 0.003959721326828003, "sim_compute_robot_state-ego": 0.005026623606681824}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.36640658094911, "sim_physics": 0.0548964183438908, "survival_time": 8.79999999999999, "driven_lanedir": 1.124442530259547, "sim_render-ego": 0.007005837830630216, "in-drivable-lane": 4.25, "agent_compute-ego": 0.01542350243438374, "deviation-heading": 1.2366881690779452, "set_robot_commands": 0.00710608877918937, "deviation-center-line": 0.31770541344904313, "driven_lanedir_consec": 1.124442530259547, "sim_compute_sim_state": 0.003443352200768211, "sim_compute_performance-ego": 0.003955555233088407, "sim_compute_robot_state-ego": 0.00490302253853191}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.051214886036785, "sim_physics": 0.055297058953179254, "survival_time": 11.250000000000025, "driven_lanedir": 2.5062587183856064, "sim_render-ego": 0.007136336432562934, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.015702407624986436, "deviation-heading": 2.4941878191406306, "set_robot_commands": 0.007184191809760199, "deviation-center-line": 0.5579389055347656, "driven_lanedir_consec": 2.5062587183856064, "sim_compute_sim_state": 0.0037225235833062064, "sim_compute_performance-ego": 0.00398317019144694, "sim_compute_robot_state-ego": 0.005052651299370659}}set_robot_commands_max 0.007322827700910897 set_robot_commands_mean 0.007016741406288407 set_robot_commands_median 0.00710608877918937 set_robot_commands_min 0.006687954068183899 sim_compute_performance-ego_max 0.004203676355296167 sim_compute_performance-ego_mean 0.004013853818068363 sim_compute_performance-ego_median 0.0039671459836822945 sim_compute_performance-ego_min 0.003955555233088407 sim_compute_robot_state-ego_max 0.00523545659821609 sim_compute_robot_state-ego_mean 0.005041674561573889 sim_compute_robot_state-ego_median 0.005026623606681824 sim_compute_robot_state-ego_min 0.00490302253853191 sim_compute_sim_state_max 0.003745176052225047 sim_compute_sim_state_mean 0.0036077340710084223 sim_compute_sim_state_median 0.0035685625943270597 sim_compute_sim_state_min 0.003443352200768211 sim_physics_max 0.057596408909764786 sim_physics_mean 0.05636155454297187 sim_physics_median 0.05700535476207733 sim_physics_min 0.0548964183438908 sim_render-ego_max 0.007136336432562934 sim_render-ego_mean 0.007082218688859404 sim_render-ego_median 0.007092788815498352 sim_render-ego_min 0.007005837830630216 simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 8.35 survival_time_min 3.999999999999994
No reset possible 279645094Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.4005672240917093 survival_time_median 11.850000000000032 deviation-center-line_median 0.8425263978467241 in-drivable-lane_median 1.900000000000027
other stats agent_compute-ego_max 0.03549532095591227 agent_compute-ego_mean 0.033782301136880646 agent_compute-ego_median 0.03471164570914374 agent_compute-ego_min 0.029516910198871597 deviation-center-line_max 1.008849582391402 deviation-center-line_mean 0.7153421227348368 deviation-center-line_min 0.27926405885542815 deviation-heading_max 3.872968014253584 deviation-heading_mean 2.409636587237151 deviation-heading_median 3.0672926718816584 deviation-heading_min 0.8299133685793338 driven_any_max 4.085420275215687 driven_any_mean 2.961884688601347 driven_any_median 3.2054949957686767 driven_any_min 1.0107700739376877 driven_lanedir_consec_max 3.515953064991834 driven_lanedir_consec_mean 2.2535031823410314 driven_lanedir_consec_min 0.6197230792243975 driven_lanedir_max 3.515953064991834 driven_lanedir_mean 2.2535031823410314 driven_lanedir_median 2.4005672240917093 driven_lanedir_min 0.6197230792243975 in-drivable-lane_max 3.5500000000000043 in-drivable-lane_mean 2.0300000000000096 in-drivable-lane_min 1.049999999999997 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2054949957686767, "sim_physics": 0.057277640209922306, "survival_time": 11.850000000000032, "driven_lanedir": 2.4005672240917093, "sim_render-ego": 0.006984703651460414, "in-drivable-lane": 2.2000000000000055, "agent_compute-ego": 0.029516910198871597, "deviation-heading": 3.0943862731058625, "set_robot_commands": 0.005766909836716793, "deviation-center-line": 0.8425263978467241, "driven_lanedir_consec": 2.4005672240917093, "sim_compute_sim_state": 0.003122461496023186, "sim_compute_performance-ego": 0.004069176404285029, "sim_compute_robot_state-ego": 0.0050786406682010446}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.085420275215687, "sim_physics": 0.05514258543650309, "survival_time": 14.950000000000076, "driven_lanedir": 3.515953064991834, "sim_render-ego": 0.007078033288319905, "in-drivable-lane": 1.4500000000000153, "agent_compute-ego": 0.03501115242640177, "deviation-heading": 3.0672926718816584, "set_robot_commands": 0.00500112533569336, "deviation-center-line": 0.9440248507049076, "driven_lanedir_consec": 3.515953064991834, "sim_compute_sim_state": 0.0028843323389689127, "sim_compute_performance-ego": 0.003977121512095134, "sim_compute_robot_state-ego": 0.005027670860290528}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0107700739376877, "sim_physics": 0.05431976197641107, "survival_time": 3.949999999999994, "driven_lanedir": 0.6197230792243975, "sim_render-ego": 0.010665975039518332, "in-drivable-lane": 1.049999999999997, "agent_compute-ego": 0.034176476394073875, "deviation-heading": 1.1836226083653147, "set_robot_commands": 0.005023440228232854, "deviation-center-line": 0.27926405885542815, "driven_lanedir_consec": 0.6197230792243975, "sim_compute_sim_state": 0.002888015553921084, "sim_compute_performance-ego": 0.004013275798363022, "sim_compute_robot_state-ego": 0.005040817622896991}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.422338370806852, "sim_physics": 0.05382546451356676, "survival_time": 8.999999999999993, "driven_lanedir": 1.407563972534403, "sim_render-ego": 0.007087898254394531, "in-drivable-lane": 3.5500000000000043, "agent_compute-ego": 0.03471164570914374, "deviation-heading": 0.8299133685793338, "set_robot_commands": 0.0050405038727654354, "deviation-center-line": 0.5020457238757223, "driven_lanedir_consec": 1.407563972534403, "sim_compute_sim_state": 0.0029083543353610568, "sim_compute_performance-ego": 0.003997691472371419, "sim_compute_robot_state-ego": 0.005054238107469347}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.0853997272778315, "sim_physics": 0.05439702908198039, "survival_time": 14.950000000000076, "driven_lanedir": 3.3237085708628147, "sim_render-ego": 0.0070716222127278645, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.03549532095591227, "deviation-heading": 3.872968014253584, "set_robot_commands": 0.005098697344462077, "deviation-center-line": 1.008849582391402, "driven_lanedir_consec": 3.3237085708628147, "sim_compute_sim_state": 0.0029826386769612632, "sim_compute_performance-ego": 0.004001144568125407, "sim_compute_robot_state-ego": 0.005147576332092285}}set_robot_commands_max 0.005766909836716793 set_robot_commands_mean 0.005186135323574104 set_robot_commands_median 0.0050405038727654354 set_robot_commands_min 0.00500112533569336 sim_compute_performance-ego_max 0.004069176404285029 sim_compute_performance-ego_mean 0.004011681951048002 sim_compute_performance-ego_median 0.004001144568125407 sim_compute_performance-ego_min 0.003977121512095134 sim_compute_robot_state-ego_max 0.005147576332092285 sim_compute_robot_state-ego_mean 0.005069788718190039 sim_compute_robot_state-ego_median 0.005054238107469347 sim_compute_robot_state-ego_min 0.005027670860290528 sim_compute_sim_state_max 0.003122461496023186 sim_compute_sim_state_mean 0.0029571604802471007 sim_compute_sim_state_median 0.0029083543353610568 sim_compute_sim_state_min 0.0028843323389689127 sim_physics_max 0.057277640209922306 sim_physics_mean 0.054992496243676726 sim_physics_median 0.05439702908198039 sim_physics_min 0.05382546451356676 sim_render-ego_max 0.010665975039518332 sim_render-ego_mean 0.007777646489284208 sim_render-ego_median 0.007078033288319905 sim_render-ego_min 0.006984703651460414 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.940000000000037 survival_time_min 3.949999999999994
No reset possible 279625093Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.937863299764421 survival_time_median 14.950000000000076 deviation-center-line_median 0.8583148882385557 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.016118305524190267 agent_compute-ego_mean 0.01569555938391038 agent_compute-ego_median 0.015610897541046142 agent_compute-ego_min 0.015108552979834286 deviation-center-line_max 1.3144846914494674 deviation-center-line_mean 0.9172776968281846 deviation-center-line_min 0.6654899175801103 deviation-heading_max 3.9545600588343377 deviation-heading_mean 2.6165801079234496 deviation-heading_median 2.5195760375208365 deviation-heading_min 1.6101357702345116 driven_any_max 2.042762183649694 driven_any_mean 1.8499554048648164 driven_any_median 2.042756452399251 driven_any_min 1.0853964512384828 driven_lanedir_consec_max 2.0072379907814577 driven_lanedir_consec_mean 1.5894726529943142 driven_lanedir_consec_min 0.9150394613723082 driven_lanedir_max 2.0072379907814577 driven_lanedir_mean 1.5894726529943142 driven_lanedir_median 1.937863299764421 driven_lanedir_min 0.9150394613723082 in-drivable-lane_max 6.500000000000092 in-drivable-lane_mean 1.480000000000018 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.036100984350013, "sim_physics": 0.05786613702774048, "survival_time": 14.950000000000076, "driven_lanedir": 1.9782396606796648, "sim_render-ego": 0.006940255165100098, "in-drivable-lane": 0, "agent_compute-ego": 0.016118305524190267, "deviation-heading": 3.199767507426827, "set_robot_commands": 0.007132616837819418, "deviation-center-line": 0.8583148882385557, "driven_lanedir_consec": 1.9782396606796648, "sim_compute_sim_state": 0.00374034325281779, "sim_compute_performance-ego": 0.00407548983891805, "sim_compute_robot_state-ego": 0.005074459711710612}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.042756452399251, "sim_physics": 0.05392313718795776, "survival_time": 14.950000000000076, "driven_lanedir": 1.937863299764421, "sim_render-ego": 0.0070703466733296715, "in-drivable-lane": 0, "agent_compute-ego": 0.015583306948343912, "deviation-heading": 3.9545600588343377, "set_robot_commands": 0.0070146377881368, "deviation-center-line": 0.9648096322966324, "driven_lanedir_consec": 1.937863299764421, "sim_compute_sim_state": 0.0035410372416178385, "sim_compute_performance-ego": 0.003963166872660319, "sim_compute_robot_state-ego": 0.0049743461608886715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0853964512384828, "sim_physics": 0.05492366684807672, "survival_time": 8.09999999999998, "driven_lanedir": 0.9150394613723082, "sim_render-ego": 0.007080526999485345, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.015108552979834286, "deviation-heading": 1.7988611656007345, "set_robot_commands": 0.006975674334867501, "deviation-center-line": 0.6654899175801103, "driven_lanedir_consec": 0.9150394613723082, "sim_compute_sim_state": 0.003664171254193341, "sim_compute_performance-ego": 0.003983834643422821, "sim_compute_robot_state-ego": 0.00508838818397051}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.042760952686642, "sim_physics": 0.05322878996531168, "survival_time": 14.950000000000076, "driven_lanedir": 1.1089828523737195, "sim_render-ego": 0.007040211359659831, "in-drivable-lane": 6.500000000000092, "agent_compute-ego": 0.015610897541046142, "deviation-heading": 1.6101357702345116, "set_robot_commands": 0.00706857442855835, "deviation-center-line": 0.7832893545761569, "driven_lanedir_consec": 1.1089828523737195, "sim_compute_sim_state": 0.0036202915509541823, "sim_compute_performance-ego": 0.003991173108418782, "sim_compute_robot_state-ego": 0.0049730459849039715}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.042762183649694, "sim_physics": 0.05569241841634114, "survival_time": 14.950000000000076, "driven_lanedir": 2.0072379907814577, "sim_render-ego": 0.007122503916422526, "in-drivable-lane": 0, "agent_compute-ego": 0.01605673392613729, "deviation-heading": 2.5195760375208365, "set_robot_commands": 0.007343571980794271, "deviation-center-line": 1.3144846914494674, "driven_lanedir_consec": 2.0072379907814577, "sim_compute_sim_state": 0.003779635429382324, "sim_compute_performance-ego": 0.004015749295552572, "sim_compute_robot_state-ego": 0.0051694885889689126}}set_robot_commands_max 0.007343571980794271 set_robot_commands_mean 0.007107015074035268 set_robot_commands_median 0.00706857442855835 set_robot_commands_min 0.006975674334867501 sim_compute_performance-ego_max 0.00407548983891805 sim_compute_performance-ego_mean 0.004005882751794509 sim_compute_performance-ego_median 0.003991173108418782 sim_compute_performance-ego_min 0.003963166872660319 sim_compute_robot_state-ego_max 0.0051694885889689126 sim_compute_robot_state-ego_mean 0.005055945726088535 sim_compute_robot_state-ego_median 0.005074459711710612 sim_compute_robot_state-ego_min 0.0049730459849039715 sim_compute_sim_state_max 0.003779635429382324 sim_compute_sim_state_mean 0.003669095745793095 sim_compute_sim_state_median 0.003664171254193341 sim_compute_sim_state_min 0.0035410372416178385 sim_physics_max 0.05786613702774048 sim_physics_mean 0.05512682988908556 sim_physics_median 0.05492366684807672 sim_physics_min 0.05322878996531168 sim_render-ego_max 0.007122503916422526 sim_render-ego_mean 0.007050768822799494 sim_render-ego_median 0.0070703466733296715 sim_render-ego_min 0.006940255165100098 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.58000000000006 survival_time_min 8.09999999999998
No reset possible 279505087Ramon Emiliani challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:22 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 279115065Dong Wang challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.3782247291010925 survival_time_median 11.55000000000003 deviation-center-line_median 0.538716028435272 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.023899375751454344 agent_compute-ego_mean 0.021292158706385563 agent_compute-ego_median 0.02221939448387392 agent_compute-ego_min 0.01673297643661499 deviation-center-line_max 0.6642982670886143 deviation-center-line_mean 0.4835014465018253 deviation-center-line_min 0.14624516375621688 deviation-heading_max 3.5660464133189036 deviation-heading_mean 1.9040570133191757 deviation-heading_median 1.554854774581328 deviation-heading_min 1.1694700535029467 driven_any_max 2.349155649032489 driven_any_mean 1.619505564064872 driven_any_median 1.8025879315488171 driven_any_min 0.6860308732602797 driven_lanedir_consec_max 2.3247813541609563 driven_lanedir_consec_mean 1.4985588082972094 driven_lanedir_consec_min 0.5945051803854399 driven_lanedir_max 2.3247813541609563 driven_lanedir_mean 1.5060097250887752 driven_lanedir_median 1.415479313058921 driven_lanedir_min 0.5945051803854399 in-drivable-lane_max 1.3500000000000192 in-drivable-lane_mean 0.3300000000000036 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6860308732602797, "sim_physics": 0.09161368493110902, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5945051803854399, "sim_render-ego": 0.010017933384064703, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.023899375751454344, "deviation-heading": 1.1694700535029467, "set_robot_commands": 0.00937152934330766, "deviation-center-line": 0.14624516375621688, "driven_lanedir_consec": 0.5945051803854399, "sim_compute_sim_state": 0.004715073493219191, "sim_compute_performance-ego": 0.00651509274718582, "sim_compute_robot_state-ego": 0.007555410426150086}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.93926393565221, "sim_physics": 0.08433842466723535, "survival_time": 12.40000000000004, "driven_lanedir": 1.9049786644259776, "sim_render-ego": 0.010496113569505751, "in-drivable-lane": 0, "agent_compute-ego": 0.02221939448387392, "deviation-heading": 1.554854774581328, "set_robot_commands": 0.009277781171183433, "deviation-center-line": 0.6541796661142487, "driven_lanedir_consec": 1.9049786644259776, "sim_compute_sim_state": 0.004520885406001922, "sim_compute_performance-ego": 0.006047332479107765, "sim_compute_robot_state-ego": 0.007502903861384238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8025879315488171, "sim_physics": 0.08595020120794122, "survival_time": 11.55000000000003, "driven_lanedir": 1.415479313058921, "sim_render-ego": 0.010308549517676943, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.02331958395062071, "deviation-heading": 3.5660464133189036, "set_robot_commands": 0.009489903718362122, "deviation-center-line": 0.6642982670886143, "driven_lanedir_consec": 1.3782247291010925, "sim_compute_sim_state": 0.004575852191809452, "sim_compute_performance-ego": 0.005977863873238171, "sim_compute_robot_state-ego": 0.007671971341748259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320489430830563, "sim_physics": 0.07477311502423203, "survival_time": 8.549999999999986, "driven_lanedir": 1.2903041134125812, "sim_render-ego": 0.009353282158834892, "in-drivable-lane": 0, "agent_compute-ego": 0.020289462909363863, "deviation-heading": 1.5482004629559805, "set_robot_commands": 0.008784023641842848, "deviation-center-line": 0.4140681071147744, "driven_lanedir_consec": 1.2903041134125812, "sim_compute_sim_state": 0.004449017563758538, "sim_compute_performance-ego": 0.005257012551290947, "sim_compute_robot_state-ego": 0.0069185265323571995}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349155649032489, "sim_physics": 0.058688236872355144, "survival_time": 14.950000000000076, "driven_lanedir": 2.3247813541609563, "sim_render-ego": 0.007458544572194417, "in-drivable-lane": 0, "agent_compute-ego": 0.01673297643661499, "deviation-heading": 1.68171336223672, "set_robot_commands": 0.007370422681172689, "deviation-center-line": 0.538716028435272, "driven_lanedir_consec": 2.3247813541609563, "sim_compute_sim_state": 0.003907089233398438, "sim_compute_performance-ego": 0.0042304595311482745, "sim_compute_robot_state-ego": 0.005365738073984782}}set_robot_commands_max 0.009489903718362122 set_robot_commands_mean 0.00885873211117375 set_robot_commands_median 0.009277781171183433 set_robot_commands_min 0.007370422681172689 sim_compute_performance-ego_max 0.00651509274718582 sim_compute_performance-ego_mean 0.005605552236394195 sim_compute_performance-ego_median 0.005977863873238171 sim_compute_performance-ego_min 0.0042304595311482745 sim_compute_robot_state-ego_max 0.007671971341748259 sim_compute_robot_state-ego_mean 0.0070029100471249136 sim_compute_robot_state-ego_median 0.007502903861384238 sim_compute_robot_state-ego_min 0.005365738073984782 sim_compute_sim_state_max 0.004715073493219191 sim_compute_sim_state_mean 0.004433583577637509 sim_compute_sim_state_median 0.004520885406001922 sim_compute_sim_state_min 0.003907089233398438 sim_physics_max 0.09161368493110902 sim_physics_mean 0.07907273254057454 sim_physics_median 0.08433842466723535 sim_physics_min 0.058688236872355144 sim_render-ego_max 0.010496113569505751 sim_render-ego_mean 0.009526884640455344 sim_render-ego_median 0.010017933384064703 sim_render-ego_min 0.007458544572194417 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.420000000000025 survival_time_min 4.6499999999999915
No reset possible 278985059Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.644838803452121 survival_time_median 14.950000000000076 deviation-center-line_median 0.5674347988356748 in-drivable-lane_median 0.8500000000000121
other stats agent_compute-ego_max 0.035445597966512046 agent_compute-ego_mean 0.03456646804420316 agent_compute-ego_median 0.034991396268208824 agent_compute-ego_min 0.03294486902198013 deviation-center-line_max 0.7391231162146208 deviation-center-line_mean 0.605248667597394 deviation-center-line_min 0.46129411590778113 deviation-heading_max 4.3480497948198495 deviation-heading_mean 2.814553786943459 deviation-heading_median 2.3198363365696157 deviation-heading_min 1.9498407620924365 driven_any_max 4.959906014450764 driven_any_mean 4.028203961523195 driven_any_median 4.1444289373911065 driven_any_min 2.584780180121572 driven_lanedir_consec_max 4.774689114136615 driven_lanedir_consec_mean 3.3264935247392216 driven_lanedir_consec_min 2.2286479376033146 driven_lanedir_max 4.774689114136615 driven_lanedir_mean 3.804410126781288 driven_lanedir_median 3.8925308371801313 driven_lanedir_min 2.2286479376033146 in-drivable-lane_max 1.7500000000000249 in-drivable-lane_mean 0.8300000000000084 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.584780180121572, "sim_physics": 0.0706470353262765, "survival_time": 9.800000000000004, "driven_lanedir": 2.2286479376033146, "sim_render-ego": 0.008577022017264853, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.03294486902198013, "deviation-heading": 1.9498407620924365, "set_robot_commands": 0.007731593385034678, "deviation-center-line": 0.5202933835232233, "driven_lanedir_consec": 2.2286479376033146, "sim_compute_sim_state": 0.003780947656047587, "sim_compute_performance-ego": 0.005108979283546915, "sim_compute_robot_state-ego": 0.006372994306136151}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.923149967788353, "sim_physics": 0.05323499043782552, "survival_time": 14.950000000000076, "driven_lanedir": 3.649421323306367, "sim_render-ego": 0.00703100045522054, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.034991396268208824, "deviation-heading": 3.3778154648676, "set_robot_commands": 0.005037790139516195, "deviation-center-line": 0.7380979235056698, "driven_lanedir_consec": 2.644838803452121, "sim_compute_sim_state": 0.002920705477396647, "sim_compute_performance-ego": 0.003970603942871093, "sim_compute_robot_state-ego": 0.005035036404927571}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.959906014450764, "sim_physics": 0.05316762526830037, "survival_time": 14.950000000000076, "driven_lanedir": 4.774689114136615, "sim_render-ego": 0.007058293024698893, "in-drivable-lane": 1.1499999999999997, "agent_compute-ego": 0.035445597966512046, "deviation-heading": 2.3198363365696157, "set_robot_commands": 0.005091099739074707, "deviation-center-line": 0.7391231162146208, "driven_lanedir_consec": 4.774689114136615, "sim_compute_sim_state": 0.003012126286824544, "sim_compute_performance-ego": 0.003999714851379395, "sim_compute_robot_state-ego": 0.005136380990346273}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.528754707864181, "sim_physics": 0.05566174507141113, "survival_time": 14.950000000000076, "driven_lanedir": 4.476761421680014, "sim_render-ego": 0.007054855028788248, "in-drivable-lane": 0, "agent_compute-ego": 0.03502012888590495, "deviation-heading": 2.0772265763677944, "set_robot_commands": 0.005120836893717448, "deviation-center-line": 0.46129411590778113, "driven_lanedir_consec": 4.476761421680014, "sim_compute_sim_state": 0.0029447356859842936, "sim_compute_performance-ego": 0.003982699712117513, "sim_compute_robot_state-ego": 0.00507010539372762}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.1444289373911065, "sim_physics": 0.052792370319366455, "survival_time": 14.950000000000076, "driven_lanedir": 3.8925308371801313, "sim_render-ego": 0.00700854221979777, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.034430348078409834, "deviation-heading": 4.3480497948198495, "set_robot_commands": 0.005051745573679606, "deviation-center-line": 0.5674347988356748, "driven_lanedir_consec": 2.5075303468240455, "sim_compute_sim_state": 0.0029275576273600262, "sim_compute_performance-ego": 0.003995165824890136, "sim_compute_robot_state-ego": 0.0050388979911804195}}set_robot_commands_max 0.007731593385034678 set_robot_commands_mean 0.005606613146204527 set_robot_commands_median 0.005091099739074707 set_robot_commands_min 0.005037790139516195 sim_compute_performance-ego_max 0.005108979283546915 sim_compute_performance-ego_mean 0.004211432722961011 sim_compute_performance-ego_median 0.003995165824890136 sim_compute_performance-ego_min 0.003970603942871093 sim_compute_robot_state-ego_max 0.006372994306136151 sim_compute_robot_state-ego_mean 0.0053306830172636065 sim_compute_robot_state-ego_median 0.00507010539372762 sim_compute_robot_state-ego_min 0.005035036404927571 sim_compute_sim_state_max 0.003780947656047587 sim_compute_sim_state_mean 0.0031172145467226195 sim_compute_sim_state_median 0.0029447356859842936 sim_compute_sim_state_min 0.002920705477396647 sim_physics_max 0.0706470353262765 sim_physics_mean 0.057100753284636 sim_physics_median 0.05323499043782552 sim_physics_min 0.052792370319366455 sim_render-ego_max 0.008577022017264853 sim_render-ego_mean 0.007345942549154061 sim_render-ego_median 0.007054855028788248 sim_render-ego_min 0.00700854221979777 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.920000000000062 survival_time_min 9.800000000000004
No reset possible 276944167Tanli Chou challenge-aido_LF-template-random aido3-LFVI-sim-testingstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:17:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6510741719617279 survival_time_median 2.5999999999999988 deviation-center-line_median 0.13998987879563426 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.024938991436591514 agent_compute-ego_mean 0.021948225698226333 agent_compute-ego_median 0.022088087522066556 agent_compute-ego_min 0.016100239753723145 deviation-center-line_max 0.3036287511501312 deviation-center-line_mean 0.15369769239159572 deviation-center-line_min 0.05216491457142899 deviation-heading_max 1.2179728408173982 deviation-heading_mean 0.5261661462618537 deviation-heading_median 0.39731350514028857 deviation-heading_min 0.17653006715371072 driven_any_max 2.224828697235836 driven_any_mean 1.0945516051967747 driven_any_median 1.035889090772785 driven_any_min 0.28141737741661643 driven_lanedir_consec_max 1.5148199711845598 driven_lanedir_consec_mean 0.6776353875620368 driven_lanedir_consec_min 0.2574360490463805 driven_lanedir_max 1.5148389893669991 driven_lanedir_mean 0.6987447229996103 driven_lanedir_median 0.6625717078190373 driven_lanedir_min 0.2574360490463805 in-drivable-lane_max 2.449999999999994 in-drivable-lane_mean 0.7399999999999982 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.120585162571246, "sim_physics": 0.23097106030112816, "survival_time": 2.849999999999998, "driven_lanedir": 1.0834331015849266, "sim_render-ego": 0.011364058444374488, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02235789466322514, "deviation-heading": 0.41432780267306696, "set_robot_commands": 0.008305273557964125, "deviation-center-line": 0.13998987879563426, "driven_lanedir_consec": 1.0834331015849266, "sim_compute_sim_state": 0.0044932030794913305, "sim_compute_performance-ego": 0.006882161424871077, "sim_compute_robot_state-ego": 0.008439812743872926, "sim_compute_robot_state-npc0": 0.007821819238495408, "sim_compute_robot_state-npc1": 0.007263413646764923, "sim_compute_robot_state-npc2": 0.007349240152459396, "sim_compute_robot_state-npc3": 0.007519793092158803}, "udem1-1-0": {"driven_any": 0.625093593968239, "sim_physics": 0.23441183907645088, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6085670792754807, "sim_render-ego": 0.012451335362025667, "in-drivable-lane": 0, "agent_compute-ego": 0.021606288637433732, "deviation-heading": 0.32013156786773145, "set_robot_commands": 0.009129129137311663, "deviation-center-line": 0.09604910370355851, "driven_lanedir_consec": 0.6085670792754807, "sim_compute_sim_state": 0.005370426177978516, "sim_compute_performance-ego": 0.0067209039415631975, "sim_compute_robot_state-ego": 0.009063495908464704, "sim_compute_robot_state-npc0": 0.008706576483590262, "sim_compute_robot_state-npc1": 0.008014604023524692, "sim_compute_robot_state-npc2": 0.008186020169939313, "sim_compute_robot_state-npc3": 0.00827432359967913}, "udem1-2-0": {"driven_any": 1.0646337119139948, "sim_physics": 0.1761380743097376, "survival_time": 2.6999999999999984, "driven_lanedir": 0.54057801494714, "sim_render-ego": 0.011553755512943974, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.02092549094447383, "deviation-heading": 0.7806490469039062, "set_robot_commands": 0.008910271856519911, "deviation-center-line": 0.18907742227401345, "driven_lanedir_consec": 0.54057801494714, "sim_compute_sim_state": 0.004464025850649233, "sim_compute_performance-ego": 0.00673612841853389, "sim_compute_robot_state-ego": 0.008611317034120913, "sim_compute_robot_state-npc0": 0.007648582811708804, "sim_compute_robot_state-npc1": 0.007522128246448658, "sim_compute_robot_state-npc2": 0.007864850538748282, "sim_compute_robot_state-npc3": 0.00694882869720459}, "udem1-3-0": {"driven_any": 0.28141737741661643, "sim_physics": 0.2327875463586105, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2574360490463805, "sim_render-ego": 0.011736054169504266, "in-drivable-lane": 0, "agent_compute-ego": 0.02145996846650776, "deviation-heading": 0.370261699898986, "set_robot_commands": 0.008257439261988589, "deviation-center-line": 0.05216491457142899, "driven_lanedir_consec": 0.2574360490463805, "sim_compute_sim_state": 0.004447886818333676, "sim_compute_performance-ego": 0.006445671382703279, "sim_compute_robot_state-ego": 0.007933942895186575, "sim_compute_robot_state-npc0": 0.00731583645469264, "sim_compute_robot_state-npc1": 0.00714261908280222, "sim_compute_robot_state-npc2": 0.007607359635202508, "sim_compute_robot_state-npc3": 0.007256921968962017}, "udem1-4-0": {"driven_any": 1.4415883765088768, "sim_physics": 0.24210983598735972, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5714453508506352, "sim_render-ego": 0.012662437600149234, "in-drivable-lane": 1.8499999999999943, "agent_compute-ego": 0.022506710509179344, "deviation-heading": 0.38647524317752424, "set_robot_commands": 0.008813132702464789, "deviation-center-line": 0.13680180419291485, "driven_lanedir_consec": 0.5714453508506352, "sim_compute_sim_state": 0.0046221571908870215, "sim_compute_performance-ego": 0.006933323094542598, "sim_compute_robot_state-ego": 0.00931884873081261, "sim_compute_robot_state-npc0": 0.008098088519673951, "sim_compute_robot_state-npc1": 0.007800982032023685, "sim_compute_robot_state-npc2": 0.008047446398667887, "sim_compute_robot_state-npc3": 0.007445016377408739}, "udem1-5-0": {"driven_any": 1.0080391968248454, "sim_physics": 0.1854743086374723, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6704865591525617, "sim_render-ego": 0.011626885487483096, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02100770748578585, "deviation-heading": 0.3922278328684869, "set_robot_commands": 0.00888600257726816, "deviation-center-line": 0.07771251037610638, "driven_lanedir_consec": 0.6704865591525617, "sim_compute_sim_state": 0.004761989300067608, "sim_compute_performance-ego": 0.006780945337735689, "sim_compute_robot_state-ego": 0.008845122960897593, "sim_compute_robot_state-npc0": 0.008551015303685116, "sim_compute_robot_state-npc1": 0.00771942505469689, "sim_compute_robot_state-npc2": 0.007972804399637075, "sim_compute_robot_state-npc3": 0.007801574010115404}, "udem1-6-0": {"driven_any": 1.0203763919640902, "sim_physics": 0.21956859185145453, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6885137224643074, "sim_render-ego": 0.012009510627159704, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.024938991436591514, "deviation-heading": 0.48275274423678327, "set_robot_commands": 0.010830980080824632, "deviation-center-line": 0.2218899592142332, "driven_lanedir_consec": 0.6510741719617279, "sim_compute_sim_state": 0.004771975370553823, "sim_compute_performance-ego": 0.007307112216949463, "sim_compute_robot_state-ego": 0.009062203077169564, "sim_compute_robot_state-npc0": 0.008626112571129432, "sim_compute_robot_state-npc1": 0.008102586636176476, "sim_compute_robot_state-npc2": 0.008688408594865065, "sim_compute_robot_state-npc3": 0.008234963967249943}, "udem1-7-0": {"driven_any": 1.518889572352387, "sim_physics": 0.2405764109467807, "survival_time": 3.649999999999995, "driven_lanedir": 1.5148389893669991, "sim_render-ego": 0.011773860617859722, "in-drivable-lane": 0, "agent_compute-ego": 0.023318940646027863, "deviation-heading": 0.20977423156921973, "set_robot_commands": 0.0090294504818851, "deviation-center-line": 0.21770843077410823, "driven_lanedir_consec": 1.5148199711845598, "sim_compute_sim_state": 0.004421939588572881, "sim_compute_performance-ego": 0.006705548665294908, "sim_compute_robot_state-ego": 0.009072336432051985, "sim_compute_robot_state-npc0": 0.00820540728634351, "sim_compute_robot_state-npc1": 0.007794912547281344, "sim_compute_robot_state-npc2": 0.007453252191412939, "sim_compute_robot_state-npc3": 0.00764918327331543}, "udem1-8-0": {"driven_any": 1.0327164362829535, "sim_physics": 0.1843058145963229, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8071665223942781, "sim_render-ego": 0.012146674669705903, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.021918833255767822, "deviation-heading": 0.7544988063126181, "set_robot_commands": 0.008994097893054668, "deviation-center-line": 0.25456483764263077, "driven_lanedir_consec": 0.7988277806254289, "sim_compute_sim_state": 0.00453022810129019, "sim_compute_performance-ego": 0.0068285465240478516, "sim_compute_robot_state-ego": 0.008358350166907677, "sim_compute_robot_state-npc0": 0.008044953529651348, "sim_compute_robot_state-npc1": 0.007473312891446627, "sim_compute_robot_state-npc2": 0.0077892725284282975, "sim_compute_robot_state-npc3": 0.007850449818831224}, "udem1-9-0": {"driven_any": 2.194603187711772, "sim_physics": 0.21463378346883333, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9504366656971932, "sim_render-ego": 0.011739283800125122, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.022526802924963143, "deviation-heading": 1.2179728408173982, "set_robot_commands": 0.009569454651612502, "deviation-center-line": 0.3036287511501312, "driven_lanedir_consec": 0.891948749340645, "sim_compute_sim_state": 0.004969633542574369, "sim_compute_performance-ego": 0.007230866413850051, "sim_compute_robot_state-ego": 0.00879654517540565, "sim_compute_robot_state-npc0": 0.008561469041384183, "sim_compute_robot_state-npc1": 0.007956750117815457, "sim_compute_robot_state-npc2": 0.00810695611513578, "sim_compute_robot_state-npc3": 0.007814599917485164}, "udem1-10-0": {"driven_any": 0.289456859388621, "sim_physics": 0.1516780972480774, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2655179454616352, "sim_render-ego": 0.00878690481185913, "in-drivable-lane": 0, "agent_compute-ego": 0.016100239753723145, "deviation-heading": 0.36575855943077534, "set_robot_commands": 0.006731593608856201, "deviation-center-line": 0.06115233279890005, "driven_lanedir_consec": 0.2655179454616352, "sim_compute_sim_state": 0.003269600868225098, "sim_compute_performance-ego": 0.004838633537292481, "sim_compute_robot_state-ego": 0.006291520595550537, "sim_compute_robot_state-npc0": 0.005815756320953369, "sim_compute_robot_state-npc1": 0.0055600166320800785, "sim_compute_robot_state-npc2": 0.00570685863494873, "sim_compute_robot_state-npc3": 0.0055335164070129395}, "udem1-11-0": {"driven_any": 1.2100209344634405, "sim_physics": 0.2127981347552801, "survival_time": 2.9499999999999975, "driven_lanedir": 0.46508942212711313, "sim_render-ego": 0.012763625484401896, "in-drivable-lane": 1.599999999999997, "agent_compute-ego": 0.021996081885644943, "deviation-heading": 0.17653006715371072, "set_robot_commands": 0.009663816225730766, "deviation-center-line": 0.129995313593986, "driven_lanedir_consec": 0.46508942212711313, "sim_compute_sim_state": 0.00542317406605866, "sim_compute_performance-ego": 0.007281182175975735, "sim_compute_robot_state-ego": 0.00997697296789137, "sim_compute_robot_state-npc0": 0.008411435757653189, "sim_compute_robot_state-npc1": 0.00843880944332834, "sim_compute_robot_state-npc2": 0.008116730188919325, "sim_compute_robot_state-npc3": 0.00836396621445478}, "udem1-12-0": {"driven_any": 2.224828697235836, "sim_physics": 0.20712150289462164, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0703777445593876, "sim_render-ego": 0.01206249686387869, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02245479363661546, "deviation-heading": 0.9732612596020856, "set_robot_commands": 0.009037265410790076, "deviation-center-line": 0.1588932542141487, "driven_lanedir_consec": 0.861653506375097, "sim_compute_sim_state": 0.004826476940741906, "sim_compute_performance-ego": 0.007018575301537147, "sim_compute_robot_state-ego": 0.009192604285020094, "sim_compute_robot_state-npc0": 0.008345535168280968, "sim_compute_robot_state-npc1": 0.00770072524364178, "sim_compute_robot_state-npc2": 0.008045017719268799, "sim_compute_robot_state-npc3": 0.007948478827109704}, "udem1-13-0": {"driven_any": 0.35013548857591936, "sim_physics": 0.29096910086545075, "survival_time": 1.1000000000000003, "driven_lanedir": 0.32471197024708154, "sim_render-ego": 0.01262567260048606, "in-drivable-lane": 0, "agent_compute-ego": 0.02401655370538885, "deviation-heading": 0.39731350514028857, "set_robot_commands": 0.009709358215332031, "deviation-center-line": 0.06622448803036315, "driven_lanedir_consec": 0.32471197024708154, "sim_compute_sim_state": 0.005291971293362704, "sim_compute_performance-ego": 0.007530992681329901, "sim_compute_robot_state-ego": 0.009899074381048027, "sim_compute_robot_state-npc0": 0.008839954029430042, "sim_compute_robot_state-npc1": 0.008309949528087269, "sim_compute_robot_state-npc2": 0.008450779047879305, "sim_compute_robot_state-npc3": 0.008537433364174583}, "udem1-14-0": {"driven_any": 1.035889090772785, "sim_physics": 0.22038796314826375, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6625717078190373, "sim_render-ego": 0.010898062816032996, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.022088087522066556, "deviation-heading": 0.6505569862752227, "set_robot_commands": 0.008771690038534312, "deviation-center-line": 0.1996123845417775, "driven_lanedir_consec": 0.6589411412501393, "sim_compute_sim_state": 0.0044413438210120565, "sim_compute_performance-ego": 0.006573686232933631, "sim_compute_robot_state-ego": 0.00830391737130972, "sim_compute_robot_state-npc0": 0.007819450818575345, "sim_compute_robot_state-npc1": 0.007249786303593562, "sim_compute_robot_state-npc2": 0.007213037747603197, "sim_compute_robot_state-npc3": 0.008072522970346304}}set_robot_commands_max 0.010830980080824632 set_robot_commands_mean 0.008975930380009168 set_robot_commands_median 0.008994097893054668 set_robot_commands_min 0.006731593608856201 sim_compute_performance-ego_max 0.007530992681329901 sim_compute_performance-ego_mean 0.006787618489944059 sim_compute_performance-ego_median 0.0068285465240478516 sim_compute_performance-ego_min 0.004838633537292481 sim_compute_robot_state-ego_max 0.00997697296789137 sim_compute_robot_state-ego_mean 0.008744404315047331 sim_compute_robot_state-ego_median 0.008845122960897593 sim_compute_robot_state-ego_min 0.006291520595550537 sim_compute_robot_state-npc0_max 0.008839954029430042 sim_compute_robot_state-npc0_mean 0.008054132889016503 sim_compute_robot_state-npc0_median 0.00820540728634351 sim_compute_robot_state-npc0_min 0.005815756320953369 sim_compute_robot_state-npc1_max 0.00843880944332834 sim_compute_robot_state-npc1_mean 0.0076033347619808 sim_compute_robot_state-npc1_median 0.00771942505469689 sim_compute_robot_state-npc1_min 0.0055600166320800785 sim_compute_robot_state-npc2_max 0.008688408594865065 sim_compute_robot_state-npc2_mean 0.007773202270874393 sim_compute_robot_state-npc2_median 0.007972804399637075 sim_compute_robot_state-npc2_min 0.00570685863494873 sim_compute_robot_state-npc3_max 0.008537433364174583 sim_compute_robot_state-npc3_mean 0.007683438167033916 sim_compute_robot_state-npc3_median 0.007814599917485164 sim_compute_robot_state-npc3_min 0.0055335164070129395 sim_compute_sim_state_max 0.00542317406605866 sim_compute_sim_state_mean 0.004673735467319937 sim_compute_sim_state_median 0.0046221571908870215 sim_compute_sim_state_min 0.003269600868225098 sim_physics_max 0.29096910086545075 sim_physics_mean 0.216262137629723 sim_physics_median 0.21956859185145453 sim_physics_min 0.1516780972480774 sim_render-ego_max 0.012763625484401896 sim_render-ego_mean 0.011746707924532664 sim_render-ego_median 0.011773860617859722 sim_render-ego_min 0.00878690481185913 simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 2.7533333333333307 survival_time_min 0.9500000000000004
No reset possible 276904175Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFVI-sim-testingstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:08 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 300, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "observations".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 36, in on_received_observations
|| self.current_image = self.preprocessor.preprocess(obs)
|| File "/workspace/wrappers.py", line 9, in preprocess
|| from scipy.misc import imresize
|| ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276874178Liam Paull challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276824193Liam Paull challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:29 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276774181Liam Paull challenge-aido_LF-baseline-duckietown aido3-LFV-sim-testingstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:40 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276644196Liam Paull challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation failed no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:23 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 341, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 113, in object_from_ipce_
raise ZValueError(msg, expected=st, given_object=mj)
zuper_typing.exceptions.ZValueError: Type mismatch for a simple type.
│ expected: float
│ given_object: 0
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 341, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 172, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 353, in object_from_ipce_dataclass_instance
) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'motor_right' of PWMCommands.
│ K_annotations: {motor_left : float, motor_right : float}
│ expect_type: float
│ ann_K: float
│ K_name: `PWMCommands`
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 69, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 172, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 353, in object_from_ipce_dataclass_instance
) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'wheels' of Duckiebot1Commands.
│ K_annotations: dict
│ │ wheels :
│ │ dataclass aido_schemas.schemas.PWMCommands
│ │ field motor_left : float
│ │ field motor_right : float
│ │ LEDS :
│ │ dataclass aido_schemas.schemas.LEDSCommands
│ │ field center : dataclass aido_schemas.schemas.RGB
│ │ field r : float
│ │ field g : float
│ │ field b : float
│ │ field front_left : dataclass aido_schemas.schemas.RGB
│ │ field r : float
│ │ field g : float
│ │ field b : float
│ │ field front_right : dataclass aido_schemas.schemas.RGB
│ │ field r : float
│ │ field g : float
│ │ field b : float
│ │ field back_left : dataclass aido_schemas.schemas.RGB
│ │ field r : float
│ │ field g : float
│ │ field b : float
│ │ field back_right : dataclass aido_schemas.schemas.RGB
│ │ field r : float
│ │ field g : float
│ │ field b : float
│ expect_type: dataclass aido_schemas.schemas.PWMCommands
│ field motor_left : float
│ field motor_right : float
│ ann_K: dataclass aido_schemas.schemas.PWMCommands
│ field motor_left : float
│ field motor_right : float
│ K_name: `Duckiebot1Commands`
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 215, in read_one
data = object_from_ipce(msg[FIELD_DATA], klass)
File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 88, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.schemas.Duckiebot1Commands
│ field wheels : dataclass aido_schemas.schemas.PWMCommands
│ field motor_left : float
│ field motor_right : float
│ field LEDS : dataclass aido_schemas.schemas.LEDSCommands
│ field center : dataclass aido_schemas.schemas.RGB
│ field r : float
│ field g : float
│ field b : float
│ field front_left : dataclass aido_schemas.schemas.RGB
│ field r : float
│ field g : float
│ field b : float
│ field front_right : dataclass aido_schemas.schemas.RGB
│ field r : float
│ field g : float
│ field b : float
│ field back_left : dataclass aido_schemas.schemas.RGB
│ field r : float
│ field g : float
│ field b : float
│ field back_right : dataclass aido_schemas.schemas.RGB
│ field r : float
│ field g : float
│ field b : float
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276424211Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFVI-sim-testingstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 300, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 276214250Manfred Diaz challenge-aido_LF-template-tensorflow aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2076332909287648 survival_time_median 0.9500000000000004 deviation-center-line_median 0.05959084682231141 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03000301784939236 agent_compute-ego_mean 0.02811190944296985 agent_compute-ego_median 0.028093727011429637 agent_compute-ego_min 0.026498892728020165 deviation-center-line_max 0.07460882796157109 deviation-center-line_mean 0.057684301647178506 deviation-center-line_min 0.03691340116837813 deviation-heading_max 0.5778737322852835 deviation-heading_mean 0.4095648208316064 deviation-heading_median 0.3816578294007733 deviation-heading_min 0.30125041999269503 driven_any_max 0.32463963755183867 driven_any_mean 0.2599065275915756 driven_any_median 0.23363327650065127 driven_any_min 0.193076027767499 driven_lanedir_consec_max 0.293034051406895 driven_lanedir_consec_mean 0.2134315916841029 driven_lanedir_consec_min 0.0961789710484 driven_lanedir_max 0.293034051406895 driven_lanedir_mean 0.2134315916841029 driven_lanedir_median 0.2076332909287648 driven_lanedir_min 0.0961789710484 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.32133069245802953, "sim_physics": 0.10243686437606812, "survival_time": 1.0000000000000002, "driven_lanedir": 0.293034051406895, "sim_render-ego": 0.012330210208892824, "in-drivable-lane": 0, "agent_compute-ego": 0.02941089868545532, "deviation-heading": 0.3704613649450698, "set_robot_commands": 0.00814056396484375, "deviation-center-line": 0.05959084682231141, "driven_lanedir_consec": 0.293034051406895, "sim_compute_sim_state": 0.004410994052886963, "sim_compute_performance-ego": 0.006823575496673584, "sim_compute_robot_state-ego": 0.008509337902069092}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22685300367985953, "sim_physics": 0.1125782798318302, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2076332909287648, "sim_render-ego": 0.012546567355885226, "in-drivable-lane": 0, "agent_compute-ego": 0.026498892728020165, "deviation-heading": 0.30125041999269503, "set_robot_commands": 0.009559028288897346, "deviation-center-line": 0.07460882796157109, "driven_lanedir_consec": 0.2076332909287648, "sim_compute_sim_state": 0.005102171617395738, "sim_compute_performance-ego": 0.007291036493637983, "sim_compute_robot_state-ego": 0.009247345082900104}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.193076027767499, "sim_physics": 0.11437083615197076, "survival_time": 0.9000000000000002, "driven_lanedir": 0.0961789710484, "sim_render-ego": 0.01225125789642334, "in-drivable-lane": 0, "agent_compute-ego": 0.03000301784939236, "deviation-heading": 0.5778737322852835, "set_robot_commands": 0.009553538428412544, "deviation-center-line": 0.05252591908922408, "driven_lanedir_consec": 0.0961789710484, "sim_compute_sim_state": 0.004957967334323459, "sim_compute_performance-ego": 0.006971571180555556, "sim_compute_robot_state-ego": 0.008656899134318033}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23363327650065127, "sim_physics": 0.1294960975646973, "survival_time": 0.9500000000000004, "driven_lanedir": 0.17923537421362745, "sim_render-ego": 0.012930104607029966, "in-drivable-lane": 0, "agent_compute-ego": 0.028093727011429637, "deviation-heading": 0.3816578294007733, "set_robot_commands": 0.009799354954769735, "deviation-center-line": 0.03691340116837813, "driven_lanedir_consec": 0.17923537421362745, "sim_compute_sim_state": 0.005126915479961194, "sim_compute_performance-ego": 0.007181907954968904, "sim_compute_robot_state-ego": 0.01036449482566432}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32463963755183867, "sim_physics": 0.10227839946746826, "survival_time": 1.0000000000000002, "driven_lanedir": 0.29107627082282717, "sim_render-ego": 0.011727714538574218, "in-drivable-lane": 0, "agent_compute-ego": 0.026553010940551756, "deviation-heading": 0.41658075753421014, "set_robot_commands": 0.008518028259277343, "deviation-center-line": 0.06478251319440778, "driven_lanedir_consec": 0.29107627082282717, "sim_compute_sim_state": 0.004416346549987793, "sim_compute_performance-ego": 0.006712925434112549, "sim_compute_robot_state-ego": 0.008464789390563965}}set_robot_commands_max 0.009799354954769735 set_robot_commands_mean 0.009114102779240144 set_robot_commands_median 0.009553538428412544 set_robot_commands_min 0.00814056396484375 sim_compute_performance-ego_max 0.007291036493637983 sim_compute_performance-ego_mean 0.006996203311989716 sim_compute_performance-ego_median 0.006971571180555556 sim_compute_performance-ego_min 0.006712925434112549 sim_compute_robot_state-ego_max 0.01036449482566432 sim_compute_robot_state-ego_mean 0.009048573267103104 sim_compute_robot_state-ego_median 0.008656899134318033 sim_compute_robot_state-ego_min 0.008464789390563965 sim_compute_sim_state_max 0.005126915479961194 sim_compute_sim_state_mean 0.004802879006911029 sim_compute_sim_state_median 0.004957967334323459 sim_compute_sim_state_min 0.004410994052886963 sim_physics_max 0.1294960975646973 sim_physics_mean 0.11223209547840692 sim_physics_median 0.1125782798318302 sim_physics_min 0.10227839946746826 sim_render-ego_max 0.012930104607029966 sim_render-ego_mean 0.012357170921361117 sim_render-ego_median 0.012330210208892824 sim_render-ego_min 0.011727714538574218 simulation-passed 1 survival_time_max 1.0000000000000002 survival_time_mean 0.9400000000000002 survival_time_min 0.8500000000000002
No reset possible 276084278Gianmarco Bernasconi Baseline-IL-logs-tensorflow aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:06 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 275774334Soroush Saryazdi challenge-aido_LF-template-random aido3-LFVI-sim-testingstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:17:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6510741719617279 survival_time_median 2.5999999999999988 deviation-center-line_median 0.13998987879563426 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.026630564739829617 agent_compute-ego_mean 0.022505570482858055 agent_compute-ego_median 0.02279581014926617 agent_compute-ego_min 0.01645133454920882 deviation-center-line_max 0.3036287511501312 deviation-center-line_mean 0.15369769239159572 deviation-center-line_min 0.05216491457142899 deviation-heading_max 1.2179728408173982 deviation-heading_mean 0.5261661462618537 deviation-heading_median 0.39731350514028857 deviation-heading_min 0.17653006715371072 driven_any_max 2.224828697235836 driven_any_mean 1.0945516051967747 driven_any_median 1.035889090772785 driven_any_min 0.28141737741661643 driven_lanedir_consec_max 1.5148199711845598 driven_lanedir_consec_mean 0.6776353875620368 driven_lanedir_consec_min 0.2574360490463805 driven_lanedir_max 1.5148389893669991 driven_lanedir_mean 0.6987447229996103 driven_lanedir_median 0.6625717078190373 driven_lanedir_min 0.2574360490463805 in-drivable-lane_max 2.449999999999994 in-drivable-lane_mean 0.7399999999999982 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.120585162571246, "sim_physics": 0.25827586023431076, "survival_time": 2.849999999999998, "driven_lanedir": 1.0834331015849266, "sim_render-ego": 0.013110671127051636, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.024027155156721148, "deviation-heading": 0.41432780267306696, "set_robot_commands": 0.009673181333039935, "deviation-center-line": 0.13998987879563426, "driven_lanedir_consec": 1.0834331015849266, "sim_compute_sim_state": 0.004728392550819798, "sim_compute_performance-ego": 0.007313339333785207, "sim_compute_robot_state-ego": 0.009122024502670556, "sim_compute_robot_state-npc0": 0.008486183066117136, "sim_compute_robot_state-npc1": 0.00795929055464895, "sim_compute_robot_state-npc2": 0.008056469130934331, "sim_compute_robot_state-npc3": 0.007931696741204513}, "udem1-1-0": {"driven_any": 0.625093593968239, "sim_physics": 0.22716403007507324, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6085670792754807, "sim_render-ego": 0.011411700929914202, "in-drivable-lane": 0, "agent_compute-ego": 0.021481159755161832, "deviation-heading": 0.32013156786773145, "set_robot_commands": 0.008834593636648996, "deviation-center-line": 0.09604910370355851, "driven_lanedir_consec": 0.6085670792754807, "sim_compute_sim_state": 0.004507943562098912, "sim_compute_performance-ego": 0.0066652570452008925, "sim_compute_robot_state-ego": 0.008408512387956892, "sim_compute_robot_state-npc0": 0.008085952486310687, "sim_compute_robot_state-npc1": 0.007465675898960658, "sim_compute_robot_state-npc2": 0.007573904309953962, "sim_compute_robot_state-npc3": 0.007496874673025949}, "udem1-2-0": {"driven_any": 1.0646337119139948, "sim_physics": 0.19882390675721345, "survival_time": 2.6999999999999984, "driven_lanedir": 0.54057801494714, "sim_render-ego": 0.011954766732675058, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.023170091487743235, "deviation-heading": 0.7806490469039062, "set_robot_commands": 0.010142617755466037, "deviation-center-line": 0.18907742227401345, "driven_lanedir_consec": 0.54057801494714, "sim_compute_sim_state": 0.005051551041779695, "sim_compute_performance-ego": 0.006827734134815357, "sim_compute_robot_state-ego": 0.009104781680636937, "sim_compute_robot_state-npc0": 0.008523729112413194, "sim_compute_robot_state-npc1": 0.00838337121186433, "sim_compute_robot_state-npc2": 0.008407928325511791, "sim_compute_robot_state-npc3": 0.008389993950172706}, "udem1-3-0": {"driven_any": 0.28141737741661643, "sim_physics": 0.450531332116378, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2574360490463805, "sim_render-ego": 0.014325857162475586, "in-drivable-lane": 0, "agent_compute-ego": 0.026630564739829617, "deviation-heading": 0.370261699898986, "set_robot_commands": 0.01169031544735557, "deviation-center-line": 0.05216491457142899, "driven_lanedir_consec": 0.2574360490463805, "sim_compute_sim_state": 0.005783545343499435, "sim_compute_performance-ego": 0.007773399353027344, "sim_compute_robot_state-ego": 0.01036257492868524, "sim_compute_robot_state-npc0": 0.010762365240799753, "sim_compute_robot_state-npc1": 0.011762957823903936, "sim_compute_robot_state-npc2": 0.011904591008236534, "sim_compute_robot_state-npc3": 0.012403613642642372}, "udem1-4-0": {"driven_any": 1.4415883765088768, "sim_physics": 0.2601860979912986, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5714453508506352, "sim_render-ego": 0.013278279505984885, "in-drivable-lane": 1.8499999999999943, "agent_compute-ego": 0.02427607858684701, "deviation-heading": 0.38647524317752424, "set_robot_commands": 0.010111315149656484, "deviation-center-line": 0.13680180419291485, "driven_lanedir_consec": 0.5714453508506352, "sim_compute_sim_state": 0.004959509406291264, "sim_compute_performance-ego": 0.007702189432063573, "sim_compute_robot_state-ego": 0.009287431206501703, "sim_compute_robot_state-npc0": 0.009351065461064728, "sim_compute_robot_state-npc1": 0.00872952165737958, "sim_compute_robot_state-npc2": 0.008206417862798127, "sim_compute_robot_state-npc3": 0.008279565354468117}, "udem1-5-0": {"driven_any": 1.0080391968248454, "sim_physics": 0.218753654223222, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6704865591525617, "sim_render-ego": 0.011873071010296162, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02279581014926617, "deviation-heading": 0.3922278328684869, "set_robot_commands": 0.009896012452932503, "deviation-center-line": 0.07771251037610638, "driven_lanedir_consec": 0.6704865591525617, "sim_compute_sim_state": 0.004861758305476262, "sim_compute_performance-ego": 0.006713303235860972, "sim_compute_robot_state-ego": 0.00937803891988901, "sim_compute_robot_state-npc0": 0.008243936758774977, "sim_compute_robot_state-npc1": 0.00816861024269691, "sim_compute_robot_state-npc2": 0.008386364349952111, "sim_compute_robot_state-npc3": 0.00841516714829665}, "udem1-6-0": {"driven_any": 1.0203763919640902, "sim_physics": 0.22162998639620268, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6885137224643074, "sim_render-ego": 0.012562925998981182, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023904438202197734, "deviation-heading": 0.48275274423678327, "set_robot_commands": 0.009716180654672476, "deviation-center-line": 0.2218899592142332, "driven_lanedir_consec": 0.6510741719617279, "sim_compute_sim_state": 0.004859740917499249, "sim_compute_performance-ego": 0.007051289081573486, "sim_compute_robot_state-ego": 0.009161976667550894, "sim_compute_robot_state-npc0": 0.008554834585923415, "sim_compute_robot_state-npc1": 0.008562885797940768, "sim_compute_robot_state-npc2": 0.008659133544334998, "sim_compute_robot_state-npc3": 0.00816883949133066}, "udem1-7-0": {"driven_any": 1.518889572352387, "sim_physics": 0.2788069574800256, "survival_time": 3.649999999999995, "driven_lanedir": 1.5148389893669991, "sim_render-ego": 0.012896283032142951, "in-drivable-lane": 0, "agent_compute-ego": 0.024895583113578906, "deviation-heading": 0.20977423156921973, "set_robot_commands": 0.011070160016621628, "deviation-center-line": 0.21770843077410823, "driven_lanedir_consec": 1.5148199711845598, "sim_compute_sim_state": 0.0054980304143200185, "sim_compute_performance-ego": 0.007593158173234495, "sim_compute_robot_state-ego": 0.009850681644596468, "sim_compute_robot_state-npc0": 0.009405201428557096, "sim_compute_robot_state-npc1": 0.008968353271484375, "sim_compute_robot_state-npc2": 0.009276801592683138, "sim_compute_robot_state-npc3": 0.009074106608351616}, "udem1-8-0": {"driven_any": 1.0327164362829535, "sim_physics": 0.21691766610512367, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8071665223942781, "sim_render-ego": 0.011909571977762075, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.02127812458918645, "deviation-heading": 0.7544988063126181, "set_robot_commands": 0.009428973381335918, "deviation-center-line": 0.25456483764263077, "driven_lanedir_consec": 0.7988277806254289, "sim_compute_sim_state": 0.004533941929156964, "sim_compute_performance-ego": 0.00733265051474938, "sim_compute_robot_state-ego": 0.009143655116741476, "sim_compute_robot_state-npc0": 0.008596401948195238, "sim_compute_robot_state-npc1": 0.007909073279454159, "sim_compute_robot_state-npc2": 0.007792940506568322, "sim_compute_robot_state-npc3": 0.007867648051335262}, "udem1-9-0": {"driven_any": 2.194603187711772, "sim_physics": 0.22461057626284087, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9504366656971932, "sim_render-ego": 0.012342906915224517, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.022180552666003887, "deviation-heading": 1.2179728408173982, "set_robot_commands": 0.0096551592533405, "deviation-center-line": 0.3036287511501312, "driven_lanedir_consec": 0.891948749340645, "sim_compute_sim_state": 0.004889696836471558, "sim_compute_performance-ego": 0.007021766442518968, "sim_compute_robot_state-ego": 0.009430543734477116, "sim_compute_robot_state-npc0": 0.008519557806161733, "sim_compute_robot_state-npc1": 0.008516898522010216, "sim_compute_robot_state-npc2": 0.008500034992511455, "sim_compute_robot_state-npc3": 0.008483150830635658}, "udem1-10-0": {"driven_any": 0.289456859388621, "sim_physics": 0.2060707688331604, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2655179454616352, "sim_render-ego": 0.011491799354553222, "in-drivable-lane": 0, "agent_compute-ego": 0.019658422470092772, "deviation-heading": 0.36575855943077534, "set_robot_commands": 0.008406603336334228, "deviation-center-line": 0.06115233279890005, "driven_lanedir_consec": 0.2655179454616352, "sim_compute_sim_state": 0.004560148715972901, "sim_compute_performance-ego": 0.00654066801071167, "sim_compute_robot_state-ego": 0.007860398292541504, "sim_compute_robot_state-npc0": 0.008357429504394531, "sim_compute_robot_state-npc1": 0.008275294303894043, "sim_compute_robot_state-npc2": 0.00888291597366333, "sim_compute_robot_state-npc3": 0.00770035982131958}, "udem1-11-0": {"driven_any": 1.2100209344634405, "sim_physics": 0.1577436317831783, "survival_time": 2.9499999999999975, "driven_lanedir": 0.46508942212711313, "sim_render-ego": 0.009291479143045716, "in-drivable-lane": 1.599999999999997, "agent_compute-ego": 0.01645133454920882, "deviation-heading": 0.17653006715371072, "set_robot_commands": 0.007119021173250877, "deviation-center-line": 0.129995313593986, "driven_lanedir_consec": 0.46508942212711313, "sim_compute_sim_state": 0.0036667928857318424, "sim_compute_performance-ego": 0.005178188873549639, "sim_compute_robot_state-ego": 0.006861290689242088, "sim_compute_robot_state-npc0": 0.006686392477003194, "sim_compute_robot_state-npc1": 0.0065414218579308465, "sim_compute_robot_state-npc2": 0.006304951037390758, "sim_compute_robot_state-npc3": 0.006076606653504453}, "udem1-12-0": {"driven_any": 2.224828697235836, "sim_physics": 0.18825208223783052, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0703777445593876, "sim_render-ego": 0.011088346059505755, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02138521579595713, "deviation-heading": 0.9732612596020856, "set_robot_commands": 0.008955712501819316, "deviation-center-line": 0.1588932542141487, "driven_lanedir_consec": 0.861653506375097, "sim_compute_sim_state": 0.004373754446323101, "sim_compute_performance-ego": 0.00645371125294612, "sim_compute_robot_state-ego": 0.00825378757256728, "sim_compute_robot_state-npc0": 0.007744681376677293, "sim_compute_robot_state-npc1": 0.007581765835101788, "sim_compute_robot_state-npc2": 0.007409966908968412, "sim_compute_robot_state-npc3": 0.007363039713639479}, "udem1-13-0": {"driven_any": 0.35013548857591936, "sim_physics": 0.2624701369892467, "survival_time": 1.1000000000000003, "driven_lanedir": 0.32471197024708154, "sim_render-ego": 0.012857523831454193, "in-drivable-lane": 0, "agent_compute-ego": 0.023917425762523304, "deviation-heading": 0.39731350514028857, "set_robot_commands": 0.009840304201299494, "deviation-center-line": 0.06622448803036315, "driven_lanedir_consec": 0.32471197024708154, "sim_compute_sim_state": 0.004681738940152255, "sim_compute_performance-ego": 0.007029956037347967, "sim_compute_robot_state-ego": 0.009229118173772638, "sim_compute_robot_state-npc0": 0.008265332742170855, "sim_compute_robot_state-npc1": 0.00805709578774192, "sim_compute_robot_state-npc2": 0.00820347395810214, "sim_compute_robot_state-npc3": 0.007992549376054243}, "udem1-14-0": {"driven_any": 1.035889090772785, "sim_physics": 0.2457334307523874, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6625717078190373, "sim_render-ego": 0.011735022068023682, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02153160021855281, "deviation-heading": 0.6505569862752227, "set_robot_commands": 0.009112532322223367, "deviation-center-line": 0.1996123845417775, "driven_lanedir_consec": 0.6589411412501393, "sim_compute_sim_state": 0.004687052506666917, "sim_compute_performance-ego": 0.006601269428546612, "sim_compute_robot_state-ego": 0.008548456888932448, "sim_compute_robot_state-npc0": 0.007938495049109826, "sim_compute_robot_state-npc1": 0.007556970302875225, "sim_compute_robot_state-npc2": 0.007749873858231764, "sim_compute_robot_state-npc3": 0.007822105517754188}}set_robot_commands_max 0.01169031544735557 set_robot_commands_mean 0.009576845507733156 set_robot_commands_median 0.009673181333039935 set_robot_commands_min 0.007119021173250877 sim_compute_performance-ego_max 0.007773399353027344 sim_compute_performance-ego_mean 0.0069198586899954445 sim_compute_performance-ego_median 0.007021766442518968 sim_compute_performance-ego_min 0.005178188873549639 sim_compute_robot_state-ego_max 0.01036257492868524 sim_compute_robot_state-ego_mean 0.008933551493784149 sim_compute_robot_state-ego_median 0.009143655116741476 sim_compute_robot_state-ego_min 0.006861290689242088 sim_compute_robot_state-npc0_max 0.010762365240799753 sim_compute_robot_state-npc0_mean 0.008501437269578244 sim_compute_robot_state-npc0_median 0.008486183066117136 sim_compute_robot_state-npc0_min 0.006686392477003194 sim_compute_robot_state-npc1_max 0.011762957823903936 sim_compute_robot_state-npc1_mean 0.008295945756525846 sim_compute_robot_state-npc1_median 0.00816861024269691 sim_compute_robot_state-npc1_min 0.0065414218579308465 sim_compute_robot_state-npc2_max 0.011904591008236534 sim_compute_robot_state-npc2_mean 0.008354384490656081 sim_compute_robot_state-npc2_median 0.008206417862798127 sim_compute_robot_state-npc2_min 0.006304951037390758 sim_compute_robot_state-npc3_max 0.012403613642642372 sim_compute_robot_state-npc3_mean 0.008231021171582363 sim_compute_robot_state-npc3_median 0.007992549376054243 sim_compute_robot_state-npc3_min 0.006076606653504453 sim_compute_sim_state_max 0.005783545343499435 sim_compute_sim_state_mean 0.004776239853484012 sim_compute_sim_state_median 0.004728392550819798 sim_compute_sim_state_min 0.0036667928857318424 sim_physics_max 0.450531332116378 sim_physics_mean 0.2410646745491661 sim_physics_median 0.22461057626284087 sim_physics_min 0.1577436317831783 sim_render-ego_max 0.014325857162475586 sim_render-ego_mean 0.012142013656606054 sim_render-ego_median 0.011954766732675058 sim_render-ego_min 0.009291479143045716 simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 2.7533333333333307 survival_time_min 0.9500000000000004
No reset possible 275564367Jeick Hincapie Barrera challenge-aido_LF-template-tensorflow aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:04:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.20658189909430935 survival_time_median 0.9500000000000004 deviation-center-line_median 0.057887678454824475 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0277640700340271 agent_compute-ego_mean 0.022278022803020183 agent_compute-ego_median 0.02139040043479518 agent_compute-ego_min 0.01699707087348489 deviation-center-line_max 0.07420154388146702 deviation-center-line_mean 0.05742880512141759 deviation-center-line_min 0.03458305857167605 deviation-heading_max 0.46615591563505954 deviation-heading_mean 0.3851837613088363 deviation-heading_median 0.40551789130771865 deviation-heading_min 0.2991313898826098 driven_any_max 0.3294490020320088 driven_any_mean 0.2670887931154212 driven_any_median 0.25245497598565275 driven_any_min 0.22504650126967593 driven_lanedir_consec_max 0.29596502048166773 driven_lanedir_consec_mean 0.2240720294395785 driven_lanedir_consec_min 0.18631696844984447 driven_lanedir_max 0.29596502048166773 driven_lanedir_mean 0.2240720294395785 driven_lanedir_median 0.20658189909430935 driven_lanedir_min 0.18631696844984447 in-drivable-lane_max 0.04999999999999993 in-drivable-lane_mean 0.009999999999999986 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.28363124672012535, "sim_physics": 0.08471179008483887, "survival_time": 1.0000000000000002, "driven_lanedir": 0.23078707117765063, "sim_render-ego": 0.008800363540649414, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.023964595794677735, "deviation-heading": 0.40551789130771865, "set_robot_commands": 0.007076847553253174, "deviation-center-line": 0.05482625460302112, "driven_lanedir_consec": 0.23078707117765063, "sim_compute_sim_state": 0.0037203431129455566, "sim_compute_performance-ego": 0.005164992809295654, "sim_compute_robot_state-ego": 0.0062855005264282225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22504650126967593, "sim_physics": 0.06580453760483686, "survival_time": 0.8500000000000002, "driven_lanedir": 0.20658189909430935, "sim_render-ego": 0.007596450693467084, "in-drivable-lane": 0, "agent_compute-ego": 0.01699707087348489, "deviation-heading": 0.2991313898826098, "set_robot_commands": 0.004951953887939453, "deviation-center-line": 0.07420154388146702, "driven_lanedir_consec": 0.20658189909430935, "sim_compute_sim_state": 0.003174908020917107, "sim_compute_performance-ego": 0.004111963159897748, "sim_compute_robot_state-ego": 0.005252207026762121}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25245497598565275, "sim_physics": 0.08025151804873817, "survival_time": 0.9500000000000004, "driven_lanedir": 0.18631696844984447, "sim_render-ego": 0.008994742443687037, "in-drivable-lane": 0, "agent_compute-ego": 0.021273976878116007, "deviation-heading": 0.46615591563505954, "set_robot_commands": 0.006876029466327868, "deviation-center-line": 0.057887678454824475, "driven_lanedir_consec": 0.18631696844984447, "sim_compute_sim_state": 0.004108504245155736, "sim_compute_performance-ego": 0.005058175639102333, "sim_compute_robot_state-ego": 0.00661049391094007}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.24486223956964304, "sim_physics": 0.07170530369407252, "survival_time": 0.9500000000000004, "driven_lanedir": 0.20070918799442028, "sim_render-ego": 0.009531171698319284, "in-drivable-lane": 0, "agent_compute-ego": 0.02139040043479518, "deviation-heading": 0.3407160551506707, "set_robot_commands": 0.007232716209010074, "deviation-center-line": 0.03458305857167605, "driven_lanedir_consec": 0.20070918799442028, "sim_compute_sim_state": 0.0034368540111340976, "sim_compute_performance-ego": 0.005266227220234118, "sim_compute_robot_state-ego": 0.006812660317671926}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3294490020320088, "sim_physics": 0.10562211275100708, "survival_time": 1.0000000000000002, "driven_lanedir": 0.29596502048166773, "sim_render-ego": 0.01203780174255371, "in-drivable-lane": 0, "agent_compute-ego": 0.0277640700340271, "deviation-heading": 0.4143975545681231, "set_robot_commands": 0.009708976745605467, "deviation-center-line": 0.06564549009609928, "driven_lanedir_consec": 0.29596502048166773, "sim_compute_sim_state": 0.005225062370300293, "sim_compute_performance-ego": 0.00711137056350708, "sim_compute_robot_state-ego": 0.00895150899887085}}set_robot_commands_max 0.009708976745605467 set_robot_commands_mean 0.007169304772427207 set_robot_commands_median 0.007076847553253174 set_robot_commands_min 0.004951953887939453 sim_compute_performance-ego_max 0.00711137056350708 sim_compute_performance-ego_mean 0.005342545878407387 sim_compute_performance-ego_median 0.005164992809295654 sim_compute_performance-ego_min 0.004111963159897748 sim_compute_robot_state-ego_max 0.00895150899887085 sim_compute_robot_state-ego_mean 0.006782474156134638 sim_compute_robot_state-ego_median 0.00661049391094007 sim_compute_robot_state-ego_min 0.005252207026762121 sim_compute_sim_state_max 0.005225062370300293 sim_compute_sim_state_mean 0.003933134352090558 sim_compute_sim_state_median 0.0037203431129455566 sim_compute_sim_state_min 0.003174908020917107 sim_physics_max 0.10562211275100708 sim_physics_mean 0.08161905243669869 sim_physics_median 0.08025151804873817 sim_physics_min 0.06580453760483686 sim_render-ego_max 0.01203780174255371 sim_render-ego_mean 0.009392106023735306 sim_render-ego_median 0.008994742443687037 sim_render-ego_min 0.007596450693467084 simulation-passed 1 survival_time_max 1.0000000000000002 survival_time_mean 0.9500000000000002 survival_time_min 0.8500000000000002
No reset possible 274984452Bea Baselines challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:29:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2712142256148775 survival_time_median 8.349999999999984 deviation-center-line_median 0.49814704306462826 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05766955087351244 agent_compute-ego_mean 0.05108654353047271 agent_compute-ego_median 0.05288389677642494 agent_compute-ego_min 0.04040247650556667 deviation-center-line_max 1.1422708643452928 deviation-center-line_mean 0.5880389377056806 deviation-center-line_min 0.15331132843795162 deviation-heading_max 3.946291183446984 deviation-heading_mean 1.7501391211932205 deviation-heading_median 1.1203991289655475 deviation-heading_min 0.5867877951223207 driven_any_max 2.3491515213282086 driven_any_mean 1.506949923859363 driven_any_median 1.2883481672965444 driven_any_min 0.6213568445996791 driven_lanedir_consec_max 2.3341323333114437 driven_lanedir_consec_mean 1.4148871798945035 driven_lanedir_consec_min 0.22022963566612125 driven_lanedir_max 2.3341323333114437 driven_lanedir_mean 1.4322538302823848 driven_lanedir_median 1.2712142256148775 driven_lanedir_min 0.4807293914843375 in-drivable-lane_max 0.7999999999999996 in-drivable-lane_mean 0.1299999999999997 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6860209395438117, "sim_physics": 0.09608831969640588, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5958763946152981, "sim_render-ego": 0.010032797372469338, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.04040247650556667, "deviation-heading": 1.182767998225812, "set_robot_commands": 0.008545739676362725, "deviation-center-line": 0.15331132843795162, "driven_lanedir_consec": 0.5958763946152981, "sim_compute_sim_state": 0.004118993718137023, "sim_compute_performance-ego": 0.006011824454030683, "sim_compute_robot_state-ego": 0.007790629581738544}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9232161674494197, "sim_physics": 0.1135949807438424, "survival_time": 12.30000000000004, "driven_lanedir": 1.9102391946324109, "sim_render-ego": 0.012689756184089476, "in-drivable-lane": 0, "agent_compute-ego": 0.052169816280768166, "deviation-heading": 0.9779208926796829, "set_robot_commands": 0.010461561078947731, "deviation-center-line": 0.8531432767674466, "driven_lanedir_consec": 1.9102391946324109, "sim_compute_sim_state": 0.005412489418091812, "sim_compute_performance-ego": 0.007410400282076704, "sim_compute_robot_state-ego": 0.009640119909270993}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3491169789132313, "sim_physics": 0.1151417096455892, "survival_time": 14.950000000000076, "driven_lanedir": 2.2382709709317306, "sim_render-ego": 0.012765239079793296, "in-drivable-lane": 0, "agent_compute-ego": 0.05260989983876546, "deviation-heading": 3.3475606010144956, "set_robot_commands": 0.010049041906992594, "deviation-center-line": 0.860613541152336, "driven_lanedir_consec": 2.2382709709317306, "sim_compute_sim_state": 0.005279219150543213, "sim_compute_performance-ego": 0.007454861799875895, "sim_compute_robot_state-ego": 0.009869964917500812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2883481672965444, "sim_physics": 0.1246690421761153, "survival_time": 8.349999999999984, "driven_lanedir": 1.2712142256148775, "sim_render-ego": 0.013465939881558904, "in-drivable-lane": 0, "agent_compute-ego": 0.05617089328651657, "deviation-heading": 1.0187035911592337, "set_robot_commands": 0.010993861866568377, "deviation-center-line": 0.49814704306462826, "driven_lanedir_consec": 1.2712142256148775, "sim_compute_sim_state": 0.005488358571857749, "sim_compute_performance-ego": 0.007813577880402526, "sim_compute_robot_state-ego": 0.01052007275427173}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491452160700517, "sim_physics": 0.1277789600690206, "survival_time": 14.950000000000076, "driven_lanedir": 2.2937179788260504, "sim_render-ego": 0.013343036969502769, "in-drivable-lane": 0, "agent_compute-ego": 0.05705300092697144, "deviation-heading": 2.371554734897432, "set_robot_commands": 0.0107972518603007, "deviation-center-line": 0.5137348214064439, "driven_lanedir_consec": 2.2937179788260504, "sim_compute_sim_state": 0.005446038246154785, "sim_compute_performance-ego": 0.00820685863494873, "sim_compute_robot_state-ego": 0.01074353297551473}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.6936708129044866, "sim_physics": 0.10992980259720996, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6696042125867366, "sim_render-ego": 0.012997675967472856, "in-drivable-lane": 0, "agent_compute-ego": 0.05288389677642494, "deviation-heading": 0.9420815859159056, "set_robot_commands": 0.00896407199162309, "deviation-center-line": 0.24481185305527936, "driven_lanedir_consec": 0.6696042125867366, "sim_compute_sim_state": 0.005262451787148753, "sim_compute_performance-ego": 0.007196005954537341, "sim_compute_robot_state-ego": 0.00947517220691968}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.349129580956721, "sim_physics": 0.12057801326115926, "survival_time": 14.950000000000076, "driven_lanedir": 2.329766683674419, "sim_render-ego": 0.012935758431752525, "in-drivable-lane": 0, "agent_compute-ego": 0.05332176129023234, "deviation-heading": 1.5109328568125235, "set_robot_commands": 0.010679521560668946, "deviation-center-line": 1.1422708643452928, "driven_lanedir_consec": 2.329766683674419, "sim_compute_sim_state": 0.005622724692026774, "sim_compute_performance-ego": 0.007785508632659912, "sim_compute_robot_state-ego": 0.0100002392133077}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.3490790328373334, "sim_physics": 0.1343575660387675, "survival_time": 14.950000000000076, "driven_lanedir": 2.227367127399411, "sim_render-ego": 0.0134595783551534, "in-drivable-lane": 0, "agent_compute-ego": 0.05529223442077637, "deviation-heading": 3.8543186703385466, "set_robot_commands": 0.01068306843439738, "deviation-center-line": 1.0497795816997997, "driven_lanedir_consec": 2.227367127399411, "sim_compute_sim_state": 0.005418561299641927, "sim_compute_performance-ego": 0.007870209217071534, "sim_compute_robot_state-ego": 0.010158329010009766}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.637420934513154, "sim_physics": 0.13131401982418325, "survival_time": 4.299999999999993, "driven_lanedir": 0.6229334679862568, "sim_render-ego": 0.01331667844639268, "in-drivable-lane": 0, "agent_compute-ego": 0.05766955087351244, "deviation-heading": 0.5867877951223207, "set_robot_commands": 0.01164270001788472, "deviation-center-line": 0.33744023723463257, "driven_lanedir_consec": 0.6229334679862568, "sim_compute_sim_state": 0.005231909973676814, "sim_compute_performance-ego": 0.007866701414418776, "sim_compute_robot_state-ego": 0.009544258893922318}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3490735224142605, "sim_physics": 0.115752907594045, "survival_time": 14.950000000000076, "driven_lanedir": 2.208008983726191, "sim_render-ego": 0.01272430658340454, "in-drivable-lane": 0, "agent_compute-ego": 0.05407812595367432, "deviation-heading": 3.946291183446984, "set_robot_commands": 0.010209803581237792, "deviation-center-line": 0.9393675521939548, "driven_lanedir_consec": 2.208008983726191, "sim_compute_sim_state": 0.005483495394388835, "sim_compute_performance-ego": 0.007803558508555094, "sim_compute_robot_state-ego": 0.009903890291849772}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7578510828917921, "sim_physics": 0.09570968977295526, "survival_time": 5.04999999999999, "driven_lanedir": 0.4807293914843375, "sim_render-ego": 0.010637892354833017, "in-drivable-lane": 0.7999999999999996, "agent_compute-ego": 0.04680537469316237, "deviation-heading": 2.5245452141329054, "set_robot_commands": 0.008119871120641727, "deviation-center-line": 0.29831013710715937, "driven_lanedir_consec": 0.22022963566612125, "sim_compute_sim_state": 0.004410401429280196, "sim_compute_performance-ego": 0.006207083711529723, "sim_compute_robot_state-ego": 0.00812714170701433}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.6454599323760919, "sim_physics": 0.1231410201938673, "survival_time": 4.3499999999999925, "driven_lanedir": 0.5463589524618305, "sim_render-ego": 0.013246327981181529, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.05598211288452149, "deviation-heading": 1.0292895900886034, "set_robot_commands": 0.010511069462217134, "deviation-center-line": 0.24017025397997163, "driven_lanedir_consec": 0.5463589524618305, "sim_compute_sim_state": 0.005404250375155745, "sim_compute_performance-ego": 0.007515860700059211, "sim_compute_robot_state-ego": 0.009522024242357275}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.256208123795662, "sim_physics": 0.08418347937929119, "survival_time": 8.14999999999998, "driven_lanedir": 1.243536702893216, "sim_render-ego": 0.01009619455396032, "in-drivable-lane": 0, "agent_compute-ego": 0.04377317867396068, "deviation-heading": 0.7612250794677126, "set_robot_commands": 0.007370243774601287, "deviation-center-line": 0.45073256774809184, "driven_lanedir_consec": 1.243536702893216, "sim_compute_sim_state": 0.0043067025260691266, "sim_compute_performance-ego": 0.005895276742478821, "sim_compute_robot_state-ego": 0.00751260160668496}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.6213568445996791, "sim_physics": 0.08203894183749244, "survival_time": 4.199999999999993, "driven_lanedir": 0.512050834091561, "sim_render-ego": 0.010007077739352272, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04361142430986677, "deviation-heading": 1.0777078956305954, "set_robot_commands": 0.0070808132489522295, "deviation-center-line": 0.18679005652891648, "driven_lanedir_consec": 0.512050834091561, "sim_compute_sim_state": 0.004103163878122966, "sim_compute_performance-ego": 0.005799378667558942, "sim_compute_robot_state-ego": 0.007216621012914749}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3491515213282086, "sim_physics": 0.08613971312840779, "survival_time": 14.950000000000076, "driven_lanedir": 2.3341323333114437, "sim_render-ego": 0.0106249737739563, "in-drivable-lane": 0, "agent_compute-ego": 0.04447440624237061, "deviation-heading": 1.1203991289655475, "set_robot_commands": 0.008369181950887044, "deviation-center-line": 1.0519609508633032, "driven_lanedir_consec": 2.3341323333114437, "sim_compute_sim_state": 0.004393397172292073, "sim_compute_performance-ego": 0.00624995231628418, "sim_compute_robot_state-ego": 0.007701725165049235}}set_robot_commands_max 0.01164270001788472 set_robot_commands_mean 0.009631853435485564 set_robot_commands_median 0.010209803581237792 set_robot_commands_min 0.0070808132489522295 sim_compute_performance-ego_max 0.00820685863494873 sim_compute_performance-ego_mean 0.007139137261099204 sim_compute_performance-ego_median 0.007454861799875895 sim_compute_performance-ego_min 0.005799378667558942 sim_compute_robot_state-ego_max 0.01074353297551473 sim_compute_robot_state-ego_mean 0.009181754899221774 sim_compute_robot_state-ego_median 0.009544258893922318 sim_compute_robot_state-ego_min 0.007216621012914749 sim_compute_sim_state_max 0.005622724692026774 sim_compute_sim_state_mean 0.0050254771755058525 sim_compute_sim_state_median 0.005279219150543213 sim_compute_sim_state_min 0.004103163878122966 sim_physics_max 0.1343575660387675 sim_physics_mean 0.11069454439722352 sim_physics_median 0.1151417096455892 sim_physics_min 0.08203894183749244 sim_render-ego_max 0.013465939881558904 sim_render-ego_mean 0.012156215578324884 sim_render-ego_median 0.012765239079793296 sim_render-ego_min 0.010007077739352272 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.71333333333336 survival_time_min 4.199999999999993
No reset possible 274844512Frank (Chude) Qian 2019-11-19|FrankNet aido3-LF-sim-testingstep1-simulation aborted no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:13:37 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 274834576Abderrahim Khalifa challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation host-error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:07 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling simulator ...
stderr | Pulling scenario_maker ...
stderr | Pulling evaluator ... done
stderr |
stderr | ERROR: for solution manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr | manifest for ai404/aido-submissions:2019_11_27_00_01_45 not found
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 273124578Jeick Hincapie Barrera challenge-aido_LF-template-random aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 1:00:21 Waited 3600 seconds [...] Waited 3600 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 273034584Jeick Hincapie Barrera challenge-aido_LF-template-random aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 272914595Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation failed yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:41 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 52, in on_received_get_commands
|| pwm_left, pwm_right = self.compute_action(self.current_image)
|| File "solution.py", line 48, in compute_action
|| action = self.model.predict(observation)
|| File "/workspace/model.py", line 40, in predict
|| output = self.model(state).cpu().data.numpy().flatten()
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
|| result = self.forward(*input, **kwargs)
|| File "/usr/local/lib/python3.7/site-packages/torchvision/models/squeezenet.py", line 100, in forward
|| x = self.features(x)
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
|| result = self.forward(*input, **kwargs)
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/container.py", line 92, in forward
|| input = module(input)
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541, in __call__
|| result = self.forward(*input, **kwargs)
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 345, in forward
|| return self.conv2d_forward(input, self.weight)
|| File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 342, in conv2d_forward
|| self.padding, self.dilation, self.groups)
|| RuntimeError: Expected 4-dimensional input for 4-dimensional weight 64 3 3 3, but got 3-dimensional input of size [3, 120, 160] instead
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 272264644Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.9916328270557315 survival_time_median 14.950000000000076 deviation-center-line_median 0.8329259703536409 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05284804344177246 agent_compute-ego_mean 0.047640862053387786 agent_compute-ego_median 0.04879305362701416 agent_compute-ego_min 0.03619985024134318 deviation-center-line_max 1.1092799836068192 deviation-center-line_mean 0.7355042353492499 deviation-center-line_min 0.3054095642950218 deviation-heading_max 3.455671122641811 deviation-heading_mean 2.4679737143249385 deviation-heading_median 2.6242588907515683 deviation-heading_min 1.0167016704814895 driven_any_max 4.849065914402251 driven_any_mean 3.368632088228329 driven_any_median 3.410892885296252 driven_any_min 1.9909578027335588 driven_lanedir_consec_max 4.698413343181561 driven_lanedir_consec_mean 3.1524106216366015 driven_lanedir_consec_min 1.8921840501656573 driven_lanedir_max 4.698413343181561 driven_lanedir_mean 3.1524106216366015 driven_lanedir_median 2.9916328270557315 driven_lanedir_min 1.8921840501656573 in-drivable-lane_max 2.249999999999992 in-drivable-lane_mean 0.8199999999999971 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.410892885296252, "sim_physics": 0.1129722245534261, "survival_time": 14.950000000000076, "driven_lanedir": 2.9916328270557315, "sim_render-ego": 0.012778836886088054, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.03619985024134318, "deviation-heading": 3.4366965073646853, "set_robot_commands": 0.01105717420578003, "deviation-center-line": 0.9035919163168192, "driven_lanedir_consec": 2.9916328270557315, "sim_compute_sim_state": 0.005505983829498291, "sim_compute_performance-ego": 0.007510159015655517, "sim_compute_robot_state-ego": 0.009282152652740478}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2282635228085175, "sim_physics": 0.11383353642054966, "survival_time": 6.999999999999983, "driven_lanedir": 1.8921840501656573, "sim_render-ego": 0.013038100515093125, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.04879305362701416, "deviation-heading": 1.0167016704814895, "set_robot_commands": 0.009906208515167237, "deviation-center-line": 0.3054095642950218, "driven_lanedir_consec": 1.8921840501656573, "sim_compute_sim_state": 0.005308641706194196, "sim_compute_performance-ego": 0.007381411961146764, "sim_compute_robot_state-ego": 0.009163784980773923}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.849065914402251, "sim_physics": 0.1152039655049642, "survival_time": 14.950000000000076, "driven_lanedir": 4.698413343181561, "sim_render-ego": 0.01321739912033081, "in-drivable-lane": 0, "agent_compute-ego": 0.048604882558186846, "deviation-heading": 3.455671122641811, "set_robot_commands": 0.010582454999287925, "deviation-center-line": 1.1092799836068192, "driven_lanedir_consec": 4.698413343181561, "sim_compute_sim_state": 0.005254033406575521, "sim_compute_performance-ego": 0.007772791385650635, "sim_compute_robot_state-ego": 0.00999269962310791}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9909578027335588, "sim_physics": 0.12798012935951963, "survival_time": 7.299999999999982, "driven_lanedir": 1.903547508694312, "sim_render-ego": 0.016272012501546782, "in-drivable-lane": 0, "agent_compute-ego": 0.05175848039862228, "deviation-heading": 1.8065403803851403, "set_robot_commands": 0.011052027140578178, "deviation-center-line": 0.5263137421739486, "driven_lanedir_consec": 1.903547508694312, "sim_compute_sim_state": 0.005299350986741993, "sim_compute_performance-ego": 0.007854461669921875, "sim_compute_robot_state-ego": 0.01027294544324483}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.363980315901065, "sim_physics": 0.11044204552968342, "survival_time": 14.950000000000076, "driven_lanedir": 4.276275379085747, "sim_render-ego": 0.0126965069770813, "in-drivable-lane": 0, "agent_compute-ego": 0.05284804344177246, "deviation-heading": 2.6242588907515683, "set_robot_commands": 0.009852250417073568, "deviation-center-line": 0.8329259703536409, "driven_lanedir_consec": 4.276275379085747, "sim_compute_sim_state": 0.004982318083445231, "sim_compute_performance-ego": 0.007521270116170247, "sim_compute_robot_state-ego": 0.00951754887898763}}set_robot_commands_max 0.01105717420578003 set_robot_commands_mean 0.010490023055577388 set_robot_commands_median 0.010582454999287925 set_robot_commands_min 0.009852250417073568 sim_compute_performance-ego_max 0.007854461669921875 sim_compute_performance-ego_mean 0.007608018829709007 sim_compute_performance-ego_median 0.007521270116170247 sim_compute_performance-ego_min 0.007381411961146764 sim_compute_robot_state-ego_max 0.01027294544324483 sim_compute_robot_state-ego_mean 0.009645826315770956 sim_compute_robot_state-ego_median 0.00951754887898763 sim_compute_robot_state-ego_min 0.009163784980773923 sim_compute_sim_state_max 0.005505983829498291 sim_compute_sim_state_mean 0.005270065602491046 sim_compute_sim_state_median 0.005299350986741993 sim_compute_sim_state_min 0.004982318083445231 sim_physics_max 0.12798012935951963 sim_physics_mean 0.1160863802736286 sim_physics_median 0.11383353642054966 sim_physics_min 0.11044204552968342 sim_render-ego_max 0.016272012501546782 sim_render-ego_mean 0.013600571200028014 sim_render-ego_median 0.013038100515093125 sim_render-ego_min 0.0126965069770813 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.830000000000036 survival_time_min 6.999999999999983
No reset possible 272214649Sergio Duvan Mendoza Rojas challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:52 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 271884676Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.370527358234694 survival_time_median 14.950000000000076 deviation-center-line_median 0.6734362105363145 in-drivable-lane_median 2.10000000000003
other stats agent_compute-ego_max 0.052101389567057295 agent_compute-ego_mean 0.0494657286008199 agent_compute-ego_median 0.049556760787963866 agent_compute-ego_min 0.04617570797602336 deviation-center-line_max 0.7836985636034406 deviation-center-line_mean 0.6839131222129179 deviation-center-line_min 0.554132259683296 deviation-heading_max 4.193935851915731 deviation-heading_mean 2.9943070834278 deviation-heading_median 3.132355455387611 deviation-heading_min 1.8830868617039291 driven_any_max 5.361668427116374 driven_any_mean 4.481930862188234 driven_any_median 4.488689701350607 driven_any_min 3.585593663948459 driven_lanedir_consec_max 4.755879238791252 driven_lanedir_consec_mean 3.9125240713094263 driven_lanedir_consec_min 2.689484783350626 driven_lanedir_max 4.755879238791252 driven_lanedir_mean 4.14382649414649 driven_lanedir_median 4.370527358234694 driven_lanedir_min 3.0428507949419155 in-drivable-lane_max 3.4499999999999904 in-drivable-lane_mean 1.7300000000000086 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.585593663948459, "sim_physics": 0.10678528706232708, "survival_time": 14.950000000000076, "driven_lanedir": 3.0428507949419155, "sim_render-ego": 0.01191539764404297, "in-drivable-lane": 3.1000000000000227, "agent_compute-ego": 0.04617570797602336, "deviation-heading": 3.2238679851035803, "set_robot_commands": 0.01021206299463908, "deviation-center-line": 0.660308569165441, "driven_lanedir_consec": 3.0428507949419155, "sim_compute_sim_state": 0.005075617631276449, "sim_compute_performance-ego": 0.007530224323272705, "sim_compute_robot_state-ego": 0.009546683629353842}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.199361046858436, "sim_physics": 0.10969282944997152, "survival_time": 14.950000000000076, "driven_lanedir": 3.845996897535937, "sim_render-ego": 0.011828940709431966, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.047732412815093994, "deviation-heading": 4.193935851915731, "set_robot_commands": 0.010236883163452148, "deviation-center-line": 0.7479900080760972, "driven_lanedir_consec": 2.689484783350626, "sim_compute_sim_state": 0.004981041749318441, "sim_compute_performance-ego": 0.007174588839213053, "sim_compute_robot_state-ego": 0.009073212146759033}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.361668427116374, "sim_physics": 0.11072313706080118, "survival_time": 14.950000000000076, "driven_lanedir": 4.755879238791252, "sim_render-ego": 0.01257714033126831, "in-drivable-lane": 3.4499999999999904, "agent_compute-ego": 0.049556760787963866, "deviation-heading": 1.8830868617039291, "set_robot_commands": 0.01040795087814331, "deviation-center-line": 0.6734362105363145, "driven_lanedir_consec": 4.755879238791252, "sim_compute_sim_state": 0.00515437126159668, "sim_compute_performance-ego": 0.007459040482838949, "sim_compute_robot_state-ego": 0.009454511801401774}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.774341471667297, "sim_physics": 0.11460373242696126, "survival_time": 14.950000000000076, "driven_lanedir": 4.703878181228644, "sim_render-ego": 0.012508579889933268, "in-drivable-lane": 0, "agent_compute-ego": 0.051762371857961016, "deviation-heading": 2.538289263028147, "set_robot_commands": 0.00994499444961548, "deviation-center-line": 0.554132259683296, "driven_lanedir_consec": 4.703878181228644, "sim_compute_sim_state": 0.0051924514770507815, "sim_compute_performance-ego": 0.007231813271840413, "sim_compute_robot_state-ego": 0.009505707422892253}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.488689701350607, "sim_physics": 0.11699081420898436, "survival_time": 14.950000000000076, "driven_lanedir": 4.370527358234694, "sim_render-ego": 0.012899293104807537, "in-drivable-lane": 0, "agent_compute-ego": 0.052101389567057295, "deviation-heading": 3.132355455387611, "set_robot_commands": 0.010191991329193116, "deviation-center-line": 0.7836985636034406, "driven_lanedir_consec": 4.370527358234694, "sim_compute_sim_state": 0.005281282265981038, "sim_compute_performance-ego": 0.007637182076772054, "sim_compute_robot_state-ego": 0.009892253081003824}}set_robot_commands_max 0.01040795087814331 set_robot_commands_mean 0.010198776563008627 set_robot_commands_median 0.01021206299463908 set_robot_commands_min 0.00994499444961548 sim_compute_performance-ego_max 0.007637182076772054 sim_compute_performance-ego_mean 0.0074065697987874355 sim_compute_performance-ego_median 0.007459040482838949 sim_compute_performance-ego_min 0.007174588839213053 sim_compute_robot_state-ego_max 0.009892253081003824 sim_compute_robot_state-ego_mean 0.009494473616282143 sim_compute_robot_state-ego_median 0.009505707422892253 sim_compute_robot_state-ego_min 0.009073212146759033 sim_compute_sim_state_max 0.005281282265981038 sim_compute_sim_state_mean 0.005136952877044678 sim_compute_sim_state_median 0.00515437126159668 sim_compute_sim_state_min 0.004981041749318441 sim_physics_max 0.11699081420898436 sim_physics_mean 0.11175916004180908 sim_physics_median 0.11072313706080118 sim_physics_min 0.10678528706232708 sim_render-ego_max 0.012899293104807537 sim_render-ego_mean 0.012345870335896809 sim_render-ego_median 0.012508579889933268 sim_render-ego_min 0.011828940709431966 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 271494716Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.934150005302535 survival_time_median 14.950000000000076 deviation-center-line_median 0.7425330521297423 in-drivable-lane_median 0.05000000000000071
other stats agent_compute-ego_max 0.031028726895650227 agent_compute-ego_mean 0.02882554516584977 agent_compute-ego_median 0.02920140345891317 agent_compute-ego_min 0.02591898130333942 deviation-center-line_max 0.9207200534443446 deviation-center-line_mean 0.6471021727852204 deviation-center-line_min 0.11011386185989495 deviation-heading_max 3.2214208795975994 deviation-heading_mean 2.2724631390293673 deviation-heading_median 2.602207588981165 deviation-heading_min 0.27014477910188256 driven_any_max 5.077397514099261 driven_any_mean 3.4703257893295145 driven_any_median 4.25526822682154 driven_any_min 0.2748168677825005 driven_lanedir_consec_max 4.988474639639929 driven_lanedir_consec_mean 3.297354434940236 driven_lanedir_consec_min 0.2663087842630094 driven_lanedir_max 4.988474639639929 driven_lanedir_mean 3.297354434940236 driven_lanedir_median 3.934150005302535 driven_lanedir_min 0.2663087842630094 in-drivable-lane_max 1.200000000000017 in-drivable-lane_mean 0.4500000000000029 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.15013531159558, "sim_physics": 0.11280542850494384, "survival_time": 14.950000000000076, "driven_lanedir": 2.780978551904666, "sim_render-ego": 0.012354544003804525, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.028200432459513345, "deviation-heading": 3.2214208795975994, "set_robot_commands": 0.011791919072469076, "deviation-center-line": 0.6742280081685437, "driven_lanedir_consec": 2.780978551904666, "sim_compute_sim_state": 0.006075615088144938, "sim_compute_performance-ego": 0.007730317115783691, "sim_compute_robot_state-ego": 0.009339489936828614}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2748168677825005, "sim_physics": 0.13255686345307724, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2663087842630094, "sim_render-ego": 0.01375307207522185, "in-drivable-lane": 0, "agent_compute-ego": 0.02591898130333942, "deviation-heading": 0.27014477910188256, "set_robot_commands": 0.013345739115839418, "deviation-center-line": 0.11011386185989495, "driven_lanedir_consec": 0.2663087842630094, "sim_compute_sim_state": 0.0055002129596212635, "sim_compute_performance-ego": 0.00785840075948964, "sim_compute_robot_state-ego": 0.009804663450821588}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.077397514099261, "sim_physics": 0.11424776077270508, "survival_time": 14.950000000000076, "driven_lanedir": 4.988474639639929, "sim_render-ego": 0.012762327988942465, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.029778181711832684, "deviation-heading": 2.3673563554674337, "set_robot_commands": 0.012030758062998454, "deviation-center-line": 0.9207200534443446, "driven_lanedir_consec": 4.988474639639929, "sim_compute_sim_state": 0.006049253145853678, "sim_compute_performance-ego": 0.007575696309407552, "sim_compute_robot_state-ego": 0.010066761175791422}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.25526822682154, "sim_physics": 0.1237508980433146, "survival_time": 14.950000000000076, "driven_lanedir": 3.934150005302535, "sim_render-ego": 0.01361758550008138, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.031028726895650227, "deviation-heading": 2.901186091998756, "set_robot_commands": 0.012269035180409747, "deviation-center-line": 0.7879158883235765, "driven_lanedir_consec": 3.934150005302535, "sim_compute_sim_state": 0.005988231499989827, "sim_compute_performance-ego": 0.007694725195566813, "sim_compute_robot_state-ego": 0.010070051352183024}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.594011026348691, "sim_physics": 0.11913105487823486, "survival_time": 14.950000000000076, "driven_lanedir": 4.5168601935910395, "sim_render-ego": 0.01297966480255127, "in-drivable-lane": 0, "agent_compute-ego": 0.02920140345891317, "deviation-heading": 2.602207588981165, "set_robot_commands": 0.012378276983896892, "deviation-center-line": 0.7425330521297423, "driven_lanedir_consec": 4.5168601935910395, "sim_compute_sim_state": 0.0060343639055887854, "sim_compute_performance-ego": 0.007624940077463786, "sim_compute_robot_state-ego": 0.00980729341506958}}set_robot_commands_max 0.013345739115839418 set_robot_commands_mean 0.012363145683122715 set_robot_commands_median 0.012269035180409747 set_robot_commands_min 0.011791919072469076 sim_compute_performance-ego_max 0.00785840075948964 sim_compute_performance-ego_mean 0.007696815891542297 sim_compute_performance-ego_median 0.007694725195566813 sim_compute_performance-ego_min 0.007575696309407552 sim_compute_robot_state-ego_max 0.010070051352183024 sim_compute_robot_state-ego_mean 0.009817651866138845 sim_compute_robot_state-ego_median 0.00980729341506958 sim_compute_robot_state-ego_min 0.009339489936828614 sim_compute_sim_state_max 0.006075615088144938 sim_compute_sim_state_mean 0.005929535319839698 sim_compute_sim_state_median 0.0060343639055887854 sim_compute_sim_state_min 0.0055002129596212635 sim_physics_max 0.13255686345307724 sim_physics_mean 0.12049840113045514 sim_physics_median 0.11913105487823486 sim_physics_min 0.11280542850494384 sim_render-ego_max 0.01375307207522185 sim_render-ego_mean 0.0130934388741203 sim_render-ego_median 0.01297966480255127 sim_render-ego_min 0.012354544003804525 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.190000000000063 survival_time_min 1.1500000000000004
No reset possible 271314722Ramon Emiliani challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:04:29 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 271194731Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.42396168122598654 survival_time_median 1.3000000000000005 deviation-center-line_median 0.09352036752300956 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.048253109960845024 agent_compute-ego_mean 0.03663291806466186 agent_compute-ego_median 0.03026037062368085 agent_compute-ego_min 0.027911619706587357 deviation-center-line_max 0.09385671883083473 deviation-center-line_mean 0.08154834604284285 deviation-center-line_min 0.0624972760241913 deviation-heading_max 0.3869181546408405 deviation-heading_mean 0.3114902176245244 deviation-heading_median 0.29561687130868636 deviation-heading_min 0.23596515174278057 driven_any_max 0.4744027673951647 driven_any_mean 0.42277169114827207 driven_any_median 0.44064729910862305 driven_any_min 0.2957481364114629 driven_lanedir_consec_max 0.4569596144115149 driven_lanedir_consec_mean 0.40737732007747385 driven_lanedir_consec_min 0.28759433960649594 driven_lanedir_max 0.4569596144115149 driven_lanedir_mean 0.40737732007747385 driven_lanedir_median 0.42396168122598654 driven_lanedir_min 0.28759433960649594 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.43220890852861776, "sim_physics": 0.1240343072197654, "survival_time": 1.1000000000000003, "driven_lanedir": 0.41669613390867377, "sim_render-ego": 0.012814987789500845, "in-drivable-lane": 0, "agent_compute-ego": 0.027911619706587357, "deviation-heading": 0.29561687130868636, "set_robot_commands": 0.010443904183127664, "deviation-center-line": 0.0624972760241913, "driven_lanedir_consec": 0.41669613390867377, "sim_compute_sim_state": 0.005808028307828036, "sim_compute_performance-ego": 0.0069123398173939095, "sim_compute_robot_state-ego": 0.008683226325295189}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2957481364114629, "sim_physics": 0.1405844688415527, "survival_time": 1.0000000000000002, "driven_lanedir": 0.28759433960649594, "sim_render-ego": 0.01404353380203247, "in-drivable-lane": 0, "agent_compute-ego": 0.029815614223480225, "deviation-heading": 0.23596515174278057, "set_robot_commands": 0.014523708820343015, "deviation-center-line": 0.09385671883083473, "driven_lanedir_consec": 0.28759433960649594, "sim_compute_sim_state": 0.006199395656585694, "sim_compute_performance-ego": 0.008059680461883545, "sim_compute_robot_state-ego": 0.01005467176437378}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4744027673951647, "sim_physics": 0.1583997049639302, "survival_time": 1.5500000000000007, "driven_lanedir": 0.4516748312346981, "sim_render-ego": 0.014452565100885209, "in-drivable-lane": 0, "agent_compute-ego": 0.03026037062368085, "deviation-heading": 0.3869181546408405, "set_robot_commands": 0.012837402282222623, "deviation-center-line": 0.09353797694719544, "driven_lanedir_consec": 0.4516748312346981, "sim_compute_sim_state": 0.006007132991667717, "sim_compute_performance-ego": 0.008142009858162172, "sim_compute_robot_state-ego": 0.011194975145401494}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4708513442974915, "sim_physics": 0.1147102876143022, "survival_time": 1.6500000000000008, "driven_lanedir": 0.4569596144115149, "sim_render-ego": 0.012726162419174656, "in-drivable-lane": 0, "agent_compute-ego": 0.048253109960845024, "deviation-heading": 0.27429111985938964, "set_robot_commands": 0.010795470440026484, "deviation-center-line": 0.0643293908889832, "driven_lanedir_consec": 0.4569596144115149, "sim_compute_sim_state": 0.005535501422304095, "sim_compute_performance-ego": 0.007508993148803711, "sim_compute_robot_state-ego": 0.009294365391586764}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.44064729910862305, "sim_physics": 0.11361489846156192, "survival_time": 1.3000000000000005, "driven_lanedir": 0.42396168122598654, "sim_render-ego": 0.011591196060180664, "in-drivable-lane": 0, "agent_compute-ego": 0.04692387580871582, "deviation-heading": 0.3646597905709249, "set_robot_commands": 0.01116023613856389, "deviation-center-line": 0.09352036752300956, "driven_lanedir_consec": 0.42396168122598654, "sim_compute_sim_state": 0.0052043749735905575, "sim_compute_performance-ego": 0.0073775419822106, "sim_compute_robot_state-ego": 0.00903633924630972}}set_robot_commands_max 0.014523708820343015 set_robot_commands_mean 0.011952144372856736 set_robot_commands_median 0.01116023613856389 set_robot_commands_min 0.010443904183127664 sim_compute_performance-ego_max 0.008142009858162172 sim_compute_performance-ego_mean 0.007600113053690788 sim_compute_performance-ego_median 0.007508993148803711 sim_compute_performance-ego_min 0.0069123398173939095 sim_compute_robot_state-ego_max 0.011194975145401494 sim_compute_robot_state-ego_mean 0.00965271557459339 sim_compute_robot_state-ego_median 0.009294365391586764 sim_compute_robot_state-ego_min 0.008683226325295189 sim_compute_sim_state_max 0.006199395656585694 sim_compute_sim_state_mean 0.0057508866703952196 sim_compute_sim_state_median 0.005808028307828036 sim_compute_sim_state_min 0.0052043749735905575 sim_physics_max 0.1583997049639302 sim_physics_mean 0.1302687334202225 sim_physics_median 0.1240343072197654 sim_physics_min 0.11361489846156192 sim_render-ego_max 0.014452565100885209 sim_render-ego_mean 0.013125689034354768 sim_render-ego_median 0.012814987789500845 sim_render-ego_min 0.011591196060180664 simulation-passed 1 survival_time_max 1.6500000000000008 survival_time_mean 1.3200000000000007 survival_time_min 1.0000000000000002
No reset possible 270854753Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.268664863908288 survival_time_median 14.950000000000076 deviation-center-line_median 0.7856775022581125 in-drivable-lane_median 1.7500000000000249
other stats agent_compute-ego_max 0.05243166208267211 agent_compute-ego_mean 0.04456751664479573 agent_compute-ego_median 0.04289998213450114 agent_compute-ego_min 0.0344297973314921 deviation-center-line_max 0.8907055503877652 deviation-center-line_mean 0.7573306766603594 deviation-center-line_min 0.6369667664122302 deviation-heading_max 3.5643802921614283 deviation-heading_mean 2.7837951972997663 deviation-heading_median 2.752045204593478 deviation-heading_min 2.379637442004899 driven_any_max 5.5306011983631045 driven_any_mean 4.457794853074247 driven_any_median 4.512195431934442 driven_any_min 3.1902260733178047 driven_lanedir_consec_max 4.7262919180668925 driven_lanedir_consec_mean 4.013825266065394 driven_lanedir_consec_min 2.648359777360618 driven_lanedir_max 4.7262919180668925 driven_lanedir_mean 4.013825266065394 driven_lanedir_median 4.268664863908288 driven_lanedir_min 2.648359777360618 in-drivable-lane_max 3.799999999999998 in-drivable-lane_mean 1.9300000000000128 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1902260733178047, "sim_physics": 0.10095676024754842, "survival_time": 14.950000000000076, "driven_lanedir": 2.648359777360618, "sim_render-ego": 0.01159312089284261, "in-drivable-lane": 2.450000000000018, "agent_compute-ego": 0.0344297973314921, "deviation-heading": 3.5643802921614283, "set_robot_commands": 0.010770103931427, "deviation-center-line": 0.8907055503877652, "driven_lanedir_consec": 2.648359777360618, "sim_compute_sim_state": 0.005147331555684407, "sim_compute_performance-ego": 0.006711977322896322, "sim_compute_robot_state-ego": 0.008395050366719564}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.512195431934442, "sim_physics": 0.07937127431233724, "survival_time": 14.950000000000076, "driven_lanedir": 4.138886676985949, "sim_render-ego": 0.00931174357732137, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.04289998213450114, "deviation-heading": 2.379637442004899, "set_robot_commands": 0.00715084711710612, "deviation-center-line": 0.6369667664122302, "driven_lanedir_consec": 4.138886676985949, "sim_compute_sim_state": 0.0040763107935587566, "sim_compute_performance-ego": 0.005421223640441894, "sim_compute_robot_state-ego": 0.006816976070404053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.5306011983631045, "sim_physics": 0.1145663865407308, "survival_time": 14.950000000000076, "driven_lanedir": 4.7262919180668925, "sim_render-ego": 0.01241304318110148, "in-drivable-lane": 3.799999999999998, "agent_compute-ego": 0.05069557507832845, "deviation-heading": 2.454232332600713, "set_robot_commands": 0.010407169659932457, "deviation-center-line": 0.7856775022581125, "driven_lanedir_consec": 4.7262919180668925, "sim_compute_sim_state": 0.005273017088572184, "sim_compute_performance-ego": 0.007394909858703613, "sim_compute_robot_state-ego": 0.009309352238972982}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.367282200286206, "sim_physics": 0.0808364987373352, "survival_time": 14.950000000000076, "driven_lanedir": 4.268664863908288, "sim_render-ego": 0.009536465803782146, "in-drivable-lane": 0, "agent_compute-ego": 0.042380566596984866, "deviation-heading": 2.752045204593478, "set_robot_commands": 0.0075539477666219075, "deviation-center-line": 0.7885504191714712, "driven_lanedir_consec": 4.268664863908288, "sim_compute_sim_state": 0.004013571739196777, "sim_compute_performance-ego": 0.005491941769917806, "sim_compute_robot_state-ego": 0.007135694821675619}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.688669361469679, "sim_physics": 0.1340732781092326, "survival_time": 14.950000000000076, "driven_lanedir": 4.286923094005223, "sim_render-ego": 0.013434100151062013, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.05243166208267211, "deviation-heading": 2.7686807151383133, "set_robot_commands": 0.011052932739257813, "deviation-center-line": 0.6847531450722173, "driven_lanedir_consec": 4.286923094005223, "sim_compute_sim_state": 0.005358448028564453, "sim_compute_performance-ego": 0.007731363773345947, "sim_compute_robot_state-ego": 0.010518458684285482}}set_robot_commands_max 0.011052932739257813 set_robot_commands_mean 0.00938700024286906 set_robot_commands_median 0.010407169659932457 set_robot_commands_min 0.00715084711710612 sim_compute_performance-ego_max 0.007731363773345947 sim_compute_performance-ego_mean 0.006550283273061117 sim_compute_performance-ego_median 0.006711977322896322 sim_compute_performance-ego_min 0.005421223640441894 sim_compute_robot_state-ego_max 0.010518458684285482 sim_compute_robot_state-ego_mean 0.00843510643641154 sim_compute_robot_state-ego_median 0.008395050366719564 sim_compute_robot_state-ego_min 0.006816976070404053 sim_compute_sim_state_max 0.005358448028564453 sim_compute_sim_state_mean 0.004773735841115315 sim_compute_sim_state_median 0.005147331555684407 sim_compute_sim_state_min 0.004013571739196777 sim_physics_max 0.1340732781092326 sim_physics_mean 0.10196083958943689 sim_physics_median 0.10095676024754842 sim_physics_min 0.07937127431233724 sim_render-ego_max 0.013434100151062013 sim_render-ego_mean 0.011257694721221925 sim_render-ego_median 0.01159312089284261 sim_render-ego_min 0.00931174357732137 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 270584775Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.2739115612178615 survival_time_median 14.950000000000076 deviation-center-line_median 0.8040165999141584 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.031810951232910153 agent_compute-ego_mean 0.027491124788920084 agent_compute-ego_median 0.02683017094930013 agent_compute-ego_min 0.024142587184906007 deviation-center-line_max 1.1007748729617362 deviation-center-line_mean 0.8309220916190195 deviation-center-line_min 0.5221891232117454 deviation-heading_max 3.1720462371531037 deviation-heading_mean 2.509388451173169 deviation-heading_median 2.80565185143022 deviation-heading_min 1.4532232628292456 driven_any_max 4.774910667605642 driven_any_mean 4.223607686174985 driven_any_median 4.358413262726118 driven_any_min 3.5690221292303854 driven_lanedir_consec_max 4.748979315293765 driven_lanedir_consec_mean 4.055218879424711 driven_lanedir_consec_min 3.1878678592546223 driven_lanedir_max 4.748979315293765 driven_lanedir_mean 4.055218879424711 driven_lanedir_median 4.2739115612178615 driven_lanedir_min 3.1878678592546223 in-drivable-lane_max 1.1999999999999955 in-drivable-lane_mean 0.36999999999999866 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5690221292303854, "sim_physics": 0.11639623880386352, "survival_time": 14.950000000000076, "driven_lanedir": 3.1878678592546223, "sim_render-ego": 0.013073379198710124, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.028507029215494792, "deviation-heading": 2.80565185143022, "set_robot_commands": 0.01165048360824585, "deviation-center-line": 0.8040165999141584, "driven_lanedir_consec": 3.1878678592546223, "sim_compute_sim_state": 0.005938313007354736, "sim_compute_performance-ego": 0.007596600850423177, "sim_compute_robot_state-ego": 0.00991071383158366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8526824873175314, "sim_physics": 0.11413342555363971, "survival_time": 14.950000000000076, "driven_lanedir": 3.765719919985814, "sim_render-ego": 0.012638234297434488, "in-drivable-lane": 0, "agent_compute-ego": 0.02616488536198934, "deviation-heading": 2.8193134735807095, "set_robot_commands": 0.011931060155232749, "deviation-center-line": 0.9434385858672528, "driven_lanedir_consec": 3.765719919985814, "sim_compute_sim_state": 0.005743123690287272, "sim_compute_performance-ego": 0.007534323533376058, "sim_compute_robot_state-ego": 0.009281911849975589}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.56300988399525, "sim_physics": 0.0951004195213318, "survival_time": 14.950000000000076, "driven_lanedir": 4.2739115612178615, "sim_render-ego": 0.010890646775563558, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.024142587184906007, "deviation-heading": 3.1720462371531037, "set_robot_commands": 0.011046553452809652, "deviation-center-line": 1.1007748729617362, "driven_lanedir_consec": 4.2739115612178615, "sim_compute_sim_state": 0.005010841687520345, "sim_compute_performance-ego": 0.006175940036773682, "sim_compute_robot_state-ego": 0.00840853452682495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.774910667605642, "sim_physics": 0.1217564336458842, "survival_time": 14.950000000000076, "driven_lanedir": 4.748979315293765, "sim_render-ego": 0.012925754388173422, "in-drivable-lane": 0, "agent_compute-ego": 0.031810951232910153, "deviation-heading": 1.4532232628292456, "set_robot_commands": 0.011668237845102946, "deviation-center-line": 0.5221891232117454, "driven_lanedir_consec": 4.748979315293765, "sim_compute_sim_state": 0.005591175556182861, "sim_compute_performance-ego": 0.0075443919499715165, "sim_compute_robot_state-ego": 0.009781351884206136}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.358413262726118, "sim_physics": 0.1099683634440104, "survival_time": 14.950000000000076, "driven_lanedir": 4.299615741371491, "sim_render-ego": 0.01221553643544515, "in-drivable-lane": 0, "agent_compute-ego": 0.02683017094930013, "deviation-heading": 2.2967074308725657, "set_robot_commands": 0.012341233094533284, "deviation-center-line": 0.7841912761402051, "driven_lanedir_consec": 4.299615741371491, "sim_compute_sim_state": 0.00615160862604777, "sim_compute_performance-ego": 0.007123013337453206, "sim_compute_robot_state-ego": 0.009135875701904297}}set_robot_commands_max 0.012341233094533284 set_robot_commands_mean 0.011727513631184894 set_robot_commands_median 0.011668237845102946 set_robot_commands_min 0.011046553452809652 sim_compute_performance-ego_max 0.007596600850423177 sim_compute_performance-ego_mean 0.007194853941599529 sim_compute_performance-ego_median 0.007534323533376058 sim_compute_performance-ego_min 0.006175940036773682 sim_compute_robot_state-ego_max 0.00991071383158366 sim_compute_robot_state-ego_mean 0.009303677558898929 sim_compute_robot_state-ego_median 0.009281911849975589 sim_compute_robot_state-ego_min 0.00840853452682495 sim_compute_sim_state_max 0.00615160862604777 sim_compute_sim_state_mean 0.005687012513478596 sim_compute_sim_state_median 0.005743123690287272 sim_compute_sim_state_min 0.005010841687520345 sim_physics_max 0.1217564336458842 sim_physics_mean 0.11147097619374594 sim_physics_median 0.11413342555363971 sim_physics_min 0.0951004195213318 sim_render-ego_max 0.013073379198710124 sim_render-ego_mean 0.012348710219065348 sim_render-ego_median 0.012638234297434488 sim_render-ego_min 0.010890646775563558 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 270394786Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2140521099856572 survival_time_median 6.349999999999985 deviation-center-line_median 0.24343202893275523 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03843072493871053 agent_compute-ego_mean 0.031478092750655454 agent_compute-ego_median 0.02886207081447138 agent_compute-ego_min 0.02478392746137536 deviation-center-line_max 0.927996466226079 deviation-center-line_mean 0.44274308603732415 deviation-center-line_min 0.13383705072405 deviation-heading_max 3.4155682754082 deviation-heading_mean 1.711453266136134 deviation-heading_median 1.8557309164160372 deviation-heading_min 0.39262588989577424 driven_any_max 3.659490070551594 driven_any_mean 2.0912710274305484 driven_any_median 1.62441275029736 driven_any_min 0.8850076956440792 driven_lanedir_consec_max 3.5120069186509957 driven_lanedir_consec_mean 1.9414555671473663 driven_lanedir_consec_min 0.8413631635724035 driven_lanedir_max 3.5120069186509957 driven_lanedir_mean 1.9414555671473663 driven_lanedir_median 1.2140521099856572 driven_lanedir_min 0.8413631635724035 in-drivable-lane_max 1.5499999999999945 in-drivable-lane_mean 0.3099999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.3717168244928093, "sim_physics": 0.1230875023206075, "survival_time": 14.950000000000076, "driven_lanedir": 3.2388504330274452, "sim_render-ego": 0.012733296553293864, "in-drivable-lane": 0, "agent_compute-ego": 0.03843072493871053, "deviation-heading": 3.4155682754082, "set_robot_commands": 0.010323050816853842, "deviation-center-line": 0.927996466226079, "driven_lanedir_consec": 3.2388504330274452, "sim_compute_sim_state": 0.005384120941162109, "sim_compute_performance-ego": 0.007651187578837077, "sim_compute_robot_state-ego": 0.00988685131072998}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9157277961668996, "sim_physics": 0.0954276145772731, "survival_time": 2.3499999999999996, "driven_lanedir": 0.9010052105003312, "sim_render-ego": 0.010890620820065762, "in-drivable-lane": 0, "agent_compute-ego": 0.027596392530076046, "deviation-heading": 0.39262588989577424, "set_robot_commands": 0.008305103220838182, "deviation-center-line": 0.13383705072405, "driven_lanedir_consec": 0.9010052105003312, "sim_compute_sim_state": 0.004809912214887903, "sim_compute_performance-ego": 0.006515396402237263, "sim_compute_robot_state-ego": 0.007931820889736743}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.659490070551594, "sim_physics": 0.08631889508149335, "survival_time": 10.700000000000015, "driven_lanedir": 3.5120069186509957, "sim_render-ego": 0.009935192972700173, "in-drivable-lane": 0, "agent_compute-ego": 0.02886207081447138, "deviation-heading": 2.2600983893409574, "set_robot_commands": 0.008097592915329977, "deviation-center-line": 0.761817091314556, "driven_lanedir_consec": 3.5120069186509957, "sim_compute_sim_state": 0.004332037729637645, "sim_compute_performance-ego": 0.005763761351041704, "sim_compute_robot_state-ego": 0.00761835374564768}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.62441275029736, "sim_physics": 0.09398348124947135, "survival_time": 6.349999999999985, "driven_lanedir": 1.2140521099856572, "sim_render-ego": 0.01035255146777536, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.03771734800864392, "deviation-heading": 1.8557309164160372, "set_robot_commands": 0.008132671746681995, "deviation-center-line": 0.24343202893275523, "driven_lanedir_consec": 1.2140521099856572, "sim_compute_sim_state": 0.004304561089342973, "sim_compute_performance-ego": 0.005703334733257143, "sim_compute_robot_state-ego": 0.007685118772852139}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8850076956440792, "sim_physics": 0.07806648378786833, "survival_time": 2.3, "driven_lanedir": 0.8413631635724035, "sim_render-ego": 0.009397579276043436, "in-drivable-lane": 0, "agent_compute-ego": 0.02478392746137536, "deviation-heading": 0.6332428596197004, "set_robot_commands": 0.007062305574831756, "deviation-center-line": 0.14663279298918055, "driven_lanedir_consec": 0.8413631635724035, "sim_compute_sim_state": 0.003922363986139712, "sim_compute_performance-ego": 0.005353336748869523, "sim_compute_robot_state-ego": 0.006684370662855065}}set_robot_commands_max 0.010323050816853842 set_robot_commands_mean 0.008384144854907152 set_robot_commands_median 0.008132671746681995 set_robot_commands_min 0.007062305574831756 sim_compute_performance-ego_max 0.007651187578837077 sim_compute_performance-ego_mean 0.006197403362848542 sim_compute_performance-ego_median 0.005763761351041704 sim_compute_performance-ego_min 0.005353336748869523 sim_compute_robot_state-ego_max 0.00988685131072998 sim_compute_robot_state-ego_mean 0.007961303076364322 sim_compute_robot_state-ego_median 0.007685118772852139 sim_compute_robot_state-ego_min 0.006684370662855065 sim_compute_sim_state_max 0.005384120941162109 sim_compute_sim_state_mean 0.004550599192234069 sim_compute_sim_state_median 0.004332037729637645 sim_compute_sim_state_min 0.003922363986139712 sim_physics_max 0.1230875023206075 sim_physics_mean 0.09537679540334272 sim_physics_median 0.09398348124947135 sim_physics_min 0.07806648378786833 sim_render-ego_max 0.012733296553293864 sim_render-ego_mean 0.01066184821797572 sim_render-ego_median 0.01035255146777536 sim_render-ego_min 0.009397579276043436 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.330000000000015 survival_time_min 2.3
No reset possible 270114809Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.3750677219522336 survival_time_median 14.950000000000076 deviation-center-line_median 0.7872007340960842 in-drivable-lane_median 2.100000000000013
other stats agent_compute-ego_max 0.05082587718963623 agent_compute-ego_mean 0.049005362317278665 agent_compute-ego_median 0.049360450903574625 agent_compute-ego_min 0.04476349433263143 deviation-center-line_max 0.9682196633799434 deviation-center-line_mean 0.7905582074291961 deviation-center-line_min 0.5438115264116925 deviation-heading_max 3.510074306005714 deviation-heading_mean 2.8830573460122055 deviation-heading_median 3.0200988625795286 deviation-heading_min 1.7551678386548668 driven_any_max 5.750086344199286 driven_any_mean 5.07481428570677 driven_any_median 5.044120762762583 driven_any_min 4.487331248025573 driven_lanedir_consec_max 4.982334115404733 driven_lanedir_consec_mean 3.5194578112583033 driven_lanedir_consec_min 2.3002053728426346 driven_lanedir_max 5.273503286328085 driven_lanedir_mean 4.733149186539352 driven_lanedir_median 4.723868602992261 driven_lanedir_min 4.318815182015405 in-drivable-lane_max 3.1000000000000156 in-drivable-lane_mean 1.7200000000000084 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.567428532688982, "sim_physics": 0.11146808385849, "survival_time": 14.950000000000076, "driven_lanedir": 4.318815182015405, "sim_render-ego": 0.012357831796010335, "in-drivable-lane": 2.100000000000013, "agent_compute-ego": 0.04476349433263143, "deviation-heading": 3.510074306005714, "set_robot_commands": 0.01053788979848226, "deviation-center-line": 0.7872007340960842, "driven_lanedir_consec": 3.3750677219522336, "sim_compute_sim_state": 0.005343759854634603, "sim_compute_performance-ego": 0.007522029876708984, "sim_compute_robot_state-ego": 0.009550127188364664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.044120762762583, "sim_physics": 0.1080063279469808, "survival_time": 14.950000000000076, "driven_lanedir": 4.723868602992261, "sim_render-ego": 0.012241582870483398, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.049360450903574625, "deviation-heading": 3.269541967931381, "set_robot_commands": 0.009371898174285888, "deviation-center-line": 0.8693176045611286, "driven_lanedir_consec": 2.3002053728426346, "sim_compute_sim_state": 0.005188511212666829, "sim_compute_performance-ego": 0.0072920505205790204, "sim_compute_robot_state-ego": 0.009440388679504396}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.5251045408574235, "sim_physics": 0.1122264313697815, "survival_time": 14.950000000000076, "driven_lanedir": 4.982334115404733, "sim_render-ego": 0.01294744888941447, "in-drivable-lane": 3.1000000000000156, "agent_compute-ego": 0.05082587718963623, "deviation-heading": 1.7551678386548668, "set_robot_commands": 0.009866076310475667, "deviation-center-line": 0.784241508697132, "driven_lanedir_consec": 4.982334115404733, "sim_compute_sim_state": 0.0051430916786193845, "sim_compute_performance-ego": 0.007308972676595052, "sim_compute_robot_state-ego": 0.009317026138305665}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.487331248025573, "sim_physics": 0.10513214464787836, "survival_time": 14.300000000000068, "driven_lanedir": 4.367224745956272, "sim_render-ego": 0.011876029568118647, "in-drivable-lane": 0, "agent_compute-ego": 0.0493281020984783, "deviation-heading": 2.860403754889538, "set_robot_commands": 0.009258422818217244, "deviation-center-line": 0.9682196633799434, "driven_lanedir_consec": 4.367224745956272, "sim_compute_sim_state": 0.004949263759426304, "sim_compute_performance-ego": 0.0068927236370273405, "sim_compute_robot_state-ego": 0.008732339718958714}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.750086344199286, "sim_physics": 0.10976069688796997, "survival_time": 14.950000000000076, "driven_lanedir": 5.273503286328085, "sim_render-ego": 0.01234015941619873, "in-drivable-lane": 2.500000000000017, "agent_compute-ego": 0.05074888706207275, "deviation-heading": 3.0200988625795286, "set_robot_commands": 0.009450434843699135, "deviation-center-line": 0.5438115264116925, "driven_lanedir_consec": 2.572457100135643, "sim_compute_sim_state": 0.005145040353139242, "sim_compute_performance-ego": 0.007308274110158284, "sim_compute_robot_state-ego": 0.009349721272786458}}set_robot_commands_max 0.01053788979848226 set_robot_commands_mean 0.00969694438903204 set_robot_commands_median 0.009450434843699135 set_robot_commands_min 0.009258422818217244 sim_compute_performance-ego_max 0.007522029876708984 sim_compute_performance-ego_mean 0.007264810164213736 sim_compute_performance-ego_median 0.007308274110158284 sim_compute_performance-ego_min 0.0068927236370273405 sim_compute_robot_state-ego_max 0.009550127188364664 sim_compute_robot_state-ego_mean 0.009277920599583978 sim_compute_robot_state-ego_median 0.009349721272786458 sim_compute_robot_state-ego_min 0.008732339718958714 sim_compute_sim_state_max 0.005343759854634603 sim_compute_sim_state_mean 0.005153933371697272 sim_compute_sim_state_median 0.005145040353139242 sim_compute_sim_state_min 0.004949263759426304 sim_physics_max 0.1122264313697815 sim_physics_mean 0.10931873694222012 sim_physics_median 0.10976069688796997 sim_physics_min 0.10513214464787836 sim_render-ego_max 0.01294744888941447 sim_render-ego_mean 0.012352610508045116 sim_render-ego_median 0.01234015941619873 sim_render-ego_min 0.011876029568118647 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.820000000000077 survival_time_min 14.300000000000068
No reset possible 269824836Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation host-error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:11:53 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
copy_to_cache(realfile, sha256hex)
File "/project/src/duckietown_challenges_runner/runner_cache.py", line 40, in copy_to_cache
msg = "Copying %s to cache %s" % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4836/step1-simulation-ip-172-31-43-40-10497-job26982/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-4-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 269614848Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.6267563087768615 survival_time_median 9.6 deviation-center-line_median 0.33945998558262674 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.036301563074300575 agent_compute-ego_mean 0.032619854296629246 agent_compute-ego_median 0.032974554846684136 agent_compute-ego_min 0.02826095937372564 deviation-center-line_max 1.0286107439929757 deviation-center-line_mean 0.5104538725045403 deviation-center-line_min 0.1741196275469202 deviation-heading_max 2.985306230439083 deviation-heading_mean 1.753392014379921 deviation-heading_median 1.844823568107501 deviation-heading_min 0.7231805487155822 driven_any_max 3.5173763387111845 driven_any_mean 2.1986656428099094 driven_any_median 1.9514265457785993 driven_any_min 1.0000893332588343 driven_lanedir_consec_max 3.355481362420227 driven_lanedir_consec_mean 2.012401632970792 driven_lanedir_consec_min 0.8067667279650714 driven_lanedir_max 3.355481362420227 driven_lanedir_mean 2.012401632970792 driven_lanedir_median 1.6267563087768615 driven_lanedir_min 0.8067667279650714 in-drivable-lane_max 1.550000000000022 in-drivable-lane_mean 0.7100000000000064 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9514265457785993, "sim_physics": 0.11143945902585985, "survival_time": 9.6, "driven_lanedir": 1.6267563087768615, "sim_render-ego": 0.01228837048014005, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.032974554846684136, "deviation-heading": 1.844823568107501, "set_robot_commands": 0.009198800971110662, "deviation-center-line": 0.33945998558262674, "driven_lanedir_consec": 1.6267563087768615, "sim_compute_sim_state": 0.0051299817860126495, "sim_compute_performance-ego": 0.007450871169567108, "sim_compute_robot_state-ego": 0.009240501870711643}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5173763387111845, "sim_physics": 0.09239780346552531, "survival_time": 14.950000000000076, "driven_lanedir": 3.1874241790934064, "sim_render-ego": 0.01066806713740031, "in-drivable-lane": 1.0500000000000131, "agent_compute-ego": 0.03014179229736328, "deviation-heading": 2.985306230439083, "set_robot_commands": 0.008104286988576253, "deviation-center-line": 1.0286107439929757, "driven_lanedir_consec": 3.1874241790934064, "sim_compute_sim_state": 0.004280360539754232, "sim_compute_performance-ego": 0.0062623929977416995, "sim_compute_robot_state-ego": 0.008059786160786947}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0000893332588343, "sim_physics": 0.08701530131664904, "survival_time": 4.549999999999992, "driven_lanedir": 0.8067667279650714, "sim_render-ego": 0.011031339456746867, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.02826095937372564, "deviation-heading": 0.8177619731266309, "set_robot_commands": 0.008321633705726037, "deviation-center-line": 0.1741196275469202, "driven_lanedir_consec": 0.8067667279650714, "sim_compute_sim_state": 0.004537922995431083, "sim_compute_performance-ego": 0.00645489745087676, "sim_compute_robot_state-ego": 0.008140448685530778}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.101975302614706, "sim_physics": 0.12558005930303218, "survival_time": 4.549999999999992, "driven_lanedir": 1.0855795865983913, "sim_render-ego": 0.013148082481635796, "in-drivable-lane": 0, "agent_compute-ego": 0.036301563074300575, "deviation-heading": 0.7231805487155822, "set_robot_commands": 0.01061444492130489, "deviation-center-line": 0.3371472253702754, "driven_lanedir_consec": 1.0855795865983913, "sim_compute_sim_state": 0.005299379537393759, "sim_compute_performance-ego": 0.00748468755365728, "sim_compute_robot_state-ego": 0.010051376217014189}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4224606936862236, "sim_physics": 0.11161453564961751, "survival_time": 14.950000000000076, "driven_lanedir": 3.355481362420227, "sim_render-ego": 0.012360324064890543, "in-drivable-lane": 0, "agent_compute-ego": 0.03542040189107259, "deviation-heading": 2.3958877515108084, "set_robot_commands": 0.009361143112182618, "deviation-center-line": 0.6729317800299035, "driven_lanedir_consec": 3.355481362420227, "sim_compute_sim_state": 0.005036767323811849, "sim_compute_performance-ego": 0.007346363067626953, "sim_compute_robot_state-ego": 0.009338748455047608}}set_robot_commands_max 0.01061444492130489 set_robot_commands_mean 0.009120061939780093 set_robot_commands_median 0.009198800971110662 set_robot_commands_min 0.008104286988576253 sim_compute_performance-ego_max 0.00748468755365728 sim_compute_performance-ego_mean 0.00699984244789396 sim_compute_performance-ego_median 0.007346363067626953 sim_compute_performance-ego_min 0.0062623929977416995 sim_compute_robot_state-ego_max 0.010051376217014189 sim_compute_robot_state-ego_mean 0.008966172277818232 sim_compute_robot_state-ego_median 0.009240501870711643 sim_compute_robot_state-ego_min 0.008059786160786947 sim_compute_sim_state_max 0.005299379537393759 sim_compute_sim_state_mean 0.004856882436480714 sim_compute_sim_state_median 0.005036767323811849 sim_compute_sim_state_min 0.004280360539754232 sim_physics_max 0.12558005930303218 sim_physics_mean 0.10560943175213676 sim_physics_median 0.11143945902585985 sim_physics_min 0.08701530131664904 sim_render-ego_max 0.013148082481635796 sim_render-ego_mean 0.011899236724162711 sim_render-ego_median 0.01228837048014005 sim_render-ego_min 0.01066806713740031 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.720000000000027 survival_time_min 4.549999999999992
No reset possible 269374866Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.804449873948777 survival_time_median 8.299999999999983 deviation-center-line_median 0.40879865900455487 in-drivable-lane_median 1.9499999999999975
other stats agent_compute-ego_max 0.03650065339528597 agent_compute-ego_mean 0.033239650860274264 agent_compute-ego_median 0.032437845071156816 agent_compute-ego_min 0.03204124995640346 deviation-center-line_max 1.0068744147667286 deviation-center-line_mean 0.5444330890019285 deviation-center-line_min 0.22581734475495907 deviation-heading_max 4.052230895637508 deviation-heading_mean 2.252761478097102 deviation-heading_median 1.890564874023978 deviation-heading_min 0.6657173997497621 driven_any_max 4.4135469481641385 driven_any_mean 2.7181220466260196 driven_any_median 2.243610916559857 driven_any_min 1.0176545814501894 driven_lanedir_consec_max 3.934225025433709 driven_lanedir_consec_mean 2.1341339554019387 driven_lanedir_consec_min 0.6206290150271602 driven_lanedir_max 3.934225025433709 driven_lanedir_mean 2.1341339554019387 driven_lanedir_median 1.804449873948777 driven_lanedir_min 0.6206290150271602 in-drivable-lane_max 4.800000000000068 in-drivable-lane_mean 2.27000000000001 in-drivable-lane_min 0.7499999999999973 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0176545814501894, "sim_physics": 0.12651554208535415, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6206290150271602, "sim_render-ego": 0.013717752236586353, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.03650065339528597, "deviation-heading": 0.6657173997497621, "set_robot_commands": 0.010831995652272152, "deviation-center-line": 0.3127871560711956, "driven_lanedir_consec": 0.6206290150271602, "sim_compute_sim_state": 0.0051942926186781665, "sim_compute_performance-ego": 0.007947321121509258, "sim_compute_robot_state-ego": 0.010351754151857816}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.243610916559857, "sim_physics": 0.09964241464454009, "survival_time": 8.299999999999983, "driven_lanedir": 1.804449873948777, "sim_render-ego": 0.012258381728666374, "in-drivable-lane": 1.9499999999999975, "agent_compute-ego": 0.032171174704310405, "deviation-heading": 1.890564874023978, "set_robot_commands": 0.009299525295395447, "deviation-center-line": 0.40879865900455487, "driven_lanedir_consec": 1.804449873948777, "sim_compute_sim_state": 0.004764457783067083, "sim_compute_performance-ego": 0.006966645459094679, "sim_compute_robot_state-ego": 0.009181630180542728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.4135469481641385, "sim_physics": 0.07953067302703858, "survival_time": 14.950000000000076, "driven_lanedir": 3.934225025433709, "sim_render-ego": 0.010148360729217529, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.032437845071156816, "deviation-heading": 4.052230895637508, "set_robot_commands": 0.007459688981374105, "deviation-center-line": 1.0068744147667286, "driven_lanedir_consec": 3.934225025433709, "sim_compute_sim_state": 0.004110140005747477, "sim_compute_performance-ego": 0.005911665757497152, "sim_compute_robot_state-ego": 0.007289033730824788}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.609090619325598, "sim_physics": 0.1219534226826259, "survival_time": 6.999999999999983, "driven_lanedir": 1.2273589819519592, "sim_render-ego": 0.0123333317892892, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.03204124995640346, "deviation-heading": 1.6502203476576804, "set_robot_commands": 0.009796745436532157, "deviation-center-line": 0.22581734475495907, "driven_lanedir_consec": 1.2273589819519592, "sim_compute_sim_state": 0.0048491631235395155, "sim_compute_performance-ego": 0.007322900635855539, "sim_compute_robot_state-ego": 0.009103545120784215}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.306707167630316, "sim_physics": 0.10245574633280435, "survival_time": 14.950000000000076, "driven_lanedir": 3.0840068806480896, "sim_render-ego": 0.011880010763804115, "in-drivable-lane": 4.800000000000068, "agent_compute-ego": 0.033047331174214684, "deviation-heading": 3.005073873416581, "set_robot_commands": 0.00904322862625122, "deviation-center-line": 0.7678878704122051, "driven_lanedir_consec": 3.0840068806480896, "sim_compute_sim_state": 0.004917330741882324, "sim_compute_performance-ego": 0.00698164701461792, "sim_compute_robot_state-ego": 0.008885360558827719}}set_robot_commands_max 0.010831995652272152 set_robot_commands_mean 0.009286236798365016 set_robot_commands_median 0.009299525295395447 set_robot_commands_min 0.007459688981374105 sim_compute_performance-ego_max 0.007947321121509258 sim_compute_performance-ego_mean 0.007026035997714909 sim_compute_performance-ego_median 0.00698164701461792 sim_compute_performance-ego_min 0.005911665757497152 sim_compute_robot_state-ego_max 0.010351754151857816 sim_compute_robot_state-ego_mean 0.008962264748567452 sim_compute_robot_state-ego_median 0.009103545120784215 sim_compute_robot_state-ego_min 0.007289033730824788 sim_compute_sim_state_max 0.0051942926186781665 sim_compute_sim_state_mean 0.004767076854582913 sim_compute_sim_state_median 0.0048491631235395155 sim_compute_sim_state_min 0.004110140005747477 sim_physics_max 0.12651554208535415 sim_physics_mean 0.1060195597544726 sim_physics_median 0.10245574633280435 sim_physics_min 0.07953067302703858 sim_render-ego_max 0.013717752236586353 sim_render-ego_mean 0.012067567449512717 sim_render-ego_median 0.012258381728666374 sim_render-ego_min 0.010148360729217529 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.08000000000002 survival_time_min 5.1999999999999895
No reset possible 269164884Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.7148779577089015 survival_time_median 10.90000000000002 deviation-center-line_median 0.6208519365774757 in-drivable-lane_median 0.7999999999999972
other stats agent_compute-ego_max 0.04063601743162068 agent_compute-ego_mean 0.03581054238946545 agent_compute-ego_median 0.034648931821187334 agent_compute-ego_min 0.03378342628479004 deviation-center-line_max 1.195536142627217 deviation-center-line_mean 0.6633678489722962 deviation-center-line_min 0.1749016817277151 deviation-heading_max 3.716440642169355 deviation-heading_mean 2.3581776292198944 deviation-heading_median 2.602630517746613 deviation-heading_min 0.6924710335882888 driven_any_max 4.296975014278555 driven_any_mean 3.0838861135132483 driven_any_median 3.5198231086670826 driven_any_min 0.8497376872640245 driven_lanedir_consec_max 3.807086238339642 driven_lanedir_consec_mean 2.6766479042930813 driven_lanedir_consec_min 0.6836877304139404 driven_lanedir_max 3.807086238339642 driven_lanedir_mean 2.6766479042930813 driven_lanedir_median 2.7148779577089015 driven_lanedir_min 0.6836877304139404 in-drivable-lane_max 2.5000000000000355 in-drivable-lane_mean 1.1300000000000094 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.948145764684579, "sim_physics": 0.10866284370422365, "survival_time": 14.950000000000076, "driven_lanedir": 3.807086238339642, "sim_render-ego": 0.012605268955230712, "in-drivable-lane": 0, "agent_compute-ego": 0.03544748147328695, "deviation-heading": 3.0155870063412475, "set_robot_commands": 0.010157513618469238, "deviation-center-line": 1.195536142627217, "driven_lanedir_consec": 3.807086238339642, "sim_compute_sim_state": 0.005172401269276937, "sim_compute_performance-ego": 0.007531922658284505, "sim_compute_robot_state-ego": 0.009362541039784749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.296975014278555, "sim_physics": 0.1086488962173462, "survival_time": 14.950000000000076, "driven_lanedir": 3.4973287916619524, "sim_render-ego": 0.012540752092997234, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.034648931821187334, "deviation-heading": 3.716440642169355, "set_robot_commands": 0.00955308437347412, "deviation-center-line": 0.8884136326491344, "driven_lanedir_consec": 3.4973287916619524, "sim_compute_sim_state": 0.004829703172047933, "sim_compute_performance-ego": 0.0076563064257303875, "sim_compute_robot_state-ego": 0.00947325865427653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8497376872640245, "sim_physics": 0.10200374603271484, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6836877304139404, "sim_render-ego": 0.012704296112060549, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.03378342628479004, "deviation-heading": 0.6924710335882888, "set_robot_commands": 0.010268510182698568, "deviation-center-line": 0.1749016817277151, "driven_lanedir_consec": 0.6836877304139404, "sim_compute_sim_state": 0.005513674418131511, "sim_compute_performance-ego": 0.00742430051167806, "sim_compute_robot_state-ego": 0.009338286717732748}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.8047489926720006, "sim_physics": 0.12241588386834835, "survival_time": 7.649999999999981, "driven_lanedir": 2.7148779577089015, "sim_render-ego": 0.013377287808586567, "in-drivable-lane": 0, "agent_compute-ego": 0.04063601743162068, "deviation-heading": 1.763758946253967, "set_robot_commands": 0.010873800788829527, "deviation-center-line": 0.4371358512799384, "driven_lanedir_consec": 2.7148779577089015, "sim_compute_sim_state": 0.005339192409141391, "sim_compute_performance-ego": 0.007578262316635232, "sim_compute_robot_state-ego": 0.010301800335154812}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5198231086670826, "sim_physics": 0.10232882652807672, "survival_time": 10.90000000000002, "driven_lanedir": 2.680258803340971, "sim_render-ego": 0.012173564062206025, "in-drivable-lane": 2.3500000000000147, "agent_compute-ego": 0.03453685493644224, "deviation-heading": 2.602630517746613, "set_robot_commands": 0.009047910707806228, "deviation-center-line": 0.6208519365774757, "driven_lanedir_consec": 2.680258803340971, "sim_compute_sim_state": 0.004845830278659086, "sim_compute_performance-ego": 0.007009687773678281, "sim_compute_robot_state-ego": 0.009204670923565503}}set_robot_commands_max 0.010873800788829527 set_robot_commands_mean 0.009980163934255536 set_robot_commands_median 0.010157513618469238 set_robot_commands_min 0.009047910707806228 sim_compute_performance-ego_max 0.0076563064257303875 sim_compute_performance-ego_mean 0.007440095937201292 sim_compute_performance-ego_median 0.007531922658284505 sim_compute_performance-ego_min 0.007009687773678281 sim_compute_robot_state-ego_max 0.010301800335154812 sim_compute_robot_state-ego_mean 0.00953611153410287 sim_compute_robot_state-ego_median 0.009362541039784749 sim_compute_robot_state-ego_min 0.009204670923565503 sim_compute_sim_state_max 0.005513674418131511 sim_compute_sim_state_mean 0.005140160309451372 sim_compute_sim_state_median 0.005172401269276937 sim_compute_sim_state_min 0.004829703172047933 sim_physics_max 0.12241588386834835 sim_physics_mean 0.10881203927014196 sim_physics_median 0.1086488962173462 sim_physics_min 0.10200374603271484 sim_render-ego_max 0.013377287808586567 sim_render-ego_mean 0.012680233806216218 sim_render-ego_median 0.012605268955230712 sim_render-ego_min 0.012173564062206025 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.44000000000003 survival_time_min 3.7499999999999942
No reset possible 269034899Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:12:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.8626061439423793 survival_time_median 14.950000000000076 deviation-center-line_median 0.6244935054752704 in-drivable-lane_median 0.9500000000000036
other stats agent_compute-ego_max 0.05097574710845947 agent_compute-ego_mean 0.03722818125360381 agent_compute-ego_median 0.029711453914642333 agent_compute-ego_min 0.028212538560231527 deviation-center-line_max 0.7402316703573324 deviation-center-line_mean 0.5852190195614738 deviation-center-line_min 0.3272285227518999 deviation-heading_max 4.063283968724842 deviation-heading_mean 2.900321036122836 deviation-heading_median 3.2863264297698316 deviation-heading_min 0.9661173181402332 driven_any_max 4.260810001144269 driven_any_mean 3.3413819955292317 driven_any_median 3.9273391185709654 driven_any_min 1.0762550248830804 driven_lanedir_consec_max 3.862154859642071 driven_lanedir_consec_mean 2.800945771549326 driven_lanedir_consec_min 1.029343165449781 driven_lanedir_max 3.862154859642071 driven_lanedir_mean 3.0866033653606832 driven_lanedir_median 3.8292437747268218 driven_lanedir_min 1.029343165449781 in-drivable-lane_max 2.650000000000012 in-drivable-lane_mean 1.2300000000000064 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.250335324143674, "sim_physics": 0.1097316018740336, "survival_time": 14.950000000000076, "driven_lanedir": 2.8626061439423793, "sim_render-ego": 0.01287057876586914, "in-drivable-lane": 2.5500000000000167, "agent_compute-ego": 0.028212538560231527, "deviation-heading": 4.063283968724842, "set_robot_commands": 0.01189186175664266, "deviation-center-line": 0.6244935054752704, "driven_lanedir_consec": 2.8626061439423793, "sim_compute_sim_state": 0.006228149731953939, "sim_compute_performance-ego": 0.007628817558288575, "sim_compute_robot_state-ego": 0.009408276875813802}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0762550248830804, "sim_physics": 0.11568696615172595, "survival_time": 4.099999999999993, "driven_lanedir": 1.029343165449781, "sim_render-ego": 0.012744438357469513, "in-drivable-lane": 0, "agent_compute-ego": 0.028515463922081923, "deviation-heading": 0.9661173181402332, "set_robot_commands": 0.011652205048537836, "deviation-center-line": 0.3272285227518999, "driven_lanedir_consec": 1.029343165449781, "sim_compute_sim_state": 0.0057760709669531845, "sim_compute_performance-ego": 0.007920989176122153, "sim_compute_robot_state-ego": 0.010027521994055773}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.260810001144269, "sim_physics": 0.12392661174138388, "survival_time": 14.950000000000076, "driven_lanedir": 3.862154859642071, "sim_render-ego": 0.01328290621439616, "in-drivable-lane": 2.650000000000012, "agent_compute-ego": 0.029711453914642333, "deviation-heading": 2.8942399889938972, "set_robot_commands": 0.011742495695749918, "deviation-center-line": 0.6310763635303325, "driven_lanedir_consec": 3.862154859642071, "sim_compute_sim_state": 0.005850192705790202, "sim_compute_performance-ego": 0.007880929311116537, "sim_compute_robot_state-ego": 0.00998723030090332}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9273391185709654, "sim_physics": 0.1343235190709432, "survival_time": 14.950000000000076, "driven_lanedir": 3.8292437747268218, "sim_render-ego": 0.014090913931528727, "in-drivable-lane": 0, "agent_compute-ego": 0.05097574710845947, "deviation-heading": 3.2863264297698316, "set_robot_commands": 0.011188348929087322, "deviation-center-line": 0.6030650356925337, "driven_lanedir_consec": 3.8292437747268218, "sim_compute_sim_state": 0.005401000181833903, "sim_compute_performance-ego": 0.00830513636271159, "sim_compute_robot_state-ego": 0.010407467683156332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.192170508904169, "sim_physics": 0.11784199635187784, "survival_time": 14.950000000000076, "driven_lanedir": 3.849668883042365, "sim_render-ego": 0.013481077353159586, "in-drivable-lane": 0.9500000000000036, "agent_compute-ego": 0.04872570276260376, "deviation-heading": 3.2916374749853765, "set_robot_commands": 0.010537601312001548, "deviation-center-line": 0.7402316703573324, "driven_lanedir_consec": 2.4213809139855766, "sim_compute_sim_state": 0.00532297690709432, "sim_compute_performance-ego": 0.007747785250345866, "sim_compute_robot_state-ego": 0.00972626288731893}}set_robot_commands_max 0.01189186175664266 set_robot_commands_mean 0.011402502548403855 set_robot_commands_median 0.011652205048537836 set_robot_commands_min 0.010537601312001548 sim_compute_performance-ego_max 0.00830513636271159 sim_compute_performance-ego_mean 0.007896731531716944 sim_compute_performance-ego_median 0.007880929311116537 sim_compute_performance-ego_min 0.007628817558288575 sim_compute_robot_state-ego_max 0.010407467683156332 sim_compute_robot_state-ego_mean 0.00991135194824963 sim_compute_robot_state-ego_median 0.00998723030090332 sim_compute_robot_state-ego_min 0.009408276875813802 sim_compute_sim_state_max 0.006228149731953939 sim_compute_sim_state_mean 0.00571567809872511 sim_compute_sim_state_median 0.0057760709669531845 sim_compute_sim_state_min 0.00532297690709432 sim_physics_max 0.1343235190709432 sim_physics_mean 0.12030213903799288 sim_physics_median 0.11784199635187784 sim_physics_min 0.1097316018740336 sim_render-ego_max 0.014090913931528727 sim_render-ego_mean 0.013293982924484629 sim_render-ego_median 0.01328290621439616 sim_render-ego_min 0.012744438357469513 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.780000000000062 survival_time_min 4.099999999999993
No reset possible 268774911Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation error yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:11:10 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 268534930Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success yes ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:14:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.577236704864144 survival_time_median 14.950000000000076 deviation-center-line_median 0.6806954056905624 in-drivable-lane_median 0.6000000000000085
other stats agent_compute-ego_max 0.05118366559346517 agent_compute-ego_mean 0.04863500308990478 agent_compute-ego_median 0.049215847651163734 agent_compute-ego_min 0.04476324240366618 deviation-center-line_max 0.8258356970409457 deviation-center-line_mean 0.7113585847339156 deviation-center-line_min 0.6228295961268752 deviation-heading_max 4.692684505915676 deviation-heading_mean 3.312137292741158 deviation-heading_median 2.911892783838267 deviation-heading_min 2.351391393437997 driven_any_max 4.847759120216 driven_any_mean 3.880301015999581 driven_any_median 3.796141854297987 driven_any_min 3.070132843173458 driven_lanedir_consec_max 4.755143462762554 driven_lanedir_consec_mean 3.671683541929155 driven_lanedir_consec_min 2.843146397911875 driven_lanedir_max 4.755143462762554 driven_lanedir_mean 3.6925667579809938 driven_lanedir_median 3.577236704864144 driven_lanedir_min 2.843146397911875 in-drivable-lane_max 1.3000000000000185 in-drivable-lane_mean 0.5900000000000072 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.070132843173458, "sim_physics": 0.11430306593577066, "survival_time": 14.950000000000076, "driven_lanedir": 2.843146397911875, "sim_render-ego": 0.011851191520690918, "in-drivable-lane": 1.0500000000000087, "agent_compute-ego": 0.04865499973297119, "deviation-heading": 3.750220157042003, "set_robot_commands": 0.01060127337773641, "deviation-center-line": 0.766145213872651, "driven_lanedir_consec": 2.843146397911875, "sim_compute_sim_state": 0.005394788583119711, "sim_compute_performance-ego": 0.007219405968983968, "sim_compute_robot_state-ego": 0.008796685536702474}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.796141854297987, "sim_physics": 0.11269398053487142, "survival_time": 14.950000000000076, "driven_lanedir": 3.577236704864144, "sim_render-ego": 0.012703665892283122, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.049215847651163734, "deviation-heading": 2.911892783838267, "set_robot_commands": 0.010103545983632403, "deviation-center-line": 0.6806954056905624, "driven_lanedir_consec": 3.577236704864144, "sim_compute_sim_state": 0.00513189951578776, "sim_compute_performance-ego": 0.007642552057902019, "sim_compute_robot_state-ego": 0.009654557704925536}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.847759120216, "sim_physics": 0.0939379620552063, "survival_time": 14.950000000000076, "driven_lanedir": 4.755143462762554, "sim_render-ego": 0.010598392486572263, "in-drivable-lane": 0, "agent_compute-ego": 0.04476324240366618, "deviation-heading": 2.351391393437997, "set_robot_commands": 0.008783026536305746, "deviation-center-line": 0.8258356970409457, "driven_lanedir_consec": 4.755143462762554, "sim_compute_sim_state": 0.004708395799001058, "sim_compute_performance-ego": 0.006320734024047852, "sim_compute_robot_state-ego": 0.008193437258402507}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9731213153263294, "sim_physics": 0.10612762451171875, "survival_time": 14.950000000000076, "driven_lanedir": 3.8797774251431703, "sim_render-ego": 0.0117458438873291, "in-drivable-lane": 0, "agent_compute-ego": 0.04935726006825765, "deviation-heading": 2.8544976234718455, "set_robot_commands": 0.009563244183858236, "deviation-center-line": 0.6612870109385433, "driven_lanedir_consec": 3.8797774251431703, "sim_compute_sim_state": 0.005013573964436849, "sim_compute_performance-ego": 0.0069177087148030595, "sim_compute_robot_state-ego": 0.00907862106959025}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.714349946984132, "sim_physics": 0.1128145718574524, "survival_time": 14.950000000000076, "driven_lanedir": 3.4075297992232247, "sim_render-ego": 0.01247414986292521, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.05118366559346517, "deviation-heading": 4.692684505915676, "set_robot_commands": 0.010425496896107993, "deviation-center-line": 0.6228295961268752, "driven_lanedir_consec": 3.3031137189640356, "sim_compute_sim_state": 0.0052653781572977705, "sim_compute_performance-ego": 0.007445425987243653, "sim_compute_robot_state-ego": 0.009545565446217857}}set_robot_commands_max 0.01060127337773641 set_robot_commands_mean 0.009895317395528158 set_robot_commands_median 0.010103545983632403 set_robot_commands_min 0.008783026536305746 sim_compute_performance-ego_max 0.007642552057902019 sim_compute_performance-ego_mean 0.00710916535059611 sim_compute_performance-ego_median 0.007219405968983968 sim_compute_performance-ego_min 0.006320734024047852 sim_compute_robot_state-ego_max 0.009654557704925536 sim_compute_robot_state-ego_mean 0.009053773403167726 sim_compute_robot_state-ego_median 0.00907862106959025 sim_compute_robot_state-ego_min 0.008193437258402507 sim_compute_sim_state_max 0.005394788583119711 sim_compute_sim_state_mean 0.00510280720392863 sim_compute_sim_state_median 0.00513189951578776 sim_compute_sim_state_min 0.004708395799001058 sim_physics_max 0.11430306593577066 sim_physics_mean 0.10797544097900393 sim_physics_median 0.11269398053487142 sim_physics_min 0.0939379620552063 sim_render-ego_max 0.012703665892283122 sim_render-ego_mean 0.011874648729960122 sim_render-ego_median 0.011851191520690918 sim_render-ego_min 0.010598392486572263 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 267514540Robert Moni kaland-22405 aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 5.732340579925448 survival_time 42.6666 deviation-center-line 2.281874436483592 in-drivable-lane 0
other stats deviation-heading 8.247862990076392 driven_any 6.00258175189593 driven_lanedir 5.732340579925448 visualized-eval0-passed 1
No reset possible 267404543Robert Moni kaland-22401 aido3-LF-real-validationeval0-videos success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 267314919Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:00:43 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 267194914Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:09:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.114978733586908 survival_time_median 14.950000000000076 deviation-center-line_median 0.7086896844061655 in-drivable-lane_median 1.1000000000000156
other stats agent_compute-ego_max 0.03537134726842244 agent_compute-ego_mean 0.03413727871576945 agent_compute-ego_median 0.0348634147644043 agent_compute-ego_min 0.030967537562052408 deviation-center-line_max 0.7748649909784914 deviation-center-line_mean 0.6920008723741375 deviation-center-line_min 0.5619320120543176 deviation-heading_max 4.145771960624343 deviation-heading_mean 3.071057212067742 deviation-heading_median 2.780654420877522 deviation-heading_min 2.715250982014109 driven_any_max 4.898995634799254 driven_any_mean 4.239764853583468 driven_any_median 4.20258911706431 driven_any_min 3.4074228045435384 driven_lanedir_consec_max 4.5303453232060535 driven_lanedir_consec_mean 4.026007935597503 driven_lanedir_consec_min 3.131101138500203 driven_lanedir_max 4.5303453232060535 driven_lanedir_mean 4.026007935597503 driven_lanedir_median 4.114978733586908 driven_lanedir_min 3.131101138500203 in-drivable-lane_max 1.5999999999999943 in-drivable-lane_mean 0.7700000000000011 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.4074228045435384, "sim_physics": 0.058132446606953936, "survival_time": 14.950000000000076, "driven_lanedir": 3.131101138500203, "sim_render-ego": 0.007105303605397542, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.030967537562052408, "deviation-heading": 4.145771960624343, "set_robot_commands": 0.005672641595204671, "deviation-center-line": 0.7748649909784914, "driven_lanedir_consec": 3.131101138500203, "sim_compute_sim_state": 0.0031575504938761395, "sim_compute_performance-ego": 0.0041341892878214515, "sim_compute_robot_state-ego": 0.005189637343088786}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.167573371189578, "sim_physics": 0.05756307363510132, "survival_time": 14.950000000000076, "driven_lanedir": 3.941163330364816, "sim_render-ego": 0.007247349421183268, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.035352926254272464, "deviation-heading": 2.9470321295295268, "set_robot_commands": 0.005063428084055583, "deviation-center-line": 0.7012657313368038, "driven_lanedir_consec": 3.941163330364816, "sim_compute_sim_state": 0.003081843058268229, "sim_compute_performance-ego": 0.004051188627878825, "sim_compute_robot_state-ego": 0.005232436656951904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.898995634799254, "sim_physics": 0.055550549825032554, "survival_time": 14.950000000000076, "driven_lanedir": 4.5303453232060535, "sim_render-ego": 0.007166140874226888, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.03413116772969564, "deviation-heading": 2.7665765672932143, "set_robot_commands": 0.00504725456237793, "deviation-center-line": 0.7132519430949091, "driven_lanedir_consec": 4.5303453232060535, "sim_compute_sim_state": 0.002999289830525716, "sim_compute_performance-ego": 0.004021647771199544, "sim_compute_robot_state-ego": 0.005104608535766601}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.522243340320658, "sim_physics": 0.054772331714630126, "survival_time": 14.950000000000076, "driven_lanedir": 4.412451152329537, "sim_render-ego": 0.0071416950225830075, "in-drivable-lane": 0, "agent_compute-ego": 0.0348634147644043, "deviation-heading": 2.780654420877522, "set_robot_commands": 0.005037250518798828, "deviation-center-line": 0.7086896844061655, "driven_lanedir_consec": 4.412451152329537, "sim_compute_sim_state": 0.0030410917599995933, "sim_compute_performance-ego": 0.004018421173095703, "sim_compute_robot_state-ego": 0.0051767865816752115}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.20258911706431, "sim_physics": 0.056594390074412027, "survival_time": 14.950000000000076, "driven_lanedir": 4.114978733586908, "sim_render-ego": 0.007199946244557698, "in-drivable-lane": 0, "agent_compute-ego": 0.03537134726842244, "deviation-heading": 2.715250982014109, "set_robot_commands": 0.005099859237670899, "deviation-center-line": 0.5619320120543176, "driven_lanedir_consec": 4.114978733586908, "sim_compute_sim_state": 0.003063796361287435, "sim_compute_performance-ego": 0.004037120342254639, "sim_compute_robot_state-ego": 0.005188227494557699}}set_robot_commands_max 0.005672641595204671 set_robot_commands_mean 0.005184086799621582 set_robot_commands_median 0.005063428084055583 set_robot_commands_min 0.005037250518798828 sim_compute_performance-ego_max 0.0041341892878214515 sim_compute_performance-ego_mean 0.004052513440450033 sim_compute_performance-ego_median 0.004037120342254639 sim_compute_performance-ego_min 0.004018421173095703 sim_compute_robot_state-ego_max 0.005232436656951904 sim_compute_robot_state-ego_mean 0.00517833932240804 sim_compute_robot_state-ego_median 0.005188227494557699 sim_compute_robot_state-ego_min 0.005104608535766601 sim_compute_sim_state_max 0.0031575504938761395 sim_compute_sim_state_mean 0.0030687143007914223 sim_compute_sim_state_median 0.003063796361287435 sim_compute_sim_state_min 0.002999289830525716 sim_physics_max 0.058132446606953936 sim_physics_mean 0.056522558371225995 sim_physics_median 0.056594390074412027 sim_physics_min 0.054772331714630126 sim_render-ego_max 0.007247349421183268 sim_render-ego_mean 0.00717208703358968 sim_render-ego_median 0.007166140874226888 sim_render-ego_min 0.007105303605397542 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 266284855Moustafa Elarabi challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.3744453364198208 survival_time_median 4.099999999999993 deviation-center-line_median 0.24351736294529824 in-drivable-lane_median 1.4500000000000073
other stats agent_compute-ego_max 0.019868472727333625 agent_compute-ego_mean 0.01930794522210496 agent_compute-ego_median 0.01910880585791359 agent_compute-ego_min 0.018730656096809788 deviation-center-line_max 0.6411822945283929 deviation-center-line_mean 0.34888380628670024 deviation-center-line_min 0.13463182298332435 deviation-heading_max 2.9654685783546793 deviation-heading_mean 1.557194704187244 deviation-heading_median 0.8852145028740689 deviation-heading_min 0.5343033528724279 driven_any_max 3.651112127865785 driven_any_mean 2.1392386714572926 driven_any_median 1.4160066219998828 driven_any_min 0.9968880129993846 driven_lanedir_consec_max 2.782255553427008 driven_lanedir_consec_mean 1.7389171343905263 driven_lanedir_consec_min 0.710691846461617 driven_lanedir_max 2.782255553427008 driven_lanedir_mean 1.7389171343905263 driven_lanedir_median 1.3744453364198208 driven_lanedir_min 0.710691846461617 in-drivable-lane_max 2.4500000000000117 in-drivable-lane_mean 1.0800000000000027 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4160066219998828, "sim_physics": 0.05901514611593107, "survival_time": 4.099999999999993, "driven_lanedir": 1.3744453364198208, "sim_render-ego": 0.007170723705756955, "in-drivable-lane": 0, "agent_compute-ego": 0.019868472727333625, "deviation-heading": 0.8704370105749297, "set_robot_commands": 0.005016716515145651, "deviation-center-line": 0.24351736294529824, "driven_lanedir_consec": 1.3744453364198208, "sim_compute_sim_state": 0.0029532705865255218, "sim_compute_performance-ego": 0.004220189117803806, "sim_compute_robot_state-ego": 0.005282044410705566}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.651112127865785, "sim_physics": 0.05847602546530426, "survival_time": 9.45, "driven_lanedir": 2.782255553427008, "sim_render-ego": 0.00708878860271797, "in-drivable-lane": 1.4500000000000073, "agent_compute-ego": 0.019781179529018506, "deviation-heading": 2.9654685783546793, "set_robot_commands": 0.004936915856820566, "deviation-center-line": 0.6411822945283929, "driven_lanedir_consec": 2.782255553427008, "sim_compute_sim_state": 0.0029767152493592923, "sim_compute_performance-ego": 0.003950528997592825, "sim_compute_robot_state-ego": 0.005139649860442631}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9968880129993846, "sim_physics": 0.0564882661166944, "survival_time": 3.7999999999999945, "driven_lanedir": 0.710691846461617, "sim_render-ego": 0.007132172584533691, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.018730656096809788, "deviation-heading": 0.5343033528724279, "set_robot_commands": 0.004939440049623188, "deviation-center-line": 0.13463182298332435, "driven_lanedir_consec": 0.710691846461617, "sim_compute_sim_state": 0.002944620032059519, "sim_compute_performance-ego": 0.0039424457048114975, "sim_compute_robot_state-ego": 0.0051721930503845215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2113617347153955, "sim_physics": 0.05627120380670252, "survival_time": 3.5499999999999954, "driven_lanedir": 1.1630232624514842, "sim_render-ego": 0.007102408879239794, "in-drivable-lane": 0, "agent_compute-ego": 0.01910880585791359, "deviation-heading": 0.8852145028740689, "set_robot_commands": 0.004823845876774317, "deviation-center-line": 0.22618553854526713, "driven_lanedir_consec": 1.1630232624514842, "sim_compute_sim_state": 0.0027802561370419785, "sim_compute_performance-ego": 0.00389931235514896, "sim_compute_robot_state-ego": 0.004944935650892661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4208248597060154, "sim_physics": 0.05331216867153461, "survival_time": 10.400000000000013, "driven_lanedir": 2.664169673192702, "sim_render-ego": 0.006957794611270611, "in-drivable-lane": 2.4500000000000117, "agent_compute-ego": 0.01905061189944927, "deviation-heading": 2.5305500762601145, "set_robot_commands": 0.004934396881323595, "deviation-center-line": 0.4989020124312188, "driven_lanedir_consec": 2.664169673192702, "sim_compute_sim_state": 0.00284190819813655, "sim_compute_performance-ego": 0.003947715346629803, "sim_compute_robot_state-ego": 0.005022712624990023}}set_robot_commands_max 0.005016716515145651 set_robot_commands_mean 0.004930263035937464 set_robot_commands_median 0.004936915856820566 set_robot_commands_min 0.004823845876774317 sim_compute_performance-ego_max 0.004220189117803806 sim_compute_performance-ego_mean 0.003992038304397378 sim_compute_performance-ego_median 0.003947715346629803 sim_compute_performance-ego_min 0.00389931235514896 sim_compute_robot_state-ego_max 0.005282044410705566 sim_compute_robot_state-ego_mean 0.0051123071194830805 sim_compute_robot_state-ego_median 0.005139649860442631 sim_compute_robot_state-ego_min 0.004944935650892661 sim_compute_sim_state_max 0.0029767152493592923 sim_compute_sim_state_mean 0.002899354040624572 sim_compute_sim_state_median 0.002944620032059519 sim_compute_sim_state_min 0.0027802561370419785 sim_physics_max 0.05901514611593107 sim_physics_mean 0.05671256203523337 sim_physics_median 0.0564882661166944 sim_physics_min 0.05331216867153461 sim_render-ego_max 0.007170723705756955 sim_render-ego_mean 0.007090377676703804 sim_render-ego_median 0.007102408879239794 sim_render-ego_min 0.006957794611270611 simulation-passed 1 survival_time_max 10.400000000000013 survival_time_mean 6.26 survival_time_min 3.5499999999999954
No reset possible 265684820Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.561176256772263 survival_time_median 14.950000000000076 deviation-center-line_median 0.8094343989268764 in-drivable-lane_median 1.499999999999995
other stats agent_compute-ego_max 0.016477768421173097 agent_compute-ego_mean 0.015925799826780957 agent_compute-ego_median 0.015732293128967286 agent_compute-ego_min 0.01561746746301651 deviation-center-line_max 0.9630303239709468 deviation-center-line_mean 0.8075467732113253 deviation-center-line_min 0.686302282050901 deviation-heading_max 4.128845277681506 deviation-heading_mean 3.4527626514139333 deviation-heading_median 3.5977125639931433 deviation-heading_min 2.513430325887003 driven_any_max 4.24242879640721 driven_any_mean 3.57257583404186 driven_any_median 3.719528737710875 driven_any_min 2.6633670319665748 driven_lanedir_consec_max 4.0040979969231865 driven_lanedir_consec_mean 3.260962824099887 driven_lanedir_consec_min 1.936049715524268 driven_lanedir_max 4.0040979969231865 driven_lanedir_mean 3.325128002127678 driven_lanedir_median 3.561176256772263 driven_lanedir_min 2.25687560566322 in-drivable-lane_max 1.8000000000000256 in-drivable-lane_mean 0.9800000000000028 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.286642242421891, "sim_physics": 0.05744997501373291, "survival_time": 14.950000000000076, "driven_lanedir": 2.9462654973733184, "sim_render-ego": 0.0069728382428487145, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.01613790273666382, "deviation-heading": 4.128845277681506, "set_robot_commands": 0.007078177134195964, "deviation-center-line": 0.8094343989268764, "driven_lanedir_consec": 2.9462654973733184, "sim_compute_sim_state": 0.003778536319732666, "sim_compute_performance-ego": 0.004077924092610677, "sim_compute_robot_state-ego": 0.005138729413350423}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.6633670319665748, "sim_physics": 0.05607663467526436, "survival_time": 12.800000000000049, "driven_lanedir": 2.25687560566322, "sim_render-ego": 0.00709879957139492, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.01561746746301651, "deviation-heading": 4.063533374782301, "set_robot_commands": 0.007009225897490978, "deviation-center-line": 0.8238465708509337, "driven_lanedir_consec": 1.936049715524268, "sim_compute_sim_state": 0.0035281432792544365, "sim_compute_performance-ego": 0.003970182500779629, "sim_compute_robot_state-ego": 0.005075071007013321}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.24242879640721, "sim_physics": 0.055570851961771646, "survival_time": 14.950000000000076, "driven_lanedir": 4.0040979969231865, "sim_render-ego": 0.006998426914215088, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.015663567384084066, "deviation-heading": 2.513430325887003, "set_robot_commands": 0.007120746771494548, "deviation-center-line": 0.7551202902569687, "driven_lanedir_consec": 4.0040979969231865, "sim_compute_sim_state": 0.003629326820373535, "sim_compute_performance-ego": 0.003987310727437337, "sim_compute_robot_state-ego": 0.005099201202392578}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.719528737710875, "sim_physics": 0.05574384530385335, "survival_time": 14.950000000000076, "driven_lanedir": 3.561176256772263, "sim_render-ego": 0.007025356292724609, "in-drivable-lane": 0, "agent_compute-ego": 0.015732293128967286, "deviation-heading": 3.5977125639931433, "set_robot_commands": 0.006911444664001465, "deviation-center-line": 0.9630303239709468, "driven_lanedir_consec": 3.561176256772263, "sim_compute_sim_state": 0.003547653357187907, "sim_compute_performance-ego": 0.003974820772806803, "sim_compute_robot_state-ego": 0.005090529123942057}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.950912361702751, "sim_physics": 0.055305461883544925, "survival_time": 14.950000000000076, "driven_lanedir": 3.8572246539063992, "sim_render-ego": 0.007079643408457438, "in-drivable-lane": 0, "agent_compute-ego": 0.016477768421173097, "deviation-heading": 2.960291714725716, "set_robot_commands": 0.007367094357808431, "deviation-center-line": 0.686302282050901, "driven_lanedir_consec": 3.8572246539063992, "sim_compute_sim_state": 0.0037802338600158697, "sim_compute_performance-ego": 0.003998323281606039, "sim_compute_robot_state-ego": 0.005154908498128255}}set_robot_commands_max 0.007367094357808431 set_robot_commands_mean 0.007097337764998277 set_robot_commands_median 0.007078177134195964 set_robot_commands_min 0.006911444664001465 sim_compute_performance-ego_max 0.004077924092610677 sim_compute_performance-ego_mean 0.004001712275048096 sim_compute_performance-ego_median 0.003987310727437337 sim_compute_performance-ego_min 0.003970182500779629 sim_compute_robot_state-ego_max 0.005154908498128255 sim_compute_robot_state-ego_mean 0.005111687848965327 sim_compute_robot_state-ego_median 0.005099201202392578 sim_compute_robot_state-ego_min 0.005075071007013321 sim_compute_sim_state_max 0.0037802338600158697 sim_compute_sim_state_mean 0.0036527787273128833 sim_compute_sim_state_median 0.003629326820373535 sim_compute_sim_state_min 0.0035281432792544365 sim_physics_max 0.05744997501373291 sim_physics_mean 0.05602935376763344 sim_physics_median 0.05574384530385335 sim_physics_min 0.055305461883544925 sim_render-ego_max 0.00709879957139492 sim_render-ego_mean 0.007035012885928155 sim_render-ego_median 0.007025356292724609 sim_render-ego_min 0.0069728382428487145 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.52000000000007 survival_time_min 12.800000000000049
No reset possible 264174721Nikolaus Howe challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.5358642813123105 survival_time_median 14.950000000000076 deviation-center-line_median 0.6578050659421102 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03545733213424682 agent_compute-ego_mean 0.03144268859091502 agent_compute-ego_median 0.035207340717315676 agent_compute-ego_min 0.016914471712979405 deviation-center-line_max 0.7400007076823317 deviation-center-line_mean 0.5707822995710103 deviation-center-line_min 0.11677237363655024 deviation-heading_max 3.415839463422607 deviation-heading_mean 2.5976455740494915 deviation-heading_median 2.8076594216034643 deviation-heading_min 0.8032838787927026 driven_any_max 3.412257793741642 driven_any_mean 2.3044181114696807 driven_any_median 2.70234921358257 driven_any_min 0.4753417944547764 driven_lanedir_consec_max 3.3396506333720817 driven_lanedir_consec_mean 2.14931420988806 driven_lanedir_consec_min 0.4413278535636822 driven_lanedir_max 3.3396506333720817 driven_lanedir_mean 2.1504907070148356 driven_lanedir_median 2.5358642813123105 driven_lanedir_min 0.4413278535636822 in-drivable-lane_max 1.0000000000000142 in-drivable-lane_mean 0.27000000000000257 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4753417944547764, "sim_physics": 0.06099566546353427, "survival_time": 2.7499999999999982, "driven_lanedir": 0.4413278535636822, "sim_render-ego": 0.007226176695390181, "in-drivable-lane": 0, "agent_compute-ego": 0.016914471712979405, "deviation-heading": 0.8032838787927026, "set_robot_commands": 0.006938193061135032, "deviation-center-line": 0.11677237363655024, "driven_lanedir_consec": 0.4413278535636822, "sim_compute_sim_state": 0.004067290912974964, "sim_compute_performance-ego": 0.0043609402396462184, "sim_compute_robot_state-ego": 0.005268153277310458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.039792313328056, "sim_physics": 0.05543495098749796, "survival_time": 14.950000000000076, "driven_lanedir": 2.921427170870986, "sim_render-ego": 0.007043352127075195, "in-drivable-lane": 0, "agent_compute-ego": 0.0343407146135966, "deviation-heading": 3.415839463422607, "set_robot_commands": 0.005064693291982015, "deviation-center-line": 0.6578050659421102, "driven_lanedir_consec": 2.921427170870986, "sim_compute_sim_state": 0.003000932534535726, "sim_compute_performance-ego": 0.004003489812215169, "sim_compute_robot_state-ego": 0.0051859402656555175}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.89234944224136, "sim_physics": 0.05545103433085423, "survival_time": 10.20000000000001, "driven_lanedir": 1.5141835959551186, "sim_render-ego": 0.00714424310945997, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.0352935837764366, "deviation-heading": 3.404422324449619, "set_robot_commands": 0.005004568427216773, "deviation-center-line": 0.7400007076823317, "driven_lanedir_consec": 1.508301110321241, "sim_compute_sim_state": 0.003003882426841586, "sim_compute_performance-ego": 0.004012562480627322, "sim_compute_robot_state-ego": 0.005157400580013499}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.70234921358257, "sim_physics": 0.05483169317245483, "survival_time": 14.950000000000076, "driven_lanedir": 2.5358642813123105, "sim_render-ego": 0.007048412164052328, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.035207340717315676, "deviation-heading": 2.8076594216034643, "set_robot_commands": 0.004919728438059489, "deviation-center-line": 0.6361970382615588, "driven_lanedir_consec": 2.5358642813123105, "sim_compute_sim_state": 0.002969977060953776, "sim_compute_performance-ego": 0.003968278566996257, "sim_compute_robot_state-ego": 0.005117166042327881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.412257793741642, "sim_physics": 0.0550365161895752, "survival_time": 14.950000000000076, "driven_lanedir": 3.3396506333720817, "sim_render-ego": 0.0070650903383890785, "in-drivable-lane": 0, "agent_compute-ego": 0.03545733213424682, "deviation-heading": 2.557022781979064, "set_robot_commands": 0.005014386971791586, "deviation-center-line": 0.7031363123325011, "driven_lanedir_consec": 3.3396506333720817, "sim_compute_sim_state": 0.0029782923062642414, "sim_compute_performance-ego": 0.003975386619567871, "sim_compute_robot_state-ego": 0.005139050483703614}}set_robot_commands_max 0.006938193061135032 set_robot_commands_mean 0.005388314038036979 set_robot_commands_median 0.005014386971791586 set_robot_commands_min 0.004919728438059489 sim_compute_performance-ego_max 0.0043609402396462184 sim_compute_performance-ego_mean 0.004064131543810567 sim_compute_performance-ego_median 0.004003489812215169 sim_compute_performance-ego_min 0.003968278566996257 sim_compute_robot_state-ego_max 0.005268153277310458 sim_compute_robot_state-ego_mean 0.005173542129802194 sim_compute_robot_state-ego_median 0.005157400580013499 sim_compute_robot_state-ego_min 0.005117166042327881 sim_compute_sim_state_max 0.004067290912974964 sim_compute_sim_state_mean 0.0032040750483140583 sim_compute_sim_state_median 0.003000932534535726 sim_compute_sim_state_min 0.002969977060953776 sim_physics_max 0.06099566546353427 sim_physics_mean 0.05634997202878329 sim_physics_median 0.05543495098749796 sim_physics_min 0.05483169317245483 sim_render-ego_max 0.007226176695390181 sim_render-ego_mean 0.007105454886873351 sim_render-ego_median 0.0070650903383890785 sim_render-ego_min 0.007043352127075195 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.560000000000048 survival_time_min 2.7499999999999982
No reset possible 263984709Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.500662529889283 survival_time_median 14.950000000000076 deviation-center-line_median 0.8118859812030803 in-drivable-lane_median 0.6999999999999975
other stats agent_compute-ego_max 0.016573941707611083 agent_compute-ego_mean 0.016020793006533664 agent_compute-ego_median 0.016006520816258023 agent_compute-ego_min 0.015751710732777913 deviation-center-line_max 1.130990208941319 deviation-center-line_mean 0.7585100594570912 deviation-center-line_min 0.3005364446315898 deviation-heading_max 3.0221449560671227 deviation-heading_mean 2.345230782830612 deviation-heading_median 2.898209418791766 deviation-heading_min 0.9286589339894548 driven_any_max 5.319836152579839 driven_any_mean 3.964276102100822 driven_any_median 3.938947717044027 driven_any_min 2.359609712574422 driven_lanedir_consec_max 5.175191176873415 driven_lanedir_consec_mean 3.675615385009962 driven_lanedir_consec_min 2.330678492687925 driven_lanedir_max 5.175191176873415 driven_lanedir_mean 3.675615385009962 driven_lanedir_median 3.500662529889283 driven_lanedir_min 2.330678492687925 in-drivable-lane_max 1.3500000000000192 in-drivable-lane_mean 0.6300000000000031 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.938947717044027, "sim_physics": 0.05711267471313477, "survival_time": 14.950000000000076, "driven_lanedir": 3.500662529889283, "sim_render-ego": 0.0070115979512532555, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.016573941707611083, "deviation-heading": 2.9889422965490726, "set_robot_commands": 0.007210054397583008, "deviation-center-line": 0.8118859812030803, "driven_lanedir_consec": 3.500662529889283, "sim_compute_sim_state": 0.004123551845550537, "sim_compute_performance-ego": 0.004082269668579101, "sim_compute_robot_state-ego": 0.005144116083780925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.224840866224808, "sim_physics": 0.05860276222229003, "survival_time": 8.999999999999993, "driven_lanedir": 2.855679659013412, "sim_render-ego": 0.009138303332858616, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.01575581232706706, "deviation-heading": 1.8881983087556424, "set_robot_commands": 0.006996709770626492, "deviation-center-line": 0.5923535250641039, "driven_lanedir_consec": 2.855679659013412, "sim_compute_sim_state": 0.004171591334872776, "sim_compute_performance-ego": 0.003998818662431505, "sim_compute_robot_state-ego": 0.0051401019096374515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.319836152579839, "sim_physics": 0.05599423408508301, "survival_time": 14.950000000000076, "driven_lanedir": 5.175191176873415, "sim_render-ego": 0.007063814004262288, "in-drivable-lane": 0, "agent_compute-ego": 0.015751710732777913, "deviation-heading": 3.0221449560671227, "set_robot_commands": 0.007274485429128011, "deviation-center-line": 1.130990208941319, "driven_lanedir_consec": 5.175191176873415, "sim_compute_sim_state": 0.004155866305033366, "sim_compute_performance-ego": 0.003991235891977946, "sim_compute_robot_state-ego": 0.005158522923787435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.359609712574422, "sim_physics": 0.0565331152507237, "survival_time": 6.299999999999986, "driven_lanedir": 2.330678492687925, "sim_render-ego": 0.007187400545392718, "in-drivable-lane": 0, "agent_compute-ego": 0.016006520816258023, "deviation-heading": 0.9286589339894548, "set_robot_commands": 0.007177971658252534, "deviation-center-line": 0.3005364446315898, "driven_lanedir_consec": 2.330678492687925, "sim_compute_sim_state": 0.004223787595355321, "sim_compute_performance-ego": 0.004027663715301998, "sim_compute_robot_state-ego": 0.005198478698730469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.978146062081015, "sim_physics": 0.05865341504414876, "survival_time": 14.950000000000076, "driven_lanedir": 4.5158650665857785, "sim_render-ego": 0.007662062644958496, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.016015979448954266, "deviation-heading": 2.898209418791766, "set_robot_commands": 0.0072285095850626625, "deviation-center-line": 0.9567841374453624, "driven_lanedir_consec": 4.5158650665857785, "sim_compute_sim_state": 0.004271399180094401, "sim_compute_performance-ego": 0.004023419221242269, "sim_compute_robot_state-ego": 0.0051891462008158366}}set_robot_commands_max 0.007274485429128011 set_robot_commands_mean 0.0071775461681305415 set_robot_commands_median 0.007210054397583008 set_robot_commands_min 0.006996709770626492 sim_compute_performance-ego_max 0.004082269668579101 sim_compute_performance-ego_mean 0.004024681431906563 sim_compute_performance-ego_median 0.004023419221242269 sim_compute_performance-ego_min 0.003991235891977946 sim_compute_robot_state-ego_max 0.005198478698730469 sim_compute_robot_state-ego_mean 0.005166073163350424 sim_compute_robot_state-ego_median 0.005158522923787435 sim_compute_robot_state-ego_min 0.0051401019096374515 sim_compute_sim_state_max 0.004271399180094401 sim_compute_sim_state_mean 0.00418923925218128 sim_compute_sim_state_median 0.004171591334872776 sim_compute_sim_state_min 0.004123551845550537 sim_physics_max 0.05865341504414876 sim_physics_mean 0.05737924026307606 sim_physics_median 0.05711267471313477 sim_physics_min 0.05599423408508301 sim_render-ego_max 0.009138303332858616 sim_render-ego_mean 0.007612635695745075 sim_render-ego_median 0.007187400545392718 sim_render-ego_min 0.0070115979512532555 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.03000000000004 survival_time_min 6.299999999999986
No reset possible 263924706Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:58 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 263784698Ramon Emiliani challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation failed no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:01:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 48, in on_received_get_commands
|| pwm_left, pwm_right = self.compute_action(self.current_image)
|| File "solution.py", line 43, in compute_action
|| observation = self.preprocessor.preprocess(observation)
|| File "/workspace/wrappers.py", line 17, in preprocess
|| observation = Image.fromarray(cv2.resize(observation, dsize=self.shape[:-1]))
|| TypeError: Expected cv::UMat for argument 'src'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fbc0fe770d0>>.
|| │ f: instance of method:
|| │ <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fbc0fe770d0>>
|| │ args: dict
|| │ │ context :
|| │ │ instance of ConcreteContext:
|| │ │ <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fbb96433c10>
|| │ argspec: <class 'inspect.FullArgSpec'>
|| │ #0 [`self`, `context`]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict
|| │ │ context : <class 'zuper_nodes_wrapper.interface.Context'>
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 263294565Frank (Chude) Qian 2019-11-19|FrankNet|Andrew_Activation aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 5.00610140881006 survival_time 24.6666 deviation-center-line 1.7166140428267256 in-drivable-lane 6.666599999999997
other stats deviation-heading 4.306779335712473 driven_any 7.019452246459964 driven_lanedir 5.00610140881006 visualized-eval0-passed 1
No reset possible 263214682Soroush Saryazdi upduck aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:06:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.490215126475166 survival_time_median 7.99999999999998 deviation-center-line_median 0.39436454388094 in-drivable-lane_median 1.2499999999999956
other stats agent_compute-ego_max 0.03455874840418498 agent_compute-ego_mean 0.019791868792441217 agent_compute-ego_median 0.01571924686431885 agent_compute-ego_min 0.015475192020848854 deviation-center-line_max 1.217572629133563 deviation-center-line_mean 0.5513696856468326 deviation-center-line_min 0.12841878366069923 deviation-heading_max 3.774712230236208 deviation-heading_mean 2.0175741427296927 deviation-heading_median 1.8575636472639112 deviation-heading_min 0.5237633585781971 driven_any_max 4.98033094393579 driven_any_mean 2.9891493776536975 driven_any_median 2.879591886497294 driven_any_min 1.2139958684546186 driven_lanedir_consec_max 4.194635560178747 driven_lanedir_consec_mean 2.6202361677278927 driven_lanedir_consec_min 1.1869742374046266 driven_lanedir_max 4.194635560178747 driven_lanedir_mean 2.6202361677278927 driven_lanedir_median 2.490215126475166 driven_lanedir_min 1.1869742374046266 in-drivable-lane_max 1.7500000000000249 in-drivable-lane_mean 0.8600000000000078 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.30805161643036, "sim_physics": 0.05430154879887899, "survival_time": 14.950000000000076, "driven_lanedir": 3.6861178008241766, "sim_render-ego": 0.006949440638224284, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.03455874840418498, "deviation-heading": 3.4029356961967334, "set_robot_commands": 0.0056140478452046715, "deviation-center-line": 0.8677824565302881, "driven_lanedir_consec": 3.6861178008241766, "sim_compute_sim_state": 0.0031876269976298015, "sim_compute_performance-ego": 0.004080414772033691, "sim_compute_robot_state-ego": 0.005070246855417887}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2139958684546186, "sim_physics": 0.058441816676746715, "survival_time": 2.7499999999999982, "driven_lanedir": 1.1869742374046266, "sim_render-ego": 0.007247729734940963, "in-drivable-lane": 0, "agent_compute-ego": 0.017524697563864967, "deviation-heading": 0.5237633585781971, "set_robot_commands": 0.007388375022194602, "deviation-center-line": 0.14871001502867337, "driven_lanedir_consec": 1.1869742374046266, "sim_compute_sim_state": 0.003809191963889382, "sim_compute_performance-ego": 0.004001678120006215, "sim_compute_robot_state-ego": 0.005125604976307262}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.98033094393579, "sim_physics": 0.053409032821655274, "survival_time": 14.950000000000076, "driven_lanedir": 4.194635560178747, "sim_render-ego": 0.007541393438975016, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.015681459108988445, "deviation-heading": 3.774712230236208, "set_robot_commands": 0.007126130263010661, "deviation-center-line": 1.217572629133563, "driven_lanedir_consec": 4.194635560178747, "sim_compute_sim_state": 0.0038678685824076334, "sim_compute_performance-ego": 0.003980183601379394, "sim_compute_robot_state-ego": 0.005079726378122966}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5637765729504265, "sim_physics": 0.05582547925182225, "survival_time": 4.849999999999991, "driven_lanedir": 1.5432381137567468, "sim_render-ego": 0.007119549918420536, "in-drivable-lane": 0, "agent_compute-ego": 0.015475192020848854, "deviation-heading": 0.5288957813734148, "set_robot_commands": 0.007012389369846619, "deviation-center-line": 0.12841878366069923, "driven_lanedir_consec": 1.5432381137567468, "sim_compute_sim_state": 0.003786357407717361, "sim_compute_performance-ego": 0.003964790363901669, "sim_compute_robot_state-ego": 0.005001803034359647}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.879591886497294, "sim_physics": 0.057208487391471864, "survival_time": 7.99999999999998, "driven_lanedir": 2.490215126475166, "sim_render-ego": 0.007961210608482362, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.01571924686431885, "deviation-heading": 1.8575636472639112, "set_robot_commands": 0.007086063921451569, "deviation-center-line": 0.39436454388094, "driven_lanedir_consec": 2.490215126475166, "sim_compute_sim_state": 0.004032143950462341, "sim_compute_performance-ego": 0.003992629051208496, "sim_compute_robot_state-ego": 0.005207604169845581}}set_robot_commands_max 0.007388375022194602 set_robot_commands_mean 0.006845401284341625 set_robot_commands_median 0.007086063921451569 set_robot_commands_min 0.0056140478452046715 sim_compute_performance-ego_max 0.004080414772033691 sim_compute_performance-ego_mean 0.004003939181705893 sim_compute_performance-ego_median 0.003992629051208496 sim_compute_performance-ego_min 0.003964790363901669 sim_compute_robot_state-ego_max 0.005207604169845581 sim_compute_robot_state-ego_mean 0.005096997082810669 sim_compute_robot_state-ego_median 0.005079726378122966 sim_compute_robot_state-ego_min 0.005001803034359647 sim_compute_sim_state_max 0.004032143950462341 sim_compute_sim_state_mean 0.003736637780421304 sim_compute_sim_state_median 0.003809191963889382 sim_compute_sim_state_min 0.0031876269976298015 sim_physics_max 0.058441816676746715 sim_physics_mean 0.055837272988115014 sim_physics_median 0.05582547925182225 sim_physics_min 0.053409032821655274 sim_render-ego_max 0.007961210608482362 sim_render-ego_mean 0.007363864867808633 sim_render-ego_median 0.007247729734940963 sim_render-ego_min 0.006949440638224284 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.100000000000025 survival_time_min 2.7499999999999982
No reset possible 263014670Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.268525637927704 survival_time_median 14.950000000000076 deviation-center-line_median 0.7543796296912793 in-drivable-lane_median 2.199999999999992
other stats agent_compute-ego_max 0.03544110218683878 agent_compute-ego_mean 0.033403607442805065 agent_compute-ego_median 0.033670979340871175 agent_compute-ego_min 0.03102721134821574 deviation-center-line_max 0.8964340317639983 deviation-center-line_mean 0.7339691707640361 deviation-center-line_min 0.5528434155408777 deviation-heading_max 4.299083900777696 deviation-heading_mean 3.146292283604212 deviation-heading_median 3.337726180512945 deviation-heading_min 2.0123797623274027 driven_any_max 4.960029868409807 driven_any_mean 4.0887151152368535 driven_any_median 3.856750139578141 driven_any_min 3.583783543097186 driven_lanedir_consec_max 4.898832471439457 driven_lanedir_consec_mean 3.522026754979195 driven_lanedir_consec_min 2.731692417252785 driven_lanedir_max 4.898832471439457 driven_lanedir_mean 3.6336981217181887 driven_lanedir_median 3.286243872501409 driven_lanedir_min 2.91366779576221 in-drivable-lane_max 3.700000000000024 in-drivable-lane_mean 2.2600000000000184 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.583783543097186, "sim_physics": 0.058194998105367025, "survival_time": 14.950000000000076, "driven_lanedir": 2.91366779576221, "sim_render-ego": 0.006966698964436849, "in-drivable-lane": 3.700000000000024, "agent_compute-ego": 0.03102721134821574, "deviation-heading": 3.802369493335871, "set_robot_commands": 0.005545047918955485, "deviation-center-line": 0.7543796296912793, "driven_lanedir_consec": 2.910931303184776, "sim_compute_sim_state": 0.003191746870676676, "sim_compute_performance-ego": 0.004073131084442139, "sim_compute_robot_state-ego": 0.005125314394632975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6968609621044184, "sim_physics": 0.0541050140062968, "survival_time": 14.950000000000076, "driven_lanedir": 3.286243872501409, "sim_render-ego": 0.007027045090993245, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.033670979340871175, "deviation-heading": 4.299083900777696, "set_robot_commands": 0.004982703526814778, "deviation-center-line": 0.8678534819319567, "driven_lanedir_consec": 2.731692417252785, "sim_compute_sim_state": 0.0029248658816019694, "sim_compute_performance-ego": 0.003942777315775553, "sim_compute_robot_state-ego": 0.004996003309885661}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.346151062994718, "sim_physics": 0.05340164343516032, "survival_time": 14.950000000000076, "driven_lanedir": 3.800151945091252, "sim_render-ego": 0.00697738250096639, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.03384515126546224, "deviation-heading": 3.337726180512945, "set_robot_commands": 0.005028257369995117, "deviation-center-line": 0.8964340317639983, "driven_lanedir_consec": 3.800151945091252, "sim_compute_sim_state": 0.0029008213678995767, "sim_compute_performance-ego": 0.003958577315012614, "sim_compute_robot_state-ego": 0.004973192214965821}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.960029868409807, "sim_physics": 0.05505095561345418, "survival_time": 14.950000000000076, "driven_lanedir": 4.898832471439457, "sim_render-ego": 0.007019464174906413, "in-drivable-lane": 0, "agent_compute-ego": 0.03544110218683878, "deviation-heading": 2.0123797623274027, "set_robot_commands": 0.005037824312845866, "deviation-center-line": 0.5983352948920688, "driven_lanedir_consec": 4.898832471439457, "sim_compute_sim_state": 0.0029692864418029786, "sim_compute_performance-ego": 0.00395172119140625, "sim_compute_robot_state-ego": 0.0050452931722005205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.856750139578141, "sim_physics": 0.05566182426626692, "survival_time": 13.150000000000052, "driven_lanedir": 3.269594523796614, "sim_render-ego": 0.006895267464815437, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.0330335930726374, "deviation-heading": 2.279902081067143, "set_robot_commands": 0.00485177819719786, "deviation-center-line": 0.5528434155408777, "driven_lanedir_consec": 3.268525637927704, "sim_compute_sim_state": 0.0029260051567744846, "sim_compute_performance-ego": 0.003899626858787392, "sim_compute_robot_state-ego": 0.004979498032834593}}set_robot_commands_max 0.005545047918955485 set_robot_commands_mean 0.005089122265161821 set_robot_commands_median 0.005028257369995117 set_robot_commands_min 0.00485177819719786 sim_compute_performance-ego_max 0.004073131084442139 sim_compute_performance-ego_mean 0.00396516675308479 sim_compute_performance-ego_median 0.00395172119140625 sim_compute_performance-ego_min 0.003899626858787392 sim_compute_robot_state-ego_max 0.005125314394632975 sim_compute_robot_state-ego_mean 0.005023860224903915 sim_compute_robot_state-ego_median 0.004996003309885661 sim_compute_robot_state-ego_min 0.004973192214965821 sim_compute_sim_state_max 0.003191746870676676 sim_compute_sim_state_mean 0.002982545143751137 sim_compute_sim_state_median 0.0029260051567744846 sim_compute_sim_state_min 0.0029008213678995767 sim_physics_max 0.058194998105367025 sim_physics_mean 0.055282887085309054 sim_physics_median 0.05505095561345418 sim_physics_min 0.05340164343516032 sim_render-ego_max 0.007027045090993245 sim_render-ego_mean 0.006977171639223667 sim_render-ego_median 0.00697738250096639 sim_render-ego_min 0.006895267464815437 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.590000000000073 survival_time_min 13.150000000000052
No reset possible 262984669Rey Wiyatno challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 7 months 5 years, 7 months 0:08:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.404556380054242 survival_time_median 14.950000000000076 deviation-center-line_median 0.5389102930354714 in-drivable-lane_median 2.6499999999999995
other stats agent_compute-ego_max 0.03706722623029632 agent_compute-ego_mean 0.034079696678870376 agent_compute-ego_median 0.03403231269078897 agent_compute-ego_min 0.030497424602508545 deviation-center-line_max 0.9398258292110828 deviation-center-line_mean 0.6235531030463586 deviation-center-line_min 0.2851640262117257 deviation-heading_max 3.390884537618885 deviation-heading_mean 2.270947047625615 deviation-heading_median 2.2545499904908657 deviation-heading_min 1.063689006458732 driven_any_max 5.629888600404822 driven_any_mean 4.290415025600876 driven_any_median 4.431012585832919 driven_any_min 2.1972284222881817 driven_lanedir_consec_max 4.816454536987581 driven_lanedir_consec_mean 2.612833357664893 driven_lanedir_consec_min 1.4315016695892515 driven_lanedir_max 5.09015488413139 driven_lanedir_mean 3.671822885025784 driven_lanedir_median 3.538050853717271 driven_lanedir_min 1.8386782920663816 in-drivable-lane_max 3.850000000000016 in-drivable-lane_mean 2.6000000000000045 in-drivable-lane_min 1.649999999999994 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.431012585832919, "sim_physics": 0.05786375363667806, "survival_time": 14.950000000000076, "driven_lanedir": 3.538050853717271, "sim_render-ego": 0.007000071207682292, "in-drivable-lane": 3.850000000000016, "agent_compute-ego": 0.030497424602508545, "deviation-heading": 3.390884537618885, "set_robot_commands": 0.005656170050303141, "deviation-center-line": 0.9398258292110828, "driven_lanedir_consec": 2.5730532268926423, "sim_compute_sim_state": 0.003164275487263997, "sim_compute_performance-ego": 0.004071852366129557, "sim_compute_robot_state-ego": 0.005128652254740397}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1972284222881817, "sim_physics": 0.05689216843733551, "survival_time": 7.049999999999983, "driven_lanedir": 1.8386782920663816, "sim_render-ego": 0.007084944569472725, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.03403231269078897, "deviation-heading": 1.063689006458732, "set_robot_commands": 0.005029000289051245, "deviation-center-line": 0.2851640262117257, "driven_lanedir_consec": 1.8386009748007457, "sim_compute_sim_state": 0.003046808513343757, "sim_compute_performance-ego": 0.003951314493274012, "sim_compute_robot_state-ego": 0.0051382230528702975}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.460812072723912, "sim_physics": 0.05454671065012614, "survival_time": 14.950000000000076, "driven_lanedir": 4.816454536987581, "sim_render-ego": 0.006984288692474365, "in-drivable-lane": 2.6499999999999995, "agent_compute-ego": 0.03382967233657837, "deviation-heading": 2.2545499904908657, "set_robot_commands": 0.005017881393432617, "deviation-center-line": 0.8784667112850681, "driven_lanedir_consec": 4.816454536987581, "sim_compute_sim_state": 0.0029452745119730632, "sim_compute_performance-ego": 0.003952818711598714, "sim_compute_robot_state-ego": 0.005008847713470459}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.7331334467545454, "sim_physics": 0.05578069943483635, "survival_time": 11.150000000000023, "driven_lanedir": 3.0757758582262955, "sim_render-ego": 0.007060816469748458, "in-drivable-lane": 2.2000000000000073, "agent_compute-ego": 0.03706722623029632, "deviation-heading": 2.6302311303742547, "set_robot_commands": 0.005033961326017508, "deviation-center-line": 0.4753986554884446, "driven_lanedir_consec": 1.4315016695892515, "sim_compute_sim_state": 0.0030219608358203563, "sim_compute_performance-ego": 0.003961701029619294, "sim_compute_robot_state-ego": 0.0051084163477602565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.629888600404822, "sim_physics": 0.05614854097366333, "survival_time": 14.950000000000076, "driven_lanedir": 5.09015488413139, "sim_render-ego": 0.006961648464202881, "in-drivable-lane": 2.6500000000000075, "agent_compute-ego": 0.03497184753417969, "deviation-heading": 2.015380573185339, "set_robot_commands": 0.005046292146046957, "deviation-center-line": 0.5389102930354714, "driven_lanedir_consec": 2.404556380054242, "sim_compute_sim_state": 0.003002019723256429, "sim_compute_performance-ego": 0.0039616791407267255, "sim_compute_robot_state-ego": 0.005094923178354899}}set_robot_commands_max 0.005656170050303141 set_robot_commands_mean 0.005156661040970294 set_robot_commands_median 0.005033961326017508 set_robot_commands_min 0.005017881393432617 sim_compute_performance-ego_max 0.004071852366129557 sim_compute_performance-ego_mean 0.0039798731482696605 sim_compute_performance-ego_median 0.0039616791407267255 sim_compute_performance-ego_min 0.003951314493274012 sim_compute_robot_state-ego_max 0.0051382230528702975 sim_compute_robot_state-ego_mean 0.0050958125094392615 sim_compute_robot_state-ego_median 0.0051084163477602565 sim_compute_robot_state-ego_min 0.005008847713470459 sim_compute_sim_state_max 0.003164275487263997 sim_compute_sim_state_mean 0.003036067814331521 sim_compute_sim_state_median 0.0030219608358203563 sim_compute_sim_state_min 0.0029452745119730632 sim_physics_max 0.05786375363667806 sim_physics_mean 0.05624637462652787 sim_physics_median 0.05614854097366333 sim_physics_min 0.05454671065012614 sim_render-ego_max 0.007084944569472725 sim_render-ego_mean 0.007018353880716144 sim_render-ego_median 0.007000071207682292 sim_render-ego_min 0.006961648464202881 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.610000000000047 survival_time_min 7.049999999999983
No reset possible 260284238Manfred Diaz Baseline-IL-logs-tensorflow aido3-LF-real-validationeval1-visualize success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0 survival_time 29.3333 deviation-center-line 0 in-drivable-lane 29.3333
other stats deviation-heading 0 driven_any 0.07730056307974578 driven_lanedir 0 visualized-eval1-passed 1
No reset possible 260164513Frank (Chude) Qian 2019-11-19|FrankNet aido3-LF-real-validationeval0-visualize success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec 0.260000410079956 survival_time 21.3333 deviation-center-line 0.196004973180867 in-drivable-lane 20
other stats deviation-heading 1.4309110780079015 driven_any 6.6459578348964685 driven_lanedir 0.260000410079956 visualized-eval0-passed 1
No reset possible 260104562Frank (Chude) Qian 2019-11-19|FrankNet|Andrew_Activation aido3-LFVI-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:41:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.87648244383903 survival_time_median 14.950000000000076 deviation-center-line_median 0.6986883116863744 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03261397636100037 agent_compute-ego_mean 0.029271539192850745 agent_compute-ego_median 0.02906349182128906 agent_compute-ego_min 0.0288050697274404 deviation-center-line_max 0.963389229823746 deviation-center-line_mean 0.6615147967503469 deviation-center-line_min 0.2144280311787227 deviation-heading_max 3.4188199259578145 deviation-heading_mean 2.3972522541770767 deviation-heading_median 2.5242787937905393 deviation-heading_min 1.4508641390963235 driven_any_max 6.05201000753951 driven_any_mean 4.033116818154024 driven_any_median 4.240701948378961 driven_any_min 1.0722899273915052 driven_lanedir_consec_max 5.7497965568942515 driven_lanedir_consec_mean 3.570110438733309 driven_lanedir_consec_min 0.8408251438574059 driven_lanedir_max 6.011789352835899 driven_lanedir_mean 3.6407128315267454 driven_lanedir_median 4.047636438025174 driven_lanedir_min 0.9004240245631236 in-drivable-lane_max 5.600000000000036 in-drivable-lane_mean 1.1366666666666687 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.0722899273915052, "sim_physics": 0.15007422721549257, "survival_time": 3.649999999999995, "driven_lanedir": 0.92508736863575, "sim_render-ego": 0.007340783942235659, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.03261397636100037, "deviation-heading": 1.4710806788025106, "set_robot_commands": 0.005246237532733238, "deviation-center-line": 0.26847484523919707, "driven_lanedir_consec": 0.8408251438574059, "sim_compute_sim_state": 0.002925039970711486, "sim_compute_performance-ego": 0.003998619236358225, "sim_compute_robot_state-ego": 0.005257773072752234, "sim_compute_robot_state-npc0": 0.004996188699382625, "sim_compute_robot_state-npc1": 0.004585759280479117, "sim_compute_robot_state-npc2": 0.004595527910206416, "sim_compute_robot_state-npc3": 0.004543644108184397}, "udem1-1-0": {"driven_any": 3.4151484369914913, "sim_physics": 0.12279407420056931, "survival_time": 11.750000000000032, "driven_lanedir": 2.457316977680102, "sim_render-ego": 0.0071216522379124415, "in-drivable-lane": 4.550000000000017, "agent_compute-ego": 0.029073903915729928, "deviation-heading": 1.6741009482876803, "set_robot_commands": 0.005041495789872839, "deviation-center-line": 0.4674898401541838, "driven_lanedir_consec": 2.457279532237012, "sim_compute_sim_state": 0.0028627395629882814, "sim_compute_performance-ego": 0.003969233086768617, "sim_compute_robot_state-ego": 0.00518268828696393, "sim_compute_robot_state-npc0": 0.0049621145775977605, "sim_compute_robot_state-npc1": 0.004592111262869327, "sim_compute_robot_state-npc2": 0.004555493212760763, "sim_compute_robot_state-npc3": 0.00452907440510202}, "udem1-2-0": {"driven_any": 4.015981492390156, "sim_physics": 0.11581417163213094, "survival_time": 14.950000000000076, "driven_lanedir": 3.8768894042858206, "sim_render-ego": 0.007059994538625081, "in-drivable-lane": 0, "agent_compute-ego": 0.02925537904103597, "deviation-heading": 3.4188199259578145, "set_robot_commands": 0.004993011951446533, "deviation-center-line": 0.963389229823746, "driven_lanedir_consec": 3.87648244383903, "sim_compute_sim_state": 0.0028569173812866212, "sim_compute_performance-ego": 0.003939359188079834, "sim_compute_robot_state-ego": 0.005166678428649902, "sim_compute_robot_state-npc0": 0.004935907522837321, "sim_compute_robot_state-npc1": 0.004571125507354736, "sim_compute_robot_state-npc2": 0.004550384680430094, "sim_compute_robot_state-npc3": 0.004527618885040283}, "udem1-3-0": {"driven_any": 4.84967319116315, "sim_physics": 0.11565186262130736, "survival_time": 14.950000000000076, "driven_lanedir": 4.130043594005958, "sim_render-ego": 0.007043513456980387, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.028945709069569905, "deviation-heading": 2.810005821136736, "set_robot_commands": 0.00498052438100179, "deviation-center-line": 0.610698341550006, "driven_lanedir_consec": 3.858789263145429, "sim_compute_sim_state": 0.0028394349416097004, "sim_compute_performance-ego": 0.003919985294342041, "sim_compute_robot_state-ego": 0.005115503470102946, "sim_compute_robot_state-npc0": 0.0049316016832987464, "sim_compute_robot_state-npc1": 0.0045650641123453775, "sim_compute_robot_state-npc2": 0.004540297985076904, "sim_compute_robot_state-npc3": 0.004535524050394694}, "udem1-4-0": {"driven_any": 4.608062597521867, "sim_physics": 0.12399339993794758, "survival_time": 14.950000000000076, "driven_lanedir": 2.876413451474757, "sim_render-ego": 0.007040621439615886, "in-drivable-lane": 5.600000000000036, "agent_compute-ego": 0.029237672487894693, "deviation-heading": 3.3917477950495365, "set_robot_commands": 0.004971198240915934, "deviation-center-line": 0.7046695703816085, "driven_lanedir_consec": 2.8344114250089008, "sim_compute_sim_state": 0.002833326657613118, "sim_compute_performance-ego": 0.00390151580174764, "sim_compute_robot_state-ego": 0.00511350949605306, "sim_compute_robot_state-npc0": 0.004930294354756673, "sim_compute_robot_state-npc1": 0.004557428359985352, "sim_compute_robot_state-npc2": 0.004506193002065023, "sim_compute_robot_state-npc3": 0.004498016834259033}, "udem1-5-0": {"driven_any": 4.141486331021924, "sim_physics": 0.12208528916041056, "survival_time": 14.950000000000076, "driven_lanedir": 4.056141882739909, "sim_render-ego": 0.007007768154144287, "in-drivable-lane": 0, "agent_compute-ego": 0.028881638844807943, "deviation-heading": 2.808780323238771, "set_robot_commands": 0.0050115076700846355, "deviation-center-line": 0.71754421302539, "driven_lanedir_consec": 4.056141882739909, "sim_compute_sim_state": 0.002818872928619385, "sim_compute_performance-ego": 0.003934979438781738, "sim_compute_robot_state-ego": 0.005153257846832276, "sim_compute_robot_state-npc0": 0.004918959140777588, "sim_compute_robot_state-npc1": 0.004549326101938884, "sim_compute_robot_state-npc2": 0.004525919755299886, "sim_compute_robot_state-npc3": 0.004529049396514892}, "udem1-6-0": {"driven_any": 4.162061619476119, "sim_physics": 0.11979644139607748, "survival_time": 14.950000000000076, "driven_lanedir": 3.44392145167579, "sim_render-ego": 0.007021158536275228, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.02906804879506429, "deviation-heading": 2.5242787937905393, "set_robot_commands": 0.005061081250508626, "deviation-center-line": 0.650830750296189, "driven_lanedir_consec": 3.3686104699782216, "sim_compute_sim_state": 0.002836885452270508, "sim_compute_performance-ego": 0.0039061411221822102, "sim_compute_robot_state-ego": 0.005124695301055908, "sim_compute_robot_state-npc0": 0.004945173263549805, "sim_compute_robot_state-npc1": 0.00455525000890096, "sim_compute_robot_state-npc2": 0.00453278382619222, "sim_compute_robot_state-npc3": 0.00452119509379069}, "udem1-7-0": {"driven_any": 4.769110656403493, "sim_physics": 0.1263572382926941, "survival_time": 14.950000000000076, "driven_lanedir": 4.653809143511484, "sim_render-ego": 0.007165971597035726, "in-drivable-lane": 0, "agent_compute-ego": 0.029293575286865235, "deviation-heading": 3.03864203193187, "set_robot_commands": 0.005130806763966878, "deviation-center-line": 0.6912558246328585, "driven_lanedir_consec": 4.389956301899035, "sim_compute_sim_state": 0.0028685808181762697, "sim_compute_performance-ego": 0.004031369686126709, "sim_compute_robot_state-ego": 0.0052344338099161785, "sim_compute_robot_state-npc0": 0.005001735687255859, "sim_compute_robot_state-npc1": 0.004640560944875081, "sim_compute_robot_state-npc2": 0.004618275960286459, "sim_compute_robot_state-npc3": 0.00462291161219279}, "udem1-8-0": {"driven_any": 4.548768769960692, "sim_physics": 0.11689604918162028, "survival_time": 14.950000000000076, "driven_lanedir": 4.4362930834428, "sim_render-ego": 0.007028664747873942, "in-drivable-lane": 0, "agent_compute-ego": 0.0290156356493632, "deviation-heading": 3.0432891771372046, "set_robot_commands": 0.004956608613332113, "deviation-center-line": 0.8735959548230136, "driven_lanedir_consec": 4.436261558640579, "sim_compute_sim_state": 0.002814814249674479, "sim_compute_performance-ego": 0.003917213280995687, "sim_compute_robot_state-ego": 0.00509235143661499, "sim_compute_robot_state-npc0": 0.004882709980010986, "sim_compute_robot_state-npc1": 0.004535334904988607, "sim_compute_robot_state-npc2": 0.0044998908042907714, "sim_compute_robot_state-npc3": 0.0045132112503051755}, "udem1-9-0": {"driven_any": 4.782074587286697, "sim_physics": 0.11722734530766804, "survival_time": 14.950000000000076, "driven_lanedir": 4.7295162621664515, "sim_render-ego": 0.007033305962880453, "in-drivable-lane": 0, "agent_compute-ego": 0.02912744601567586, "deviation-heading": 1.8983716402777675, "set_robot_commands": 0.004980417887369791, "deviation-center-line": 0.6986883116863744, "driven_lanedir_consec": 4.7295162621664515, "sim_compute_sim_state": 0.0028162328402201336, "sim_compute_performance-ego": 0.0039149626096089685, "sim_compute_robot_state-ego": 0.005129489103953043, "sim_compute_robot_state-npc0": 0.004901421070098877, "sim_compute_robot_state-npc1": 0.004569365978240967, "sim_compute_robot_state-npc2": 0.004507880210876464, "sim_compute_robot_state-npc3": 0.004517881075541178}, "udem1-10-0": {"driven_any": 4.124677240810272, "sim_physics": 0.110477770169576, "survival_time": 14.950000000000076, "driven_lanedir": 4.047636438025174, "sim_render-ego": 0.006989180246988932, "in-drivable-lane": 0, "agent_compute-ego": 0.02906349182128906, "deviation-heading": 2.5295546459193994, "set_robot_commands": 0.005068386395772298, "deviation-center-line": 0.7594610837499518, "driven_lanedir_consec": 4.047636438025174, "sim_compute_sim_state": 0.0028233846028645833, "sim_compute_performance-ego": 0.003906615575154622, "sim_compute_robot_state-ego": 0.0051350696881612146, "sim_compute_robot_state-npc0": 0.0049222246805826824, "sim_compute_robot_state-npc1": 0.004575835069020589, "sim_compute_robot_state-npc2": 0.004540566603342692, "sim_compute_robot_state-npc3": 0.00454944133758545}, "udem1-11-0": {"driven_any": 4.240701948378961, "sim_physics": 0.11958521922429402, "survival_time": 14.950000000000076, "driven_lanedir": 4.190357551775706, "sim_render-ego": 0.006893513202667237, "in-drivable-lane": 0, "agent_compute-ego": 0.02888580560684204, "deviation-heading": 2.084985328114597, "set_robot_commands": 0.004891502062479655, "deviation-center-line": 0.8253460212581829, "driven_lanedir_consec": 4.190357551775706, "sim_compute_sim_state": 0.0027746693293253582, "sim_compute_performance-ego": 0.0038294394810994463, "sim_compute_robot_state-ego": 0.005128517945607503, "sim_compute_robot_state-npc0": 0.004823877811431885, "sim_compute_robot_state-npc1": 0.0044615952173868816, "sim_compute_robot_state-npc2": 0.004458216031392416, "sim_compute_robot_state-npc3": 0.00443381388982137}, "udem1-12-0": {"driven_any": 6.05201000753951, "sim_physics": 0.11684591293334962, "survival_time": 14.950000000000076, "driven_lanedir": 6.011789352835899, "sim_render-ego": 0.006935292879740397, "in-drivable-lane": 0, "agent_compute-ego": 0.0289218807220459, "deviation-heading": 1.4842205598345086, "set_robot_commands": 0.004868110020955403, "deviation-center-line": 0.6002472161059571, "driven_lanedir_consec": 5.7497965568942515, "sim_compute_sim_state": 0.0028116877873738608, "sim_compute_performance-ego": 0.0038566891352335617, "sim_compute_robot_state-ego": 0.004985113143920899, "sim_compute_robot_state-npc0": 0.00480758269627889, "sim_compute_robot_state-npc1": 0.0044638975461324054, "sim_compute_robot_state-npc2": 0.004440677165985107, "sim_compute_robot_state-npc3": 0.004418339729309082}, "udem1-13-0": {"driven_any": 1.0795831421043185, "sim_physics": 0.12097890409704758, "survival_time": 3.649999999999995, "driven_lanedir": 0.9004240245631236, "sim_render-ego": 0.007182274779228315, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0288050697274404, "deviation-heading": 1.4508641390963235, "set_robot_commands": 0.004888932998866251, "deviation-center-line": 0.2144280311787227, "driven_lanedir_consec": 0.8581796757757996, "sim_compute_sim_state": 0.0028371810913085938, "sim_compute_performance-ego": 0.003847099330327282, "sim_compute_robot_state-ego": 0.005062325360023812, "sim_compute_robot_state-npc0": 0.004824697154842011, "sim_compute_robot_state-npc1": 0.004515128592922263, "sim_compute_robot_state-npc2": 0.004436894638897622, "sim_compute_robot_state-npc3": 0.004440644016004589}, "udem1-14-0": {"driven_any": 4.635122323870203, "sim_physics": 0.1193947704633077, "survival_time": 14.950000000000076, "driven_lanedir": 3.875052486082456, "sim_render-ego": 0.006895426114400228, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.02888385454813639, "deviation-heading": 2.330042004080884, "set_robot_commands": 0.004845849672953288, "deviation-center-line": 0.8766027173498221, "driven_lanedir_consec": 3.857412075016723, "sim_compute_sim_state": 0.0028045066197713215, "sim_compute_performance-ego": 0.0038450074195861814, "sim_compute_robot_state-ego": 0.005055974324544271, "sim_compute_robot_state-npc0": 0.004813818136850992, "sim_compute_robot_state-npc1": 0.004460461934407552, "sim_compute_robot_state-npc2": 0.004430741469065348, "sim_compute_robot_state-npc3": 0.004428411324818929}}set_robot_commands_max 0.005246237532733238 set_robot_commands_mean 0.004995711415483952 set_robot_commands_median 0.00498052438100179 set_robot_commands_min 0.004845849672953288 sim_compute_performance-ego_max 0.004031369686126709 sim_compute_performance-ego_mean 0.003914548645759517 sim_compute_performance-ego_median 0.0039149626096089685 sim_compute_performance-ego_min 0.0038294394810994463 sim_compute_robot_state-ego_max 0.005257773072752234 sim_compute_robot_state-ego_mean 0.005129158714343478 sim_compute_robot_state-ego_median 0.005128517945607503 sim_compute_robot_state-ego_min 0.004985113143920899 sim_compute_robot_state-npc0_max 0.005001735687255859 sim_compute_robot_state-npc0_mean 0.004906553763970181 sim_compute_robot_state-npc0_median 0.0049222246805826824 sim_compute_robot_state-npc0_min 0.00480758269627889 sim_compute_robot_state-npc1_max 0.004640560944875081 sim_compute_robot_state-npc1_mean 0.004546549654789874 sim_compute_robot_state-npc1_median 0.004557428359985352 sim_compute_robot_state-npc1_min 0.004460461934407552 sim_compute_robot_state-npc2_max 0.004618275960286459 sim_compute_robot_state-npc2_mean 0.004515982883744546 sim_compute_robot_state-npc2_median 0.004525919755299886 sim_compute_robot_state-npc2_min 0.004430741469065348 sim_compute_robot_state-npc3_max 0.00462291161219279 sim_compute_robot_state-npc3_mean 0.0045072518005909714 sim_compute_robot_state-npc3_median 0.00452119509379069 sim_compute_robot_state-npc3_min 0.004418339729309082 sim_compute_sim_state_max 0.002925039970711486 sim_compute_sim_state_mean 0.0028349516155875805 sim_compute_sim_state_median 0.002833326657613118 sim_compute_sim_state_min 0.0027746693293253582 sim_physics_max 0.15007422721549257 sim_physics_mean 0.12119817838889954 sim_physics_median 0.11958521922429402 sim_physics_min 0.110477770169576 sim_render-ego_max 0.007340783942235659 sim_render-ego_mean 0.007050608122440278 sim_render-ego_median 0.007033305962880453 sim_render-ego_min 0.006893513202667237 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.230000000000064 survival_time_min 3.649999999999995
No reset possible 259744541Robert Moni kaland-22401 aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:10:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5903729579435912 survival_time_median 14.950000000000076 deviation-center-line_median 0.3868720317477985 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.025153650442759197 agent_compute-ego_mean 0.024284462769826255 agent_compute-ego_median 0.024123822053273517 agent_compute-ego_min 0.02396987040837606 deviation-center-line_max 0.5556476837749575 deviation-center-line_mean 0.3762502008739931 deviation-center-line_min 0.11949956855715796 deviation-heading_max 3.5343579223165524 deviation-heading_mean 1.7747085181471491 deviation-heading_median 1.4790324086177606 deviation-heading_min 0.9260981962858638 driven_any_max 0.6032946656746333 driven_any_mean 0.5921552252951884 driven_any_median 0.5947481805032668 driven_any_min 0.575587157653563 driven_lanedir_consec_max 0.600901441171495 driven_lanedir_consec_mean 0.5844987578260455 driven_lanedir_consec_min 0.5511889304832824 driven_lanedir_max 0.600901441171495 driven_lanedir_mean 0.5844987578260455 driven_lanedir_median 0.5903729579435912 driven_lanedir_min 0.5511889304832824 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.575587157653563, "sim_physics": 0.062148377895355225, "survival_time": 14.950000000000076, "driven_lanedir": 0.5511889304832824, "sim_render-ego": 0.007006086508433024, "in-drivable-lane": 0, "agent_compute-ego": 0.025153650442759197, "deviation-heading": 3.5343579223165524, "set_robot_commands": 0.005054056644439697, "deviation-center-line": 0.3868720317477985, "driven_lanedir_consec": 0.5511889304832824, "sim_compute_sim_state": 0.002983353932698568, "sim_compute_performance-ego": 0.0040556716918945315, "sim_compute_robot_state-ego": 0.0051581398646036785}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5958747068095394, "sim_physics": 0.05708342949549357, "survival_time": 14.950000000000076, "driven_lanedir": 0.5903729579435912, "sim_render-ego": 0.007026545206705729, "in-drivable-lane": 0, "agent_compute-ego": 0.02396987040837606, "deviation-heading": 1.735935445510351, "set_robot_commands": 0.005038135051727295, "deviation-center-line": 0.5556476837749575, "driven_lanedir_consec": 0.5903729579435912, "sim_compute_sim_state": 0.002908294200897217, "sim_compute_performance-ego": 0.003946783542633056, "sim_compute_robot_state-ego": 0.004975399971008301}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5947481805032668, "sim_physics": 0.0542625617980957, "survival_time": 14.950000000000076, "driven_lanedir": 0.5909322563533381, "sim_render-ego": 0.008086868127187093, "in-drivable-lane": 0, "agent_compute-ego": 0.024123822053273517, "deviation-heading": 1.4790324086177606, "set_robot_commands": 0.005022165775299073, "deviation-center-line": 0.2839382596784663, "driven_lanedir_consec": 0.5909322563533381, "sim_compute_sim_state": 0.0029371436436971027, "sim_compute_performance-ego": 0.003958672682444255, "sim_compute_robot_state-ego": 0.00504479169845581}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6032946656746333, "sim_physics": 0.05890561739603679, "survival_time": 14.950000000000076, "driven_lanedir": 0.600901441171495, "sim_render-ego": 0.006900319258371989, "in-drivable-lane": 0, "agent_compute-ego": 0.023976643085479737, "deviation-heading": 1.198118618005218, "set_robot_commands": 0.004936720530192057, "deviation-center-line": 0.535293460611585, "driven_lanedir_consec": 0.600901441171495, "sim_compute_sim_state": 0.0028822938601175945, "sim_compute_performance-ego": 0.003927948474884033, "sim_compute_robot_state-ego": 0.004933427969614664}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5912714158349395, "sim_physics": 0.057522422472635906, "survival_time": 14.950000000000076, "driven_lanedir": 0.5890982031785206, "sim_render-ego": 0.007058475017547607, "in-drivable-lane": 0, "agent_compute-ego": 0.024198327859242755, "deviation-heading": 0.9260981962858638, "set_robot_commands": 0.0049807874361673995, "deviation-center-line": 0.11949956855715796, "driven_lanedir_consec": 0.5890982031785206, "sim_compute_sim_state": 0.0029425803820292153, "sim_compute_performance-ego": 0.003960673809051514, "sim_compute_robot_state-ego": 0.0050115450223286945}}set_robot_commands_max 0.005054056644439697 set_robot_commands_mean 0.005006373087565105 set_robot_commands_median 0.005022165775299073 set_robot_commands_min 0.004936720530192057 sim_compute_performance-ego_max 0.0040556716918945315 sim_compute_performance-ego_mean 0.003969950040181478 sim_compute_performance-ego_median 0.003958672682444255 sim_compute_performance-ego_min 0.003927948474884033 sim_compute_robot_state-ego_max 0.0051581398646036785 sim_compute_robot_state-ego_mean 0.005024660905202229 sim_compute_robot_state-ego_median 0.0050115450223286945 sim_compute_robot_state-ego_min 0.004933427969614664 sim_compute_sim_state_max 0.002983353932698568 sim_compute_sim_state_mean 0.0029307332038879396 sim_compute_sim_state_median 0.0029371436436971027 sim_compute_sim_state_min 0.0028822938601175945 sim_physics_max 0.062148377895355225 sim_physics_mean 0.05798448181152344 sim_physics_median 0.057522422472635906 sim_physics_min 0.0542625617980957 sim_render-ego_max 0.008086868127187093 sim_render-ego_mean 0.007215658823649089 sim_render-ego_median 0.007026545206705729 sim_render-ego_min 0.006900319258371989 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 259564537Rick Lindstrom challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:07:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.9018826489327956 survival_time_median 12.35000000000004 deviation-center-line_median 0.45879104194826126 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.01755997668141904 agent_compute-ego_mean 0.016542260937999695 agent_compute-ego_median 0.016207826137542725 agent_compute-ego_min 0.01617484526200728 deviation-center-line_max 0.7884160488722091 deviation-center-line_mean 0.5053413100267559 deviation-center-line_min 0.2105321650931611 deviation-heading_max 4.812792932535979 deviation-heading_mean 2.095754061892676 deviation-heading_median 1.7184665415808429 deviation-heading_min 1.012802355262915 driven_any_max 2.349148138757713 driven_any_mean 1.7159332957913087 driven_any_median 1.9312421092134036 driven_any_min 0.6779952006111903 driven_lanedir_consec_max 2.3251648697384777 driven_lanedir_consec_mean 1.6580192677913446 driven_lanedir_consec_min 0.6426189577288484 driven_lanedir_max 2.3251648697384777 driven_lanedir_mean 1.6580192677913446 driven_lanedir_median 1.9018826489327956 driven_lanedir_min 0.6426189577288484 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6779952006111903, "sim_physics": 0.06229918158572653, "survival_time": 4.599999999999992, "driven_lanedir": 0.6426189577288484, "sim_render-ego": 0.007582464943761411, "in-drivable-lane": 0, "agent_compute-ego": 0.01755997668141904, "deviation-heading": 1.201963348366307, "set_robot_commands": 0.007683515548706055, "deviation-center-line": 0.2105321650931611, "driven_lanedir_consec": 0.6426189577288484, "sim_compute_sim_state": 0.004020558751147726, "sim_compute_performance-ego": 0.007041822309079377, "sim_compute_robot_state-ego": 0.005407729874486508}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9312421092134036, "sim_physics": 0.06035799343093687, "survival_time": 12.35000000000004, "driven_lanedir": 1.9018826489327956, "sim_render-ego": 0.007441715672913833, "in-drivable-lane": 0, "agent_compute-ego": 0.016182054874868044, "deviation-heading": 1.7327451317173364, "set_robot_commands": 0.007074585810364017, "deviation-center-line": 0.45879104194826126, "driven_lanedir_consec": 1.9018826489327956, "sim_compute_sim_state": 0.003678607554570866, "sim_compute_performance-ego": 0.004212642005580639, "sim_compute_robot_state-ego": 0.005395707813834372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490060010091383, "sim_physics": 0.05897315820058187, "survival_time": 14.950000000000076, "driven_lanedir": 2.164883309104049, "sim_render-ego": 0.007395061651865641, "in-drivable-lane": 0, "agent_compute-ego": 0.016207826137542725, "deviation-heading": 4.812792932535979, "set_robot_commands": 0.007090342044830322, "deviation-center-line": 0.7884160488722091, "driven_lanedir_consec": 2.164883309104049, "sim_compute_sim_state": 0.003659658432006836, "sim_compute_performance-ego": 0.00419426441192627, "sim_compute_robot_state-ego": 0.005396455923716227}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2722750293650986, "sim_physics": 0.05810007904515122, "survival_time": 8.249999999999982, "driven_lanedir": 1.2555465534525512, "sim_render-ego": 0.007449291691635595, "in-drivable-lane": 0, "agent_compute-ego": 0.01617484526200728, "deviation-heading": 1.012802355262915, "set_robot_commands": 0.007081460952758789, "deviation-center-line": 0.4131842427992844, "driven_lanedir_consec": 1.2555465534525512, "sim_compute_sim_state": 0.003651753338900479, "sim_compute_performance-ego": 0.004201127543593898, "sim_compute_robot_state-ego": 0.0052224086992668384}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349148138757713, "sim_physics": 0.06047162135442098, "survival_time": 14.950000000000076, "driven_lanedir": 2.3251648697384777, "sim_render-ego": 0.007476960817972819, "in-drivable-lane": 0, "agent_compute-ego": 0.016586601734161377, "deviation-heading": 1.7184665415808429, "set_robot_commands": 0.007294549147288005, "deviation-center-line": 0.6557830514208638, "driven_lanedir_consec": 2.3251648697384777, "sim_compute_sim_state": 0.0038436476389567056, "sim_compute_performance-ego": 0.004213592211405436, "sim_compute_robot_state-ego": 0.005381807486216228}}set_robot_commands_max 0.007683515548706055 set_robot_commands_mean 0.007244890700789437 set_robot_commands_median 0.007090342044830322 set_robot_commands_min 0.007074585810364017 sim_compute_performance-ego_max 0.007041822309079377 sim_compute_performance-ego_mean 0.004772689696317124 sim_compute_performance-ego_median 0.004212642005580639 sim_compute_performance-ego_min 0.00419426441192627 sim_compute_robot_state-ego_max 0.005407729874486508 sim_compute_robot_state-ego_mean 0.005360821959504035 sim_compute_robot_state-ego_median 0.005395707813834372 sim_compute_robot_state-ego_min 0.0052224086992668384 sim_compute_sim_state_max 0.004020558751147726 sim_compute_sim_state_mean 0.003770845143116522 sim_compute_sim_state_median 0.003678607554570866 sim_compute_sim_state_min 0.003651753338900479 sim_physics_max 0.06229918158572653 sim_physics_mean 0.06004040672336349 sim_physics_median 0.06035799343093687 sim_physics_min 0.05810007904515122 sim_render-ego_max 0.007582464943761411 sim_render-ego_mean 0.007469098955629859 sim_render-ego_median 0.007449291691635595 sim_render-ego_min 0.007395061651865641 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.020000000000032 survival_time_min 4.599999999999992
No reset possible 259444534Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:19:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.327742295742241 survival_time_median 12.200000000000038 deviation-center-line_median 0.6095248129971736 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.01764825979868571 agent_compute-ego_mean 0.016669371481757123 agent_compute-ego_median 0.016554746471467565 agent_compute-ego_min 0.016234596570332844 deviation-center-line_max 1.2328913474015666 deviation-center-line_mean 0.6012367809844122 deviation-center-line_min 0.1363830174067054 deviation-heading_max 4.20723404734841 deviation-heading_mean 1.917036530292198 deviation-heading_median 1.4409848429337695 deviation-heading_min 0.6573446167797182 driven_any_max 2.3491525812214937 driven_any_mean 1.640334983641741 driven_any_median 1.9071393132930508 driven_any_min 0.64545750055106 driven_lanedir_consec_max 2.315378383924776 driven_lanedir_consec_mean 1.5085253848962166 driven_lanedir_consec_min 0.5716312712969349 driven_lanedir_max 2.315378383924776 driven_lanedir_mean 1.5644187605646154 driven_lanedir_median 1.8864073949591167 driven_lanedir_min 0.5716312712969349 in-drivable-lane_max 0.9000000000000012 in-drivable-lane_mean 0.1166666666666666 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6619254427230739, "sim_physics": 0.06712195343441434, "survival_time": 4.499999999999992, "driven_lanedir": 0.5716312712969349, "sim_render-ego": 0.0077118423249986435, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01764825979868571, "deviation-heading": 1.1165862860016222, "set_robot_commands": 0.007413013776143392, "deviation-center-line": 0.1363830174067054, "driven_lanedir_consec": 0.5716312712969349, "sim_compute_sim_state": 0.004088065359327528, "sim_compute_performance-ego": 0.004591033193800185, "sim_compute_robot_state-ego": 0.0055829736921522355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9071393132930508, "sim_physics": 0.06360913397835903, "survival_time": 12.200000000000038, "driven_lanedir": 1.8864073949591167, "sim_render-ego": 0.007475880325817671, "in-drivable-lane": 0, "agent_compute-ego": 0.016554746471467565, "deviation-heading": 1.4409848429337695, "set_robot_commands": 0.007244446238533395, "deviation-center-line": 0.46055959519782413, "driven_lanedir_consec": 1.8864073949591167, "sim_compute_sim_state": 0.0038385918883026625, "sim_compute_performance-ego": 0.004241967787508105, "sim_compute_robot_state-ego": 0.0054663224298445905}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490919574897062, "sim_physics": 0.057927915255228675, "survival_time": 14.950000000000076, "driven_lanedir": 2.209175649704699, "sim_render-ego": 0.007437465985616048, "in-drivable-lane": 0, "agent_compute-ego": 0.016466988722483318, "deviation-heading": 3.7771448544832538, "set_robot_commands": 0.007215271790822347, "deviation-center-line": 0.9069684525387356, "driven_lanedir_consec": 2.209175649704699, "sim_compute_sim_state": 0.003768289089202881, "sim_compute_performance-ego": 0.004229435125986735, "sim_compute_robot_state-ego": 0.0054614845911661785}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3491182608054317, "sim_physics": 0.05917134523391723, "survival_time": 14.950000000000076, "driven_lanedir": 2.310860059276315, "sim_render-ego": 0.007334554195404052, "in-drivable-lane": 0, "agent_compute-ego": 0.016304419040679932, "deviation-heading": 2.1211524664771653, "set_robot_commands": 0.007127236525217692, "deviation-center-line": 0.7729579002284793, "driven_lanedir_consec": 2.310860059276315, "sim_compute_sim_state": 0.003775182565053304, "sim_compute_performance-ego": 0.004196169376373291, "sim_compute_robot_state-ego": 0.0053779506683349606}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491435337429327, "sim_physics": 0.06027623494466146, "survival_time": 14.950000000000076, "driven_lanedir": 2.315378383924776, "sim_render-ego": 0.0074445104598999026, "in-drivable-lane": 0, "agent_compute-ego": 0.016884225209554037, "deviation-heading": 1.604889128364047, "set_robot_commands": 0.007391845385233561, "deviation-center-line": 0.7498817490636873, "driven_lanedir_consec": 2.315378383924776, "sim_compute_sim_state": 0.003966899712880453, "sim_compute_performance-ego": 0.004230026404062907, "sim_compute_robot_state-ego": 0.0054392631848653155}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.7258087747460961, "sim_physics": 0.06123316656682909, "survival_time": 4.849999999999991, "driven_lanedir": 0.6940712685992091, "sim_render-ego": 0.0075430476788393005, "in-drivable-lane": 0, "agent_compute-ego": 0.016691571658419578, "deviation-heading": 0.9382955942863968, "set_robot_commands": 0.007473859590353425, "deviation-center-line": 0.23361058058323053, "driven_lanedir_consec": 0.6940712685992091, "sim_compute_sim_state": 0.00391136002294796, "sim_compute_performance-ego": 0.004238485061016279, "sim_compute_robot_state-ego": 0.005471259048304607}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.3285124296451505, "sim_physics": 0.05862288696821346, "survival_time": 8.599999999999987, "driven_lanedir": 1.3078596798639532, "sim_render-ego": 0.007488096869269083, "in-drivable-lane": 0, "agent_compute-ego": 0.016326757364494855, "deviation-heading": 1.1461758019567208, "set_robot_commands": 0.007239216981932174, "deviation-center-line": 0.6095248129971736, "driven_lanedir_consec": 1.3078596798639532, "sim_compute_sim_state": 0.003862045532049135, "sim_compute_performance-ego": 0.0042133331298828125, "sim_compute_robot_state-ego": 0.005423770394436148}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.348889278200704, "sim_physics": 0.05938021262486776, "survival_time": 14.950000000000076, "driven_lanedir": 2.0333484985568173, "sim_render-ego": 0.007497260570526123, "in-drivable-lane": 0.9000000000000012, "agent_compute-ego": 0.016780033111572265, "deviation-heading": 4.20723404734841, "set_robot_commands": 0.007296735445658366, "deviation-center-line": 0.7355506734068988, "driven_lanedir_consec": 1.1949478635308344, "sim_compute_sim_state": 0.00393977959950765, "sim_compute_performance-ego": 0.004243385791778564, "sim_compute_robot_state-ego": 0.005476969877878825}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.64545750055106, "sim_physics": 0.059721220498797536, "survival_time": 4.3499999999999925, "driven_lanedir": 0.619170860555613, "sim_render-ego": 0.007467697406637257, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.016457881050548333, "deviation-heading": 0.6573446167797182, "set_robot_commands": 0.007139005880246217, "deviation-center-line": 0.3128027828524501, "driven_lanedir_consec": 0.619170860555613, "sim_compute_sim_state": 0.003727268898624113, "sim_compute_performance-ego": 0.004159198410209568, "sim_compute_robot_state-ego": 0.0053403678981737155}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3490767077831056, "sim_physics": 0.05854881207148234, "survival_time": 14.950000000000076, "driven_lanedir": 2.132931679300153, "sim_render-ego": 0.007515760262807211, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01683132886886597, "deviation-heading": 4.088435420319021, "set_robot_commands": 0.00735536257425944, "deviation-center-line": 1.026750334257755, "driven_lanedir_consec": 2.132931679300153, "sim_compute_sim_state": 0.0038836248715718585, "sim_compute_performance-ego": 0.004303756554921468, "sim_compute_robot_state-ego": 0.005469514528910319}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.3491032995482835, "sim_physics": 0.05994468847910563, "survival_time": 14.950000000000076, "driven_lanedir": 2.2598361038909927, "sim_render-ego": 0.007250031630198161, "in-drivable-lane": 0, "agent_compute-ego": 0.017145034472147623, "deviation-heading": 3.002314020499261, "set_robot_commands": 0.007153417269388835, "deviation-center-line": 1.2328913474015666, "driven_lanedir_consec": 2.2598361038909927, "sim_compute_sim_state": 0.0035863343874613443, "sim_compute_performance-ego": 0.004210968017578125, "sim_compute_robot_state-ego": 0.0053333425521850586}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7820420985027281, "sim_physics": 0.058466906730945296, "survival_time": 5.1999999999999895, "driven_lanedir": 0.753002751341462, "sim_render-ego": 0.007462923343365009, "in-drivable-lane": 0, "agent_compute-ego": 0.01637029189329881, "deviation-heading": 1.007731682730798, "set_robot_commands": 0.007572449170626127, "deviation-center-line": 0.22006097968652152, "driven_lanedir_consec": 0.753002751341462, "sim_compute_sim_state": 0.003872763652067918, "sim_compute_performance-ego": 0.004207883889858539, "sim_compute_robot_state-ego": 0.005360956375415509}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.3445963343118634, "sim_physics": 0.06048724706145538, "survival_time": 8.699999999999989, "driven_lanedir": 1.327742295742241, "sim_render-ego": 0.007436467313218391, "in-drivable-lane": 0, "agent_compute-ego": 0.016520386454702794, "deviation-heading": 0.8664602369707889, "set_robot_commands": 0.007103640457679485, "deviation-center-line": 0.4534188188719455, "driven_lanedir_consec": 1.327742295742241, "sim_compute_sim_state": 0.003853710218407642, "sim_compute_performance-ego": 0.004194481619473161, "sim_compute_robot_state-ego": 0.005405752138159741}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7659672420614337, "sim_physics": 0.06236273400923785, "survival_time": 5.09999999999999, "driven_lanedir": 0.7333457413051401, "sim_render-ego": 0.007623595349928912, "in-drivable-lane": 0, "agent_compute-ego": 0.016234596570332844, "deviation-heading": 1.1511212317173356, "set_robot_commands": 0.007354086520625096, "deviation-center-line": 0.2363783628545584, "driven_lanedir_consec": 0.7333457413051401, "sim_compute_sim_state": 0.003985461066750919, "sim_compute_performance-ego": 0.004235421910005457, "sim_compute_robot_state-ego": 0.005347934423708448}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3491525812214937, "sim_physics": 0.059713249206542966, "survival_time": 14.950000000000076, "driven_lanedir": 2.3115197701518073, "sim_render-ego": 0.007428608735402425, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.01682405153910319, "deviation-heading": 1.6296777235146604, "set_robot_commands": 0.00732625961303711, "deviation-center-line": 0.9308123074186516, "driven_lanedir_consec": 2.3115197701518073, "sim_compute_sim_state": 0.003927229245503743, "sim_compute_performance-ego": 0.004163849353790283, "sim_compute_robot_state-ego": 0.0053671113650004066}}set_robot_commands_max 0.007572449170626127 set_robot_commands_mean 0.007293723147983778 set_robot_commands_median 0.007296735445658366 set_robot_commands_min 0.007103640457679485 sim_compute_performance-ego_max 0.004591033193800185 sim_compute_performance-ego_mean 0.004243959708416365 sim_compute_performance-ego_median 0.004229435125986735 sim_compute_performance-ego_min 0.004159198410209568 sim_compute_robot_state-ego_max 0.0055829736921522355 sim_compute_robot_state-ego_mean 0.005421664877902405 sim_compute_robot_state-ego_median 0.005423770394436148 sim_compute_robot_state-ego_min 0.0053333425521850586 sim_compute_sim_state_max 0.004088065359327528 sim_compute_sim_state_mean 0.003865773740643941 sim_compute_sim_state_median 0.003872763652067918 sim_compute_sim_state_min 0.0035863343874613443 sim_physics_max 0.06712195343441434 sim_physics_mean 0.06043918047093721 sim_physics_median 0.059721220498797536 sim_physics_min 0.057927915255228675 sim_render-ego_max 0.0077118423249986435 sim_render-ego_mean 0.007474516163461881 sim_render-ego_median 0.007467697406637257 sim_render-ego_min 0.007250031630198161 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.543333333333369 survival_time_min 4.3499999999999925
No reset possible 259174530Frank (Chude) Qian 2019-11-19|FrankNet|highreward aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:26:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.161507275394201 survival_time_median 14.950000000000076 deviation-center-line_median 0.8103733499256218 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.029632564385732016 agent_compute-ego_mean 0.0285355554437026 agent_compute-ego_median 0.02847946246465047 agent_compute-ego_min 0.027914401812431135 deviation-center-line_max 1.1599509377114767 deviation-center-line_mean 0.7757507700261033 deviation-center-line_min 0.15068301088442468 deviation-heading_max 3.101374629549956 deviation-heading_mean 2.2401383974622555 deviation-heading_median 2.47523116690928 deviation-heading_min 0.42577180784190366 driven_any_max 5.369605318990088 driven_any_mean 3.996919641871306 driven_any_median 4.233829748660659 driven_any_min 1.0416533310126603 driven_lanedir_consec_max 5.1381324356468365 driven_lanedir_consec_mean 3.851739594449102 driven_lanedir_consec_min 0.74998165127742 driven_lanedir_max 5.1381324356468365 driven_lanedir_mean 3.851739594449102 driven_lanedir_median 4.161507275394201 driven_lanedir_min 0.74998165127742 in-drivable-lane_max 1.8000000000000256 in-drivable-lane_mean 0.41666666666666974 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5556826611158683, "sim_physics": 0.052646692593892416, "survival_time": 14.950000000000076, "driven_lanedir": 3.4859301645784124, "sim_render-ego": 0.006848271687825521, "in-drivable-lane": 0, "agent_compute-ego": 0.029632564385732016, "deviation-heading": 2.6663685786610194, "set_robot_commands": 0.004981449445088704, "deviation-center-line": 0.8265656888623147, "driven_lanedir_consec": 3.4859301645784124, "sim_compute_sim_state": 0.002920236587524414, "sim_compute_performance-ego": 0.003981371720631917, "sim_compute_robot_state-ego": 0.0049206884702046715}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.233829748660659, "sim_physics": 0.05576869487762451, "survival_time": 14.950000000000076, "driven_lanedir": 4.161507275394201, "sim_render-ego": 0.006963976224263509, "in-drivable-lane": 0, "agent_compute-ego": 0.028647123177846272, "deviation-heading": 2.547855895011356, "set_robot_commands": 0.0049072933197021485, "deviation-center-line": 0.8038543297518351, "driven_lanedir_consec": 4.161507275394201, "sim_compute_sim_state": 0.002909337679545085, "sim_compute_performance-ego": 0.0038805596033732095, "sim_compute_robot_state-ego": 0.005009045600891113}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.369605318990088, "sim_physics": 0.052910854816436766, "survival_time": 14.950000000000076, "driven_lanedir": 5.1381324356468365, "sim_render-ego": 0.006953737735748291, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.028774850368499756, "deviation-heading": 1.429535709411332, "set_robot_commands": 0.004902822971343994, "deviation-center-line": 0.7816175945849818, "driven_lanedir_consec": 5.1381324356468365, "sim_compute_sim_state": 0.0029389031728108725, "sim_compute_performance-ego": 0.003906764984130859, "sim_compute_robot_state-ego": 0.005029218196868896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.771070974397065, "sim_physics": 0.05647276163101196, "survival_time": 14.950000000000076, "driven_lanedir": 4.7037427184390985, "sim_render-ego": 0.00692729393641154, "in-drivable-lane": 0, "agent_compute-ego": 0.028412831624348957, "deviation-heading": 2.47523116690928, "set_robot_commands": 0.004907029469807943, "deviation-center-line": 0.5291950664174668, "driven_lanedir_consec": 4.7037427184390985, "sim_compute_sim_state": 0.0029288172721862794, "sim_compute_performance-ego": 0.0038953248659769697, "sim_compute_robot_state-ego": 0.004891244570414225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.391663133458514, "sim_physics": 0.058169101079305015, "survival_time": 14.950000000000076, "driven_lanedir": 4.300142678187957, "sim_render-ego": 0.006941885153452555, "in-drivable-lane": 0, "agent_compute-ego": 0.028936870892842612, "deviation-heading": 2.7357993843233586, "set_robot_commands": 0.00490784486134847, "deviation-center-line": 1.0868565045263496, "driven_lanedir_consec": 4.300142678187957, "sim_compute_sim_state": 0.0029448127746582032, "sim_compute_performance-ego": 0.00391800324122111, "sim_compute_robot_state-ego": 0.005047414302825928}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.650832151990608, "sim_physics": 0.05397760311762491, "survival_time": 14.950000000000076, "driven_lanedir": 3.5675738049354777, "sim_render-ego": 0.006923075517018636, "in-drivable-lane": 0, "agent_compute-ego": 0.028369998931884764, "deviation-heading": 2.8054785636927275, "set_robot_commands": 0.004922356605529785, "deviation-center-line": 0.9207053730608618, "driven_lanedir_consec": 3.5675738049354777, "sim_compute_sim_state": 0.002935818036397298, "sim_compute_performance-ego": 0.0039036003748575848, "sim_compute_robot_state-ego": 0.004904547532399496}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.738467651536784, "sim_physics": 0.053930840492248534, "survival_time": 14.950000000000076, "driven_lanedir": 4.674608953202885, "sim_render-ego": 0.006900621255238851, "in-drivable-lane": 0, "agent_compute-ego": 0.028567756811777752, "deviation-heading": 2.320485699051694, "set_robot_commands": 0.004873274167378743, "deviation-center-line": 0.7255092103210476, "driven_lanedir_consec": 4.674608953202885, "sim_compute_sim_state": 0.0029195531209309897, "sim_compute_performance-ego": 0.003902542591094971, "sim_compute_robot_state-ego": 0.005017163753509521}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0416533310126603, "sim_physics": 0.05516232282687456, "survival_time": 3.899999999999994, "driven_lanedir": 0.74998165127742, "sim_render-ego": 0.007067995193677071, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.027914401812431135, "deviation-heading": 0.42577180784190366, "set_robot_commands": 0.004957960202143743, "deviation-center-line": 0.15068301088442468, "driven_lanedir_consec": 0.74998165127742, "sim_compute_sim_state": 0.002902954052656125, "sim_compute_performance-ego": 0.003893182827876165, "sim_compute_robot_state-ego": 0.004836757977803548}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.9545996891230257, "sim_physics": 0.05306394974390666, "survival_time": 14.950000000000076, "driven_lanedir": 3.8898213969089697, "sim_render-ego": 0.006976839701334636, "in-drivable-lane": 0, "agent_compute-ego": 0.028580318291982015, "deviation-heading": 2.3214134838432083, "set_robot_commands": 0.004973169962565104, "deviation-center-line": 1.0503024000007646, "driven_lanedir_consec": 3.8898213969089697, "sim_compute_sim_state": 0.0028977155685424804, "sim_compute_performance-ego": 0.003912854989369711, "sim_compute_robot_state-ego": 0.005012690226236979}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.8995013866669663, "sim_physics": 0.0536359707514445, "survival_time": 14.950000000000076, "driven_lanedir": 3.839155285052444, "sim_render-ego": 0.0069067041079203285, "in-drivable-lane": 0, "agent_compute-ego": 0.028406904538472492, "deviation-heading": 2.2642597155861632, "set_robot_commands": 0.004894421895345052, "deviation-center-line": 0.996395853425789, "driven_lanedir_consec": 3.839155285052444, "sim_compute_sim_state": 0.002891979217529297, "sim_compute_performance-ego": 0.003882037003835042, "sim_compute_robot_state-ego": 0.004948771794637044}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 5.210908969325235, "sim_physics": 0.0533523964881897, "survival_time": 14.950000000000076, "driven_lanedir": 4.983392387261424, "sim_render-ego": 0.0068443099657694495, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.028267420132954916, "deviation-heading": 2.013467990492962, "set_robot_commands": 0.004867014884948731, "deviation-center-line": 1.1599509377114767, "driven_lanedir_consec": 4.983392387261424, "sim_compute_sim_state": 0.0028824710845947264, "sim_compute_performance-ego": 0.0038642350832621256, "sim_compute_robot_state-ego": 0.0048584230740865075}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.949244864254011, "sim_physics": 0.0545970892906189, "survival_time": 14.950000000000076, "driven_lanedir": 3.855462370843819, "sim_render-ego": 0.006926275889078776, "in-drivable-lane": 0, "agent_compute-ego": 0.028541199366251623, "deviation-heading": 3.101374629549956, "set_robot_commands": 0.004936066468556722, "deviation-center-line": 0.7759825218512469, "driven_lanedir_consec": 3.855462370843819, "sim_compute_sim_state": 0.0029079826672871907, "sim_compute_performance-ego": 0.003900241057078044, "sim_compute_robot_state-ego": 0.004960199197133382}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8417901621463952, "sim_physics": 0.053593480959534645, "survival_time": 6.399999999999985, "driven_lanedir": 1.625028394742956, "sim_render-ego": 0.00691642053425312, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.028147108852863312, "deviation-heading": 1.0012169694182358, "set_robot_commands": 0.004776282235980034, "deviation-center-line": 0.20286648349249775, "driven_lanedir_consec": 1.625028394742956, "sim_compute_sim_state": 0.0028693899512290955, "sim_compute_performance-ego": 0.0038876794278621674, "sim_compute_robot_state-ego": 0.00482572428882122}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.679138951948569, "sim_physics": 0.055309117635091144, "survival_time": 14.950000000000076, "driven_lanedir": 4.588447066530767, "sim_render-ego": 0.0068759004275004065, "in-drivable-lane": 0, "agent_compute-ego": 0.02847946246465047, "deviation-heading": 2.858921168058005, "set_robot_commands": 0.0049500171343485515, "deviation-center-line": 0.8154032255748689, "driven_lanedir_consec": 4.588447066530767, "sim_compute_sim_state": 0.00289185365041097, "sim_compute_performance-ego": 0.0038927578926086425, "sim_compute_robot_state-ego": 0.004965166250864665}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.665805633443132, "sim_physics": 0.05450016339619954, "survival_time": 14.950000000000076, "driven_lanedir": 4.213167333733872, "sim_render-ego": 0.006814424991607666, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.028354520003000896, "deviation-heading": 2.634895200082632, "set_robot_commands": 0.004878505071004232, "deviation-center-line": 0.8103733499256218, "driven_lanedir_consec": 4.213167333733872, "sim_compute_sim_state": 0.0028737966219584145, "sim_compute_performance-ego": 0.003874806563059489, "sim_compute_robot_state-ego": 0.004875064690907796}}set_robot_commands_max 0.004981449445088704 set_robot_commands_mean 0.004909033913006131 set_robot_commands_median 0.0049072933197021485 set_robot_commands_min 0.004776282235980034 sim_compute_performance-ego_max 0.003981371720631917 sim_compute_performance-ego_mean 0.0038997308150825337 sim_compute_performance-ego_median 0.0038953248659769697 sim_compute_performance-ego_min 0.0038642350832621256 sim_compute_robot_state-ego_max 0.005047414302825928 sim_compute_robot_state-ego_mean 0.004940141328507001 sim_compute_robot_state-ego_median 0.004948771794637044 sim_compute_robot_state-ego_min 0.00482572428882122 sim_compute_sim_state_max 0.0029448127746582032 sim_compute_sim_state_mean 0.0029077080972174287 sim_compute_sim_state_median 0.0029079826672871907 sim_compute_sim_state_min 0.0028693899512290955 sim_physics_max 0.058169101079305015 sim_physics_mean 0.054472735980000256 sim_physics_median 0.05397760311762491 sim_physics_min 0.052646692593892416 sim_render-ego_max 0.007067995193677071 sim_render-ego_mean 0.006919182154740023 sim_render-ego_median 0.006923075517018636 sim_render-ego_min 0.006814424991607666 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.643333333333398 survival_time_min 3.899999999999994
No reset possible 258784211Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFVI-sim-testingstep1-simulation failed no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:07:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 300, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 258454368Jeick Hincapie Barrera challenge-aido_LF-template-tensorflow aido3-LFV-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:09:23 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 258274525Thomas Hitchcox challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:02:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5728900130190617 survival_time_median 3.049999999999997 deviation-center-line_median 0.12663250504026446 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.01484260820362666 agent_compute-ego_mean 0.014515091905786056 agent_compute-ego_median 0.014535414206015096 agent_compute-ego_min 0.014182364940643313 deviation-center-line_max 0.22820877647883453 deviation-center-line_mean 0.14132521348984317 deviation-center-line_min 0.08492450847657326 deviation-heading_max 0.7204674568635022 deviation-heading_mean 0.511274559210195 deviation-heading_median 0.46418759639345647 deviation-heading_min 0.35358071986381573 driven_any_max 1.029569969954737 driven_any_mean 0.6843344650560483 driven_any_median 0.7833781665871041 driven_any_min 0.21586906071648584 driven_lanedir_consec_max 0.9241157643596049 driven_lanedir_consec_mean 0.5576745090662147 driven_lanedir_consec_min 0.19811047289692163 driven_lanedir_max 0.9241157643596049 driven_lanedir_mean 0.5576745090662147 driven_lanedir_median 0.5728900130190617 driven_lanedir_min 0.19811047289692163 in-drivable-lane_max 1.399999999999995 in-drivable-lane_mean 0.32999999999999885 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.05774781148727626, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.007227218314392926, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.01484260820362666, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.005096246118414892, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.0030474858741237694, "sim_compute_performance-ego": 0.004299911734176009, "sim_compute_robot_state-ego": 0.005294260913378572}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21586906071648584, "sim_physics": 0.06080702543258667, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19811047289692163, "sim_render-ego": 0.007240688800811768, "in-drivable-lane": 0, "agent_compute-ego": 0.014182364940643313, "deviation-heading": 0.35358071986381573, "set_robot_commands": 0.004983329772949218, "deviation-center-line": 0.08492450847657326, "driven_lanedir_consec": 0.19811047289692163, "sim_compute_sim_state": 0.002888655662536621, "sim_compute_performance-ego": 0.003975200653076172, "sim_compute_robot_state-ego": 0.00514305830001831}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0285461590131229, "sim_physics": 0.05523233155946474, "survival_time": 3.699999999999995, "driven_lanedir": 0.9241157643596049, "sim_render-ego": 0.007260686642414815, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.014535414206015096, "deviation-heading": 0.7204674568635022, "set_robot_commands": 0.004973008825972273, "deviation-center-line": 0.12663250504026446, "driven_lanedir_consec": 0.9241157643596049, "sim_compute_sim_state": 0.0030327036574080185, "sim_compute_performance-ego": 0.004090241483739905, "sim_compute_robot_state-ego": 0.0051801462431211726}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7833781665871041, "sim_physics": 0.058972362612114575, "survival_time": 3.049999999999997, "driven_lanedir": 0.7738646695799877, "sim_render-ego": 0.007301291481393283, "in-drivable-lane": 0, "agent_compute-ego": 0.014634460699362832, "deviation-heading": 0.3999540773760856, "set_robot_commands": 0.005046633423351851, "deviation-center-line": 0.22820877647883453, "driven_lanedir_consec": 0.7738646695799877, "sim_compute_sim_state": 0.00303309862730933, "sim_compute_performance-ego": 0.003956962804325292, "sim_compute_robot_state-ego": 0.005152065245831599}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36430896900879234, "sim_physics": 0.06014212220907211, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3193916254754976, "sim_render-ego": 0.007269680500030518, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01438061147928238, "deviation-heading": 0.618182945554115, "set_robot_commands": 0.005110815167427063, "deviation-center-line": 0.1026554262752819, "driven_lanedir_consec": 0.3193916254754976, "sim_compute_sim_state": 0.00302162766456604, "sim_compute_performance-ego": 0.0039559006690979, "sim_compute_robot_state-ego": 0.0051990896463394165}}set_robot_commands_max 0.005110815167427063 set_robot_commands_mean 0.00504200666162306 set_robot_commands_median 0.005046633423351851 set_robot_commands_min 0.004973008825972273 sim_compute_performance-ego_max 0.004299911734176009 sim_compute_performance-ego_mean 0.004055643468883056 sim_compute_performance-ego_median 0.003975200653076172 sim_compute_performance-ego_min 0.0039559006690979 sim_compute_robot_state-ego_max 0.005294260913378572 sim_compute_robot_state-ego_mean 0.005193724069737814 sim_compute_robot_state-ego_median 0.0051801462431211726 sim_compute_robot_state-ego_min 0.00514305830001831 sim_compute_sim_state_max 0.0030474858741237694 sim_compute_sim_state_mean 0.0030047142971887557 sim_compute_sim_state_median 0.0030327036574080185 sim_compute_sim_state_min 0.002888655662536621 sim_physics_max 0.06080702543258667 sim_physics_mean 0.058580330660102875 sim_physics_median 0.058972362612114575 sim_physics_min 0.05523233155946474 sim_render-ego_max 0.007301291481393283 sim_render-ego_mean 0.007259913147808663 sim_render-ego_median 0.007260686642414815 sim_render-ego_min 0.007227218314392926 simulation-passed 1 survival_time_max 3.699999999999995 survival_time_mean 2.599999999999998 survival_time_min 1.0000000000000002
No reset possible 257444501Frank (Chude) Qian 2019-11-19 aido3-LF-sim-validationstep1-simulation aborted no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:07:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8978997977437846 survival_time_median 7.199999999999982 deviation-center-line_median 0.49778689284343786 in-drivable-lane_median 1.0499999999999965
other stats agent_compute-ego_max 0.017353269415841976 agent_compute-ego_mean 0.017140249190942407 agent_compute-ego_median 0.017107011477152507 agent_compute-ego_min 0.01699838638305664 deviation-center-line_max 0.8034062041480641 deviation-center-line_mean 0.4621703991507273 deviation-center-line_min 0.17238591589984817 deviation-heading_max 3.9887402177435054 deviation-heading_mean 1.6273210043631243 deviation-heading_median 0.9256554896153736 deviation-heading_min 0.4191039867426454 driven_any_max 2.0769235506617463 driven_any_mean 1.4145604773313325 driven_any_median 1.5983869362773129 driven_any_min 0.3063703111368038 driven_lanedir_consec_max 2.041879048591704 driven_lanedir_consec_mean 1.0273990788592575 driven_lanedir_consec_min 0.29828162725028773 driven_lanedir_max 2.041879048591704 driven_lanedir_mean 1.0592196391801028 driven_lanedir_median 0.8978997977437846 driven_lanedir_min 0.29828162725028773 in-drivable-lane_max 4.499999999999998 in-drivable-lane_mean 1.5799999999999972 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3071926778615033, "sim_physics": 0.0571532753151907, "survival_time": 10.650000000000016, "driven_lanedir": 0.8028097880934745, "sim_render-ego": 0.007204913197548736, "in-drivable-lane": 4.499999999999998, "agent_compute-ego": 0.017353269415841976, "deviation-heading": 3.9887402177435054, "set_robot_commands": 0.0051953344837600635, "deviation-center-line": 0.538639153569491, "driven_lanedir_consec": 0.643706986489249, "sim_compute_sim_state": 0.0029815049238607915, "sim_compute_performance-ego": 0.004192699289098032, "sim_compute_robot_state-ego": 0.005186261145721579}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3063703111368038, "sim_physics": 0.06020896302329169, "survival_time": 1.800000000000001, "driven_lanedir": 0.29828162725028773, "sim_render-ego": 0.0073203908072577584, "in-drivable-lane": 0, "agent_compute-ego": 0.01705996857749091, "deviation-heading": 0.4191039867426454, "set_robot_commands": 0.004931337303585476, "deviation-center-line": 0.17238591589984817, "driven_lanedir_consec": 0.29828162725028773, "sim_compute_sim_state": 0.002907024489508735, "sim_compute_performance-ego": 0.004026995764838325, "sim_compute_robot_state-ego": 0.0052232808536953395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.0769235506617463, "sim_physics": 0.05462708711624145, "survival_time": 14.950000000000076, "driven_lanedir": 2.041879048591704, "sim_render-ego": 0.0071875667572021485, "in-drivable-lane": 0, "agent_compute-ego": 0.017107011477152507, "deviation-heading": 2.2059063985935445, "set_robot_commands": 0.005125118096669515, "deviation-center-line": 0.8034062041480641, "driven_lanedir_consec": 2.041879048591704, "sim_compute_sim_state": 0.003010550340016683, "sim_compute_performance-ego": 0.004094351132710775, "sim_compute_robot_state-ego": 0.005195439656575521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5983869362773129, "sim_physics": 0.05623960702315621, "survival_time": 5.749999999999988, "driven_lanedir": 1.2552279342212636, "sim_render-ego": 0.007260082079016644, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.01699838638305664, "deviation-heading": 0.5971989291205544, "set_robot_commands": 0.0050243958182956865, "deviation-center-line": 0.49778689284343786, "driven_lanedir_consec": 1.2552279342212636, "sim_compute_sim_state": 0.0029802799224853517, "sim_compute_performance-ego": 0.004051274838654892, "sim_compute_robot_state-ego": 0.005151203404302182}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7839289107192948, "sim_physics": 0.055917777948909335, "survival_time": 7.199999999999982, "driven_lanedir": 0.8978997977437846, "sim_render-ego": 0.007291335198614333, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.01718261010117001, "deviation-heading": 0.9256554896153736, "set_robot_commands": 0.005030549234814114, "deviation-center-line": 0.2986338292927957, "driven_lanedir_consec": 0.8978997977437846, "sim_compute_sim_state": 0.003019675612449646, "sim_compute_performance-ego": 0.004112846321529812, "sim_compute_robot_state-ego": 0.005207050177786086}}set_robot_commands_max 0.0051953344837600635 set_robot_commands_mean 0.005061346987424971 set_robot_commands_median 0.005030549234814114 set_robot_commands_min 0.004931337303585476 sim_compute_performance-ego_max 0.004192699289098032 sim_compute_performance-ego_mean 0.004095633469366368 sim_compute_performance-ego_median 0.004094351132710775 sim_compute_performance-ego_min 0.004026995764838325 sim_compute_robot_state-ego_max 0.0052232808536953395 sim_compute_robot_state-ego_mean 0.005192647047616141 sim_compute_robot_state-ego_median 0.005195439656575521 sim_compute_robot_state-ego_min 0.005151203404302182 sim_compute_sim_state_max 0.003019675612449646 sim_compute_sim_state_mean 0.002979807057664241 sim_compute_sim_state_median 0.0029815049238607915 sim_compute_sim_state_min 0.002907024489508735 sim_physics_max 0.06020896302329169 sim_physics_mean 0.05682934208535788 sim_physics_median 0.05623960702315621 sim_physics_min 0.05462708711624145 sim_render-ego_max 0.0073203908072577584 sim_render-ego_mean 0.007252857607927923 sim_render-ego_median 0.007260082079016644 sim_render-ego_min 0.0071875667572021485 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.070000000000013 survival_time_min 1.800000000000001
No reset possible 257374496András Kalapos reinforcement-learning-2240s aido3-LF-sim-testingstep1-simulation host-error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:22:33 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 438, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4496/step1-simulation-ip-172-31-43-40-10497-job25737/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-9-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 257204488YUNG-CHIEN CHOU challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:07:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8271325012475388 survival_time_median 12.050000000000036 deviation-center-line_median 0.7127838388109509 in-drivable-lane_median 0.10000000000000142
other stats agent_compute-ego_max 0.01722592835897928 agent_compute-ego_mean 0.016823840187986678 agent_compute-ego_median 0.016804180949567312 agent_compute-ego_min 0.016584736677620917 deviation-center-line_max 0.8582264444924019 deviation-center-line_mean 0.5737002851857614 deviation-center-line_min 0.13295611458874007 deviation-heading_max 4.108451039169379 deviation-heading_mean 2.010455087131574 deviation-heading_median 1.7356868566702226 deviation-heading_min 1.0804162429904245 driven_any_max 2.349132657160247 driven_any_mean 1.7062953102315828 driven_any_median 1.8830259757287644 driven_any_min 0.6699597124750526 driven_lanedir_consec_max 2.3164071432177034 driven_lanedir_consec_mean 1.626638651922849 driven_lanedir_consec_min 0.5712723633068897 driven_lanedir_max 2.3164071432177034 driven_lanedir_mean 1.626638651922849 driven_lanedir_median 1.8271325012475388 driven_lanedir_min 0.5712723633068897 in-drivable-lane_max 0.34999999999999876 in-drivable-lane_mean 0.15000000000000088 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6699597124750526, "sim_physics": 0.05966457167824546, "survival_time": 4.549999999999992, "driven_lanedir": 0.5712723633068897, "sim_render-ego": 0.008288417543683733, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.01722592835897928, "deviation-heading": 1.0804162429904245, "set_robot_commands": 0.007118680974939368, "deviation-center-line": 0.13295611458874007, "driven_lanedir_consec": 0.5712723633068897, "sim_compute_sim_state": 0.0036152352343548784, "sim_compute_performance-ego": 0.004412813501043634, "sim_compute_robot_state-ego": 0.0054135374970488495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8830259757287644, "sim_physics": 0.05925918614715956, "survival_time": 12.050000000000036, "driven_lanedir": 1.8271325012475388, "sim_render-ego": 0.007472778256998023, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.016584736677620917, "deviation-heading": 1.7356868566702226, "set_robot_commands": 0.007259568732803788, "deviation-center-line": 0.7253868418508721, "driven_lanedir_consec": 1.8271325012475388, "sim_compute_sim_state": 0.003705772621503015, "sim_compute_performance-ego": 0.004172652588840343, "sim_compute_robot_state-ego": 0.005424665712222024}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490443748295373, "sim_physics": 0.05713581720987956, "survival_time": 14.950000000000076, "driven_lanedir": 2.1572516375359228, "sim_render-ego": 0.007439750830332438, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.016692772706349692, "deviation-heading": 4.108451039169379, "set_robot_commands": 0.007225776513417562, "deviation-center-line": 0.8582264444924019, "driven_lanedir_consec": 2.1572516375359228, "sim_compute_sim_state": 0.0036474148432413737, "sim_compute_performance-ego": 0.004205381075541179, "sim_compute_robot_state-ego": 0.005319303671518962}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.280313830964312, "sim_physics": 0.0597895714173834, "survival_time": 8.299999999999983, "driven_lanedir": 1.2611296143061923, "sim_render-ego": 0.00754422739327672, "in-drivable-lane": 0, "agent_compute-ego": 0.016804180949567312, "deviation-heading": 1.1511027284967486, "set_robot_commands": 0.007238619298820036, "deviation-center-line": 0.4391481861858422, "driven_lanedir_consec": 1.2611296143061923, "sim_compute_sim_state": 0.003724419927022543, "sim_compute_performance-ego": 0.00419891311461667, "sim_compute_robot_state-ego": 0.0054131229239774035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349132657160247, "sim_physics": 0.05823847929636637, "survival_time": 14.950000000000076, "driven_lanedir": 2.3164071432177034, "sim_render-ego": 0.007508950233459473, "in-drivable-lane": 0, "agent_compute-ego": 0.01681158224741618, "deviation-heading": 1.9766185683310948, "set_robot_commands": 0.0071787611643473305, "deviation-center-line": 0.7127838388109509, "driven_lanedir_consec": 2.3164071432177034, "sim_compute_sim_state": 0.003899823824564616, "sim_compute_performance-ego": 0.004243752956390381, "sim_compute_robot_state-ego": 0.00544905424118042}}set_robot_commands_max 0.007259568732803788 set_robot_commands_mean 0.007204281336865617 set_robot_commands_median 0.007225776513417562 set_robot_commands_min 0.007118680974939368 sim_compute_performance-ego_max 0.004412813501043634 sim_compute_performance-ego_mean 0.004246702647286441 sim_compute_performance-ego_median 0.004205381075541179 sim_compute_performance-ego_min 0.004172652588840343 sim_compute_robot_state-ego_max 0.00544905424118042 sim_compute_robot_state-ego_mean 0.005403936809189532 sim_compute_robot_state-ego_median 0.0054135374970488495 sim_compute_robot_state-ego_min 0.005319303671518962 sim_compute_sim_state_max 0.003899823824564616 sim_compute_sim_state_mean 0.0037185332901372857 sim_compute_sim_state_median 0.003705772621503015 sim_compute_sim_state_min 0.0036152352343548784 sim_physics_max 0.0597895714173834 sim_physics_mean 0.05881752514980687 sim_physics_median 0.05925918614715956 sim_physics_min 0.05713581720987956 sim_render-ego_max 0.008288417543683733 sim_render-ego_mean 0.007650824851550077 sim_render-ego_median 0.007508950233459473 sim_render-ego_min 0.007439750830332438 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.960000000000033 survival_time_min 4.549999999999992
No reset possible 257174486András Kalapos reinforcement-learning-2234 aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:04:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8337241269737595 survival_time_median 3.049999999999997 deviation-center-line_median 0.18839937473893204 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.025021888707813463 agent_compute-ego_mean 0.02414760207267764 agent_compute-ego_median 0.024018340640597872 agent_compute-ego_min 0.02369991127325564 deviation-center-line_max 0.3894665189224262 deviation-center-line_mean 0.20891874033019567 deviation-center-line_min 0.10899257193665132 deviation-heading_max 2.340598483717633 deviation-heading_mean 1.278281941662819 deviation-heading_median 1.1621491300152746 deviation-heading_min 0.6056226106908649 driven_any_max 2.771186943504049 driven_any_mean 1.228807590222877 driven_any_median 0.931574988895468 driven_any_min 0.5231405370788565 driven_lanedir_consec_max 1.9869391517346124 driven_lanedir_consec_mean 0.990103161421121 driven_lanedir_consec_min 0.48078342679008457 driven_lanedir_max 1.9869391517346124 driven_lanedir_mean 0.990103161421121 driven_lanedir_median 0.8337241269737595 driven_lanedir_min 0.48078342679008457 in-drivable-lane_max 1.5499999999999945 in-drivable-lane_mean 0.34999999999999876 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.771186943504049, "sim_physics": 0.054501851922587344, "survival_time": 7.599999999999981, "driven_lanedir": 1.9869391517346124, "sim_render-ego": 0.0071371056531604965, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.025021888707813463, "deviation-heading": 2.340598483717633, "set_robot_commands": 0.00507982937913192, "deviation-center-line": 0.3894665189224262, "driven_lanedir_consec": 1.9869391517346124, "sim_compute_sim_state": 0.0029305533358925267, "sim_compute_performance-ego": 0.004239198408628765, "sim_compute_robot_state-ego": 0.005232522362156918}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1573667662489049, "sim_physics": 0.05810901323954264, "survival_time": 3.7499999999999942, "driven_lanedir": 1.00995571594537, "sim_render-ego": 0.007177438735961914, "in-drivable-lane": 0, "agent_compute-ego": 0.024105854034423828, "deviation-heading": 1.6021607714063186, "set_robot_commands": 0.005046701431274414, "deviation-center-line": 0.2462030044005195, "driven_lanedir_consec": 1.00995571594537, "sim_compute_sim_state": 0.00295591672261556, "sim_compute_performance-ego": 0.003947270711263021, "sim_compute_robot_state-ego": 0.005155789057413737}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7607687153871066, "sim_physics": 0.057037183216639926, "survival_time": 2.4499999999999993, "driven_lanedir": 0.6391133856617786, "sim_render-ego": 0.007187935770774374, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.02369991127325564, "deviation-heading": 0.6808787124840039, "set_robot_commands": 0.004971372837923011, "deviation-center-line": 0.10899257193665132, "driven_lanedir_consec": 0.6391133856617786, "sim_compute_sim_state": 0.002914477367790378, "sim_compute_performance-ego": 0.004016263144356864, "sim_compute_robot_state-ego": 0.005112993473909339}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.931574988895468, "sim_physics": 0.055066526913252034, "survival_time": 3.049999999999997, "driven_lanedir": 0.8337241269737595, "sim_render-ego": 0.007185842170089972, "in-drivable-lane": 0, "agent_compute-ego": 0.023892015707297404, "deviation-heading": 1.1621491300152746, "set_robot_commands": 0.0049553308330598424, "deviation-center-line": 0.18839937473893204, "driven_lanedir_consec": 0.8337241269737595, "sim_compute_sim_state": 0.0028741437880719293, "sim_compute_performance-ego": 0.003947738741264969, "sim_compute_robot_state-ego": 0.005110580413067927}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5231405370788565, "sim_physics": 0.0580449832810296, "survival_time": 1.800000000000001, "driven_lanedir": 0.48078342679008457, "sim_render-ego": 0.007135026984744602, "in-drivable-lane": 0, "agent_compute-ego": 0.024018340640597872, "deviation-heading": 0.6056226106908649, "set_robot_commands": 0.004905727174546983, "deviation-center-line": 0.1115322316524491, "driven_lanedir_consec": 0.48078342679008457, "sim_compute_sim_state": 0.002925097942352295, "sim_compute_performance-ego": 0.00391481982337104, "sim_compute_robot_state-ego": 0.005066593488057454}}set_robot_commands_max 0.00507982937913192 set_robot_commands_mean 0.004991792331187234 set_robot_commands_median 0.004971372837923011 set_robot_commands_min 0.004905727174546983 sim_compute_performance-ego_max 0.004239198408628765 sim_compute_performance-ego_mean 0.004013058165776931 sim_compute_performance-ego_median 0.003947738741264969 sim_compute_performance-ego_min 0.00391481982337104 sim_compute_robot_state-ego_max 0.005232522362156918 sim_compute_robot_state-ego_mean 0.005135695758921075 sim_compute_robot_state-ego_median 0.005112993473909339 sim_compute_robot_state-ego_min 0.005066593488057454 sim_compute_sim_state_max 0.00295591672261556 sim_compute_sim_state_mean 0.002920037831344538 sim_compute_sim_state_median 0.002925097942352295 sim_compute_sim_state_min 0.0028741437880719293 sim_physics_max 0.05810901323954264 sim_physics_mean 0.056551911714610305 sim_physics_median 0.057037183216639926 sim_physics_min 0.054501851922587344 sim_render-ego_max 0.007187935770774374 sim_render-ego_mean 0.007164669862946271 sim_render-ego_median 0.007177438735961914 sim_render-ego_min 0.007135026984744602 simulation-passed 1 survival_time_max 7.599999999999981 survival_time_mean 3.729999999999994 survival_time_min 1.800000000000001
No reset possible 256484262Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:14:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.886279650638051 survival_time_median 12.25000000000004 deviation-center-line_median 0.5184849208608815 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.057910099029541015 agent_compute-ego_mean 0.05020808745408911 agent_compute-ego_median 0.05477435106322879 agent_compute-ego_min 0.03116538191354403 deviation-center-line_max 1.1192436198710691 deviation-center-line_mean 0.5749478022912964 deviation-center-line_min 0.1361418199117434 deviation-heading_max 3.208301702436053 deviation-heading_mean 1.725211954675571 deviation-heading_median 1.3964953879384516 deviation-heading_min 1.108008333432107 driven_any_max 2.3491481788622592 driven_any_mean 1.7191692826791496 driven_any_median 1.9151767784421752 driven_any_min 0.6860292498882744 driven_lanedir_consec_max 2.3321948048121643 driven_lanedir_consec_mean 1.6357789597213988 driven_lanedir_consec_min 0.5925961715945751 driven_lanedir_max 2.3321948048121643 driven_lanedir_mean 1.6357789597213988 driven_lanedir_median 1.886279650638051 driven_lanedir_min 0.5925961715945751 in-drivable-lane_max 0.9500000000000136 in-drivable-lane_mean 0.2500000000000025 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6860292498882744, "sim_physics": 0.12184849605765394, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5925961715945751, "sim_render-ego": 0.013071770309120096, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.03116538191354403, "deviation-heading": 1.108008333432107, "set_robot_commands": 0.011628009939706451, "deviation-center-line": 0.1361418199117434, "driven_lanedir_consec": 0.5925961715945751, "sim_compute_sim_state": 0.005386029520342427, "sim_compute_performance-ego": 0.008082769250357023, "sim_compute_robot_state-ego": 0.009506546041016938}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9151767784421752, "sim_physics": 0.10789434179967763, "survival_time": 12.25000000000004, "driven_lanedir": 1.886279650638051, "sim_render-ego": 0.012668836360075037, "in-drivable-lane": 0, "agent_compute-ego": 0.050579068125510704, "deviation-heading": 1.52925691481952, "set_robot_commands": 0.01233848455000897, "deviation-center-line": 0.5184849208608815, "driven_lanedir_consec": 1.886279650638051, "sim_compute_sim_state": 0.005272131550068758, "sim_compute_performance-ego": 0.008031469461869221, "sim_compute_robot_state-ego": 0.009272825474641762}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.349118376874941, "sim_physics": 0.12399835904439292, "survival_time": 14.950000000000076, "driven_lanedir": 2.103570784508938, "sim_render-ego": 0.013705127239227295, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.056611537138621014, "deviation-heading": 3.208301702436053, "set_robot_commands": 0.010662768681844076, "deviation-center-line": 1.1192436198710691, "driven_lanedir_consec": 2.103570784508938, "sim_compute_sim_state": 0.005732972621917725, "sim_compute_performance-ego": 0.008214855194091797, "sim_compute_robot_state-ego": 0.010235251585642495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2963738293280973, "sim_physics": 0.1213997190906888, "survival_time": 8.399999999999984, "driven_lanedir": 1.2642533870532646, "sim_render-ego": 0.013706943818501065, "in-drivable-lane": 0, "agent_compute-ego": 0.05477435106322879, "deviation-heading": 1.3964953879384516, "set_robot_commands": 0.010639433349881851, "deviation-center-line": 0.3358626156566083, "driven_lanedir_consec": 1.2642533870532646, "sim_compute_sim_state": 0.005451081764130365, "sim_compute_performance-ego": 0.008004272267931984, "sim_compute_robot_state-ego": 0.010169410989398048}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491481788622592, "sim_physics": 0.13609755436579388, "survival_time": 14.950000000000076, "driven_lanedir": 2.3321948048121643, "sim_render-ego": 0.013979846636454263, "in-drivable-lane": 0, "agent_compute-ego": 0.057910099029541015, "deviation-heading": 1.3839974347517248, "set_robot_commands": 0.011331021785736084, "deviation-center-line": 0.7650060351561793, "driven_lanedir_consec": 2.3321948048121643, "sim_compute_sim_state": 0.005638762315114339, "sim_compute_performance-ego": 0.008412386576334635, "sim_compute_robot_state-ego": 0.010644177595774332}}set_robot_commands_max 0.01233848455000897 set_robot_commands_mean 0.011319943661435483 set_robot_commands_median 0.011331021785736084 set_robot_commands_min 0.010639433349881851 sim_compute_performance-ego_max 0.008412386576334635 sim_compute_performance-ego_mean 0.008149150550116932 sim_compute_performance-ego_median 0.008082769250357023 sim_compute_performance-ego_min 0.008004272267931984 sim_compute_robot_state-ego_max 0.010644177595774332 sim_compute_robot_state-ego_mean 0.009965642337294717 sim_compute_robot_state-ego_median 0.010169410989398048 sim_compute_robot_state-ego_min 0.009272825474641762 sim_compute_sim_state_max 0.005732972621917725 sim_compute_sim_state_mean 0.005496195554314723 sim_compute_sim_state_median 0.005451081764130365 sim_compute_sim_state_min 0.005272131550068758 sim_physics_max 0.13609755436579388 sim_physics_mean 0.12224769407164142 sim_physics_median 0.12184849605765394 sim_physics_min 0.10789434179967763 sim_render-ego_max 0.013979846636454263 sim_render-ego_mean 0.013426504872675552 sim_render-ego_median 0.013705127239227295 sim_render-ego_min 0.012668836360075037 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.040000000000036 survival_time_min 4.6499999999999915
No reset possible 256444276Riza Velioglu Uni Bielefeld aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:49 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 256324330Soroush Saryazdi challenge-aido_LF-template-random aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4838163264350306 survival_time_median 1.7000000000000008 deviation-center-line_median 0.08751730474052305 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.023772183586569393 agent_compute-ego_mean 0.021733110485524124 agent_compute-ego_median 0.021285498142242433 agent_compute-ego_min 0.01945781707763672 deviation-center-line_max 0.10683019887032848 deviation-center-line_mean 0.08719800587294524 deviation-center-line_min 0.07065220523066396 deviation-heading_max 0.5050851849885492 deviation-heading_mean 0.37472646794797326 deviation-heading_median 0.3711400756311837 deviation-heading_min 0.242154099114489 driven_any_max 1.224736399271231 driven_any_mean 0.7001682289165533 driven_any_median 0.6334906616120762 driven_any_min 0.311949329092399 driven_lanedir_consec_max 0.6642632200434848 driven_lanedir_consec_mean 0.47031102562542887 driven_lanedir_consec_min 0.28855079430839536 driven_lanedir_max 0.6642632200434848 driven_lanedir_mean 0.47031102562542887 driven_lanedir_median 0.4838163264350306 driven_lanedir_min 0.28855079430839536 in-drivable-lane_max 1.5999999999999963 in-drivable-lane_mean 0.4499999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.121831646332374, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.012600518189943751, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.022902016456310566, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.010015661899860088, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.005462949092571552, "sim_compute_performance-ego": 0.008022606372833252, "sim_compute_robot_state-ego": 0.009350932561434232}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.1056073784828186, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.010815262794494627, "in-drivable-lane": 0, "agent_compute-ego": 0.021285498142242433, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.009031224250793456, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.0047697782516479496, "sim_compute_performance-ego": 0.006045353412628174, "sim_compute_robot_state-ego": 0.00778571367263794}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.1345829823437859, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.012954361298504998, "in-drivable-lane": 0, "agent_compute-ego": 0.023772183586569393, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.010805740075952868, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.004977822303771973, "sim_compute_performance-ego": 0.0076926806393791645, "sim_compute_robot_state-ego": 0.009729483548332665}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.09379875855367692, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.010240070155409516, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.01945781707763672, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008084668487798973, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.004235380985697762, "sim_compute_performance-ego": 0.006312862771456359, "sim_compute_robot_state-ego": 0.008010965878846215}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.11029099334370006, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.012166630138050426, "in-drivable-lane": 0, "agent_compute-ego": 0.021248037164861507, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008556474338878284, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.005036462437022816, "sim_compute_performance-ego": 0.0074576247822154655, "sim_compute_robot_state-ego": 0.008430036631497469}}set_robot_commands_max 0.010805740075952868 set_robot_commands_mean 0.009298753810656734 set_robot_commands_median 0.009031224250793456 set_robot_commands_min 0.008084668487798973 sim_compute_performance-ego_max 0.008022606372833252 sim_compute_performance-ego_mean 0.007106225595702484 sim_compute_performance-ego_median 0.0074576247822154655 sim_compute_performance-ego_min 0.006045353412628174 sim_compute_robot_state-ego_max 0.009729483548332665 sim_compute_robot_state-ego_mean 0.008661426458549702 sim_compute_robot_state-ego_median 0.008430036631497469 sim_compute_robot_state-ego_min 0.00778571367263794 sim_compute_sim_state_max 0.005462949092571552 sim_compute_sim_state_mean 0.00489647861414241 sim_compute_sim_state_median 0.004977822303771973 sim_compute_sim_state_min 0.004235380985697762 sim_physics_max 0.1345829823437859 sim_physics_mean 0.11322235181127108 sim_physics_median 0.11029099334370006 sim_physics_min 0.09379875855367692 sim_render-ego_max 0.012954361298504998 sim_render-ego_mean 0.011755368515280664 sim_render-ego_median 0.012166630138050426 sim_render-ego_min 0.010240070155409516 simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 1.8899999999999997 survival_time_min 1.0000000000000002
No reset possible 256284364Soroush Saryazdi bluejay aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 256184381Soroush Saryazdi bluejay aido3-LF-sim-validationstep1-simulation failed no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:03:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 301, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 79 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
yield cie
File "experiment_manager.py", line 446, in <module>
wrap(cie)
File "experiment_manager.py", line 434, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 138, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 256044390Jeick Hincapie Barrera challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:10:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5728900130190617 survival_time_median 3.049999999999997 deviation-center-line_median 0.1287081573255118 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.025766341916976437 agent_compute-ego_mean 0.020214455221276177 agent_compute-ego_median 0.018935875814469136 agent_compute-ego_min 0.014093609956594614 deviation-center-line_max 0.36443765592383554 deviation-center-line_mean 0.1588742978783914 deviation-center-line_min 0.08393700821326386 deviation-heading_max 1.0316671781452431 deviation-heading_mean 0.5356514512770911 deviation-heading_median 0.46418759639345647 deviation-heading_min 0.2008327977683927 driven_any_max 1.0990919961264012 driven_any_mean 0.7035676322925487 driven_any_median 0.7833781665871041 driven_any_min 0.21586906071648584 driven_lanedir_consec_max 1.0280875807340986 driven_lanedir_consec_mean 0.5474505695862126 driven_lanedir_consec_min 0.19811047289692163 driven_lanedir_max 1.0280875807340986 driven_lanedir_mean 0.5474505695862126 driven_lanedir_median 0.5728900130190617 driven_lanedir_min 0.19811047289692163 in-drivable-lane_max 1.399999999999995 in-drivable-lane_mean 0.4166666666666652 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029569969954737, "sim_physics": 0.1102780283313908, "survival_time": 3.649999999999995, "driven_lanedir": 0.5728900130190617, "sim_render-ego": 0.012024098879670445, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.024824932829974448, "deviation-heading": 0.46418759639345647, "set_robot_commands": 0.009539832807567022, "deviation-center-line": 0.16420485117826172, "driven_lanedir_consec": 0.5728900130190617, "sim_compute_sim_state": 0.004838205363652478, "sim_compute_performance-ego": 0.007384045483314828, "sim_compute_robot_state-ego": 0.009948299355702857}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21586906071648584, "sim_physics": 0.07751545906066895, "survival_time": 1.0000000000000002, "driven_lanedir": 0.19811047289692163, "sim_render-ego": 0.008087420463562011, "in-drivable-lane": 0, "agent_compute-ego": 0.015729546546936035, "deviation-heading": 0.35358071986381573, "set_robot_commands": 0.006194281578063965, "deviation-center-line": 0.08492450847657326, "driven_lanedir_consec": 0.19811047289692163, "sim_compute_sim_state": 0.003552043437957764, "sim_compute_performance-ego": 0.0046234607696533205, "sim_compute_robot_state-ego": 0.015764963626861573}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0285461590131229, "sim_physics": 0.0754187654804539, "survival_time": 3.699999999999995, "driven_lanedir": 0.9241157643596049, "sim_render-ego": 0.009404246871535843, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.018262566746892157, "deviation-heading": 0.7204674568635022, "set_robot_commands": 0.006710126593306258, "deviation-center-line": 0.12663250504026446, "driven_lanedir_consec": 0.9241157643596049, "sim_compute_sim_state": 0.004070204657477302, "sim_compute_performance-ego": 0.005214955355670001, "sim_compute_robot_state-ego": 0.006677034738901499}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7833781665871041, "sim_physics": 0.07772306536064773, "survival_time": 3.049999999999997, "driven_lanedir": 0.7738646695799877, "sim_render-ego": 0.009280908303182633, "in-drivable-lane": 0, "agent_compute-ego": 0.018935875814469136, "deviation-heading": 0.3999540773760856, "set_robot_commands": 0.006698100293268923, "deviation-center-line": 0.22820877647883453, "driven_lanedir_consec": 0.7738646695799877, "sim_compute_sim_state": 0.004158844713304863, "sim_compute_performance-ego": 0.005250680642049821, "sim_compute_robot_state-ego": 0.006659265424384445}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36430896900879234, "sim_physics": 0.07312120497226715, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3193916254754976, "sim_render-ego": 0.007932119071483612, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015397951006889343, "deviation-heading": 0.618182945554115, "set_robot_commands": 0.006140001118183136, "deviation-center-line": 0.1026554262752819, "driven_lanedir_consec": 0.3193916254754976, "sim_compute_sim_state": 0.0034638643264770508, "sim_compute_performance-ego": 0.0043531134724617004, "sim_compute_robot_state-ego": 0.005851417779922485}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0127346981029353, "sim_physics": 0.07915347975653571, "survival_time": 3.699999999999995, "driven_lanedir": 0.664699798794147, "sim_render-ego": 0.01041435873186266, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.019895650245047903, "deviation-heading": 0.6957245682129789, "set_robot_commands": 0.007903807872050517, "deviation-center-line": 0.12805471035650365, "driven_lanedir_consec": 0.664699798794147, "sim_compute_sim_state": 0.004062249853804305, "sim_compute_performance-ego": 0.00597283646867082, "sim_compute_robot_state-ego": 0.007484854878606023}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5787661712418932, "sim_physics": 0.07527033118314522, "survival_time": 2.1500000000000004, "driven_lanedir": 0.5755780495920495, "sim_render-ego": 0.00944066047668457, "in-drivable-lane": 0, "agent_compute-ego": 0.017649412155151367, "deviation-heading": 0.2008327977683927, "set_robot_commands": 0.0063377979189850565, "deviation-center-line": 0.2232664765139516, "driven_lanedir_consec": 0.5755780495920495, "sim_compute_sim_state": 0.003598263097363849, "sim_compute_performance-ego": 0.005633071411487668, "sim_compute_robot_state-ego": 0.006864891495815543}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0990919961264012, "sim_physics": 0.11209759154877104, "survival_time": 3.8499999999999943, "driven_lanedir": 1.0280875807340986, "sim_render-ego": 0.01233689815967114, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02253944533211844, "deviation-heading": 1.0316671781452431, "set_robot_commands": 0.009001518224740957, "deviation-center-line": 0.25301109796403, "driven_lanedir_consec": 1.0280875807340986, "sim_compute_sim_state": 0.005097729819161552, "sim_compute_performance-ego": 0.007140020271400352, "sim_compute_robot_state-ego": 0.008798425847833807}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.34198065118955295, "sim_physics": 0.07442606728652428, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3296055640738418, "sim_render-ego": 0.009212230813914332, "in-drivable-lane": 0, "agent_compute-ego": 0.017520403039866482, "deviation-heading": 0.2910852191740013, "set_robot_commands": 0.006332208370340282, "deviation-center-line": 0.10276020650779565, "driven_lanedir_consec": 0.3296055640738418, "sim_compute_sim_state": 0.0033987555010565394, "sim_compute_performance-ego": 0.0053761416468127024, "sim_compute_robot_state-ego": 0.006733417510986328}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.30168509044195024, "sim_physics": 0.05663538896120512, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2398637996379982, "sim_render-ego": 0.012670342738811787, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.014093609956594614, "deviation-heading": 0.6213263219174483, "set_robot_commands": 0.005057078141432542, "deviation-center-line": 0.08393700821326386, "driven_lanedir_consec": 0.2398637996379982, "sim_compute_sim_state": 0.003026907260601337, "sim_compute_performance-ego": 0.004444305713360126, "sim_compute_robot_state-ego": 0.005520802277785081}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.046691039627755, "sim_physics": 0.05696358618798194, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7353781713772528, "sim_render-ego": 0.007339991532362901, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.018207884454107905, "deviation-heading": 1.022159846748188, "set_robot_commands": 0.00493026708627676, "deviation-center-line": 0.36443765592383554, "driven_lanedir_consec": 0.7353781713772528, "sim_compute_sim_state": 0.002881607451996246, "sim_compute_performance-ego": 0.004961171707549653, "sim_compute_robot_state-ego": 0.005264019037221933}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0281134464550938, "sim_physics": 0.12078790261711872, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6131669992313173, "sim_render-ego": 0.01353216507065464, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02441886445166359, "deviation-heading": 0.3935283064502115, "set_robot_commands": 0.010982013084519078, "deviation-center-line": 0.13238951415004194, "driven_lanedir_consec": 0.6131669992313173, "sim_compute_sim_state": 0.005426430366408657, "sim_compute_performance-ego": 0.007381029531989299, "sim_compute_robot_state-ego": 0.010472771147607078}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9401367212800152, "sim_physics": 0.12749218229037612, "survival_time": 3.349999999999996, "driven_lanedir": 0.4881946546804131, "sim_render-ego": 0.01389377864439096, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02550890552463816, "deviation-heading": 0.32326847163084654, "set_robot_commands": 0.011394248079897753, "deviation-center-line": 0.114696662336249, "driven_lanedir_consec": 0.4881946546804131, "sim_compute_sim_state": 0.005907122768572907, "sim_compute_performance-ego": 0.008882099123143437, "sim_compute_robot_state-ego": 0.0109068457760028}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4273559741287285, "sim_physics": 0.11092846734183176, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4020208579940019, "sim_render-ego": 0.013002020972115651, "in-drivable-lane": 0, "agent_compute-ego": 0.024465438297816684, "deviation-heading": 0.5828627869444176, "set_robot_commands": 0.00979478018624442, "deviation-center-line": 0.1287081573255118, "driven_lanedir_consec": 0.4020208579940019, "sim_compute_sim_state": 0.004886477334158761, "sim_compute_performance-ego": 0.007117387226649693, "sim_compute_robot_state-ego": 0.009479740687779018}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3552863705136616, "sim_physics": 0.14663749356423655, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3467905223469958, "sim_render-ego": 0.021564129860170422, "in-drivable-lane": 0, "agent_compute-ego": 0.025766341916976437, "deviation-heading": 0.31594347611366247, "set_robot_commands": 0.011120211693548388, "deviation-center-line": 0.1452269114354725, "driven_lanedir_consec": 0.3467905223469958, "sim_compute_sim_state": 0.00579693240504111, "sim_compute_performance-ego": 0.008011064221782068, "sim_compute_robot_state-ego": 0.01157297626618416}}set_robot_commands_max 0.011394248079897753 set_robot_commands_mean 0.00787575153656167 set_robot_commands_median 0.006710126593306258 set_robot_commands_min 0.00493026708627676 sim_compute_performance-ego_max 0.008882099123143437 sim_compute_performance-ego_mean 0.006116358869733032 sim_compute_performance-ego_median 0.005633071411487668 sim_compute_performance-ego_min 0.0043531134724617004 sim_compute_robot_state-ego_max 0.015764963626861573 sim_compute_robot_state-ego_mean 0.008533315056772973 sim_compute_robot_state-ego_median 0.007484854878606023 sim_compute_robot_state-ego_min 0.005264019037221933 sim_compute_sim_state_max 0.005907122768572907 sim_compute_sim_state_mean 0.0042777092238023146 sim_compute_sim_state_median 0.004070204657477302 sim_compute_sim_state_min 0.002881607451996246 sim_physics_max 0.14663749356423655 sim_physics_mean 0.091629934262877 sim_physics_median 0.07772306536064773 sim_physics_min 0.05663538896120512 sim_render-ego_max 0.021564129860170422 sim_render-ego_mean 0.01134235803933824 sim_render-ego_median 0.01041435873186266 sim_render-ego_min 0.007339991532362901 simulation-passed 1 survival_time_max 3.8499999999999943 survival_time_mean 2.63333333333333 survival_time_min 1.0000000000000002
No reset possible 255884308Gianmarco Bernasconi Baseline-IL-logs-tensorflow aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:03:45 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 255854322Gianmarco Bernasconi baseline-IL-sim-tensorflow aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 255834325Gianmarco Bernasconi baseline-IL-sim-tensorflow aido3-LF-sim-validationstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:54 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 255574476András Kalapos reinforcement-learning-2230-b aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:11:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.269251516988972 survival_time_median 5.14999999999999 deviation-center-line_median 0.23119195616586777 in-drivable-lane_median 0.3999999999999986
other stats agent_compute-ego_max 0.043067575425140614 agent_compute-ego_mean 0.03964554272894211 agent_compute-ego_median 0.040239461417337065 agent_compute-ego_min 0.03645398400046609 deviation-center-line_max 0.7480861527703603 deviation-center-line_mean 0.2823691502918406 deviation-center-line_min 0.0745384925705684 deviation-heading_max 4.5730740173833855 deviation-heading_mean 1.8508511647959716 deviation-heading_median 1.685677705914314 deviation-heading_min 0.428527248891684 driven_any_max 4.482090502995419 driven_any_mean 1.7858811712494844 driven_any_median 1.833183408278842 driven_any_min 0.28482465026540515 driven_lanedir_consec_max 3.618141913276894 driven_lanedir_consec_mean 1.4090122379368537 driven_lanedir_consec_min 0.2479312510598932 driven_lanedir_max 3.618141913276894 driven_lanedir_mean 1.4090122379368537 driven_lanedir_median 1.269251516988972 driven_lanedir_min 0.2479312510598932 in-drivable-lane_max 1.2500000000000178 in-drivable-lane_mean 0.5400000000000025 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9032301247786303, "sim_physics": 0.10470311343669891, "survival_time": 5.599999999999988, "driven_lanedir": 1.269251516988972, "sim_render-ego": 0.011962075318608965, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.04092454697404589, "deviation-heading": 2.1239112447016675, "set_robot_commands": 0.009265676140785216, "deviation-center-line": 0.2820082991599457, "driven_lanedir_consec": 1.269251516988972, "sim_compute_sim_state": 0.0048977477209908625, "sim_compute_performance-ego": 0.007561860339982169, "sim_compute_robot_state-ego": 0.009229225771767753}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.482090502995419, "sim_physics": 0.11637126105700352, "survival_time": 12.900000000000048, "driven_lanedir": 3.618141913276894, "sim_render-ego": 0.012901214666144791, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.043067575425140614, "deviation-heading": 4.5730740173833855, "set_robot_commands": 0.010423511497734128, "deviation-center-line": 0.7480861527703603, "driven_lanedir_consec": 3.618141913276894, "sim_compute_sim_state": 0.005469592042671618, "sim_compute_performance-ego": 0.007580853247827338, "sim_compute_robot_state-ego": 0.009636015855064689}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28482465026540515, "sim_physics": 0.11551184004003352, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2479312510598932, "sim_render-ego": 0.011325066739862616, "in-drivable-lane": 0, "agent_compute-ego": 0.03645398400046609, "deviation-heading": 0.428527248891684, "set_robot_commands": 0.008387554775584827, "deviation-center-line": 0.07602085079246111, "driven_lanedir_consec": 0.2479312510598932, "sim_compute_sim_state": 0.004794597625732422, "sim_compute_performance-ego": 0.005915024063803933, "sim_compute_robot_state-ego": 0.007578481327403675}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.833183408278842, "sim_physics": 0.10415868157321968, "survival_time": 5.14999999999999, "driven_lanedir": 1.514503729787689, "sim_render-ego": 0.012464092773141212, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.040239461417337065, "deviation-heading": 1.685677705914314, "set_robot_commands": 0.009640075628039906, "deviation-center-line": 0.23119195616586777, "driven_lanedir_consec": 1.514503729787689, "sim_compute_sim_state": 0.005155338824374005, "sim_compute_performance-ego": 0.007569412583286322, "sim_compute_robot_state-ego": 0.009666866469151766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4260771699291237, "sim_physics": 0.1133956662539778, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3952327785708185, "sim_render-ego": 0.01135427376319622, "in-drivable-lane": 0, "agent_compute-ego": 0.037542145827720905, "deviation-heading": 0.4430656070888068, "set_robot_commands": 0.009357296187302164, "deviation-center-line": 0.0745384925705684, "driven_lanedir_consec": 0.3952327785708185, "sim_compute_sim_state": 0.005024605783922919, "sim_compute_performance-ego": 0.006827576407070817, "sim_compute_robot_state-ego": 0.008535771534360689}}set_robot_commands_max 0.010423511497734128 set_robot_commands_mean 0.009414822845889247 set_robot_commands_median 0.009357296187302164 set_robot_commands_min 0.008387554775584827 sim_compute_performance-ego_max 0.007580853247827338 sim_compute_performance-ego_mean 0.007090945328394116 sim_compute_performance-ego_median 0.007561860339982169 sim_compute_performance-ego_min 0.005915024063803933 sim_compute_robot_state-ego_max 0.009666866469151766 sim_compute_robot_state-ego_mean 0.008929272191549714 sim_compute_robot_state-ego_median 0.009229225771767753 sim_compute_robot_state-ego_min 0.007578481327403675 sim_compute_sim_state_max 0.005469592042671618 sim_compute_sim_state_mean 0.005068376399538365 sim_compute_sim_state_median 0.005024605783922919 sim_compute_sim_state_min 0.004794597625732422 sim_physics_max 0.11637126105700352 sim_physics_mean 0.11082811247218669 sim_physics_median 0.1133956662539778 sim_physics_min 0.10415868157321968 sim_render-ego_max 0.012901214666144791 sim_render-ego_mean 0.01200134465219076 sim_render-ego_median 0.011962075318608965 sim_render-ego_min 0.011325066739862616 simulation-passed 1 survival_time_max 12.900000000000048 survival_time_mean 5.2400000000000055 survival_time_min 1.1000000000000003
No reset possible 254814446Frank (Chude) Qian Frank custom server test aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:08:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7032507281650768 survival_time_median 3.4499999999999957 deviation-center-line_median 0.12282247269312647 in-drivable-lane_median 0.8499999999999979
other stats agent_compute-ego_max 0.016935847469211854 agent_compute-ego_mean 0.016055599370708905 agent_compute-ego_median 0.016086506556315595 agent_compute-ego_min 0.015626783724184388 deviation-center-line_max 0.42121303987503184 deviation-center-line_mean 0.15508367990557378 deviation-center-line_min 0.06871728302693718 deviation-heading_max 1.3287964738637486 deviation-heading_mean 0.6297360108122607 deviation-heading_median 0.5203467892116386 deviation-heading_min 0.313429595724932 driven_any_max 2.8120894757093895 driven_any_mean 1.4677591085065598 driven_any_median 1.3935739544974346 driven_any_min 0.6802640719271363 driven_lanedir_consec_max 2.3254981347718413 driven_lanedir_consec_mean 0.9611276272981084 driven_lanedir_consec_min 0.5730801016559173 driven_lanedir_max 2.3254981347718413 driven_lanedir_mean 0.9611276272981084 driven_lanedir_median 0.7032507281650768 driven_lanedir_min 0.5730801016559173 in-drivable-lane_max 3.2499999999999885 in-drivable-lane_mean 1.04333333333333 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9527539998301295, "sim_physics": 0.05814954177620485, "survival_time": 4.849999999999991, "driven_lanedir": 0.7945928542625688, "sim_render-ego": 0.0071086809807217, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.016935847469211854, "deviation-heading": 1.3287964738637486, "set_robot_commands": 0.005057634766568842, "deviation-center-line": 0.18148186987925485, "driven_lanedir_consec": 0.7945928542625688, "sim_compute_sim_state": 0.002929296690164153, "sim_compute_performance-ego": 0.004148775769263199, "sim_compute_robot_state-ego": 0.005190320850647602}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3935739544974346, "sim_physics": 0.05716557088105575, "survival_time": 3.4499999999999957, "driven_lanedir": 1.3639856013725271, "sim_render-ego": 0.009459194929703424, "in-drivable-lane": 0, "agent_compute-ego": 0.01599009140678074, "deviation-heading": 0.6474682633467816, "set_robot_commands": 0.0049612245697906055, "deviation-center-line": 0.2066750927068335, "driven_lanedir_consec": 1.3639856013725271, "sim_compute_sim_state": 0.0027916915174843607, "sim_compute_performance-ego": 0.003911270611528037, "sim_compute_robot_state-ego": 0.005043631014616593}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.023616058945747, "sim_physics": 0.05656624290178407, "survival_time": 2.6499999999999986, "driven_lanedir": 0.7004966416474652, "sim_render-ego": 0.007109961419735315, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.016136520313766767, "deviation-heading": 0.3783341897296197, "set_robot_commands": 0.004910756956856206, "deviation-center-line": 0.11128551827366392, "driven_lanedir_consec": 0.7004966416474652, "sim_compute_sim_state": 0.002924005940275372, "sim_compute_performance-ego": 0.0038787239002731617, "sim_compute_robot_state-ego": 0.005094213305779223}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.71746717964497, "sim_physics": 0.05794282419135772, "survival_time": 4.149999999999993, "driven_lanedir": 1.219182576743902, "sim_render-ego": 0.007141917584890343, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.016086506556315595, "deviation-heading": 0.4164404248142567, "set_robot_commands": 0.005034880465771778, "deviation-center-line": 0.08042946337663495, "driven_lanedir_consec": 1.219182576743902, "sim_compute_sim_state": 0.0029418095048651637, "sim_compute_performance-ego": 0.0039320250591599794, "sim_compute_robot_state-ego": 0.0051673148051801935}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4724058652543208, "sim_physics": 0.05851977893284389, "survival_time": 3.4999999999999956, "driven_lanedir": 1.427788137267237, "sim_render-ego": 0.007163619995117188, "in-drivable-lane": 0, "agent_compute-ego": 0.016128832953316824, "deviation-heading": 0.8006020952993024, "set_robot_commands": 0.0049123491559709825, "deviation-center-line": 0.19701621934991373, "driven_lanedir_consec": 1.427788137267237, "sim_compute_sim_state": 0.00282566887991769, "sim_compute_performance-ego": 0.003942370414733887, "sim_compute_robot_state-ego": 0.005007702963692801}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0116833973699155, "sim_physics": 0.055959041302020736, "survival_time": 2.5999999999999988, "driven_lanedir": 0.659205093733243, "sim_render-ego": 0.007148609711573674, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.015819457861093376, "deviation-heading": 0.5203467892116386, "set_robot_commands": 0.004896833346440242, "deviation-center-line": 0.0799953567022158, "driven_lanedir_consec": 0.659205093733243, "sim_compute_sim_state": 0.0028930352284358097, "sim_compute_performance-ego": 0.0039064884185791016, "sim_compute_robot_state-ego": 0.005086747499612661}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.483993401903879, "sim_physics": 0.05647476712862651, "survival_time": 5.999999999999987, "driven_lanedir": 0.9188224826543716, "sim_render-ego": 0.008244148890177409, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.01601317524909973, "deviation-heading": 1.0986069521169373, "set_robot_commands": 0.004864245653152466, "deviation-center-line": 0.22693652952962123, "driven_lanedir_consec": 0.9188224826543716, "sim_compute_sim_state": 0.002794814109802246, "sim_compute_performance-ego": 0.003930242856343588, "sim_compute_robot_state-ego": 0.004980154832204183}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.017899420708356, "sim_physics": 0.05697082097713764, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6362626261814905, "sim_render-ego": 0.007204184165367713, "in-drivable-lane": 0.8499999999999979, "agent_compute-ego": 0.016101387830880973, "deviation-heading": 0.313429595724932, "set_robot_commands": 0.004875742472135103, "deviation-center-line": 0.11799756600196384, "driven_lanedir_consec": 0.6362626261814905, "sim_compute_sim_state": 0.002927537147815411, "sim_compute_performance-ego": 0.00390543845983652, "sim_compute_robot_state-ego": 0.005074922855083759}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0332768515241568, "sim_physics": 0.05700560335843068, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5730801016559173, "sim_render-ego": 0.007118899867219745, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.016111297427483323, "deviation-heading": 0.3249871927519725, "set_robot_commands": 0.00494660071606906, "deviation-center-line": 0.06871728302693718, "driven_lanedir_consec": 0.5730801016559173, "sim_compute_sim_state": 0.002832151808828678, "sim_compute_performance-ego": 0.003914329240906914, "sim_compute_robot_state-ego": 0.0050697056752330855}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.082337727359855, "sim_physics": 0.05306877471782543, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7032507281650768, "sim_render-ego": 0.007034849237512659, "in-drivable-lane": 0.8499999999999974, "agent_compute-ego": 0.015626783724184388, "deviation-heading": 0.4095599277644053, "set_robot_commands": 0.0048633504796911165, "deviation-center-line": 0.15970580246033564, "driven_lanedir_consec": 0.7032507281650768, "sim_compute_sim_state": 0.0027676997361359775, "sim_compute_performance-ego": 0.0039567505871808085, "sim_compute_robot_state-ego": 0.0049842507750899705}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.6802640719271363, "sim_physics": 0.06037709519669816, "survival_time": 1.850000000000001, "driven_lanedir": 0.5791703475156331, "sim_render-ego": 0.007126672847850903, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.015977079803879198, "deviation-heading": 0.5273359025639366, "set_robot_commands": 0.0050326102488749734, "deviation-center-line": 0.1484374938161593, "driven_lanedir_consec": 0.5791703475156331, "sim_compute_sim_state": 0.0029388956121496252, "sim_compute_performance-ego": 0.003958225250244141, "sim_compute_robot_state-ego": 0.005094811723038957}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0578003911188991, "sim_physics": 0.0539101519674625, "survival_time": 2.6499999999999986, "driven_lanedir": 0.6536053482591073, "sim_render-ego": 0.007028854118203217, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.01568971040113917, "deviation-heading": 0.46209211742515094, "set_robot_commands": 0.004828808442601618, "deviation-center-line": 0.09000286261314862, "driven_lanedir_consec": 0.6536053482591073, "sim_compute_sim_state": 0.0027677428047612027, "sim_compute_performance-ego": 0.003873622642373139, "sim_compute_robot_state-ego": 0.004940847180924326}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6963427072635229, "sim_physics": 0.055428168859826515, "survival_time": 4.149999999999993, "driven_lanedir": 1.2076417042546066, "sim_render-ego": 0.007062621863491564, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.016186788857701313, "deviation-heading": 0.4599345308800417, "set_robot_commands": 0.004877989550670946, "deviation-center-line": 0.12282247269312647, "driven_lanedir_consec": 1.2076417042546066, "sim_compute_sim_state": 0.0028228673590234964, "sim_compute_performance-ego": 0.003895544144044439, "sim_compute_robot_state-ego": 0.004977547978780356}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5808821245406848, "sim_physics": 0.05820900880837742, "survival_time": 3.949999999999994, "driven_lanedir": 0.6543320309866378, "sim_render-ego": 0.007118828688995747, "in-drivable-lane": 1.8999999999999937, "agent_compute-ego": 0.01621147952502287, "deviation-heading": 0.8468267581812277, "set_robot_commands": 0.004928917824467526, "deviation-center-line": 0.11353862827876562, "driven_lanedir_consec": 0.6543320309866378, "sim_compute_sim_state": 0.002885537811472446, "sim_compute_performance-ego": 0.003929998301252534, "sim_compute_robot_state-ego": 0.005071489116813563}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.8120894757093895, "sim_physics": 0.056175959832740555, "survival_time": 6.5999999999999845, "driven_lanedir": 2.3254981347718413, "sim_render-ego": 0.0070531043139371, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.015819031180757465, "deviation-heading": 0.9112789485099592, "set_robot_commands": 0.00487046530752471, "deviation-center-line": 0.42121303987503184, "driven_lanedir_consec": 2.3254981347718413, "sim_compute_sim_state": 0.002819030573873809, "sim_compute_performance-ego": 0.003908030914537834, "sim_compute_robot_state-ego": 0.005002980882471258}}set_robot_commands_max 0.005057634766568842 set_robot_commands_mean 0.0049241606637724115 set_robot_commands_median 0.004910756956856206 set_robot_commands_min 0.004828808442601618 sim_compute_performance-ego_max 0.004148775769263199 sim_compute_performance-ego_mean 0.003932789104683819 sim_compute_performance-ego_median 0.003914329240906914 sim_compute_performance-ego_min 0.003873622642373139 sim_compute_robot_state-ego_max 0.005190320850647602 sim_compute_robot_state-ego_mean 0.005052442763944568 sim_compute_robot_state-ego_median 0.0050697056752330855 sim_compute_robot_state-ego_min 0.004940847180924326 sim_compute_sim_state_max 0.0029418095048651637 sim_compute_sim_state_mean 0.002857452315000363 sim_compute_sim_state_median 0.002832151808828678 sim_compute_sim_state_min 0.0027676997361359775 sim_physics_max 0.06037709519669816 sim_physics_mean 0.05679489005549283 sim_physics_median 0.05697082097713764 sim_physics_min 0.05306877471782543 sim_render-ego_max 0.009459194929703424 sim_render-ego_mean 0.007341609907633179 sim_render-ego_median 0.007118899867219745 sim_render-ego_min 0.007028854118203217 simulation-passed 1 survival_time_max 6.5999999999999845 survival_time_mean 3.6233333333333286 survival_time_min 1.850000000000001
No reset possible 254804445Frank (Chude) Qian Frank custom server test aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:05:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2105364283336697 survival_time_median 3.7499999999999942 deviation-center-line_median 0.12456963636979916 in-drivable-lane_median 0.8999999999999968
other stats agent_compute-ego_max 0.017976205924461627 agent_compute-ego_mean 0.017263729813949136 agent_compute-ego_median 0.01713150769323852 agent_compute-ego_min 0.01695752739906311 deviation-center-line_max 0.39668951620903514 deviation-center-line_mean 0.18815408688720797 deviation-center-line_min 0.08137947202530384 deviation-heading_max 1.5481600973598888 deviation-heading_mean 0.7853631484615884 deviation-heading_median 0.7238287010113763 deviation-heading_min 0.329298874196587 driven_any_max 4.276711917174447 driven_any_mean 1.9392060421748152 driven_any_median 1.5772676570912598 driven_any_min 1.0492170954975475 driven_lanedir_consec_max 1.6716861325085306 driven_lanedir_consec_mean 1.169840886865027 driven_lanedir_consec_min 0.6625651570534187 driven_lanedir_max 1.6716861325085306 driven_lanedir_mean 1.169840886865027 driven_lanedir_median 1.2105364283336697 driven_lanedir_min 0.6625651570534187 in-drivable-lane_max 5.650000000000004 in-drivable-lane_mean 1.6199999999999988 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.132295301477061, "sim_physics": 0.05710873521607498, "survival_time": 2.8999999999999977, "driven_lanedir": 0.6625651570534187, "sim_render-ego": 0.00722760167615167, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.017976205924461627, "deviation-heading": 0.7238287010113763, "set_robot_commands": 0.004968910381711763, "deviation-center-line": 0.12456963636979916, "driven_lanedir_consec": 0.6625651570534187, "sim_compute_sim_state": 0.0028411108871986127, "sim_compute_performance-ego": 0.004117677951681203, "sim_compute_robot_state-ego": 0.005028868543690649}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.276711917174447, "sim_physics": 0.059137059681451144, "survival_time": 10.050000000000008, "driven_lanedir": 1.6716861325085306, "sim_render-ego": 0.007012689884622299, "in-drivable-lane": 5.650000000000004, "agent_compute-ego": 0.01713150769323852, "deviation-heading": 1.5481600973598888, "set_robot_commands": 0.004945813126824981, "deviation-center-line": 0.39668951620903514, "driven_lanedir_consec": 1.6716861325085306, "sim_compute_sim_state": 0.002893408732627755, "sim_compute_performance-ego": 0.0039099294747879255, "sim_compute_robot_state-ego": 0.005075951713827712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0492170954975475, "sim_physics": 0.05739549490121695, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7767754813219958, "sim_render-ego": 0.007143988059117244, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.01699773623393132, "deviation-heading": 0.329298874196587, "set_robot_commands": 0.004888507036062388, "deviation-center-line": 0.10577959576268292, "driven_lanedir_consec": 0.7767754813219958, "sim_compute_sim_state": 0.00292967833005465, "sim_compute_performance-ego": 0.003883687349466177, "sim_compute_robot_state-ego": 0.0050909977692824146}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6605382396337591, "sim_physics": 0.057785728573799135, "survival_time": 3.999999999999994, "driven_lanedir": 1.2105364283336697, "sim_render-ego": 0.007156729698181152, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.01695752739906311, "deviation-heading": 0.45463975662411493, "set_robot_commands": 0.005119714140892029, "deviation-center-line": 0.08137947202530384, "driven_lanedir_consec": 1.2105364283336697, "sim_compute_sim_state": 0.0029436230659484865, "sim_compute_performance-ego": 0.003970402479171753, "sim_compute_robot_state-ego": 0.005126157402992248}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5772676570912598, "sim_physics": 0.05718366305033366, "survival_time": 3.7499999999999942, "driven_lanedir": 1.5276412351075208, "sim_render-ego": 0.007166601816813151, "in-drivable-lane": 0, "agent_compute-ego": 0.01725567181905111, "deviation-heading": 0.8708883131159751, "set_robot_commands": 0.004984302520751953, "deviation-center-line": 0.2323522140692188, "driven_lanedir_consec": 1.5276412351075208, "sim_compute_sim_state": 0.002926476796468099, "sim_compute_performance-ego": 0.003994690577189128, "sim_compute_robot_state-ego": 0.00514378547668457}}set_robot_commands_max 0.005119714140892029 set_robot_commands_mean 0.0049814494412486225 set_robot_commands_median 0.004968910381711763 set_robot_commands_min 0.004888507036062388 sim_compute_performance-ego_max 0.004117677951681203 sim_compute_performance-ego_mean 0.003975277566459237 sim_compute_performance-ego_median 0.003970402479171753 sim_compute_performance-ego_min 0.003883687349466177 sim_compute_robot_state-ego_max 0.00514378547668457 sim_compute_robot_state-ego_mean 0.0050931521812955195 sim_compute_robot_state-ego_median 0.0050909977692824146 sim_compute_robot_state-ego_min 0.005028868543690649 sim_compute_sim_state_max 0.0029436230659484865 sim_compute_sim_state_mean 0.0029068595624595207 sim_compute_sim_state_median 0.002926476796468099 sim_compute_sim_state_min 0.0028411108871986127 sim_physics_max 0.059137059681451144 sim_physics_mean 0.057722136284575176 sim_physics_median 0.05739549490121695 sim_physics_min 0.05710873521607498 sim_render-ego_max 0.00722760167615167 sim_render-ego_mean 0.007141522226977104 sim_render-ego_median 0.007156729698181152 sim_render-ego_min 0.007012689884622299 simulation-passed 1 survival_time_max 10.050000000000008 survival_time_mean 4.659999999999998 survival_time_min 2.5999999999999988
No reset possible 254724440Bea Baselines straight aido3-LFV-sim-testingstep1-simulation aborted no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:21 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 254274239Manfred Diaz Baseline-IL-logs-tensorflow aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:38:55 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 254254396András Kalapos exp2217 aido3-LF-sim-validationstep1-simulation host-error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:07 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluator ...
stderr | Pulling scenario_maker ...
stderr | Pulling simulator ... done
stderr |
stderr | ERROR: for solution pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 254244396András Kalapos exp2217 aido3-LF-sim-validationstep1-simulation host-error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:07 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluator ...
stderr | Pulling simulator ...
stderr | Pulling scenario_maker ... done
stderr |
stderr | ERROR: for solution pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 253734255Manfred Diaz challenge-aido_LF-template-pytorch aido3-LF-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:17:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.10322938522100156 survival_time_median 14.950000000000076 deviation-center-line_median 0.3956091784874364 in-drivable-lane_median 7.150000000000034
other stats agent_compute-ego_max 0.03870104948679606 agent_compute-ego_mean 0.03663056055704753 agent_compute-ego_median 0.03622218449910482 agent_compute-ego_min 0.03437473615010579 deviation-center-line_max 0.5154731433601045 deviation-center-line_mean 0.3975998633655121 deviation-center-line_min 0.212024645512446 deviation-heading_max 6.052795078603955 deviation-heading_mean 5.873260289969701 deviation-heading_median 5.891432194693023 deviation-heading_min 5.694118692975444 driven_any_max 0.5093495154103768 driven_any_mean 0.3968001982938682 driven_any_median 0.3883303466589908 driven_any_min 0.2757002979922711 driven_lanedir_consec_max 0.23599842743885913 driven_lanedir_consec_mean 0.11166302944131948 driven_lanedir_consec_min 0.035921060804143146 driven_lanedir_max 0.23599842743885913 driven_lanedir_mean 0.11166302944131948 driven_lanedir_median 0.10322938522100156 driven_lanedir_min 0.035921060804143146 in-drivable-lane_max 7.700000000000043 in-drivable-lane_mean 7.310000000000038 in-drivable-lane_min 7.100000000000037 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3883303466589908, "sim_physics": 0.12547625064849854, "survival_time": 14.950000000000076, "driven_lanedir": 0.05261154031550208, "sim_render-ego": 0.013855752150217691, "in-drivable-lane": 7.500000000000037, "agent_compute-ego": 0.03622218449910482, "deviation-heading": 5.694118692975444, "set_robot_commands": 0.010429532527923583, "deviation-center-line": 0.37719135626771255, "driven_lanedir_consec": 0.05261154031550208, "sim_compute_sim_state": 0.005521962642669678, "sim_compute_performance-ego": 0.008343352476755777, "sim_compute_robot_state-ego": 0.010688560009002684}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5093495154103768, "sim_physics": 0.12654728174209595, "survival_time": 14.950000000000076, "driven_lanedir": 0.23599842743885913, "sim_render-ego": 0.013852895100911458, "in-drivable-lane": 7.100000000000037, "agent_compute-ego": 0.036037254333496097, "deviation-heading": 6.052795078603955, "set_robot_commands": 0.010848433176676432, "deviation-center-line": 0.4877009931998609, "driven_lanedir_consec": 0.23599842743885913, "sim_compute_sim_state": 0.005890679359436035, "sim_compute_performance-ego": 0.00824722131093343, "sim_compute_robot_state-ego": 0.010382582346598309}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2757002979922711, "sim_physics": 0.13174352248509724, "survival_time": 14.950000000000076, "driven_lanedir": 0.035921060804143146, "sim_render-ego": 0.014217296441396077, "in-drivable-lane": 7.150000000000034, "agent_compute-ego": 0.037817578315734866, "deviation-heading": 5.99902206952372, "set_robot_commands": 0.010599446296691895, "deviation-center-line": 0.5154731433601045, "driven_lanedir_consec": 0.035921060804143146, "sim_compute_sim_state": 0.005450833638509115, "sim_compute_performance-ego": 0.008097976048787436, "sim_compute_robot_state-ego": 0.010376399358113606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3599489438942099, "sim_physics": 0.14114943504333496, "survival_time": 14.950000000000076, "driven_lanedir": 0.13055473342709156, "sim_render-ego": 0.014153883457183838, "in-drivable-lane": 7.10000000000004, "agent_compute-ego": 0.03870104948679606, "deviation-heading": 5.891432194693023, "set_robot_commands": 0.010622202555338542, "deviation-center-line": 0.212024645512446, "driven_lanedir_consec": 0.13055473342709156, "sim_compute_sim_state": 0.005694387753804524, "sim_compute_performance-ego": 0.008343740304311117, "sim_compute_robot_state-ego": 0.01065103848775228}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4506718875134925, "sim_physics": 0.11139883120854696, "survival_time": 14.950000000000076, "driven_lanedir": 0.10322938522100156, "sim_render-ego": 0.012429735660552978, "in-drivable-lane": 7.700000000000043, "agent_compute-ego": 0.03437473615010579, "deviation-heading": 5.728933414052361, "set_robot_commands": 0.009507459004720052, "deviation-center-line": 0.3956091784874364, "driven_lanedir_consec": 0.10322938522100156, "sim_compute_sim_state": 0.00510173241297404, "sim_compute_performance-ego": 0.007236800193786621, "sim_compute_robot_state-ego": 0.00970329761505127}}set_robot_commands_max 0.010848433176676432 set_robot_commands_mean 0.0104014147122701 set_robot_commands_median 0.010599446296691895 set_robot_commands_min 0.009507459004720052 sim_compute_performance-ego_max 0.008343740304311117 sim_compute_performance-ego_mean 0.008053818066914877 sim_compute_performance-ego_median 0.00824722131093343 sim_compute_performance-ego_min 0.007236800193786621 sim_compute_robot_state-ego_max 0.010688560009002684 sim_compute_robot_state-ego_mean 0.010360375563303627 sim_compute_robot_state-ego_median 0.010382582346598309 sim_compute_robot_state-ego_min 0.00970329761505127 sim_compute_sim_state_max 0.005890679359436035 sim_compute_sim_state_mean 0.005531919161478678 sim_compute_sim_state_median 0.005521962642669678 sim_compute_sim_state_min 0.00510173241297404 sim_physics_max 0.14114943504333496 sim_physics_mean 0.12726306422551475 sim_physics_median 0.12654728174209595 sim_physics_min 0.11139883120854696 sim_render-ego_max 0.014217296441396077 sim_render-ego_mean 0.01370191256205241 sim_render-ego_median 0.013855752150217691 sim_render-ego_min 0.012429735660552978 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 253584346Frank (Chude) Qian Frank raw run 1 aido3-LF-sim-testingstep1-simulation error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:03:44 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 252714410Bea Baselines straight aido3-LF-sim-testingstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:17:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6428223971715386 survival_time_median 6.349999999999985 deviation-center-line_median 0.2434327349551263 in-drivable-lane_median 1.5499999999999945
other stats agent_compute-ego_max 0.024491094052791595 agent_compute-ego_mean 0.020994874295555865 agent_compute-ego_median 0.0207807794213295 agent_compute-ego_min 0.015156527927943638 deviation-center-line_max 0.6796165358324546 deviation-center-line_mean 0.31092511716802335 deviation-center-line_min 0.1713666285660812 deviation-heading_max 2.4104429956021214 deviation-heading_mean 1.110889218766428 deviation-heading_median 0.904368077667768 deviation-heading_min 0.35519524457114415 driven_any_max 1.5826885944142448 driven_any_mean 0.848401125589893 driven_any_median 0.9972846521970212 driven_any_min 0.27446984077030756 driven_lanedir_consec_max 1.239677125985382 driven_lanedir_consec_mean 0.6280075506126248 driven_lanedir_consec_min 0.26413082073262006 driven_lanedir_max 1.239677125985382 driven_lanedir_mean 0.6280075506126248 driven_lanedir_median 0.6428223971715386 driven_lanedir_min 0.26413082073262006 in-drivable-lane_max 2.8500000000000227 in-drivable-lane_mean 1.0700000000000005 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4329892855289159, "sim_physics": 0.10778466321654238, "survival_time": 2.9499999999999975, "driven_lanedir": 0.41895655267034937, "sim_render-ego": 0.013089038557925469, "in-drivable-lane": 0, "agent_compute-ego": 0.0242442114878509, "deviation-heading": 0.7560843063940643, "set_robot_commands": 0.009355844077417406, "deviation-center-line": 0.19764810458264365, "driven_lanedir_consec": 0.41895655267034937, "sim_compute_sim_state": 0.004880420232223252, "sim_compute_performance-ego": 0.0077054379350048, "sim_compute_robot_state-ego": 0.009291729684603416}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.27446984077030756, "sim_physics": 0.09759793877601625, "survival_time": 2.000000000000001, "driven_lanedir": 0.26413082073262006, "sim_render-ego": 0.010946667194366455, "in-drivable-lane": 0, "agent_compute-ego": 0.019815433025360107, "deviation-heading": 0.5441215891238315, "set_robot_commands": 0.00837969183921814, "deviation-center-line": 0.19106117228989036, "driven_lanedir_consec": 0.26413082073262006, "sim_compute_sim_state": 0.004372459650039673, "sim_compute_performance-ego": 0.0062135040760040285, "sim_compute_robot_state-ego": 0.007814592123031617}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9996918468448536, "sim_physics": 0.126519326120615, "survival_time": 6.399999999999985, "driven_lanedir": 0.710198258207154, "sim_render-ego": 0.013901930302381516, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.024491094052791595, "deviation-heading": 0.9409174277962308, "set_robot_commands": 0.012007582932710648, "deviation-center-line": 0.22977090028577793, "driven_lanedir_consec": 0.710198258207154, "sim_compute_sim_state": 0.005499396473169327, "sim_compute_performance-ego": 0.008052365854382515, "sim_compute_robot_state-ego": 0.01060546189546585}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5826885944142448, "sim_physics": 0.08176287135692557, "survival_time": 9.900000000000006, "driven_lanedir": 1.1031707649587832, "sim_render-ego": 0.009363953513328476, "in-drivable-lane": 2.8500000000000227, "agent_compute-ego": 0.017740330310783002, "deviation-heading": 0.6826459337710251, "set_robot_commands": 0.007547166612413194, "deviation-center-line": 0.6796165358324546, "driven_lanedir_consec": 1.1031707649587832, "sim_compute_sim_state": 0.0039009746879038183, "sim_compute_performance-ego": 0.0053752299511071406, "sim_compute_robot_state-ego": 0.006816416075735381}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4070653407701556, "sim_physics": 0.12104146821158272, "survival_time": 2.799999999999998, "driven_lanedir": 0.38722570498862874, "sim_render-ego": 0.012885745082582748, "in-drivable-lane": 0, "agent_compute-ego": 0.023473731109074185, "deviation-heading": 0.8824281803416928, "set_robot_commands": 0.010213017463684082, "deviation-center-line": 0.1958855672485388, "driven_lanedir_consec": 0.38722570498862874, "sim_compute_sim_state": 0.005538480622427804, "sim_compute_performance-ego": 0.008015309061322893, "sim_compute_robot_state-ego": 0.010015794209071569}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.000109872353219, "sim_physics": 0.09632894024252892, "survival_time": 6.399999999999985, "driven_lanedir": 0.6703863314709375, "sim_render-ego": 0.01122894324362278, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.0207807794213295, "deviation-heading": 1.1379660561561529, "set_robot_commands": 0.00820455327630043, "deviation-center-line": 0.1713666285660812, "driven_lanedir_consec": 0.6703863314709375, "sim_compute_sim_state": 0.004648387432098389, "sim_compute_performance-ego": 0.006866047158837318, "sim_compute_robot_state-ego": 0.008464807644486427}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.30207057117966796, "sim_physics": 0.11510490816692974, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2980187397908838, "sim_render-ego": 0.01265794731849848, "in-drivable-lane": 0, "agent_compute-ego": 0.023909208386443385, "deviation-heading": 0.35519524457114415, "set_robot_commands": 0.009939093922459804, "deviation-center-line": 0.24059704319378403, "driven_lanedir_consec": 0.2980187397908838, "sim_compute_sim_state": 0.005139045937116756, "sim_compute_performance-ego": 0.007497233013774074, "sim_compute_robot_state-ego": 0.009350277656732605}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0279771235590969, "sim_physics": 0.12148862758665596, "survival_time": 6.549999999999985, "driven_lanedir": 0.8953430699173686, "sim_render-ego": 0.012516951742973036, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.022864148816989577, "deviation-heading": 2.4104429956021214, "set_robot_commands": 0.00976491156425185, "deviation-center-line": 0.5850339250043108, "driven_lanedir_consec": 0.8953430699173686, "sim_compute_sim_state": 0.005003448661047084, "sim_compute_performance-ego": 0.0071029954284202055, "sim_compute_robot_state-ego": 0.009518346713699458}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.9972846521970212, "sim_physics": 0.09314051387816902, "survival_time": 6.349999999999985, "driven_lanedir": 0.6519133333300936, "sim_render-ego": 0.01074570745933713, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.021387481313990795, "deviation-heading": 1.517256570527567, "set_robot_commands": 0.008515684623417891, "deviation-center-line": 0.3267090317442054, "driven_lanedir_consec": 0.6519133333300936, "sim_compute_sim_state": 0.004167498566034272, "sim_compute_performance-ego": 0.006166822328342227, "sim_compute_robot_state-ego": 0.007723778251587875}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4909691557102775, "sim_physics": 0.08057462446617358, "survival_time": 3.2999999999999963, "driven_lanedir": 0.4729816831015534, "sim_render-ego": 0.009501312718246922, "in-drivable-lane": 0, "agent_compute-ego": 0.018519101720867737, "deviation-heading": 0.904368077667768, "set_robot_commands": 0.006950772169864539, "deviation-center-line": 0.2255609017292757, "driven_lanedir_consec": 0.4729816831015534, "sim_compute_sim_state": 0.003953745870879202, "sim_compute_performance-ego": 0.005623954715150775, "sim_compute_robot_state-ego": 0.007254578850486062}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0155597867850337, "sim_physics": 0.07558220486308254, "survival_time": 6.449999999999985, "driven_lanedir": 0.4741910178411497, "sim_render-ego": 0.009032946224360502, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.01793173302051633, "deviation-heading": 2.009033552138105, "set_robot_commands": 0.006937437279279842, "deviation-center-line": 0.4329193446532667, "driven_lanedir_consec": 0.4741910178411497, "sim_compute_sim_state": 0.0039644980615423635, "sim_compute_performance-ego": 0.005221827085628066, "sim_compute_robot_state-ego": 0.006695813910905705}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.995166779343191, "sim_physics": 0.08823431382967731, "survival_time": 6.349999999999985, "driven_lanedir": 0.6694668258578893, "sim_render-ego": 0.010861235340749184, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.020550602064357968, "deviation-heading": 0.9996789901704458, "set_robot_commands": 0.008269411372387504, "deviation-center-line": 0.2434327349551263, "driven_lanedir_consec": 0.6694668258578893, "sim_compute_sim_state": 0.0043989166500061514, "sim_compute_performance-ego": 0.006189473970668522, "sim_compute_robot_state-ego": 0.00798036733011561}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.5784983540714226, "sim_physics": 0.11056718922624684, "survival_time": 9.900000000000006, "driven_lanedir": 1.239677125985382, "sim_render-ego": 0.012438116651592833, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.023396118722780787, "deviation-heading": 0.7480158037000678, "set_robot_commands": 0.010158772420401524, "deviation-center-line": 0.24904267725129764, "driven_lanedir_consec": 1.239677125985382, "sim_compute_sim_state": 0.005198641256852584, "sim_compute_performance-ego": 0.007302815263921564, "sim_compute_robot_state-ego": 0.009250923840686529}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.095274237578504, "sim_physics": 0.09648080523923148, "survival_time": 6.949999999999983, "driven_lanedir": 0.6428223971715386, "sim_render-ego": 0.011157245087109025, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.02066261305225839, "deviation-heading": 2.3100334054335954, "set_robot_commands": 0.008938803089608392, "deviation-center-line": 0.3630551901762962, "driven_lanedir_consec": 0.6428223971715386, "sim_compute_sim_state": 0.004499423418113654, "sim_compute_performance-ego": 0.006399513148575378, "sim_compute_robot_state-ego": 0.008241063399280575}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5262014427424839, "sim_physics": 0.06788958821977888, "survival_time": 3.4999999999999956, "driven_lanedir": 0.5216306331650404, "sim_render-ego": 0.011052908216203965, "in-drivable-lane": 0, "agent_compute-ego": 0.015156527927943638, "deviation-heading": 0.46515014810260585, "set_robot_commands": 0.006057408877781459, "deviation-center-line": 0.3321770000073998, "driven_lanedir_consec": 0.5216306331650404, "sim_compute_sim_state": 0.0031944751739501954, "sim_compute_performance-ego": 0.004716409955705915, "sim_compute_robot_state-ego": 0.0058838674000331334}}set_robot_commands_max 0.012007582932710648 set_robot_commands_mean 0.008749343434746449 set_robot_commands_median 0.008515684623417891 set_robot_commands_min 0.006057408877781459 sim_compute_performance-ego_max 0.008052365854382515 sim_compute_performance-ego_mean 0.006563262596456361 sim_compute_performance-ego_median 0.006399513148575378 sim_compute_performance-ego_min 0.004716409955705915 sim_compute_robot_state-ego_max 0.01060546189546585 sim_compute_robot_state-ego_mean 0.008327187932394788 sim_compute_robot_state-ego_median 0.008241063399280575 sim_compute_robot_state-ego_min 0.0058838674000331334 sim_compute_sim_state_max 0.005538480622427804 sim_compute_sim_state_mean 0.004557320846226968 sim_compute_sim_state_median 0.004499423418113654 sim_compute_sim_state_min 0.0031944751739501954 sim_physics_max 0.126519326120615 sim_physics_mean 0.09867319889334376 sim_physics_median 0.09648080523923148 sim_physics_min 0.06788958821977888 sim_render-ego_max 0.013901930302381516 sim_render-ego_mean 0.011425376576885232 sim_render-ego_median 0.011157245087109025 sim_render-ego_min 0.009032946224360502 simulation-passed 1 survival_time_max 9.900000000000006 survival_time_mean 5.463333333333327 survival_time_min 2.000000000000001
No reset possible 252684414András Kalapos exp2217 aido3-LF-sim-validationstep1-simulation host-error no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:10 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluator ...
stderr | Pulling simulator ...
stderr | Pulling scenario_maker ... done
stderr |
stderr | ERROR: for solution pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for kaland/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 252314412Bea Baselines straight aido3-LFVI-sim-validationstep1-simulation success no ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:18:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.101375705130415 survival_time_median 10.25000000000001 deviation-center-line_median 0.4458896490318971 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.023952325185139973 agent_compute-ego_mean 0.023345667266449613 agent_compute-ego_median 0.02310771825836926 agent_compute-ego_min 0.022758846030090794 deviation-center-line_max 0.818496770385012 deviation-center-line_mean 0.4635644309735531 deviation-center-line_min 0.1984224380093448 deviation-heading_max 1.0091119558624635 deviation-heading_mean 0.8607739098446565 deviation-heading_median 0.8472180637462061 deviation-heading_min 0.6984721802764756 driven_any_max 2.41488962214002 driven_any_mean 1.410777409521749 driven_any_median 1.63410644262876 driven_any_min 0.3881809573070047 driven_lanedir_consec_max 2.3613676450255157 driven_lanedir_consec_mean 1.1890966443141917 driven_lanedir_consec_min 0.375295791103325 driven_lanedir_max 2.3613910903748567 driven_lanedir_mean 1.189471727989016 driven_lanedir_median 1.1029927066906156 driven_lanedir_min 0.375295791103325 in-drivable-lane_max 6.10000000000007 in-drivable-lane_mean 1.270000000000015 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.63410644262876, "sim_physics": 0.1978918912934094, "survival_time": 10.25000000000001, "driven_lanedir": 1.6282785404569635, "sim_render-ego": 0.012076160384387503, "in-drivable-lane": 0, "agent_compute-ego": 0.02310771825836926, "deviation-heading": 0.8412376023998304, "set_robot_commands": 0.009884136479075364, "deviation-center-line": 0.6121779204138462, "driven_lanedir_consec": 1.628043568992385, "sim_compute_sim_state": 0.004997462761111376, "sim_compute_performance-ego": 0.00709606961506169, "sim_compute_robot_state-ego": 0.009254281113787396, "sim_compute_robot_state-npc0": 0.008592054320544731, "sim_compute_robot_state-npc1": 0.00871531672594024, "sim_compute_robot_state-npc2": 0.008539944160275342, "sim_compute_robot_state-npc3": 0.00832711778035978}, "udem1-1-0": {"driven_any": 0.5014802794698637, "sim_physics": 0.19594106389515437, "survival_time": 3.349999999999996, "driven_lanedir": 0.47940051131931893, "sim_render-ego": 0.012376219479005728, "in-drivable-lane": 0, "agent_compute-ego": 0.02306553854871152, "deviation-heading": 1.0091119558624635, "set_robot_commands": 0.009371988808930807, "deviation-center-line": 0.24283537702766575, "driven_lanedir_consec": 0.47940051131931893, "sim_compute_sim_state": 0.005288195254197761, "sim_compute_performance-ego": 0.006937528724101053, "sim_compute_robot_state-ego": 0.00912280936739338, "sim_compute_robot_state-npc0": 0.008482256932045096, "sim_compute_robot_state-npc1": 0.008285429940294863, "sim_compute_robot_state-npc2": 0.008472236234750321, "sim_compute_robot_state-npc3": 0.008416054853752478}, "udem1-2-0": {"driven_any": 2.1152297460630964, "sim_physics": 0.1882973611354828, "survival_time": 13.200000000000053, "driven_lanedir": 1.1029927066906156, "sim_render-ego": 0.011796253197120896, "in-drivable-lane": 6.10000000000007, "agent_compute-ego": 0.022758846030090794, "deviation-heading": 0.8472180637462061, "set_robot_commands": 0.009400054360880997, "deviation-center-line": 0.4458896490318971, "driven_lanedir_consec": 1.101375705130415, "sim_compute_sim_state": 0.004935902176481305, "sim_compute_performance-ego": 0.007060398658116658, "sim_compute_robot_state-ego": 0.009262811956983624, "sim_compute_robot_state-npc0": 0.008548242576194532, "sim_compute_robot_state-npc1": 0.008323359670061054, "sim_compute_robot_state-npc2": 0.008130190047350798, "sim_compute_robot_state-npc3": 0.008114260254484234}, "udem1-3-0": {"driven_any": 2.41488962214002, "sim_physics": 0.19561211585998536, "survival_time": 14.950000000000076, "driven_lanedir": 2.3613910903748567, "sim_render-ego": 0.012573002179463704, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.023843908309936525, "deviation-heading": 0.9078297469383072, "set_robot_commands": 0.009998421669006347, "deviation-center-line": 0.818496770385012, "driven_lanedir_consec": 2.3613676450255157, "sim_compute_sim_state": 0.005081267356872559, "sim_compute_performance-ego": 0.007147395610809326, "sim_compute_robot_state-ego": 0.00920303503672282, "sim_compute_robot_state-npc0": 0.008614841302235922, "sim_compute_robot_state-npc1": 0.008551368713378906, "sim_compute_robot_state-npc2": 0.008473192850748698, "sim_compute_robot_state-npc3": 0.008443567752838135}, "udem1-4-0": {"driven_any": 0.3881809573070047, "sim_physics": 0.1813786692089505, "survival_time": 2.6999999999999984, "driven_lanedir": 0.375295791103325, "sim_render-ego": 0.012809294241446036, "in-drivable-lane": 0, "agent_compute-ego": 0.023952325185139973, "deviation-heading": 0.6984721802764756, "set_robot_commands": 0.009591265960975927, "deviation-center-line": 0.1984224380093448, "driven_lanedir_consec": 0.375295791103325, "sim_compute_sim_state": 0.00493612112822356, "sim_compute_performance-ego": 0.007093575265672471, "sim_compute_robot_state-ego": 0.009388680811281558, "sim_compute_robot_state-npc0": 0.008851466355500397, "sim_compute_robot_state-npc1": 0.008379618326822916, "sim_compute_robot_state-npc2": 0.007803029484219021, "sim_compute_robot_state-npc3": 0.008004502013877587}}set_robot_commands_max 0.009998421669006347 set_robot_commands_mean 0.009649173455773888 set_robot_commands_median 0.009591265960975927 set_robot_commands_min 0.009371988808930807 sim_compute_performance-ego_max 0.007147395610809326 sim_compute_performance-ego_mean 0.0070669935747522394 sim_compute_performance-ego_median 0.007093575265672471 sim_compute_performance-ego_min 0.006937528724101053 sim_compute_robot_state-ego_max 0.009388680811281558 sim_compute_robot_state-ego_mean 0.009246323657233756 sim_compute_robot_state-ego_median 0.009254281113787396 sim_compute_robot_state-ego_min 0.00912280936739338 sim_compute_robot_state-npc0_max 0.008851466355500397 sim_compute_robot_state-npc0_mean 0.008617772297304135 sim_compute_robot_state-npc0_median 0.008592054320544731 sim_compute_robot_state-npc0_min 0.008482256932045096 sim_compute_robot_state-npc1_max 0.00871531672594024 sim_compute_robot_state-npc1_mean 0.008451018675299595 sim_compute_robot_state-npc1_median 0.008379618326822916 sim_compute_robot_state-npc1_min 0.008285429940294863 sim_compute_robot_state-npc2_max 0.008539944160275342 sim_compute_robot_state-npc2_mean 0.008283718555468837 sim_compute_robot_state-npc2_median 0.008472236234750321 sim_compute_robot_state-npc2_min 0.007803029484219021 sim_compute_robot_state-npc3_max 0.008443567752838135 sim_compute_robot_state-npc3_mean 0.008261100531062443 sim_compute_robot_state-npc3_median 0.00832711778035978 sim_compute_robot_state-npc3_min 0.008004502013877587 sim_compute_sim_state_max 0.005288195254197761 sim_compute_sim_state_mean 0.005047789735377312 sim_compute_sim_state_median 0.004997462761111376 sim_compute_sim_state_min 0.004935902176481305 sim_physics_max 0.1978918912934094 sim_physics_mean 0.19182422027859647 sim_physics_median 0.19561211585998536 sim_physics_min 0.1813786692089505 sim_render-ego_max 0.012809294241446036 sim_render-ego_mean 0.012326185896284774 sim_render-ego_median 0.012376219479005728 sim_render-ego_min 0.011796253197120896 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.890000000000027 survival_time_min 2.6999999999999984
No reset possible 252223264Liu Sam challenge-aido_LF-template-random aido2-PREDstep1-simulation host-error yes ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:04 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 252173257Liu Sam PredictorLast aido2-PREDstep1-simulation host-error yes ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:04 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 251903265Liu Sam challenge-aido_LF-template-random aido2-PREDstep1-simulation host-error yes ip-172-31-43-40-104975 years, 8 months 5 years, 8 months 0:00:26 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 
Gianmarco Bernasconi
Lisa Rangosch 🇩🇪
c reddy 🇮🇳
Philippe Marcotte 🇨🇦
Oliver Widler
Robert Moni 🇭🇺
Aleksei Shpilman 🇷🇺
Rey Wiyatno 🇨🇦
Ramon Emiliani 🇨🇦
Moustafa Elarabi
Bea Baselines 🐤
Soroush Saryazdi 🇨🇦
Frank (Chude) Qian 🇨🇦
Mikita Sazanovich 🇷🇺
Anastasiya Nikolskaya 🇷🇺
Liam Paull 🇨🇦
Jeick Hincapie Barrera 🇨🇴
Alex Deliyannis
Basile Dura 🇨🇦
Charles Cossette 🇨🇦
Nikolaus Howe
Dong Wang 🇨🇦
Tanli Chou 🇹🇼
Bhairav Mehta
Manfred Diaz
Abderrahim Khalifa 🇨🇦
Sergio Duvan Mendoza Rojas 🇨🇴
Rick Lindstrom 🇺🇸
Thomas Hitchcox
András Kalapos
YUNG-CHIEN CHOU 🇹🇼
Riza Velioglu 🇩🇪
Liu Sam 🇹🇼