AI Driving Olympics Home Challenges Submissions Jobs

Submission 2633

Submission2633
Competingyes
Challengeaido2-LFV-sim-validation
UserAndrea Censi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22846
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessing50
User priority

22846

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
228462633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes-0:08:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.17755488838468278
agent_compute-ego_mean0.15240288644407302
agent_compute-ego_median0.14812106132507324
agent_compute-ego_min0.1389357198642779
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1474917906301993, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05718990166982015, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14799557350299977, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08671904934777154, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037823504871792264, "sim_compute_performance-ego": 0.06051652078275328, "sim_compute_robot_state-ego": 0.06581000487009685, "sim_compute_robot_state-npc0": 0.06700247746926767, "sim_compute_robot_state-npc1": 0.06862560466483787, "sim_compute_robot_state-npc2": 0.06452735265096028, "sim_compute_robot_state-npc3": 0.06447519637920239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1798582363128662, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0553582763671875, "in-drivable-lane": 0, "agent_compute-ego": 0.14812106132507324, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09095892906188964, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041527013778686526, "sim_compute_performance-ego": 0.05951970100402832, "sim_compute_robot_state-ego": 0.06276653289794921, "sim_compute_robot_state-npc0": 0.06634442329406738, "sim_compute_robot_state-npc1": 0.0697330379486084, "sim_compute_robot_state-npc2": 0.07164067268371582, "sim_compute_robot_state-npc3": 0.06951704025268554}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1732350368248789, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.061908085095255, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14940718914333145, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08969562618356001, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0374992991748609, "sim_compute_performance-ego": 0.07082227970424451, "sim_compute_robot_state-ego": 0.07192142699894152, "sim_compute_robot_state-npc0": 0.0634148120880127, "sim_compute_robot_state-npc1": 0.0668225696212367, "sim_compute_robot_state-npc2": 0.06538675019615575, "sim_compute_robot_state-npc3": 0.06416409894039757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17432209208041807, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05549545227726803, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1389357198642779, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0860226848457433, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0353407980520514, "sim_compute_performance-ego": 0.06215010111844992, "sim_compute_robot_state-ego": 0.06773116316976427, "sim_compute_robot_state-npc0": 0.06430658811255346, "sim_compute_robot_state-npc1": 0.06344874901107594, "sim_compute_robot_state-npc2": 0.063851552673533, "sim_compute_robot_state-npc3": 0.06429938726787325}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1675068395478385, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05958873885018485, "in-drivable-lane": 0, "agent_compute-ego": 0.17755488838468278, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0904221705027989, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.039251361574445455, "sim_compute_performance-ego": 0.06594703027180263, "sim_compute_robot_state-ego": 0.07235567910330636, "sim_compute_robot_state-npc0": 0.06686457565852574, "sim_compute_robot_state-npc1": 0.06242257356643677, "sim_compute_robot_state-npc2": 0.06847038439341954, "sim_compute_robot_state-npc3": 0.07189409221921648}}
set_robot_commands_max0.09095892906188964
set_robot_commands_mean0.08876369198835268
set_robot_commands_median0.08969562618356001
set_robot_commands_min0.0860226848457433
sim_compute_performance-ego_max0.07082227970424451
sim_compute_performance-ego_mean0.06379112657625574
sim_compute_performance-ego_median0.06215010111844992
sim_compute_performance-ego_min0.05951970100402832
sim_compute_robot_state-ego_max0.07235567910330636
sim_compute_robot_state-ego_mean0.06811696140801164
sim_compute_robot_state-ego_median0.06773116316976427
sim_compute_robot_state-ego_min0.06276653289794921
sim_compute_robot_state-npc0_max0.06700247746926767
sim_compute_robot_state-npc0_mean0.06558657532448539
sim_compute_robot_state-npc0_median0.06634442329406738
sim_compute_robot_state-npc0_min0.0634148120880127
sim_compute_robot_state-npc1_max0.0697330379486084
sim_compute_robot_state-npc1_mean0.06621050696243913
sim_compute_robot_state-npc1_median0.0668225696212367
sim_compute_robot_state-npc1_min0.06242257356643677
sim_compute_robot_state-npc2_max0.07164067268371582
sim_compute_robot_state-npc2_mean0.06677534251955689
sim_compute_robot_state-npc2_median0.06538675019615575
sim_compute_robot_state-npc2_min0.063851552673533
sim_compute_robot_state-npc3_max0.07189409221921648
sim_compute_robot_state-npc3_mean0.06686996301187505
sim_compute_robot_state-npc3_median0.06447519637920239
sim_compute_robot_state-npc3_min0.06416409894039757
sim_compute_sim_state_max0.041527013778686526
sim_compute_sim_state_mean0.038288395490367305
sim_compute_sim_state_median0.037823504871792264
sim_compute_sim_state_min0.0353407980520514
sim_physics_max0.1798582363128662
sim_physics_mean0.1684827990792402
sim_physics_median0.1732350368248789
sim_physics_min0.1474917906301993
sim_render-ego_max0.061908085095255
sim_render-ego_mean0.05790809085194311
sim_render-ego_median0.05718990166982015
sim_render-ego_min0.0553582763671875
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
211172633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:10:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.18026463291313077
agent_compute-ego_mean0.16680291433092545
agent_compute-ego_median0.1750034800282231
agent_compute-ego_min0.14417771602931775
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.2194281463269834, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06444881138978181, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1750034800282231, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1085559571230853, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04073879895386873, "sim_compute_performance-ego": 0.07654258056923195, "sim_compute_robot_state-ego": 0.08613808508272525, "sim_compute_robot_state-npc0": 0.07554284731547038, "sim_compute_robot_state-npc1": 0.07860416836208767, "sim_compute_robot_state-npc2": 0.07472786196955929, "sim_compute_robot_state-npc3": 0.07446683336187292}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.20434903144836425, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06643013954162598, "in-drivable-lane": 0, "agent_compute-ego": 0.1565767478942871, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10517814636230469, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04146278381347656, "sim_compute_performance-ego": 0.07114498138427734, "sim_compute_robot_state-ego": 0.07924938201904297, "sim_compute_robot_state-npc0": 0.0754024314880371, "sim_compute_robot_state-npc1": 0.07255032539367676, "sim_compute_robot_state-npc2": 0.07402278900146485, "sim_compute_robot_state-npc3": 0.07287243843078613}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1709588985694082, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05637203392229582, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14417771602931775, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09242032389891774, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03708664367073461, "sim_compute_performance-ego": 0.06529947017368518, "sim_compute_robot_state-ego": 0.06902218806116205, "sim_compute_robot_state-npc0": 0.06623543877350657, "sim_compute_robot_state-npc1": 0.06653680926875065, "sim_compute_robot_state-npc2": 0.06696141393561113, "sim_compute_robot_state-npc3": 0.06405956180472124}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.23113025592852243, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.07345211053196388, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.18026463291313077, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.1169282213042054, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04506051389476921, "sim_compute_performance-ego": 0.08211629300177851, "sim_compute_robot_state-ego": 0.09102447727058507, "sim_compute_robot_state-npc0": 0.08114040048816536, "sim_compute_robot_state-npc1": 0.08045436460760576, "sim_compute_robot_state-npc2": 0.0821246074724801, "sim_compute_robot_state-npc3": 0.08131971842126001}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.22678689445768083, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.07303336688450404, "in-drivable-lane": 0, "agent_compute-ego": 0.17799199478966848, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.1207939386367798, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04551115206309727, "sim_compute_performance-ego": 0.08283446516309466, "sim_compute_robot_state-ego": 0.09840757506234306, "sim_compute_robot_state-npc0": 0.08046126365661621, "sim_compute_robot_state-npc1": 0.08256052221570696, "sim_compute_robot_state-npc2": 0.08176023619515556, "sim_compute_robot_state-npc3": 0.08036643266677856}}
set_robot_commands_max0.1207939386367798
set_robot_commands_mean0.10877531746505856
set_robot_commands_median0.1085559571230853
set_robot_commands_min0.09242032389891774
sim_compute_performance-ego_max0.08283446516309466
sim_compute_performance-ego_mean0.07558755805841352
sim_compute_performance-ego_median0.07654258056923195
sim_compute_performance-ego_min0.06529947017368518
sim_compute_robot_state-ego_max0.09840757506234306
sim_compute_robot_state-ego_mean0.08476834149917169
sim_compute_robot_state-ego_median0.08613808508272525
sim_compute_robot_state-ego_min0.06902218806116205
sim_compute_robot_state-npc0_max0.08114040048816536
sim_compute_robot_state-npc0_mean0.07575647634435913
sim_compute_robot_state-npc0_median0.07554284731547038
sim_compute_robot_state-npc0_min0.06623543877350657
sim_compute_robot_state-npc1_max0.08256052221570696
sim_compute_robot_state-npc1_mean0.07614123796956555
sim_compute_robot_state-npc1_median0.07860416836208767
sim_compute_robot_state-npc1_min0.06653680926875065
sim_compute_robot_state-npc2_max0.0821246074724801
sim_compute_robot_state-npc2_mean0.07591938171485418
sim_compute_robot_state-npc2_median0.07472786196955929
sim_compute_robot_state-npc2_min0.06696141393561113
sim_compute_robot_state-npc3_max0.08131971842126001
sim_compute_robot_state-npc3_mean0.07461699693708376
sim_compute_robot_state-npc3_median0.07446683336187292
sim_compute_robot_state-npc3_min0.06405956180472124
sim_compute_sim_state_max0.04551115206309727
sim_compute_sim_state_mean0.04197197847918928
sim_compute_sim_state_median0.04146278381347656
sim_compute_sim_state_min0.03708664367073461
sim_physics_max0.23113025592852243
sim_physics_mean0.2105306453461918
sim_physics_median0.2194281463269834
sim_physics_min0.1709588985694082
sim_render-ego_max0.07345211053196388
sim_render-ego_mean0.0667472924540343
sim_render-ego_median0.06643013954162598
sim_render-ego_min0.05637203392229582
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
204272633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:09:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.576224177547854
survival_time_median2.6499999999999986
deviation-center-line_median0.11441348272325454
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.17425736000663355
agent_compute-ego_mean0.16745294450238496
agent_compute-ego_median0.16706158541425875
agent_compute-ego_min0.16094623671637642
deviation-center-line_max0.1591461472514269
deviation-center-line_mean0.11596609894630484
deviation-center-line_min0.08510371473961074
deviation-heading_max0.476664618733542
deviation-heading_mean0.334022300897731
deviation-heading_median0.33193430349064146
deviation-heading_min0.19231746951364015
driven_any_max1.6164397331284492
driven_any_mean1.0223266277113094
driven_any_median1.006879208370262
driven_any_min0.431219000505003
driven_lanedir_consec_max1.2450085389977108
driven_lanedir_consec_mean0.7771319802171096
driven_lanedir_consec_min0.40042409985820093
driven_lanedir_max1.2450085389977108
driven_lanedir_mean0.7771319802171096
driven_lanedir_median0.576224177547854
driven_lanedir_min0.40042409985820093
in-drivable-lane_max0.9499999999999976
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.15942503371328678, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06618073751341622, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16533269072478674, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10851263999938963, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04278131251065236, "sim_compute_performance-ego": 0.07705336246850356, "sim_compute_robot_state-ego": 0.07961217412408793, "sim_compute_robot_state-npc0": 0.07308480424701043, "sim_compute_robot_state-npc1": 0.0761765848915532, "sim_compute_robot_state-npc2": 0.07764211690650796, "sim_compute_robot_state-npc3": 0.07823272471158009}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.17055204281440148, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.0691145475094135, "in-drivable-lane": 0, "agent_compute-ego": 0.16966684964986947, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.10981475389920747, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.0419006164257343, "sim_compute_performance-ego": 0.07912017748906063, "sim_compute_robot_state-ego": 0.08476587442251352, "sim_compute_robot_state-npc0": 0.07652767804952768, "sim_compute_robot_state-npc1": 0.07706279021043044, "sim_compute_robot_state-npc2": 0.07431989449721116, "sim_compute_robot_state-npc3": 0.07809722423553467}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.18571360801395617, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.07084334524054277, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.17425736000663355, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.10775613157372724, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.04388757128464548, "sim_compute_performance-ego": 0.0783261405794244, "sim_compute_robot_state-ego": 0.08565241412112587, "sim_compute_robot_state-npc0": 0.07905452816109908, "sim_compute_robot_state-npc1": 0.07572902503766511, "sim_compute_robot_state-npc2": 0.07664643149626882, "sim_compute_robot_state-npc3": 0.07599982462431255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1725334004510807, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06943563268154482, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16706158541425875, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.10765208775484109, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.04255493079559713, "sim_compute_performance-ego": 0.07668480692030508, "sim_compute_robot_state-ego": 0.07957849623281744, "sim_compute_robot_state-npc0": 0.0756384179561953, "sim_compute_robot_state-npc1": 0.0748080845120587, "sim_compute_robot_state-npc2": 0.07552223265925541, "sim_compute_robot_state-npc3": 0.07539425016958502}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.16671811209784615, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06565724478827582, "in-drivable-lane": 0, "agent_compute-ego": 0.16094623671637642, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.10549181478994864, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.042775516156797054, "sim_compute_performance-ego": 0.07515891393025716, "sim_compute_robot_state-ego": 0.08145280237551089, "sim_compute_robot_state-npc0": 0.07533452245924208, "sim_compute_robot_state-npc1": 0.07202944932160554, "sim_compute_robot_state-npc2": 0.07648537777088306, "sim_compute_robot_state-npc3": 0.07270573686670374}}
set_robot_commands_max0.10981475389920747
set_robot_commands_mean0.10784548560342282
set_robot_commands_median0.10775613157372724
set_robot_commands_min0.10549181478994864
sim_compute_performance-ego_max0.07912017748906063
sim_compute_performance-ego_mean0.07726868027751016
sim_compute_performance-ego_median0.07705336246850356
sim_compute_performance-ego_min0.07515891393025716
sim_compute_robot_state-ego_max0.08565241412112587
sim_compute_robot_state-ego_mean0.08221235225521113
sim_compute_robot_state-ego_median0.08145280237551089
sim_compute_robot_state-ego_min0.07957849623281744
sim_compute_robot_state-npc0_max0.07905452816109908
sim_compute_robot_state-npc0_mean0.0759279901746149
sim_compute_robot_state-npc0_median0.0756384179561953
sim_compute_robot_state-npc0_min0.07308480424701043
sim_compute_robot_state-npc1_max0.07706279021043044
sim_compute_robot_state-npc1_mean0.0751611867946626
sim_compute_robot_state-npc1_median0.07572902503766511
sim_compute_robot_state-npc1_min0.07202944932160554
sim_compute_robot_state-npc2_max0.07764211690650796
sim_compute_robot_state-npc2_mean0.07612321066602527
sim_compute_robot_state-npc2_median0.07648537777088306
sim_compute_robot_state-npc2_min0.07431989449721116
sim_compute_robot_state-npc3_max0.07823272471158009
sim_compute_robot_state-npc3_mean0.0760859521215432
sim_compute_robot_state-npc3_median0.07599982462431255
sim_compute_robot_state-npc3_min0.07270573686670374
sim_compute_sim_state_max0.04388757128464548
sim_compute_sim_state_mean0.042779989434685264
sim_compute_sim_state_median0.042775516156797054
sim_compute_sim_state_min0.0419006164257343
sim_physics_max0.18571360801395617
sim_physics_mean0.17098843941811426
sim_physics_median0.17055204281440148
sim_physics_min0.15942503371328678
sim_render-ego_max0.07084334524054277
sim_render-ego_mean0.06824630154663862
sim_render-ego_median0.0691145475094135
sim_render-ego_min0.06565724478827582
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.609999999999998
survival_time_min1.3000000000000005
204132633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationhost-errorno-0:09:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
199122633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationerrorno-0:00:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
194582633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:07:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14790151516596475
agent_compute-ego_mean0.13652684552275088
agent_compute-ego_median0.13086586489396937
agent_compute-ego_min0.128153535452756
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03133376139514851, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05288203257434773, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1301090672331036, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08475075127943507, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03386105681365391, "sim_compute_performance-ego": 0.05805038056283627, "sim_compute_robot_state-ego": 0.0591962382478534, "sim_compute_robot_state-npc0": 0.05993849376462541, "sim_compute_robot_state-npc1": 0.05851918346477005, "sim_compute_robot_state-npc2": 0.05871943707736033, "sim_compute_robot_state-npc3": 0.05951376681057912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03238215229728005, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05408658222718672, "in-drivable-lane": 0, "agent_compute-ego": 0.128153535452756, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08245568925684149, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03166161342100664, "sim_compute_performance-ego": 0.05689022757790305, "sim_compute_robot_state-ego": 0.05764967745000666, "sim_compute_robot_state-npc0": 0.057473670352589, "sim_compute_robot_state-npc1": 0.059358818964524704, "sim_compute_robot_state-npc2": 0.05804805863987316, "sim_compute_robot_state-npc3": 0.057703169909390534}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03588499493069119, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.058660591973198783, "in-drivable-lane": 0, "agent_compute-ego": 0.1456042448679606, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09350914425320096, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.036991082297431095, "sim_compute_performance-ego": 0.06690294477674696, "sim_compute_robot_state-ego": 0.0706840303209093, "sim_compute_robot_state-npc0": 0.06703113979763455, "sim_compute_robot_state-npc1": 0.067459593878852, "sim_compute_robot_state-npc2": 0.0641013675265842, "sim_compute_robot_state-npc3": 0.06405782699584961}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.035852079590161644, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06045270959536234, "in-drivable-lane": 0, "agent_compute-ego": 0.14790151516596475, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0964652995268504, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034712026516596474, "sim_compute_performance-ego": 0.06431900958220164, "sim_compute_robot_state-ego": 0.06529965500036876, "sim_compute_robot_state-npc0": 0.06512875358263652, "sim_compute_robot_state-npc1": 0.06534456213315327, "sim_compute_robot_state-npc2": 0.0649724652369817, "sim_compute_robot_state-npc3": 0.06611625850200653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.034605808117810416, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05265237653956694, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13086586489396937, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08109685252694522, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.035202576833612775, "sim_compute_performance-ego": 0.05951055358437931, "sim_compute_robot_state-ego": 0.06329700175453634, "sim_compute_robot_state-npc0": 0.057747073033276725, "sim_compute_robot_state-npc1": 0.061567359110888314, "sim_compute_robot_state-npc2": 0.06071210258147296, "sim_compute_robot_state-npc3": 0.06150550351423376}}
set_robot_commands_max0.0964652995268504
set_robot_commands_mean0.08765554736865463
set_robot_commands_median0.08475075127943507
set_robot_commands_min0.08109685252694522
sim_compute_performance-ego_max0.06690294477674696
sim_compute_performance-ego_mean0.06113462321681344
sim_compute_performance-ego_median0.05951055358437931
sim_compute_performance-ego_min0.05689022757790305
sim_compute_robot_state-ego_max0.0706840303209093
sim_compute_robot_state-ego_mean0.0632253205547349
sim_compute_robot_state-ego_median0.06329700175453634
sim_compute_robot_state-ego_min0.05764967745000666
sim_compute_robot_state-npc0_max0.06703113979763455
sim_compute_robot_state-npc0_mean0.06146382610615244
sim_compute_robot_state-npc0_median0.05993849376462541
sim_compute_robot_state-npc0_min0.057473670352589
sim_compute_robot_state-npc1_max0.067459593878852
sim_compute_robot_state-npc1_mean0.062449903510437665
sim_compute_robot_state-npc1_median0.061567359110888314
sim_compute_robot_state-npc1_min0.05851918346477005
sim_compute_robot_state-npc2_max0.0649724652369817
sim_compute_robot_state-npc2_mean0.06131068621245447
sim_compute_robot_state-npc2_median0.06071210258147296
sim_compute_robot_state-npc2_min0.05804805863987316
sim_compute_robot_state-npc3_max0.06611625850200653
sim_compute_robot_state-npc3_mean0.06177930514641191
sim_compute_robot_state-npc3_median0.06150550351423376
sim_compute_robot_state-npc3_min0.057703169909390534
sim_compute_sim_state_max0.036991082297431095
sim_compute_sim_state_mean0.034485671176460175
sim_compute_sim_state_median0.034712026516596474
sim_compute_sim_state_min0.03166161342100664
sim_physics_max0.03588499493069119
sim_physics_mean0.03401175926621837
sim_physics_median0.034605808117810416
sim_physics_min0.03133376139514851
sim_render-ego_max0.06045270959536234
sim_render-ego_mean0.0557468585819325
sim_render-ego_median0.05408658222718672
sim_render-ego_min0.05265237653956694
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
187162633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:09:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14203124537187464
agent_compute-ego_mean0.1377749662644115
agent_compute-ego_median0.13822298679711684
agent_compute-ego_min0.13264168392528186
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.023141150204640516, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.058370153858976544, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13822298679711684, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07383729376882878, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03353184574055222, "sim_compute_performance-ego": 0.058626804711683744, "sim_compute_robot_state-ego": 0.05863653488878934, "sim_compute_robot_state-npc0": 0.06556962571054134, "sim_compute_robot_state-npc1": 0.061537090337501384, "sim_compute_robot_state-npc2": 0.05985524069588139, "sim_compute_robot_state-npc3": 0.05974539720787192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.024744689464569092, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06132635745135221, "in-drivable-lane": 0, "agent_compute-ego": 0.13264168392528186, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07324117963964288, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.0339034687389027, "sim_compute_performance-ego": 0.05874891172755848, "sim_compute_robot_state-ego": 0.06030205163088712, "sim_compute_robot_state-npc0": 0.06544527140530673, "sim_compute_robot_state-npc1": 0.06098102981393987, "sim_compute_robot_state-npc2": 0.06043065136129206, "sim_compute_robot_state-npc3": 0.0632889054038308}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02460714446173774, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06210232310824925, "in-drivable-lane": 0, "agent_compute-ego": 0.13600686921013727, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07736303541395399, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03538399272494846, "sim_compute_performance-ego": 0.05983261532253689, "sim_compute_robot_state-ego": 0.06141135427686903, "sim_compute_robot_state-npc0": 0.0669692145453559, "sim_compute_robot_state-npc1": 0.060541825824313694, "sim_compute_robot_state-npc2": 0.059778192308213976, "sim_compute_robot_state-npc3": 0.06134976281060113}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.026064058144887287, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06317021449406941, "in-drivable-lane": 0, "agent_compute-ego": 0.1399720460176468, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07693653305371602, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034862314661343895, "sim_compute_performance-ego": 0.061992461482683815, "sim_compute_robot_state-ego": 0.06299878160158794, "sim_compute_robot_state-npc0": 0.07073256870110829, "sim_compute_robot_state-npc1": 0.06553052365779877, "sim_compute_robot_state-npc2": 0.06159096956253052, "sim_compute_robot_state-npc3": 0.06265198191006978}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.023742847582873174, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06121952744091258, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14203124537187464, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07652425765991211, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0341687518007615, "sim_compute_performance-ego": 0.059959232807159424, "sim_compute_robot_state-ego": 0.06019243773292093, "sim_compute_robot_state-npc0": 0.06611485341015984, "sim_compute_robot_state-npc1": 0.06247784810907701, "sim_compute_robot_state-npc2": 0.06006242247188792, "sim_compute_robot_state-npc3": 0.06122515131445492}}
set_robot_commands_max0.07736303541395399
set_robot_commands_mean0.07558045990721075
set_robot_commands_median0.07652425765991211
set_robot_commands_min0.07324117963964288
sim_compute_performance-ego_max0.061992461482683815
sim_compute_performance-ego_mean0.05983200521032447
sim_compute_performance-ego_median0.05983261532253689
sim_compute_performance-ego_min0.058626804711683744
sim_compute_robot_state-ego_max0.06299878160158794
sim_compute_robot_state-ego_mean0.060708232026210875
sim_compute_robot_state-ego_median0.06030205163088712
sim_compute_robot_state-ego_min0.05863653488878934
sim_compute_robot_state-npc0_max0.07073256870110829
sim_compute_robot_state-npc0_mean0.06696630675449441
sim_compute_robot_state-npc0_median0.06611485341015984
sim_compute_robot_state-npc0_min0.06544527140530673
sim_compute_robot_state-npc1_max0.06553052365779877
sim_compute_robot_state-npc1_mean0.062213663548526144
sim_compute_robot_state-npc1_median0.061537090337501384
sim_compute_robot_state-npc1_min0.060541825824313694
sim_compute_robot_state-npc2_max0.06159096956253052
sim_compute_robot_state-npc2_mean0.06034349527996117
sim_compute_robot_state-npc2_median0.06006242247188792
sim_compute_robot_state-npc2_min0.059778192308213976
sim_compute_robot_state-npc3_max0.0632889054038308
sim_compute_robot_state-npc3_mean0.06165223972936571
sim_compute_robot_state-npc3_median0.06134976281060113
sim_compute_robot_state-npc3_min0.05974539720787192
sim_compute_sim_state_max0.03538399272494846
sim_compute_sim_state_mean0.03437007473330176
sim_compute_sim_state_median0.0341687518007615
sim_compute_sim_state_min0.03353184574055222
sim_physics_max0.026064058144887287
sim_physics_mean0.024459977971741563
sim_physics_median0.02460714446173774
sim_physics_min0.023141150204640516
sim_render-ego_max0.06317021449406941
sim_render-ego_mean0.06123771527071199
sim_render-ego_median0.06132635745135221
sim_render-ego_min0.058370153858976544
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
183722633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:09:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14976226932862224
agent_compute-ego_mean0.1442080439089069
agent_compute-ego_median0.14698432286580404
agent_compute-ego_min0.13453328384543364
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.023403059761479217, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05841221899356482, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13453328384543364, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07449702046952157, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.032304624341568854, "sim_compute_performance-ego": 0.05970725473367943, "sim_compute_robot_state-ego": 0.05985953223030522, "sim_compute_robot_state-npc0": 0.06324851737832124, "sim_compute_robot_state-npc1": 0.06096129147511608, "sim_compute_robot_state-npc2": 0.0613542007950117, "sim_compute_robot_state-npc3": 0.06025030927838019}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.025281765244223858, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06155372749675403, "in-drivable-lane": 0, "agent_compute-ego": 0.14064147797497836, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07843495499004018, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03463977033441717, "sim_compute_performance-ego": 0.06417047435587103, "sim_compute_robot_state-ego": 0.06552326679229736, "sim_compute_robot_state-npc0": 0.07140357385982167, "sim_compute_robot_state-npc1": 0.06442554972388527, "sim_compute_robot_state-npc2": 0.06342228976162997, "sim_compute_robot_state-npc3": 0.06373090093786066}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.024870517518785263, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06383079952663845, "in-drivable-lane": 0, "agent_compute-ego": 0.14698432286580404, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07699254353841146, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.035516648822360566, "sim_compute_performance-ego": 0.06443791389465332, "sim_compute_robot_state-ego": 0.06728428734673395, "sim_compute_robot_state-npc0": 0.07269156244066026, "sim_compute_robot_state-npc1": 0.06869064966837565, "sim_compute_robot_state-npc2": 0.06696831915113662, "sim_compute_robot_state-npc3": 0.0660081598493788}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025914266705513, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06493620077768962, "in-drivable-lane": 0, "agent_compute-ego": 0.14911886552969614, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07699903349081676, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03669876356919607, "sim_compute_performance-ego": 0.06511519849300385, "sim_compute_robot_state-ego": 0.06417083243529002, "sim_compute_robot_state-npc0": 0.0731264998515447, "sim_compute_robot_state-npc1": 0.067579319079717, "sim_compute_robot_state-npc2": 0.066117063164711, "sim_compute_robot_state-npc3": 0.0659509797890981}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02620144100750194, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06413500799852259, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14976226932862224, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07718064504511216, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03545918534783756, "sim_compute_performance-ego": 0.06365077986436732, "sim_compute_robot_state-ego": 0.06210393765393425, "sim_compute_robot_state-npc0": 0.07007145180421717, "sim_compute_robot_state-npc1": 0.06656809764749863, "sim_compute_robot_state-npc2": 0.0631223531330333, "sim_compute_robot_state-npc3": 0.06554226664935842}}
set_robot_commands_max0.07843495499004018
set_robot_commands_mean0.07682083950678043
set_robot_commands_median0.07699903349081676
set_robot_commands_min0.07449702046952157
sim_compute_performance-ego_max0.06511519849300385
sim_compute_performance-ego_mean0.06341632426831498
sim_compute_performance-ego_median0.06417047435587103
sim_compute_performance-ego_min0.05970725473367943
sim_compute_robot_state-ego_max0.06728428734673395
sim_compute_robot_state-ego_mean0.06378837129171215
sim_compute_robot_state-ego_median0.06417083243529002
sim_compute_robot_state-ego_min0.05985953223030522
sim_compute_robot_state-npc0_max0.0731264998515447
sim_compute_robot_state-npc0_mean0.070108321066913
sim_compute_robot_state-npc0_median0.07140357385982167
sim_compute_robot_state-npc0_min0.06324851737832124
sim_compute_robot_state-npc1_max0.06869064966837565
sim_compute_robot_state-npc1_mean0.06564498151891854
sim_compute_robot_state-npc1_median0.06656809764749863
sim_compute_robot_state-npc1_min0.06096129147511608
sim_compute_robot_state-npc2_max0.06696831915113662
sim_compute_robot_state-npc2_mean0.06419684520110451
sim_compute_robot_state-npc2_median0.06342228976162997
sim_compute_robot_state-npc2_min0.0613542007950117
sim_compute_robot_state-npc3_max0.0660081598493788
sim_compute_robot_state-npc3_mean0.06429652330081523
sim_compute_robot_state-npc3_median0.06554226664935842
sim_compute_robot_state-npc3_min0.06025030927838019
sim_compute_sim_state_max0.03669876356919607
sim_compute_sim_state_mean0.03492379848307604
sim_compute_sim_state_median0.03545918534783756
sim_compute_sim_state_min0.032304624341568854
sim_physics_max0.02620144100750194
sim_physics_mean0.025134210047500653
sim_physics_median0.025281765244223858
sim_physics_min0.023403059761479217
sim_render-ego_max0.06493620077768962
sim_render-ego_mean0.0625735909586339
sim_render-ego_median0.06383079952663845
sim_render-ego_min0.05841221899356482
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
180402633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno-0:06:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.1263368855351987
agent_compute-ego_mean0.0978445445994702
agent_compute-ego_median0.08549972942897252
agent_compute-ego_min0.0850083449530223
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.02419304847717285, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.05477450204932171, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1263368855351987, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07672716223675272, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.031475315923276154, "sim_compute_performance-ego": 0.05690766417461893, "sim_compute_robot_state-ego": 0.05880797427633534, "sim_compute_robot_state-npc0": 0.05470300757366678, "sim_compute_robot_state-npc1": 0.058055183161859925, "sim_compute_robot_state-npc2": 0.05707434985948646, "sim_compute_robot_state-npc3": 0.05732480339382006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.025288977930622715, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.04501246252367573, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.10718272578331732, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.06331813335418701, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.026733782983595324, "sim_compute_performance-ego": 0.045951789425265406, "sim_compute_robot_state-ego": 0.04890349603468372, "sim_compute_robot_state-npc0": 0.05011940002441406, "sim_compute_robot_state-npc1": 0.04693943454373267, "sim_compute_robot_state-npc2": 0.04783558460973924, "sim_compute_robot_state-npc3": 0.04723806919590119}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.018472024372645782, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.037575176783970425, "in-drivable-lane": 0, "agent_compute-ego": 0.08549972942897252, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.05413964816502163, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.02181039537702288, "sim_compute_performance-ego": 0.03730886323111398, "sim_compute_robot_state-ego": 0.03921733583722796, "sim_compute_robot_state-npc0": 0.03862942968096052, "sim_compute_robot_state-npc1": 0.03805889402117048, "sim_compute_robot_state-npc2": 0.03799165998186384, "sim_compute_robot_state-npc3": 0.038495847157069614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.016615193230765206, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.0370413030896868, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08519503729684012, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.05419431413922991, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.02184183256966727, "sim_compute_performance-ego": 0.037221009390694754, "sim_compute_robot_state-ego": 0.03909575598580497, "sim_compute_robot_state-npc0": 0.03904054505484445, "sim_compute_robot_state-npc1": 0.0379922662462507, "sim_compute_robot_state-npc2": 0.03800415992736816, "sim_compute_robot_state-npc3": 0.038527911049979074}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.018479649982755145, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03734195800054641, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.0850083449530223, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.054140658605666386, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.021621813849797323, "sim_compute_performance-ego": 0.03714844158717564, "sim_compute_robot_state-ego": 0.038813636416480654, "sim_compute_robot_state-npc0": 0.0389927795955113, "sim_compute_robot_state-npc1": 0.03803778830028716, "sim_compute_robot_state-npc2": 0.037969664921836246, "sim_compute_robot_state-npc3": 0.038608187720889135}}
set_robot_commands_max0.07672716223675272
set_robot_commands_mean0.06050398330017152
set_robot_commands_median0.05419431413922991
set_robot_commands_min0.05413964816502163
sim_compute_performance-ego_max0.05690766417461893
sim_compute_performance-ego_mean0.04290755356177374
sim_compute_performance-ego_median0.03730886323111398
sim_compute_performance-ego_min0.03714844158717564
sim_compute_robot_state-ego_max0.05880797427633534
sim_compute_robot_state-ego_mean0.04496763971010653
sim_compute_robot_state-ego_median0.03921733583722796
sim_compute_robot_state-ego_min0.038813636416480654
sim_compute_robot_state-npc0_max0.05470300757366678
sim_compute_robot_state-npc0_mean0.04429703238587942
sim_compute_robot_state-npc0_median0.03904054505484445
sim_compute_robot_state-npc0_min0.03862942968096052
sim_compute_robot_state-npc1_max0.058055183161859925
sim_compute_robot_state-npc1_mean0.043816713254660175
sim_compute_robot_state-npc1_median0.03805889402117048
sim_compute_robot_state-npc1_min0.0379922662462507
sim_compute_robot_state-npc2_max0.05707434985948646
sim_compute_robot_state-npc2_mean0.04377508386005878
sim_compute_robot_state-npc2_median0.03800415992736816
sim_compute_robot_state-npc2_min0.037969664921836246
sim_compute_robot_state-npc3_max0.05732480339382006
sim_compute_robot_state-npc3_mean0.04403896370353182
sim_compute_robot_state-npc3_median0.038608187720889135
sim_compute_robot_state-npc3_min0.038495847157069614
sim_compute_sim_state_max0.031475315923276154
sim_compute_sim_state_mean0.024696628140671792
sim_compute_sim_state_median0.02184183256966727
sim_compute_sim_state_min0.021621813849797323
sim_physics_max0.025288977930622715
sim_physics_mean0.02060977879879234
sim_physics_median0.018479649982755145
sim_physics_min0.016615193230765206
sim_render-ego_max0.05477450204932171
sim_render-ego_mean0.042349080489440215
sim_render-ego_median0.037575176783970425
sim_render-ego_min0.0370413030896868
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35