Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 19698
3002
Manfred Diaz challenge-aido_LF-template-tensorflow aido2-LFVI-sim-testing
step1-simulation host-error no ip-172-31-42-167-28276
2019-04-24 20:18:23+00:00 2019-04-24 20:23:28+00:00 0:05:05 Error while running [...]
stderr | Pulling evaluator ...
stderr | Pulling solution ...
stderr | Pulling simulator ... done
stderr |
stderr | ERROR: for scenario_maker Cannot overwrite digest sha256:05e710b86e6ab11de59540f75f9f95f3fe30c989f099986d47c462aab7356da1
stderr | Cannot overwrite digest sha256:05e710b86e6ab11de59540f75f9f95f3fe30c989f099986d47c462aab7356da1
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19676
2364
Andrea Censi  🇨ðŸ‡random_agent aido2-LFV-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 16:38:34+00:00 2019-04-24 16:45:08+00:00 0:06:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.14219459078528665 agent_compute-ego_mean 0.12121244650360638 agent_compute-ego_median 0.12669288887167876 agent_compute-ego_min 0.0842603655422435 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03552492159717488, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05899734766978138, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12669288887167876, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08588113874759314, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03679688921514547, "sim_compute_performance-ego": 0.06472440485684376, "sim_compute_robot_state-ego": 0.06567975260176749, "sim_compute_robot_state-npc0": 0.06418847138026976, "sim_compute_robot_state-npc1": 0.062175026479757055, "sim_compute_robot_state-npc2": 0.06387217989507711, "sim_compute_robot_state-npc3": 0.0642223763016035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04201342300935225, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0671916820786216, "in-drivable-lane": 0, "agent_compute-ego": 0.14219459078528665, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09911257028579712, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.04094184528697621, "sim_compute_performance-ego": 0.07136251709677956, "sim_compute_robot_state-ego": 0.07288956642150879, "sim_compute_robot_state-npc0": 0.07409169457175514, "sim_compute_robot_state-npc1": 0.07363335110924461, "sim_compute_robot_state-npc2": 0.07282808152112094, "sim_compute_robot_state-npc3": 0.0719062089920044}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.034185568491617836, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05870019065009223, "in-drivable-lane": 0, "agent_compute-ego": 0.12120172712537976, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08238725662231446, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03328930536905925, "sim_compute_performance-ego": 0.07173456615871854, "sim_compute_robot_state-ego": 0.06285131772359212, "sim_compute_robot_state-npc0": 0.06252671347724068, "sim_compute_robot_state-npc1": 0.06188637945387099, "sim_compute_robot_state-npc2": 0.061689503987630206, "sim_compute_robot_state-npc3": 0.06068354712592231}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0380037526289622, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0629188468058904, "in-drivable-lane": 0, "agent_compute-ego": 0.1317126601934433, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09136282404263814, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.038408840696016945, "sim_compute_performance-ego": 0.06712054212888081, "sim_compute_robot_state-ego": 0.07199810445308685, "sim_compute_robot_state-npc0": 0.06609480082988739, "sim_compute_robot_state-npc1": 0.06694420178731282, "sim_compute_robot_state-npc2": 0.06585999329884847, "sim_compute_robot_state-npc3": 0.06562176843484242}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.023394395323360663, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.040495525388156664, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0842603655422435, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05920266403871424, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.025179543915916893, "sim_compute_performance-ego": 0.043220744413488055, "sim_compute_robot_state-ego": 0.04487356368233176, "sim_compute_robot_state-npc0": 0.04504963930915384, "sim_compute_robot_state-npc1": 0.04411052605685066, "sim_compute_robot_state-npc2": 0.04263397174723008, "sim_compute_robot_state-npc3": 0.043564586078419405}}set_robot_commands_max 0.09911257028579712 set_robot_commands_mean 0.08358929074741142 set_robot_commands_median 0.08588113874759314 set_robot_commands_min 0.05920266403871424 sim_compute_performance-ego_max 0.07173456615871854 sim_compute_performance-ego_mean 0.06363255493094214 sim_compute_performance-ego_median 0.06712054212888081 sim_compute_performance-ego_min 0.043220744413488055 sim_compute_robot_state-ego_max 0.07288956642150879 sim_compute_robot_state-ego_mean 0.0636584609764574 sim_compute_robot_state-ego_median 0.06567975260176749 sim_compute_robot_state-ego_min 0.04487356368233176 sim_compute_robot_state-npc0_max 0.07409169457175514 sim_compute_robot_state-npc0_mean 0.06239026391366136 sim_compute_robot_state-npc0_median 0.06418847138026976 sim_compute_robot_state-npc0_min 0.04504963930915384 sim_compute_robot_state-npc1_max 0.07363335110924461 sim_compute_robot_state-npc1_mean 0.06174989697740722 sim_compute_robot_state-npc1_median 0.062175026479757055 sim_compute_robot_state-npc1_min 0.04411052605685066 sim_compute_robot_state-npc2_max 0.07282808152112094 sim_compute_robot_state-npc2_mean 0.06137674608998137 sim_compute_robot_state-npc2_median 0.06387217989507711 sim_compute_robot_state-npc2_min 0.04263397174723008 sim_compute_robot_state-npc3_max 0.0719062089920044 sim_compute_robot_state-npc3_mean 0.06119969738655841 sim_compute_robot_state-npc3_median 0.0642223763016035 sim_compute_robot_state-npc3_min 0.043564586078419405 sim_compute_sim_state_max 0.04094184528697621 sim_compute_sim_state_mean 0.034923284896622955 sim_compute_sim_state_median 0.03679688921514547 sim_compute_sim_state_min 0.025179543915916893 sim_physics_max 0.04201342300935225 sim_physics_mean 0.03462441221009356 sim_physics_median 0.03552492159717488 sim_physics_min 0.023394395323360663 sim_render-ego_max 0.0671916820786216 sim_render-ego_mean 0.05766071851850845 sim_render-ego_median 0.05899734766978138 sim_render-ego_min 0.040495525388156664 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19670
2578
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation error no ip-172-31-42-167-28276
2019-04-24 16:35:23+00:00 2019-04-24 16:38:19+00:00 0:02:56 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19657
2385
Andrea Censi  🇨ðŸ‡Baseline solution using reinforcement learning aido2-LFV-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 16:29:12+00:00 2019-04-24 16:35:03+00:00 0:05:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0829126492451202 survival_time_median 1.2500000000000004 deviation-center-line_median 0.04392583588508732 in-drivable-lane_median 0.10000000000000007
other stats agent_compute-ego_max 0.19673864364624025 agent_compute-ego_mean 0.1565584047408331 agent_compute-ego_median 0.1624033832550049 agent_compute-ego_min 0.1228567679723104 deviation-center-line_max 0.0557719339629337 deviation-center-line_mean 0.042522377544770576 deviation-center-line_min 0.024050797440499292 deviation-heading_max 0.7517543113562304 deviation-heading_mean 0.671545327993486 deviation-heading_median 0.6905942951845397 deviation-heading_min 0.5835274340929161 driven_any_max 0.16342221698000453 driven_any_mean 0.15764939924196486 driven_any_median 0.16211655696871788 driven_any_min 0.14702614265263778 driven_lanedir_consec_max 0.10625246701710632 driven_lanedir_consec_mean 0.08430306952146331 driven_lanedir_consec_min 0.058797813953510136 driven_lanedir_max 0.10625246701710632 driven_lanedir_mean 0.08430306952146331 driven_lanedir_median 0.0829126492451202 driven_lanedir_min 0.058797813953510136 in-drivable-lane_max 0.4500000000000004 in-drivable-lane_mean 0.16000000000000014 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16211655696871788, "sim_physics": 0.02873275961194719, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0829126492451202, "sim_render-ego": 0.04724044459206717, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.13771096297672816, "deviation-heading": 0.6127767921502485, "set_robot_commands": 0.07906085252761841, "deviation-center-line": 0.033756733966509224, "driven_lanedir_consec": 0.0829126492451202, "sim_compute_sim_state": 0.030257489000047957, "sim_compute_performance-ego": 0.05063272374016898, "sim_compute_robot_state-ego": 0.050922232014792304, "sim_compute_robot_state-npc0": 0.05017104319163731, "sim_compute_robot_state-npc1": 0.05043986013957432, "sim_compute_robot_state-npc2": 0.05101744617734637, "sim_compute_robot_state-npc3": 0.0494410651070731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16342221698000453, "sim_physics": 0.029441165924072265, "survival_time": 1.5000000000000009, "driven_lanedir": 0.058797813953510136, "sim_render-ego": 0.04448413848876953, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1228567679723104, "deviation-heading": 0.5835274340929161, "set_robot_commands": 0.06953728993733724, "deviation-center-line": 0.024050797440499292, "driven_lanedir_consec": 0.058797813953510136, "sim_compute_sim_state": 0.029431939125061035, "sim_compute_performance-ego": 0.04699829419453939, "sim_compute_robot_state-ego": 0.04866247177124024, "sim_compute_robot_state-npc0": 0.051762024561564125, "sim_compute_robot_state-npc1": 0.05072431564331055, "sim_compute_robot_state-npc2": 0.05135288238525391, "sim_compute_robot_state-npc3": 0.0510122537612915}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16230654123978427, "sim_physics": 0.035826740264892576, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10625246701710632, "sim_render-ego": 0.05829207420349121, "in-drivable-lane": 0, "agent_compute-ego": 0.1624033832550049, "deviation-heading": 0.7190738071834952, "set_robot_commands": 0.09344379425048828, "deviation-center-line": 0.05510658646882333, "driven_lanedir_consec": 0.10625246701710632, "sim_compute_sim_state": 0.03827956199645996, "sim_compute_performance-ego": 0.06341635704040527, "sim_compute_robot_state-ego": 0.06796178817749024, "sim_compute_robot_state-npc0": 0.06710586547851563, "sim_compute_robot_state-npc1": 0.06470463752746582, "sim_compute_robot_state-npc2": 0.06972640991210938, "sim_compute_robot_state-npc3": 0.06811882972717286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14702614265263778, "sim_physics": 0.0453444766998291, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07890509865388484, "sim_render-ego": 0.0673145866394043, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19673864364624025, "deviation-heading": 0.6905942951845397, "set_robot_commands": 0.10366549491882324, "deviation-center-line": 0.04392583588508732, "driven_lanedir_consec": 0.07890509865388484, "sim_compute_sim_state": 0.04158125877380371, "sim_compute_performance-ego": 0.07222460746765137, "sim_compute_robot_state-ego": 0.07980679512023926, "sim_compute_robot_state-npc0": 0.07237082481384277, "sim_compute_robot_state-npc1": 0.07151211738586426, "sim_compute_robot_state-npc2": 0.07711247444152831, "sim_compute_robot_state-npc3": 0.07228410720825196}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1533755383686798, "sim_physics": 0.0330655574798584, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09464731873769504, "sim_render-ego": 0.06254037857055664, "in-drivable-lane": 0, "agent_compute-ego": 0.16308226585388183, "deviation-heading": 0.7517543113562304, "set_robot_commands": 0.08906733512878418, "deviation-center-line": 0.0557719339629337, "driven_lanedir_consec": 0.09464731873769504, "sim_compute_sim_state": 0.036471290588378905, "sim_compute_performance-ego": 0.06405582427978515, "sim_compute_robot_state-ego": 0.06440915107727051, "sim_compute_robot_state-npc0": 0.059090585708618165, "sim_compute_robot_state-npc1": 0.05998077392578125, "sim_compute_robot_state-npc2": 0.06281962394714355, "sim_compute_robot_state-npc3": 0.06870366096496582}}set_robot_commands_max 0.10366549491882324 set_robot_commands_mean 0.08695495335261028 set_robot_commands_median 0.08906733512878418 set_robot_commands_min 0.06953728993733724 sim_compute_performance-ego_max 0.07222460746765137 sim_compute_performance-ego_mean 0.05946556134451002 sim_compute_performance-ego_median 0.06341635704040527 sim_compute_performance-ego_min 0.04699829419453939 sim_compute_robot_state-ego_max 0.07980679512023926 sim_compute_robot_state-ego_mean 0.06235248763220651 sim_compute_robot_state-ego_median 0.06440915107727051 sim_compute_robot_state-ego_min 0.04866247177124024 sim_compute_robot_state-npc0_max 0.07237082481384277 sim_compute_robot_state-npc0_mean 0.0601000687508356 sim_compute_robot_state-npc0_median 0.059090585708618165 sim_compute_robot_state-npc0_min 0.05017104319163731 sim_compute_robot_state-npc1_max 0.07151211738586426 sim_compute_robot_state-npc1_mean 0.05947234092439925 sim_compute_robot_state-npc1_median 0.05998077392578125 sim_compute_robot_state-npc1_min 0.05043986013957432 sim_compute_robot_state-npc2_max 0.07711247444152831 sim_compute_robot_state-npc2_mean 0.062405767372676314 sim_compute_robot_state-npc2_median 0.06281962394714355 sim_compute_robot_state-npc2_min 0.05101744617734637 sim_compute_robot_state-npc3_max 0.07228410720825196 sim_compute_robot_state-npc3_mean 0.061911983353751046 sim_compute_robot_state-npc3_median 0.06811882972717286 sim_compute_robot_state-npc3_min 0.0494410651070731 sim_compute_sim_state_max 0.04158125877380371 sim_compute_sim_state_mean 0.03520430789675031 sim_compute_sim_state_median 0.036471290588378905 sim_compute_sim_state_min 0.029431939125061035 sim_physics_max 0.0453444766998291 sim_physics_mean 0.03448213999611991 sim_physics_median 0.0330655574798584 sim_physics_min 0.02873275961194719 sim_render-ego_max 0.0673145866394043 sim_render-ego_mean 0.05597432449885777 sim_render-ego_median 0.05829207420349121 sim_render-ego_min 0.04448413848876953 simulation-passed 1 survival_time_max 1.5000000000000009 survival_time_mean 1.3300000000000003 survival_time_min 1.2500000000000004
No reset possible 19637
2409
jiang peng Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 16:08:12+00:00 2019-04-24 16:28:22+00:00 0:20:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.3614583993086016 survival_time_median 14.950000000000076 deviation-center-line_median 1.011969887428033 in-drivable-lane_median 4.050000000000022
other stats agent_compute-ego_max 0.1704488221804301 agent_compute-ego_mean 0.1585214956601461 agent_compute-ego_median 0.1608134881655375 agent_compute-ego_min 0.14931798537572225 deviation-center-line_max 1.0119709059919424 deviation-center-line_mean 1.0119700704341597 deviation-center-line_min 1.0119697838947566 deviation-heading_max 6.81542792438532 deviation-heading_mean 6.815427924385318 deviation-heading_median 6.815427924385319 deviation-heading_min 6.815427924385317 driven_any_max 4.390824152784936 driven_any_mean 4.390824152784928 driven_any_median 4.390824152784926 driven_any_min 4.390824152784922 driven_lanedir_consec_max -1.361452200425545 driven_lanedir_consec_mean -1.3614594960339783 driven_lanedir_consec_min -1.3614696049818191 driven_lanedir_max -2.315814608416598 driven_lanedir_mean -2.3158178509092298 driven_lanedir_median -2.3158179462767055 driven_lanedir_min -2.315821760973971 in-drivable-lane_max 4.050000000000022 in-drivable-lane_mean 4.050000000000022 in-drivable-lane_min 4.050000000000022 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.022794102032979328, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.05740727265675863, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15105137427647908, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08482579151789348, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.03758922338485718, "sim_compute_performance-ego": 0.06289856592814128, "sim_compute_robot_state-ego": 0.06403964201609294}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.023184777895609535, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.06215247392654419, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.16097580830256145, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.09093519846598308, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.03882179101308187, "sim_compute_performance-ego": 0.06490331411361694, "sim_compute_robot_state-ego": 0.06952800671259562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.024862213134765623, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.06208552678426107, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1704488221804301, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.09391892751057944, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.038748566309611, "sim_compute_performance-ego": 0.06825909296671549, "sim_compute_robot_state-ego": 0.07114670197168986}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.022971450487772625, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.055940251350402835, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14931798537572225, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08511637528737385, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03562427282333374, "sim_compute_performance-ego": 0.06150150537490845, "sim_compute_robot_state-ego": 0.06514329195022583}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.02315868854522705, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.06019066095352173, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1608134881655375, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08782877763112386, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.036683037281036376, "sim_compute_performance-ego": 0.06652021090189617, "sim_compute_robot_state-ego": 0.06980939706166585}}set_robot_commands_max 0.09391892751057944 set_robot_commands_mean 0.08852501408259074 set_robot_commands_median 0.08782877763112386 set_robot_commands_min 0.08482579151789348 sim_compute_performance-ego_max 0.06825909296671549 sim_compute_performance-ego_mean 0.06481653785705566 sim_compute_performance-ego_median 0.06490331411361694 sim_compute_performance-ego_min 0.06150150537490845 sim_compute_robot_state-ego_max 0.07114670197168986 sim_compute_robot_state-ego_mean 0.06793340794245402 sim_compute_robot_state-ego_median 0.06952800671259562 sim_compute_robot_state-ego_min 0.06403964201609294 sim_compute_sim_state_max 0.03882179101308187 sim_compute_sim_state_mean 0.03749337816238403 sim_compute_sim_state_median 0.03758922338485718 sim_compute_sim_state_min 0.03562427282333374 sim_physics_max 0.024862213134765623 sim_physics_mean 0.02339424641927083 sim_physics_median 0.02315868854522705 sim_physics_min 0.022794102032979328 sim_render-ego_max 0.06215247392654419 sim_render-ego_mean 0.05955523713429769 sim_render-ego_median 0.06019066095352173 sim_render-ego_min 0.055940251350402835 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 19629
2416
Andrea Censi  🇨ðŸ‡random_agent aido2-LF-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 16:01:49+00:00 2019-04-24 16:07:47+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.13952859242757162 agent_compute-ego_mean 0.12507426972616362 agent_compute-ego_median 0.12113480298024304 agent_compute-ego_min 0.117898867410772 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021927419698463298, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05833410766889464, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12113480298024304, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08132273745986651, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.034116101714799986, "sim_compute_performance-ego": 0.06311210146490133, "sim_compute_robot_state-ego": 0.061143042906275334}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020297586917877197, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05641026388515125, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1261673244563016, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08070151914249767, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03462454947558316, "sim_compute_performance-ego": 0.05854807116768577, "sim_compute_robot_state-ego": 0.06337172876704823}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.022644578086005316, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06140189700656467, "in-drivable-lane": 0, "agent_compute-ego": 0.12064176135592992, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08266222212049697, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.034365643395317926, "sim_compute_performance-ego": 0.06437586148579916, "sim_compute_robot_state-ego": 0.06433379915025499}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.024932483832041424, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06306338806947072, "in-drivable-lane": 0, "agent_compute-ego": 0.13952859242757162, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10272613167762756, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03974499801794688, "sim_compute_performance-ego": 0.07179790238539378, "sim_compute_robot_state-ego": 0.07414243121941884}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02377176986021154, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.058980903204749614, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.117898867410772, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08394865428700167, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03335796384250417, "sim_compute_performance-ego": 0.0776693575522479, "sim_compute_robot_state-ego": 0.0660822777187123}}set_robot_commands_max 0.10272613167762756 set_robot_commands_mean 0.08627225293749807 set_robot_commands_median 0.08266222212049697 set_robot_commands_min 0.08070151914249767 sim_compute_performance-ego_max 0.0776693575522479 sim_compute_performance-ego_mean 0.0671006588112056 sim_compute_performance-ego_median 0.06437586148579916 sim_compute_performance-ego_min 0.05854807116768577 sim_compute_robot_state-ego_max 0.07414243121941884 sim_compute_robot_state-ego_mean 0.06581465595234193 sim_compute_robot_state-ego_median 0.06433379915025499 sim_compute_robot_state-ego_min 0.061143042906275334 sim_compute_sim_state_max 0.03974499801794688 sim_compute_sim_state_mean 0.03524185128923042 sim_compute_sim_state_median 0.034365643395317926 sim_compute_sim_state_min 0.03335796384250417 sim_physics_max 0.024932483832041424 sim_physics_mean 0.02271476767891976 sim_physics_median 0.022644578086005316 sim_physics_min 0.020297586917877197 sim_render-ego_max 0.06306338806947072 sim_render-ego_mean 0.05963811196696619 sim_render-ego_median 0.058980903204749614 sim_render-ego_min 0.05641026388515125 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19615
2413
jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-validation
step1-simulation host-error no ip-172-31-42-167-28276
2019-04-24 15:59:55+00:00 2019-04-24 16:01:36+00:00 0:01:41 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19602
2440
Jacopo Tani random_agent aido2-LF-sim-validation
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 15:54:22+00:00 2019-04-24 15:59:48+00:00 0:05:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.1548853079477946 agent_compute-ego_mean 0.1448944113852378 agent_compute-ego_median 0.14096960600684671 agent_compute-ego_min 0.13699670557705862 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.022636562023522717, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05621425610668254, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13699670557705862, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08797020282385484, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03555277608475595, "sim_compute_performance-ego": 0.05904507637023926, "sim_compute_robot_state-ego": 0.0635982279507619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.022312180562452835, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0572234337980097, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1394194852222096, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08587990565733476, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03331232612783259, "sim_compute_performance-ego": 0.069088030945171, "sim_compute_robot_state-ego": 0.0677301666953347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.024074660407172307, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06329116291469998, "in-drivable-lane": 0, "agent_compute-ego": 0.1548853079477946, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09732037120395236, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04341418478224013, "sim_compute_performance-ego": 0.07333229912651909, "sim_compute_robot_state-ego": 0.08025570975409614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0243448664744695, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06163720786571503, "in-drivable-lane": 0, "agent_compute-ego": 0.15220095217227936, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0923914909362793, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03923061986764272, "sim_compute_performance-ego": 0.0681713471810023, "sim_compute_robot_state-ego": 0.0700582464536031}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.025127463481005505, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06145732893663294, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14096960600684671, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08672199880375582, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.036461500560536104, "sim_compute_performance-ego": 0.06401285003213321, "sim_compute_robot_state-ego": 0.0655251846593969}}set_robot_commands_max 0.09732037120395236 set_robot_commands_mean 0.09005679388503542 set_robot_commands_median 0.08797020282385484 set_robot_commands_min 0.08587990565733476 sim_compute_performance-ego_max 0.07333229912651909 sim_compute_performance-ego_mean 0.06672992073101297 sim_compute_performance-ego_median 0.0681713471810023 sim_compute_performance-ego_min 0.05904507637023926 sim_compute_robot_state-ego_max 0.08025570975409614 sim_compute_robot_state-ego_mean 0.06943350710263854 sim_compute_robot_state-ego_median 0.0677301666953347 sim_compute_robot_state-ego_min 0.0635982279507619 sim_compute_sim_state_max 0.04341418478224013 sim_compute_sim_state_mean 0.0375942814846015 sim_compute_sim_state_median 0.036461500560536104 sim_compute_sim_state_min 0.03331232612783259 sim_physics_max 0.025127463481005505 sim_physics_mean 0.023699146589724572 sim_physics_median 0.024074660407172307 sim_physics_min 0.022312180562452835 sim_render-ego_max 0.06329116291469998 sim_render-ego_mean 0.05996467792434803 sim_render-ego_median 0.06145732893663294 sim_render-ego_min 0.05621425610668254 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19579
2471
Liam Paull  🇨🇦challenge-aido_LF-template-random aido2-LFV-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 15:47:16+00:00 2019-04-24 15:54:15+00:00 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.15652814971076118 agent_compute-ego_mean 0.14307726945734373 agent_compute-ego_median 0.13867639794069178 agent_compute-ego_min 0.13203303515911102 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.032870787494587446, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05733436008669295, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13616583932120846, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08860830990773327, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03587584675482984, "sim_compute_performance-ego": 0.06449090759709196, "sim_compute_robot_state-ego": 0.07074667372793522, "sim_compute_robot_state-npc0": 0.06453751168161068, "sim_compute_robot_state-npc1": 0.06299504244102622, "sim_compute_robot_state-npc2": 0.06033949132235545, "sim_compute_robot_state-npc3": 0.06123358798476885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04385761781172319, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.061768531799316406, "in-drivable-lane": 0, "agent_compute-ego": 0.15198292515494607, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09679127823222768, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.042240446264093574, "sim_compute_performance-ego": 0.07182512500069359, "sim_compute_robot_state-ego": 0.07298415899276733, "sim_compute_robot_state-npc0": 0.06785531477494673, "sim_compute_robot_state-npc1": 0.07033463499762795, "sim_compute_robot_state-npc2": 0.06597483158111572, "sim_compute_robot_state-npc3": 0.06622936508872292}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.041264141930474174, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0655013985104031, "in-drivable-lane": 0, "agent_compute-ego": 0.15652814971076118, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09322774145338272, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03959573109944661, "sim_compute_performance-ego": 0.0720197836558024, "sim_compute_robot_state-ego": 0.07328930430942111, "sim_compute_robot_state-npc0": 0.0695199383629693, "sim_compute_robot_state-npc1": 0.06912613444858128, "sim_compute_robot_state-npc2": 0.06860080824957954, "sim_compute_robot_state-npc3": 0.06865327623155382}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.034972826639811196, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.051075647274653115, "in-drivable-lane": 0, "agent_compute-ego": 0.13203303515911102, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07758828997612, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03360365331172943, "sim_compute_performance-ego": 0.053997586170832314, "sim_compute_robot_state-ego": 0.05722317099571228, "sim_compute_robot_state-npc0": 0.05978748699029287, "sim_compute_robot_state-npc1": 0.05862813194592794, "sim_compute_robot_state-npc2": 0.05775320033232371, "sim_compute_robot_state-npc3": 0.07006776332855225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03640715164296767, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05689457584829891, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13867639794069178, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08493974278954898, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0355534273035386, "sim_compute_performance-ego": 0.062187163268818575, "sim_compute_robot_state-ego": 0.06787148293326883, "sim_compute_robot_state-npc0": 0.06467038743636187, "sim_compute_robot_state-npc1": 0.06343410295598648, "sim_compute_robot_state-npc2": 0.06340673390556784, "sim_compute_robot_state-npc3": 0.0627636383561527}}set_robot_commands_max 0.09679127823222768 set_robot_commands_mean 0.08823107247180252 set_robot_commands_median 0.08860830990773327 set_robot_commands_min 0.07758828997612 sim_compute_performance-ego_max 0.0720197836558024 sim_compute_performance-ego_mean 0.06490411313864777 sim_compute_performance-ego_median 0.06449090759709196 sim_compute_performance-ego_min 0.053997586170832314 sim_compute_robot_state-ego_max 0.07328930430942111 sim_compute_robot_state-ego_mean 0.06842295819182095 sim_compute_robot_state-ego_median 0.07074667372793522 sim_compute_robot_state-ego_min 0.05722317099571228 sim_compute_robot_state-npc0_max 0.0695199383629693 sim_compute_robot_state-npc0_mean 0.0652741278492363 sim_compute_robot_state-npc0_median 0.06467038743636187 sim_compute_robot_state-npc0_min 0.05978748699029287 sim_compute_robot_state-npc1_max 0.07033463499762795 sim_compute_robot_state-npc1_mean 0.06490360935782997 sim_compute_robot_state-npc1_median 0.06343410295598648 sim_compute_robot_state-npc1_min 0.05862813194592794 sim_compute_robot_state-npc2_max 0.06860080824957954 sim_compute_robot_state-npc2_mean 0.06321501307818846 sim_compute_robot_state-npc2_median 0.06340673390556784 sim_compute_robot_state-npc2_min 0.05775320033232371 sim_compute_robot_state-npc3_max 0.07006776332855225 sim_compute_robot_state-npc3_mean 0.06578952619795012 sim_compute_robot_state-npc3_median 0.06622936508872292 sim_compute_robot_state-npc3_min 0.06123358798476885 sim_compute_sim_state_max 0.042240446264093574 sim_compute_sim_state_mean 0.037373820946727615 sim_compute_sim_state_median 0.03587584675482984 sim_compute_sim_state_min 0.03360365331172943 sim_physics_max 0.04385761781172319 sim_physics_mean 0.037874505103912735 sim_physics_median 0.03640715164296767 sim_physics_min 0.032870787494587446 sim_render-ego_max 0.0655013985104031 sim_render-ego_mean 0.0585149027038729 sim_render-ego_median 0.05733436008669295 sim_render-ego_min 0.051075647274653115 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19539
2529
Liam Paull  🇨🇦baseline-IL-sim-tensorflow aido2-LF-sim-validation
step1-simulation error no ip-172-31-42-167-28276
2019-04-24 15:43:00+00:00 2019-04-24 15:47:03+00:00 0:04:03 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19532
2540
jiang peng test for ppo aido2-LF-sim-testing
step1-simulation error no ip-172-31-42-167-28276
2019-04-24 15:40:41+00:00 2019-04-24 15:42:43+00:00 0:02:02 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19493
2595
Julian Zilly baseline-IL-logs-tensorflow aido2-LFVI-sim-validation
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 15:24:55+00:00 2019-04-24 15:40:34+00:00 0:15:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.23792084397112268 survival_time_median 5.14999999999999 deviation-center-line_median 0.25781725254353827 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2291106399224729 agent_compute-ego_mean 0.2191631984467904 agent_compute-ego_median 0.2206543239892698 agent_compute-ego_min 0.21047169140407015 deviation-center-line_max 0.2852377460275258 deviation-center-line_mean 0.2607608351366192 deviation-center-line_min 0.23853783968123832 deviation-heading_max 2.1527916402025076 deviation-heading_mean 2.028981049836761 deviation-heading_median 2.01021410496083 deviation-heading_min 1.950899187720357 driven_any_max 0.2826031894333863 driven_any_mean 0.2769345619360099 driven_any_median 0.2762162341521128 driven_any_min 0.2722613633207132 driven_lanedir_consec_max 0.24661044187165992 driven_lanedir_consec_mean 0.23925635376056023 driven_lanedir_consec_min 0.23353482883371648 driven_lanedir_max 0.24661044187165992 driven_lanedir_mean 0.23925635376056023 driven_lanedir_median 0.23792084397112268 driven_lanedir_min 0.23353482883371648 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.275024657971044, "sim_physics": 0.04514305688896958, "survival_time": 4.899999999999991, "driven_lanedir": 0.2375596929641699, "sim_render-ego": 0.0591125877536073, "in-drivable-lane": 0, "agent_compute-ego": 0.2291106399224729, "deviation-heading": 1.950899187720357, "set_robot_commands": 0.0957201354357661, "deviation-center-line": 0.25781725254353827, "driven_lanedir_consec": 0.2375596929641699, "sim_compute_sim_state": 0.0361157412431678, "sim_compute_performance-ego": 0.06481080639119051, "sim_compute_robot_state-ego": 0.07058712657617063, "sim_compute_robot_state-npc0": 0.06430546118288624, "sim_compute_robot_state-npc1": 0.0625111570163649, "sim_compute_robot_state-npc2": 0.06511476818396121, "sim_compute_robot_state-npc3": 0.06251359472469407}, "udem1-1-0": {"driven_any": 0.2785673648027933, "sim_physics": 0.04241230625372667, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2406559611621324, "sim_render-ego": 0.0610453005020435, "in-drivable-lane": 0, "agent_compute-ego": 0.22099972229737505, "deviation-heading": 1.9592575580268967, "set_robot_commands": 0.09389051107259896, "deviation-center-line": 0.23853783968123832, "driven_lanedir_consec": 0.2406559611621324, "sim_compute_sim_state": 0.03779386098568256, "sim_compute_performance-ego": 0.06671052483411935, "sim_compute_robot_state-ego": 0.07072890721834622, "sim_compute_robot_state-npc0": 0.06648035232837383, "sim_compute_robot_state-npc1": 0.0662397421323336, "sim_compute_robot_state-npc2": 0.06628911999555734, "sim_compute_robot_state-npc3": 0.06521064043045044}, "udem1-2-0": {"driven_any": 0.2762162341521128, "sim_physics": 0.04727408955398115, "survival_time": 5.14999999999999, "driven_lanedir": 0.23792084397112268, "sim_render-ego": 0.05937677448235669, "in-drivable-lane": 0, "agent_compute-ego": 0.21457961462076428, "deviation-heading": 2.1527916402025076, "set_robot_commands": 0.08599971336068458, "deviation-center-line": 0.2852377460275258, "driven_lanedir_consec": 0.23792084397112268, "sim_compute_sim_state": 0.03672531970496317, "sim_compute_performance-ego": 0.06845275406698578, "sim_compute_robot_state-ego": 0.06728393591723396, "sim_compute_robot_state-npc0": 0.06480636642974558, "sim_compute_robot_state-npc1": 0.06458780372027055, "sim_compute_robot_state-npc2": 0.06340372215196924, "sim_compute_robot_state-npc3": 0.06348757142002143}, "udem1-3-0": {"driven_any": 0.2722613633207132, "sim_physics": 0.04337694531395322, "survival_time": 5.249999999999989, "driven_lanedir": 0.23353482883371648, "sim_render-ego": 0.05515955516270229, "in-drivable-lane": 0, "agent_compute-ego": 0.21047169140407015, "deviation-heading": 2.0717427582732126, "set_robot_commands": 0.08225189163571313, "deviation-center-line": 0.2456165083194027, "driven_lanedir_consec": 0.23353482883371648, "sim_compute_sim_state": 0.03344257672627767, "sim_compute_performance-ego": 0.05891943659101214, "sim_compute_robot_state-ego": 0.06401999791463216, "sim_compute_robot_state-npc0": 0.05838940484183175, "sim_compute_robot_state-npc1": 0.05929910114833287, "sim_compute_robot_state-npc2": 0.06359436398460752, "sim_compute_robot_state-npc3": 0.06051405952090309}, "udem1-4-0": {"driven_any": 0.2826031894333863, "sim_physics": 0.04255000750223795, "survival_time": 5.09999999999999, "driven_lanedir": 0.24661044187165992, "sim_render-ego": 0.05632243203181846, "in-drivable-lane": 0, "agent_compute-ego": 0.2206543239892698, "deviation-heading": 2.01021410496083, "set_robot_commands": 0.09337298075358072, "deviation-center-line": 0.2765948291113909, "driven_lanedir_consec": 0.24661044187165992, "sim_compute_sim_state": 0.03724049119388356, "sim_compute_performance-ego": 0.06198929337894216, "sim_compute_robot_state-ego": 0.06599103235730938, "sim_compute_robot_state-npc0": 0.06446840950087004, "sim_compute_robot_state-npc1": 0.06418264613432043, "sim_compute_robot_state-npc2": 0.06341046211766262, "sim_compute_robot_state-npc3": 0.06319905496111103}}set_robot_commands_max 0.0957201354357661 set_robot_commands_mean 0.0902470464516687 set_robot_commands_median 0.09337298075358072 set_robot_commands_min 0.08225189163571313 sim_compute_performance-ego_max 0.06845275406698578 sim_compute_performance-ego_mean 0.06417656305244998 sim_compute_performance-ego_median 0.06481080639119051 sim_compute_performance-ego_min 0.05891943659101214 sim_compute_robot_state-ego_max 0.07072890721834622 sim_compute_robot_state-ego_mean 0.06772219999673848 sim_compute_robot_state-ego_median 0.06728393591723396 sim_compute_robot_state-ego_min 0.06401999791463216 sim_compute_robot_state-npc0_max 0.06648035232837383 sim_compute_robot_state-npc0_mean 0.0636899988567415 sim_compute_robot_state-npc0_median 0.06446840950087004 sim_compute_robot_state-npc0_min 0.05838940484183175 sim_compute_robot_state-npc1_max 0.0662397421323336 sim_compute_robot_state-npc1_mean 0.06336409003032446 sim_compute_robot_state-npc1_median 0.06418264613432043 sim_compute_robot_state-npc1_min 0.05929910114833287 sim_compute_robot_state-npc2_max 0.06628911999555734 sim_compute_robot_state-npc2_mean 0.06436248728675158 sim_compute_robot_state-npc2_median 0.06359436398460752 sim_compute_robot_state-npc2_min 0.06340372215196924 sim_compute_robot_state-npc3_max 0.06521064043045044 sim_compute_robot_state-npc3_mean 0.06298498421143602 sim_compute_robot_state-npc3_median 0.06319905496111103 sim_compute_robot_state-npc3_min 0.06051405952090309 sim_compute_sim_state_max 0.03779386098568256 sim_compute_sim_state_mean 0.03626359797079495 sim_compute_sim_state_median 0.03672531970496317 sim_compute_sim_state_min 0.03344257672627767 sim_physics_max 0.04727408955398115 sim_physics_mean 0.044151281102573714 sim_physics_median 0.04337694531395322 sim_physics_min 0.04241230625372667 sim_render-ego_max 0.0610453005020435 sim_render-ego_mean 0.058203329986505646 sim_render-ego_median 0.0591125877536073 sim_render-ego_min 0.05515955516270229 simulation-passed 1 survival_time_max 5.249999999999989 survival_time_mean 5.1199999999999894 survival_time_min 4.899999999999991
No reset possible 19486
2604
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 15:19:01+00:00 2019-04-24 15:24:39+00:00 0:05:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0933418587634438 agent_compute-ego_mean 0.07510217598786177 agent_compute-ego_median 0.07283777195018726 agent_compute-ego_min 0.06516814231872559 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02741894780135736, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0601323639474264, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06926387984578203, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09851882225129664, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.038990529572091454, "sim_compute_performance-ego": 0.06825561348984881, "sim_compute_robot_state-ego": 0.07382560939323611}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02266561068021334, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05435808805318979, "in-drivable-lane": 0, "agent_compute-ego": 0.06516814231872559, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08978917965522179, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03910995446718656, "sim_compute_performance-ego": 0.06769206890693077, "sim_compute_robot_state-ego": 0.06719813897059514}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.023986547551256544, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.0630725901177589, "in-drivable-lane": 0, "agent_compute-ego": 0.0748992270611702, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.09561858785913344, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03580015770932461, "sim_compute_performance-ego": 0.06624924882929376, "sim_compute_robot_state-ego": 0.06714636214235996}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.03048551999605619, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06258633634546301, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07283777195018726, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.1012375485766065, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03881889647179908, "sim_compute_performance-ego": 0.07186895936400026, "sim_compute_robot_state-ego": 0.07224211588010683}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.03500043091021086, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.07514870794195878, "in-drivable-lane": 0, "agent_compute-ego": 0.0933418587634438, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.11460148660760176, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.046967933052464536, "sim_compute_performance-ego": 0.08259278849551552, "sim_compute_robot_state-ego": 0.09087192384820236}}set_robot_commands_max 0.11460148660760176 set_robot_commands_mean 0.09995312498997204 set_robot_commands_median 0.09851882225129664 set_robot_commands_min 0.08978917965522179 sim_compute_performance-ego_max 0.08259278849551552 sim_compute_performance-ego_mean 0.07133173581711783 sim_compute_performance-ego_median 0.06825561348984881 sim_compute_performance-ego_min 0.06624924882929376 sim_compute_robot_state-ego_max 0.09087192384820236 sim_compute_robot_state-ego_mean 0.07425683004690008 sim_compute_robot_state-ego_median 0.07224211588010683 sim_compute_robot_state-ego_min 0.06714636214235996 sim_compute_sim_state_max 0.046967933052464536 sim_compute_sim_state_mean 0.03993749425457325 sim_compute_sim_state_median 0.038990529572091454 sim_compute_sim_state_min 0.03580015770932461 sim_physics_max 0.03500043091021086 sim_physics_mean 0.027911411387818857 sim_physics_median 0.02741894780135736 sim_physics_min 0.02266561068021334 sim_render-ego_max 0.07514870794195878 sim_render-ego_mean 0.06305961728115937 sim_render-ego_median 0.06258633634546301 sim_render-ego_min 0.05435808805318979 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 19455
2680
Rami Al-Naim  🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 15:00:30+00:00 2019-04-24 15:18:50+00:00 0:18:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0240093155136043 survival_time_median 6.8999999999999835 deviation-center-line_median 0.4768743338929914 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.091946595509847 agent_compute-ego_mean 0.08684022580904638 agent_compute-ego_median 0.08772176612507213 agent_compute-ego_min 0.07876198879186658 deviation-center-line_max 0.6680510785758133 deviation-center-line_mean 0.4827280842553369 deviation-center-line_min 0.27245655101549265 deviation-heading_max 1.4219328001059632 deviation-heading_mean 1.226393609169372 deviation-heading_median 1.2670270328437836 deviation-heading_min 0.9750786737419777 driven_any_max 1.1583444269684966 driven_any_mean 1.0404710094067904 driven_any_median 1.061897793095121 driven_any_min 0.826124985421427 driven_lanedir_consec_max 1.1275355962650453 driven_lanedir_consec_mean 1.0116781290253154 driven_lanedir_consec_min 0.7926179835525367 driven_lanedir_max 1.1275355962650453 driven_lanedir_mean 1.0116781290253154 driven_lanedir_median 1.0240093155136043 driven_lanedir_min 0.7926179835525367 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.826124985421427, "sim_physics": 0.04794454141096635, "survival_time": 5.4999999999999885, "driven_lanedir": 0.7926179835525367, "sim_render-ego": 0.06943152384324507, "in-drivable-lane": 0, "agent_compute-ego": 0.08772176612507213, "deviation-heading": 1.1303159433032055, "set_robot_commands": 0.1102610718120228, "deviation-center-line": 0.27245655101549265, "driven_lanedir_consec": 0.7926179835525367, "sim_compute_sim_state": 0.04387309984727339, "sim_compute_performance-ego": 0.07631322253834118, "sim_compute_robot_state-ego": 0.08133997266942805, "sim_compute_robot_state-npc0": 0.07785440574992787, "sim_compute_robot_state-npc1": 0.07782458392056552, "sim_compute_robot_state-npc2": 0.07815422361547297, "sim_compute_robot_state-npc3": 0.07795810049230402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1342352788874617, "sim_physics": 0.04797448430742536, "survival_time": 7.349999999999982, "driven_lanedir": 1.1095075558762866, "sim_render-ego": 0.07153981234751591, "in-drivable-lane": 0, "agent_compute-ego": 0.08768382040010829, "deviation-heading": 1.2670270328437836, "set_robot_commands": 0.11161322820754278, "deviation-center-line": 0.6381826438294421, "driven_lanedir_consec": 1.1095075558762866, "sim_compute_sim_state": 0.043668904272066496, "sim_compute_performance-ego": 0.07892482783518681, "sim_compute_robot_state-ego": 0.08221117655436198, "sim_compute_robot_state-npc0": 0.07638412754551895, "sim_compute_robot_state-npc1": 0.07919608168050546, "sim_compute_robot_state-npc2": 0.07797589918383124, "sim_compute_robot_state-npc3": 0.07802939739357047}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0217525626614452, "sim_physics": 0.04862336467083236, "survival_time": 6.649999999999984, "driven_lanedir": 1.0047201939191042, "sim_render-ego": 0.0724440248388993, "in-drivable-lane": 0, "agent_compute-ego": 0.0880869582183379, "deviation-heading": 0.9750786737419777, "set_robot_commands": 0.11358853031818132, "deviation-center-line": 0.6680510785758133, "driven_lanedir_consec": 1.0047201939191042, "sim_compute_sim_state": 0.04302767165621421, "sim_compute_performance-ego": 0.0793965364757337, "sim_compute_robot_state-ego": 0.08714400915274943, "sim_compute_robot_state-npc0": 0.08240886559163717, "sim_compute_robot_state-npc1": 0.07793993519661122, "sim_compute_robot_state-npc2": 0.07874628296472076, "sim_compute_robot_state-npc3": 0.07833965021864812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1583444269684966, "sim_physics": 0.046646011670430504, "survival_time": 7.499999999999981, "driven_lanedir": 1.1275355962650453, "sim_render-ego": 0.07011596838633219, "in-drivable-lane": 0, "agent_compute-ego": 0.091946595509847, "deviation-heading": 1.3376135958519308, "set_robot_commands": 0.1171632973353068, "deviation-center-line": 0.4768743338929914, "driven_lanedir_consec": 1.1275355962650453, "sim_compute_sim_state": 0.0445082410176595, "sim_compute_performance-ego": 0.07905644893646241, "sim_compute_robot_state-ego": 0.08685746033986409, "sim_compute_robot_state-npc0": 0.07912398815155029, "sim_compute_robot_state-npc1": 0.07794795831044515, "sim_compute_robot_state-npc2": 0.0790939458211263, "sim_compute_robot_state-npc3": 0.07979381879170735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.061897793095121, "sim_physics": 0.039001660070557526, "survival_time": 6.8999999999999835, "driven_lanedir": 1.0240093155136043, "sim_render-ego": 0.06187779661537944, "in-drivable-lane": 0, "agent_compute-ego": 0.07876198879186658, "deviation-heading": 1.4219328001059632, "set_robot_commands": 0.0927256414855736, "deviation-center-line": 0.35807581396294486, "driven_lanedir_consec": 1.0240093155136043, "sim_compute_sim_state": 0.038469463154889534, "sim_compute_performance-ego": 0.0688541004623192, "sim_compute_robot_state-ego": 0.06995647540990857, "sim_compute_robot_state-npc0": 0.06827106683150581, "sim_compute_robot_state-npc1": 0.06852705064027206, "sim_compute_robot_state-npc2": 0.06812747492306474, "sim_compute_robot_state-npc3": 0.06906057095182115}}set_robot_commands_max 0.1171632973353068 set_robot_commands_mean 0.10907035383172548 set_robot_commands_median 0.11161322820754278 set_robot_commands_min 0.0927256414855736 sim_compute_performance-ego_max 0.0793965364757337 sim_compute_performance-ego_mean 0.07650902724960866 sim_compute_performance-ego_median 0.07892482783518681 sim_compute_performance-ego_min 0.0688541004623192 sim_compute_robot_state-ego_max 0.08714400915274943 sim_compute_robot_state-ego_mean 0.08150181882526243 sim_compute_robot_state-ego_median 0.08221117655436198 sim_compute_robot_state-ego_min 0.06995647540990857 sim_compute_robot_state-npc0_max 0.08240886559163717 sim_compute_robot_state-npc0_mean 0.07680849077402802 sim_compute_robot_state-npc0_median 0.07785440574992787 sim_compute_robot_state-npc0_min 0.06827106683150581 sim_compute_robot_state-npc1_max 0.07919608168050546 sim_compute_robot_state-npc1_mean 0.07628712194967988 sim_compute_robot_state-npc1_median 0.07793993519661122 sim_compute_robot_state-npc1_min 0.06852705064027206 sim_compute_robot_state-npc2_max 0.0790939458211263 sim_compute_robot_state-npc2_mean 0.0764195653016432 sim_compute_robot_state-npc2_median 0.07815422361547297 sim_compute_robot_state-npc2_min 0.06812747492306474 sim_compute_robot_state-npc3_max 0.07979381879170735 sim_compute_robot_state-npc3_mean 0.07663630756961022 sim_compute_robot_state-npc3_median 0.07802939739357047 sim_compute_robot_state-npc3_min 0.06906057095182115 sim_compute_sim_state_max 0.0445082410176595 sim_compute_sim_state_mean 0.042709475989620625 sim_compute_sim_state_median 0.043668904272066496 sim_compute_sim_state_min 0.038469463154889534 sim_physics_max 0.04862336467083236 sim_physics_mean 0.04603801242604242 sim_physics_median 0.04794454141096635 sim_physics_min 0.039001660070557526 sim_render-ego_max 0.0724440248388993 sim_render-ego_mean 0.06908182520627439 sim_render-ego_median 0.07011596838633219 sim_render-ego_min 0.06187779661537944 simulation-passed 1 survival_time_max 7.499999999999981 survival_time_mean 6.779999999999984 survival_time_min 5.4999999999999885
No reset possible 19441
2652
Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation host-error no ip-172-31-42-167-28276
2019-04-24 14:54:12+00:00 2019-04-24 15:00:08+00:00 0:05:56 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19381
2965
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-validation
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 14:20:42+00:00 2019-04-24 14:54:04+00:00 0:33:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5763173996467272 survival_time_median 14.950000000000076 deviation-center-line_median 0.3911228143725886 in-drivable-lane_median 3.000000000000014
other stats agent_compute-ego_max 0.21422396739323937 agent_compute-ego_mean 0.204718612108601 agent_compute-ego_median 0.2124345954259237 agent_compute-ego_min 0.18126836799135143 deviation-center-line_max 0.8951117156378982 deviation-center-line_mean 0.5488496750587151 deviation-center-line_min 0.18272855721428313 deviation-heading_max 5.7180555753723 deviation-heading_mean 2.24957754453992 deviation-heading_median 1.3887414101714666 deviation-heading_min 1.3204172304203865 driven_any_max 1.742340037573792 driven_any_mean 1.4734045721775644 driven_any_median 1.5350188837624157 driven_any_min 0.9814403019069082 driven_lanedir_consec_max 1.578764120892484 driven_lanedir_consec_mean 0.8638562585541372 driven_lanedir_consec_min 0.5264593436903899 driven_lanedir_max 1.578764120892484 driven_lanedir_mean 0.8668835955042095 driven_lanedir_median 0.587771422298192 driven_lanedir_min 0.5264593436903899 in-drivable-lane_max 8.950000000000092 in-drivable-lane_mean 4.490000000000038 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.742340037573792, "sim_physics": 0.03685688092404564, "survival_time": 14.900000000000077, "driven_lanedir": 1.1127451865038838, "sim_render-ego": 0.05370047668482633, "in-drivable-lane": 3.000000000000014, "agent_compute-ego": 0.18126836799135143, "deviation-heading": 5.7180555753723, "set_robot_commands": 0.08108847173268363, "deviation-center-line": 0.8883639139408307, "driven_lanedir_consec": 1.1090625244049872, "sim_compute_sim_state": 0.03425760717199953, "sim_compute_performance-ego": 0.05818897605742384, "sim_compute_robot_state-ego": 0.0596322437260775, "sim_compute_robot_state-npc0": 0.05965808814003964, "sim_compute_robot_state-npc1": 0.05914226474377933, "sim_compute_robot_state-npc2": 0.05854020502743305, "sim_compute_robot_state-npc3": 0.05962616965274683}, "udem1-1-0": {"driven_any": 0.9814403019069082, "sim_physics": 0.0416826699909411, "survival_time": 6.649999999999984, "driven_lanedir": 0.587771422298192, "sim_render-ego": 0.05985501296538159, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.2023988343719253, "deviation-heading": 1.3887414101714666, "set_robot_commands": 0.0948064865026259, "deviation-center-line": 0.18272855721428313, "driven_lanedir_consec": 0.5763173996467272, "sim_compute_sim_state": 0.03703560327228747, "sim_compute_performance-ego": 0.06739939424328338, "sim_compute_robot_state-ego": 0.06872485096293285, "sim_compute_robot_state-npc0": 0.06541938889295534, "sim_compute_robot_state-npc1": 0.0663046567959893, "sim_compute_robot_state-npc2": 0.06735915169680029, "sim_compute_robot_state-npc3": 0.06662379350877345}, "udem1-2-0": {"driven_any": 1.5350188837624157, "sim_physics": 0.04165470600128174, "survival_time": 14.950000000000076, "driven_lanedir": 0.5286779041360976, "sim_render-ego": 0.0628215750058492, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.21422396739323937, "deviation-heading": 1.3218320545233164, "set_robot_commands": 0.0941782546043396, "deviation-center-line": 0.3911228143725886, "driven_lanedir_consec": 0.5286779041360976, "sim_compute_sim_state": 0.03916319211324056, "sim_compute_performance-ego": 0.065614439646403, "sim_compute_robot_state-ego": 0.07043543577194214, "sim_compute_robot_state-npc0": 0.06793867349624634, "sim_compute_robot_state-npc1": 0.06694735606511434, "sim_compute_robot_state-npc2": 0.06831875960032145, "sim_compute_robot_state-npc3": 0.06871916055679321}, "udem1-3-0": {"driven_any": 1.5172680246062988, "sim_physics": 0.04388713200887044, "survival_time": 14.950000000000076, "driven_lanedir": 0.5264593436903899, "sim_render-ego": 0.06078401724497477, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.2124345954259237, "deviation-heading": 1.3204172304203865, "set_robot_commands": 0.09636871258417766, "deviation-center-line": 0.3869213741279744, "driven_lanedir_consec": 0.5264593436903899, "sim_compute_sim_state": 0.038197494347890215, "sim_compute_performance-ego": 0.0655510965983073, "sim_compute_robot_state-ego": 0.07168463468551636, "sim_compute_robot_state-npc0": 0.06833851973215739, "sim_compute_robot_state-npc1": 0.06817989031473795, "sim_compute_robot_state-npc2": 0.06799485365549723, "sim_compute_robot_state-npc3": 0.068014341990153}, "udem1-4-0": {"driven_any": 1.5909556130384073, "sim_physics": 0.04299930254618327, "survival_time": 14.950000000000076, "driven_lanedir": 1.578764120892484, "sim_render-ego": 0.061240493456522625, "in-drivable-lane": 0, "agent_compute-ego": 0.2132672953605652, "deviation-heading": 1.4988414522121318, "set_robot_commands": 0.0915544319152832, "deviation-center-line": 0.8951117156378982, "driven_lanedir_consec": 1.578764120892484, "sim_compute_sim_state": 0.039957746664683026, "sim_compute_performance-ego": 0.06796042362848918, "sim_compute_robot_state-ego": 0.07193906863530476, "sim_compute_robot_state-npc0": 0.06736022154490152, "sim_compute_robot_state-npc1": 0.0668534771601359, "sim_compute_robot_state-npc2": 0.0680749225616455, "sim_compute_robot_state-npc3": 0.0682423726717631}}set_robot_commands_max 0.09636871258417766 set_robot_commands_mean 0.091599271467822 set_robot_commands_median 0.0941782546043396 set_robot_commands_min 0.08108847173268363 sim_compute_performance-ego_max 0.06796042362848918 sim_compute_performance-ego_mean 0.06494286603478135 sim_compute_performance-ego_median 0.065614439646403 sim_compute_performance-ego_min 0.05818897605742384 sim_compute_robot_state-ego_max 0.07193906863530476 sim_compute_robot_state-ego_mean 0.06848324675635473 sim_compute_robot_state-ego_median 0.07043543577194214 sim_compute_robot_state-ego_min 0.0596322437260775 sim_compute_robot_state-npc0_max 0.06833851973215739 sim_compute_robot_state-npc0_mean 0.06574297836126004 sim_compute_robot_state-npc0_median 0.06736022154490152 sim_compute_robot_state-npc0_min 0.05965808814003964 sim_compute_robot_state-npc1_max 0.06817989031473795 sim_compute_robot_state-npc1_mean 0.06548552901595137 sim_compute_robot_state-npc1_median 0.0668534771601359 sim_compute_robot_state-npc1_min 0.05914226474377933 sim_compute_robot_state-npc2_max 0.06831875960032145 sim_compute_robot_state-npc2_mean 0.0660575785083395 sim_compute_robot_state-npc2_median 0.06799485365549723 sim_compute_robot_state-npc2_min 0.05854020502743305 sim_compute_robot_state-npc3_max 0.06871916055679321 sim_compute_robot_state-npc3_mean 0.06624516767604591 sim_compute_robot_state-npc3_median 0.068014341990153 sim_compute_robot_state-npc3_min 0.05962616965274683 sim_compute_sim_state_max 0.039957746664683026 sim_compute_sim_state_mean 0.03772232871402016 sim_compute_sim_state_median 0.038197494347890215 sim_compute_sim_state_min 0.03425760717199953 sim_physics_max 0.04388713200887044 sim_physics_mean 0.04141613829426444 sim_physics_median 0.0416826699909411 sim_physics_min 0.03685688092404564 sim_render-ego_max 0.0628215750058492 sim_render-ego_mean 0.059680315071510906 sim_render-ego_median 0.06078401724497477 sim_render-ego_min 0.05370047668482633 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.280000000000058 survival_time_min 6.649999999999984
No reset possible 19334
2860
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 14:00:27+00:00 2019-04-24 14:20:06+00:00 0:19:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5177324595837185 survival_time_median 7.299999999999982 deviation-center-line_median 0.1621038927564964 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.11234582180068606 agent_compute-ego_mean 0.105472958929358 agent_compute-ego_median 0.10528488569362188 agent_compute-ego_min 0.09778356209075709 deviation-center-line_max 0.2502866759220912 deviation-center-line_mean 0.17396493741523614 deviation-center-line_min 0.1214735246740866 deviation-heading_max 1.781660788722 deviation-heading_mean 1.6924744901497055 deviation-heading_median 1.7279292154229322 deviation-heading_min 1.5785678301240016 driven_any_max 1.176677343799044 driven_any_mean 0.655285191888143 driven_any_median 0.5631093149803889 driven_any_min 0.350146881476964 driven_lanedir_consec_max 0.6186787020548552 driven_lanedir_consec_mean 0.48703898156761055 driven_lanedir_consec_min 0.30118830672574726 driven_lanedir_max 0.6186787020548552 driven_lanedir_mean 0.48703898156761055 driven_lanedir_median 0.5177324595837185 driven_lanedir_min 0.30118830672574726 in-drivable-lane_max 7.550000000000094 in-drivable-lane_mean 1.540000000000019 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.176677343799044, "sim_physics": 0.03881615241368612, "survival_time": 14.950000000000076, "driven_lanedir": 0.520699227613048, "sim_render-ego": 0.06571362257003784, "in-drivable-lane": 7.550000000000094, "agent_compute-ego": 0.10911217212677002, "deviation-heading": 1.781660788722, "set_robot_commands": 0.10491028547286987, "deviation-center-line": 0.1621038927564964, "driven_lanedir_consec": 0.520699227613048, "sim_compute_sim_state": 0.04056580702463786, "sim_compute_performance-ego": 0.07259453614552816, "sim_compute_robot_state-ego": 0.07664793173472087, "sim_compute_robot_state-npc0": 0.07251346429189046, "sim_compute_robot_state-npc1": 0.07403036594390869, "sim_compute_robot_state-npc2": 0.07455262819925944, "sim_compute_robot_state-npc3": 0.07203188021977742}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.350146881476964, "sim_physics": 0.04407526088017289, "survival_time": 4.6499999999999915, "driven_lanedir": 0.30118830672574726, "sim_render-ego": 0.06510578432390766, "in-drivable-lane": 0, "agent_compute-ego": 0.10528488569362188, "deviation-heading": 1.7279292154229322, "set_robot_commands": 0.10136960655130366, "deviation-center-line": 0.15380448251272097, "driven_lanedir_consec": 0.30118830672574726, "sim_compute_sim_state": 0.03959918791247952, "sim_compute_performance-ego": 0.07037220206311955, "sim_compute_robot_state-ego": 0.07524896180757912, "sim_compute_robot_state-npc0": 0.07304496662591094, "sim_compute_robot_state-npc1": 0.07283475322108116, "sim_compute_robot_state-npc2": 0.06963453241573866, "sim_compute_robot_state-npc3": 0.06959136070743684}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6515117721126895, "sim_physics": 0.04240355321339199, "survival_time": 8.399999999999984, "driven_lanedir": 0.6186787020548552, "sim_render-ego": 0.06715463314737592, "in-drivable-lane": 0, "agent_compute-ego": 0.11234582180068606, "deviation-heading": 1.6361796855923458, "set_robot_commands": 0.10862239911442712, "deviation-center-line": 0.2502866759220912, "driven_lanedir_consec": 0.6186787020548552, "sim_compute_sim_state": 0.04268607071467808, "sim_compute_performance-ego": 0.07332462923867362, "sim_compute_robot_state-ego": 0.07932571002415248, "sim_compute_robot_state-npc0": 0.07450272781508309, "sim_compute_robot_state-npc1": 0.0734321205388932, "sim_compute_robot_state-npc2": 0.07378799148968287, "sim_compute_robot_state-npc3": 0.0760819244952429}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5349806470716294, "sim_physics": 0.038985760091877666, "survival_time": 6.949999999999983, "driven_lanedir": 0.4768962118606837, "sim_render-ego": 0.05930405040439085, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09778356209075709, "deviation-heading": 1.5785678301240016, "set_robot_commands": 0.09416324286152132, "deviation-center-line": 0.1214735246740866, "driven_lanedir_consec": 0.4768962118606837, "sim_compute_sim_state": 0.03759848299643976, "sim_compute_performance-ego": 0.06790156501660244, "sim_compute_robot_state-ego": 0.06809535472513102, "sim_compute_robot_state-npc0": 0.06575985435101626, "sim_compute_robot_state-npc1": 0.06527223689950627, "sim_compute_robot_state-npc2": 0.0705800090762351, "sim_compute_robot_state-npc3": 0.0647625288517355}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5631093149803889, "sim_physics": 0.03527375769941774, "survival_time": 7.299999999999982, "driven_lanedir": 0.5177324595837185, "sim_render-ego": 0.060513718487465215, "in-drivable-lane": 0, "agent_compute-ego": 0.10283835293495493, "deviation-heading": 1.7380349308872487, "set_robot_commands": 0.09456540460455908, "deviation-center-line": 0.1821561112107856, "driven_lanedir_consec": 0.5177324595837185, "sim_compute_sim_state": 0.03664445877075195, "sim_compute_performance-ego": 0.06782262782527976, "sim_compute_robot_state-ego": 0.06923516809123836, "sim_compute_robot_state-npc0": 0.0679663795314423, "sim_compute_robot_state-npc1": 0.0660715250119771, "sim_compute_robot_state-npc2": 0.06642115769320972, "sim_compute_robot_state-npc3": 0.0644289304132331}}set_robot_commands_max 0.10862239911442712 set_robot_commands_mean 0.1007261877209362 set_robot_commands_median 0.10136960655130366 set_robot_commands_min 0.09416324286152132 sim_compute_performance-ego_max 0.07332462923867362 sim_compute_performance-ego_mean 0.0704031120578407 sim_compute_performance-ego_median 0.07037220206311955 sim_compute_performance-ego_min 0.06782262782527976 sim_compute_robot_state-ego_max 0.07932571002415248 sim_compute_robot_state-ego_mean 0.07371062527656437 sim_compute_robot_state-ego_median 0.07524896180757912 sim_compute_robot_state-ego_min 0.06809535472513102 sim_compute_robot_state-npc0_max 0.07450272781508309 sim_compute_robot_state-npc0_mean 0.07075747852306861 sim_compute_robot_state-npc0_median 0.07251346429189046 sim_compute_robot_state-npc0_min 0.06575985435101626 sim_compute_robot_state-npc1_max 0.07403036594390869 sim_compute_robot_state-npc1_mean 0.07032820032307328 sim_compute_robot_state-npc1_median 0.07283475322108116 sim_compute_robot_state-npc1_min 0.06527223689950627 sim_compute_robot_state-npc2_max 0.07455262819925944 sim_compute_robot_state-npc2_mean 0.07099526377482515 sim_compute_robot_state-npc2_median 0.0705800090762351 sim_compute_robot_state-npc2_min 0.06642115769320972 sim_compute_robot_state-npc3_max 0.0760819244952429 sim_compute_robot_state-npc3_mean 0.06937932493748515 sim_compute_robot_state-npc3_median 0.06959136070743684 sim_compute_robot_state-npc3_min 0.0644289304132331 sim_compute_sim_state_max 0.04268607071467808 sim_compute_sim_state_mean 0.03941880148379744 sim_compute_sim_state_median 0.03959918791247952 sim_compute_sim_state_min 0.03664445877075195 sim_physics_max 0.04407526088017289 sim_physics_mean 0.03991089685970928 sim_physics_median 0.038985760091877666 sim_physics_min 0.03527375769941774 sim_render-ego_max 0.06715463314737592 sim_render-ego_mean 0.0635583617866355 sim_render-ego_median 0.06510578432390766 sim_render-ego_min 0.05930405040439085 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.450000000000005 survival_time_min 4.6499999999999915
No reset possible 19303
2857
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-validation
step1-simulation host-error no ip-172-31-42-167-28276
2019-04-24 13:53:07+00:00 2019-04-24 14:00:14+00:00 0:07:07 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19284
2891
Diego Charrez  🇵🇪Python template aido2-AMOD-efficiency
step1-simulation success yes ip-172-31-42-167-28276
2019-04-24 13:43:04+00:00 2019-04-24 13:53:01+00:00 0:09:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19250
2928
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-42-167-28276
2019-04-24 13:20:35+00:00 2019-04-24 13:42:57+00:00 0:22:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.08238667281181611 survival_time_median 1.3500000000000003 deviation-center-line_median 0.04065667616435421 in-drivable-lane_median 0.20000000000000015
other stats agent_compute-ego_max 0.3555845309948099 agent_compute-ego_mean 0.1956024702949835 agent_compute-ego_median 0.16467605187342718 agent_compute-ego_min 0.14219419161478675 deviation-center-line_max 0.06620342472754193 deviation-center-line_mean 0.0473441589144017 deviation-center-line_min 0.034462049149360685 deviation-heading_max 0.8363489530989983 deviation-heading_mean 0.6843313602855202 deviation-heading_median 0.6577131889044856 deviation-heading_min 0.6042386307362206 driven_any_max 0.18929707866635445 driven_any_mean 0.16754923443693298 driven_any_median 0.16268676116628014 driven_any_min 0.1506392741327123 driven_lanedir_consec_max 0.14273976803173394 driven_lanedir_consec_mean 0.09685352680037664 driven_lanedir_consec_min 0.07538253565936515 driven_lanedir_max 0.14273976803173394 driven_lanedir_mean 0.09685352680037664 driven_lanedir_median 0.08238667281181611 driven_lanedir_min 0.07538253565936515 in-drivable-lane_max 0.3500000000000003 in-drivable-lane_mean 0.16000000000000014 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.18929707866635445, "sim_physics": 0.03911954623002272, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14273976803173394, "sim_render-ego": 0.057150657360370345, "in-drivable-lane": 0, "agent_compute-ego": 0.16467605187342718, "deviation-heading": 0.6042386307362206, "set_robot_commands": 0.09311820910527156, "deviation-center-line": 0.05752495602446073, "driven_lanedir_consec": 0.14273976803173394, "sim_compute_sim_state": 0.03483159725482647, "sim_compute_performance-ego": 0.06010033534123348, "sim_compute_robot_state-ego": 0.06315436730018029, "sim_compute_robot_state-npc0": 0.06659049254197341, "sim_compute_robot_state-npc1": 0.06503858933081993, "sim_compute_robot_state-npc2": 0.06364265772012564, "sim_compute_robot_state-npc3": 0.0962442526450524}, "udem1-1-0": {"driven_any": 0.16268676116628014, "sim_physics": 0.07197435970964103, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08238667281181611, "sim_render-ego": 0.09171573869113264, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.3555845309948099, "deviation-heading": 0.6979751589534597, "set_robot_commands": 0.15729975700378418, "deviation-center-line": 0.04065667616435421, "driven_lanedir_consec": 0.08238667281181611, "sim_compute_sim_state": 0.056307661122289195, "sim_compute_performance-ego": 0.102147258561233, "sim_compute_robot_state-ego": 0.10942277415045376, "sim_compute_robot_state-npc0": 0.10745186641298492, "sim_compute_robot_state-npc1": 0.09667280624652733, "sim_compute_robot_state-npc2": 0.1048070397870294, "sim_compute_robot_state-npc3": 0.099444553769868}, "udem1-2-0": {"driven_any": 0.1506392741327123, "sim_physics": 0.049694573437726056, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07538253565936515, "sim_render-ego": 0.06149812980934426, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.16700191851015445, "deviation-heading": 0.6577131889044856, "set_robot_commands": 0.09380529544971608, "deviation-center-line": 0.03787368850629095, "driven_lanedir_consec": 0.07538253565936515, "sim_compute_sim_state": 0.04073981002525047, "sim_compute_performance-ego": 0.06415130473949292, "sim_compute_robot_state-ego": 0.06664649645487468, "sim_compute_robot_state-npc0": 0.06830207506815593, "sim_compute_robot_state-npc1": 0.06921667522854275, "sim_compute_robot_state-npc2": 0.07031031891151711, "sim_compute_robot_state-npc3": 0.07061530042577673}, "udem1-3-0": {"driven_any": 0.17252353346342972, "sim_physics": 0.03765534559885661, "survival_time": 1.5000000000000009, "driven_lanedir": 0.08189315062263702, "sim_render-ego": 0.057973480224609374, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.14219419161478675, "deviation-heading": 0.625380869734437, "set_robot_commands": 0.08101008733113607, "deviation-center-line": 0.034462049149360685, "driven_lanedir_consec": 0.08189315062263702, "sim_compute_sim_state": 0.03274555206298828, "sim_compute_performance-ego": 0.05748173395792643, "sim_compute_robot_state-ego": 0.062039939562479655, "sim_compute_robot_state-npc0": 0.056739036242167154, "sim_compute_robot_state-npc1": 0.053576421737670896, "sim_compute_robot_state-npc2": 0.05403548081715902, "sim_compute_robot_state-npc3": 0.05822705427805583}, "udem1-4-0": {"driven_any": 0.1625995247558882, "sim_physics": 0.03199585278828939, "survival_time": 1.3500000000000003, "driven_lanedir": 0.101865506876331, "sim_render-ego": 0.054427641409414786, "in-drivable-lane": 0, "agent_compute-ego": 0.14855565848173918, "deviation-heading": 0.8363489530989983, "set_robot_commands": 0.08183949965017813, "deviation-center-line": 0.06620342472754193, "driven_lanedir_consec": 0.101865506876331, "sim_compute_sim_state": 0.029462487609298146, "sim_compute_performance-ego": 0.05749515250877098, "sim_compute_robot_state-ego": 0.05591150566383645, "sim_compute_robot_state-npc0": 0.059401335539641206, "sim_compute_robot_state-npc1": 0.0599027121508563, "sim_compute_robot_state-npc2": 0.05801359812418619, "sim_compute_robot_state-npc3": 0.05463113608183684}}set_robot_commands_max 0.15729975700378418 set_robot_commands_mean 0.1014145697080172 set_robot_commands_median 0.09311820910527156 set_robot_commands_min 0.08101008733113607 sim_compute_performance-ego_max 0.102147258561233 sim_compute_performance-ego_mean 0.06827515702173136 sim_compute_performance-ego_median 0.06010033534123348 sim_compute_performance-ego_min 0.05748173395792643 sim_compute_robot_state-ego_max 0.10942277415045376 sim_compute_robot_state-ego_mean 0.07143501662636496 sim_compute_robot_state-ego_median 0.06315436730018029 sim_compute_robot_state-ego_min 0.05591150566383645 sim_compute_robot_state-npc0_max 0.10745186641298492 sim_compute_robot_state-npc0_mean 0.07169696116098453 sim_compute_robot_state-npc0_median 0.06659049254197341 sim_compute_robot_state-npc0_min 0.056739036242167154 sim_compute_robot_state-npc1_max 0.09667280624652733 sim_compute_robot_state-npc1_mean 0.06888144093888345 sim_compute_robot_state-npc1_median 0.06503858933081993 sim_compute_robot_state-npc1_min 0.053576421737670896 sim_compute_robot_state-npc2_max 0.1048070397870294 sim_compute_robot_state-npc2_mean 0.07016181907200349 sim_compute_robot_state-npc2_median 0.06364265772012564 sim_compute_robot_state-npc2_min 0.05403548081715902 sim_compute_robot_state-npc3_max 0.099444553769868 sim_compute_robot_state-npc3_mean 0.07583245944011795 sim_compute_robot_state-npc3_median 0.07061530042577673 sim_compute_robot_state-npc3_min 0.05463113608183684 sim_compute_sim_state_max 0.056307661122289195 sim_compute_sim_state_mean 0.038817421614930514 sim_compute_sim_state_median 0.03483159725482647 sim_compute_sim_state_min 0.029462487609298146 sim_physics_max 0.07197435970964103 sim_physics_mean 0.04608793555290717 sim_physics_median 0.03911954623002272 sim_physics_min 0.03199585278828939 sim_render-ego_max 0.09171573869113264 sim_render-ego_mean 0.06455312949897428 sim_render-ego_median 0.057973480224609374 sim_render-ego_min 0.054427641409414786 simulation-passed 1 survival_time_max 1.5000000000000009 survival_time_mean 1.3900000000000006 survival_time_min 1.3000000000000005
No reset possible