Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 196882995Manfred Diaz challenge-aido_LF-template-tensorflow aido2-LF-sim-validationstep1-simulation error no ip-172-31-40-253-87532019-04-24 20:17:47+00:00 2019-04-24 20:20:24+00:00 0:02:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 196852990Maxim Scherbakov challenge-aido_LF-template-tensorflow aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 18:23:50+00:00 2019-04-24 18:30:07+00:00 0:06:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8456899508273221 survival_time_median 5.09999999999999 deviation-center-line_median 0.18313761697608277 in-drivable-lane_median 0.04999999999999982
other stats agent_compute-ego_max 0.08325117429097494 agent_compute-ego_mean 0.08246509328563713 agent_compute-ego_median 0.08251360787285698 agent_compute-ego_min 0.08150269831830298 deviation-center-line_max 0.4180014428760432 deviation-center-line_mean 0.2223639078229755 deviation-center-line_min 0.09960671048434468 deviation-heading_max 1.905332744617711 deviation-heading_mean 1.1839927058197963 deviation-heading_median 1.5107289837186126 deviation-heading_min 0.3947408929324547 driven_any_max 2.079936126430071 driven_any_mean 1.1265329009022371 driven_any_median 1.0705857244141463 driven_any_min 0.3766350998914698 driven_lanedir_consec_max 1.3640350924639055 driven_lanedir_consec_mean 0.8077200801522842 driven_lanedir_consec_min 0.35716760703616224 driven_lanedir_max 1.3640350924639055 driven_lanedir_mean 0.8077200801522842 driven_lanedir_median 0.8456899508273221 driven_lanedir_min 0.35716760703616224 in-drivable-lane_max 4.449999999999984 in-drivable-lane_mean 1.0699999999999965 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.481261589195794, "sim_physics": 0.013555741507159776, "survival_time": 6.0499999999999865, "driven_lanedir": 1.3640350924639055, "sim_render-ego": 0.034801295966156255, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08295910220500852, "deviation-heading": 1.5874242190287848, "set_robot_commands": 0.053783519208923845, "deviation-center-line": 0.4180014428760432, "driven_lanedir_consec": 1.3640350924639055, "sim_compute_sim_state": 0.021725487117924967, "sim_compute_performance-ego": 0.03723446396756763, "sim_compute_robot_state-ego": 0.038498990791888274}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0705857244141463, "sim_physics": 0.01310416997647753, "survival_time": 5.09999999999999, "driven_lanedir": 0.8456899508273221, "sim_render-ego": 0.034103561850155104, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0820988837410422, "deviation-heading": 1.5107289837186126, "set_robot_commands": 0.055511568106857, "deviation-center-line": 0.18313761697608277, "driven_lanedir_consec": 0.8456899508273221, "sim_compute_sim_state": 0.021876933527927772, "sim_compute_performance-ego": 0.03691526020274443, "sim_compute_robot_state-ego": 0.03824326337552538}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3766350998914698, "sim_physics": 0.012510935465494793, "survival_time": 1.5000000000000009, "driven_lanedir": 0.35716760703616224, "sim_render-ego": 0.03417910734812419, "in-drivable-lane": 0, "agent_compute-ego": 0.08325117429097494, "deviation-heading": 0.3947408929324547, "set_robot_commands": 0.055760955810546874, "deviation-center-line": 0.09960671048434468, "driven_lanedir_consec": 0.35716760703616224, "sim_compute_sim_state": 0.02197012901306152, "sim_compute_performance-ego": 0.03786274592081706, "sim_compute_robot_state-ego": 0.0391229232152303}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6242459645797064, "sim_physics": 0.01333679093254937, "survival_time": 2.25, "driven_lanedir": 0.5947791440309671, "sim_render-ego": 0.034783029556274415, "in-drivable-lane": 0, "agent_compute-ego": 0.08251360787285698, "deviation-heading": 0.5217366888014197, "set_robot_commands": 0.05366617308722602, "deviation-center-line": 0.13475465968900144, "driven_lanedir_consec": 0.5947791440309671, "sim_compute_sim_state": 0.022021055221557617, "sim_compute_performance-ego": 0.03726616965399848, "sim_compute_robot_state-ego": 0.038509501351250544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.079936126430071, "sim_physics": 0.012519231316638967, "survival_time": 8.549999999999986, "driven_lanedir": 0.8769286064030637, "sim_render-ego": 0.03433548776726974, "in-drivable-lane": 4.449999999999984, "agent_compute-ego": 0.08150269831830298, "deviation-heading": 1.905332744617711, "set_robot_commands": 0.05440957225554171, "deviation-center-line": 0.2763191090894054, "driven_lanedir_consec": 0.8769286064030637, "sim_compute_sim_state": 0.021745245359097307, "sim_compute_performance-ego": 0.037299223113478275, "sim_compute_robot_state-ego": 0.03790162739000822}}set_robot_commands_max 0.055760955810546874 set_robot_commands_mean 0.054626357693819086 set_robot_commands_median 0.05440957225554171 set_robot_commands_min 0.05366617308722602 sim_compute_performance-ego_max 0.03786274592081706 sim_compute_performance-ego_mean 0.037315572571721176 sim_compute_performance-ego_median 0.03726616965399848 sim_compute_performance-ego_min 0.03691526020274443 sim_compute_robot_state-ego_max 0.0391229232152303 sim_compute_robot_state-ego_mean 0.03845526122478054 sim_compute_robot_state-ego_median 0.038498990791888274 sim_compute_robot_state-ego_min 0.03790162739000822 sim_compute_sim_state_max 0.022021055221557617 sim_compute_sim_state_mean 0.02186777004791384 sim_compute_sim_state_median 0.021876933527927772 sim_compute_sim_state_min 0.021725487117924967 sim_physics_max 0.013555741507159776 sim_physics_mean 0.013005373839664084 sim_physics_median 0.01310416997647753 sim_physics_min 0.012510935465494793 sim_render-ego_max 0.034801295966156255 sim_render-ego_mean 0.03444049649759594 sim_render-ego_median 0.03433548776726974 sim_render-ego_min 0.034103561850155104 simulation-passed 1 survival_time_max 8.549999999999986 survival_time_mean 4.689999999999992 survival_time_min 1.5000000000000009
No reset possible 196652371Liam Paull minimal_agent (Python 3) aido2-LFV-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 16:33:30+00:00 2019-04-24 16:51:34+00:00 0:18:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2271628965464352 survival_time_median 10.800000000000018 deviation-center-line_median 0.4302836987803837 in-drivable-lane_median 2.0499999999999927
other stats agent_compute-ego_max 0.14391026337941487 agent_compute-ego_mean 0.1223291337109292 agent_compute-ego_median 0.11829535093175653 agent_compute-ego_min 0.10794817076789008 deviation-center-line_max 0.5576039074284667 deviation-center-line_mean 0.3744391706010032 deviation-center-line_min 0.1475671628461062 deviation-heading_max 1.826624936691222 deviation-heading_mean 1.1745965471911113 deviation-heading_median 0.9779276407610488 deviation-heading_min 0.7451786321286323 driven_any_max 2.1956524856063173 driven_any_mean 1.585349600382327 driven_any_median 1.5771367475578253 driven_any_min 0.993745776226499 driven_lanedir_consec_max 1.659262210665728 driven_lanedir_consec_mean 1.1960969538526285 driven_lanedir_consec_min 0.6474115509746436 driven_lanedir_max 1.659262210665728 driven_lanedir_mean 1.1960969538526285 driven_lanedir_median 1.2271628965464352 driven_lanedir_min 0.6474115509746436 in-drivable-lane_max 3.5000000000000497 in-drivable-lane_mean 2.280000000000025 in-drivable-lane_min 1.7000000000000242 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.03444897356650812, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.05667814933996406, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.13243290674772193, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.08116217311337698, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.03505994947694188, "sim_compute_performance-ego": 0.06240684351475119, "sim_compute_robot_state-ego": 0.06483898059927302, "sim_compute_robot_state-npc0": 0.06200279777856182, "sim_compute_robot_state-npc1": 0.06310893820344116, "sim_compute_robot_state-npc2": 0.06281165596392514, "sim_compute_robot_state-npc3": 0.061063968877998184}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1956524856063173, "sim_physics": 0.03516266504923503, "survival_time": 14.950000000000076, "driven_lanedir": 1.659262210665728, "sim_render-ego": 0.05999520222345988, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.14391026337941487, "deviation-heading": 0.9779276407610488, "set_robot_commands": 0.08856504440307617, "deviation-center-line": 0.5576039074284667, "driven_lanedir_consec": 1.659262210665728, "sim_compute_sim_state": 0.03510601361592611, "sim_compute_performance-ego": 0.06325397968292236, "sim_compute_robot_state-ego": 0.06655237595240275, "sim_compute_robot_state-npc0": 0.06395571708679199, "sim_compute_robot_state-npc1": 0.06342819770177205, "sim_compute_robot_state-npc2": 0.06267963171005249, "sim_compute_robot_state-npc3": 0.06294948339462281}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.583473805081668, "sim_physics": 0.02781531338318152, "survival_time": 10.85000000000002, "driven_lanedir": 1.243796514016382, "sim_render-ego": 0.04725465906380509, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11829535093175653, "deviation-heading": 1.4958981170639498, "set_robot_commands": 0.07245586215076359, "deviation-center-line": 0.28274302907821136, "driven_lanedir_consec": 1.243796514016382, "sim_compute_sim_state": 0.033610618608887845, "sim_compute_performance-ego": 0.05098758205290763, "sim_compute_robot_state-ego": 0.053259235373290456, "sim_compute_robot_state-npc0": 0.05338531924832251, "sim_compute_robot_state-npc1": 0.05274674529853504, "sim_compute_robot_state-npc2": 0.05136897816636046, "sim_compute_robot_state-npc3": 0.05347130705134659}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5767391874393253, "sim_physics": 0.02596095866627163, "survival_time": 10.800000000000018, "driven_lanedir": 1.2271628965464352, "sim_render-ego": 0.04181124214772825, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.10794817076789008, "deviation-heading": 1.826624936691222, "set_robot_commands": 0.06574132817762869, "deviation-center-line": 0.4302836987803837, "driven_lanedir_consec": 1.2271628965464352, "sim_compute_sim_state": 0.026362004103483976, "sim_compute_performance-ego": 0.045253987665529606, "sim_compute_robot_state-ego": 0.04695567378291377, "sim_compute_robot_state-npc0": 0.04757716589503818, "sim_compute_robot_state-npc1": 0.046269220334512216, "sim_compute_robot_state-npc2": 0.045769987282929595, "sim_compute_robot_state-npc3": 0.0468081169658237}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771367475578253, "sim_physics": 0.02447031930435535, "survival_time": 10.750000000000018, "driven_lanedir": 1.2028515970599525, "sim_render-ego": 0.04242646416952444, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.10905897672786267, "deviation-heading": 0.7451786321286323, "set_robot_commands": 0.06540424435637718, "deviation-center-line": 0.4539980548718481, "driven_lanedir_consec": 1.2028515970599525, "sim_compute_sim_state": 0.026566975615745368, "sim_compute_performance-ego": 0.044908003474390785, "sim_compute_robot_state-ego": 0.04672487391981968, "sim_compute_robot_state-npc0": 0.047902922297632974, "sim_compute_robot_state-npc1": 0.04716117326603379, "sim_compute_robot_state-npc2": 0.04848123927449071, "sim_compute_robot_state-npc3": 0.04803221502969431}}set_robot_commands_max 0.08856504440307617 set_robot_commands_mean 0.07466573044024452 set_robot_commands_median 0.07245586215076359 set_robot_commands_min 0.06540424435637718 sim_compute_performance-ego_max 0.06325397968292236 sim_compute_performance-ego_mean 0.05336207927810031 sim_compute_performance-ego_median 0.05098758205290763 sim_compute_performance-ego_min 0.044908003474390785 sim_compute_robot_state-ego_max 0.06655237595240275 sim_compute_robot_state-ego_mean 0.055666227925539935 sim_compute_robot_state-ego_median 0.053259235373290456 sim_compute_robot_state-ego_min 0.04672487391981968 sim_compute_robot_state-npc0_max 0.06395571708679199 sim_compute_robot_state-npc0_mean 0.0549647844612695 sim_compute_robot_state-npc0_median 0.05338531924832251 sim_compute_robot_state-npc0_min 0.04757716589503818 sim_compute_robot_state-npc1_max 0.06342819770177205 sim_compute_robot_state-npc1_mean 0.05454285496085885 sim_compute_robot_state-npc1_median 0.05274674529853504 sim_compute_robot_state-npc1_min 0.046269220334512216 sim_compute_robot_state-npc2_max 0.06281165596392514 sim_compute_robot_state-npc2_mean 0.05422229847955168 sim_compute_robot_state-npc2_median 0.05136897816636046 sim_compute_robot_state-npc2_min 0.045769987282929595 sim_compute_robot_state-npc3_max 0.06294948339462281 sim_compute_robot_state-npc3_mean 0.05446501826389712 sim_compute_robot_state-npc3_median 0.05347130705134659 sim_compute_robot_state-npc3_min 0.0468081169658237 sim_compute_sim_state_max 0.03510601361592611 sim_compute_sim_state_mean 0.03134111228419703 sim_compute_sim_state_median 0.033610618608887845 sim_compute_sim_state_min 0.026362004103483976 sim_physics_max 0.03516266504923503 sim_physics_mean 0.029571645993910333 sim_physics_median 0.02781531338318152 sim_physics_min 0.02447031930435535 sim_render-ego_max 0.05999520222345988 sim_render-ego_mean 0.04963314338889634 sim_render-ego_median 0.04725465906380509 sim_render-ego_min 0.04181124214772825 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.860000000000024 survival_time_min 6.949999999999983
No reset possible 196532386Andrea Censi Baseline solution using reinforcement learning aido2-LFV-sim-validationstep1-simulation success no ip-172-31-40-253-87532019-04-24 16:27:45+00:00 2019-04-24 16:33:04+00:00 0:05:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.04508588271213532 survival_time_median 1.6500000000000008 deviation-center-line_median 0.02338593978007875 in-drivable-lane_median 0.5500000000000005
other stats agent_compute-ego_max 0.17465814677151767 agent_compute-ego_mean 0.1623734292871387 agent_compute-ego_median 0.15807121641495647 agent_compute-ego_min 0.1561904475092888 deviation-center-line_max 0.039449414687960024 deviation-center-line_mean 0.027407604391871333 deviation-center-line_min 0.021733933101080308 deviation-heading_max 0.7332471951499171 deviation-heading_mean 0.6559745565863114 deviation-heading_median 0.6423221613309326 deviation-heading_min 0.629158350131957 driven_any_max 0.1598691842418699 driven_any_mean 0.15017275335979577 driven_any_median 0.14864974063723366 driven_any_min 0.1403505589189591 driven_lanedir_consec_max 0.06639356656401585 driven_lanedir_consec_mean 0.04996774113442657 driven_lanedir_consec_min 0.04004141042224196 driven_lanedir_max 0.06639356656401585 driven_lanedir_mean 0.04996774113442657 driven_lanedir_median 0.04508588271213532 driven_lanedir_min 0.04004141042224196 in-drivable-lane_max 0.7000000000000006 in-drivable-lane_mean 0.5700000000000005 in-drivable-lane_min 0.5000000000000004 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15665265200303904, "sim_physics": 0.035753533244132996, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05820615611147417, "sim_render-ego": 0.055015929043293, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15703462809324265, "deviation-heading": 0.6423221613309326, "set_robot_commands": 0.08443712443113327, "deviation-center-line": 0.03055569802400375, "driven_lanedir_consec": 0.05820615611147417, "sim_compute_sim_state": 0.03912883251905441, "sim_compute_performance-ego": 0.06031346321105957, "sim_compute_robot_state-ego": 0.06886649131774902, "sim_compute_robot_state-npc0": 0.06238677352666855, "sim_compute_robot_state-npc1": 0.06268687546253204, "sim_compute_robot_state-npc2": 0.06666476279497147, "sim_compute_robot_state-npc3": 0.06873992830514908}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1598691842418699, "sim_physics": 0.030976007966434255, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06639356656401585, "sim_render-ego": 0.05343508720397949, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15807121641495647, "deviation-heading": 0.7332471951499171, "set_robot_commands": 0.09171438217163086, "deviation-center-line": 0.039449414687960024, "driven_lanedir_consec": 0.06639356656401585, "sim_compute_sim_state": 0.034224468119004196, "sim_compute_performance-ego": 0.062014713006861066, "sim_compute_robot_state-ego": 0.06313101684345919, "sim_compute_robot_state-npc0": 0.06321424596449908, "sim_compute_robot_state-npc1": 0.06608002326067756, "sim_compute_robot_state-npc2": 0.061371992616092455, "sim_compute_robot_state-npc3": 0.061446210917304546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1403505589189591, "sim_physics": 0.03732902353460139, "survival_time": 1.6500000000000008, "driven_lanedir": 0.04004141042224196, "sim_render-ego": 0.059655066692467895, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.17465814677151767, "deviation-heading": 0.629158350131957, "set_robot_commands": 0.09083022493304628, "deviation-center-line": 0.02191303636623381, "driven_lanedir_consec": 0.04004141042224196, "sim_compute_sim_state": 0.03548809253808224, "sim_compute_performance-ego": 0.0680339697635535, "sim_compute_robot_state-ego": 0.06674945715701941, "sim_compute_robot_state-npc0": 0.06328926664410216, "sim_compute_robot_state-npc1": 0.06497788429260254, "sim_compute_robot_state-npc2": 0.06347146178736832, "sim_compute_robot_state-npc3": 0.05877676154627944}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14864974063723366, "sim_physics": 0.035933636128902435, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04011168986226554, "sim_render-ego": 0.060378365218639374, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1561904475092888, "deviation-heading": 0.6316026058348523, "set_robot_commands": 0.09146609157323836, "deviation-center-line": 0.021733933101080308, "driven_lanedir_consec": 0.04011168986226554, "sim_compute_sim_state": 0.03615376353263855, "sim_compute_performance-ego": 0.06678140163421631, "sim_compute_robot_state-ego": 0.06831692904233932, "sim_compute_robot_state-npc0": 0.06569486856460571, "sim_compute_robot_state-npc1": 0.06386655569076538, "sim_compute_robot_state-npc2": 0.06006406247615814, "sim_compute_robot_state-npc3": 0.05907893180847168}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1453416309978771, "sim_physics": 0.034455445077684194, "survival_time": 1.800000000000001, "driven_lanedir": 0.04508588271213532, "sim_render-ego": 0.06073927879333496, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16591270764668783, "deviation-heading": 0.643542470483898, "set_robot_commands": 0.08828465806113349, "deviation-center-line": 0.02338593978007875, "driven_lanedir_consec": 0.04508588271213532, "sim_compute_sim_state": 0.03608030743069119, "sim_compute_performance-ego": 0.06276342603895399, "sim_compute_robot_state-ego": 0.06712250577078925, "sim_compute_robot_state-npc0": 0.06506666209962633, "sim_compute_robot_state-npc1": 0.06509790155622694, "sim_compute_robot_state-npc2": 0.06646482149759929, "sim_compute_robot_state-npc3": 0.06424478027555677}}set_robot_commands_max 0.09171438217163086 set_robot_commands_mean 0.08934649623403645 set_robot_commands_median 0.09083022493304628 set_robot_commands_min 0.08443712443113327 sim_compute_performance-ego_max 0.0680339697635535 sim_compute_performance-ego_mean 0.0639813947309289 sim_compute_performance-ego_median 0.06276342603895399 sim_compute_performance-ego_min 0.06031346321105957 sim_compute_robot_state-ego_max 0.06886649131774902 sim_compute_robot_state-ego_mean 0.06683728002627123 sim_compute_robot_state-ego_median 0.06712250577078925 sim_compute_robot_state-ego_min 0.06313101684345919 sim_compute_robot_state-npc0_max 0.06569486856460571 sim_compute_robot_state-npc0_mean 0.06393036335990036 sim_compute_robot_state-npc0_median 0.06328926664410216 sim_compute_robot_state-npc0_min 0.06238677352666855 sim_compute_robot_state-npc1_max 0.06608002326067756 sim_compute_robot_state-npc1_mean 0.06454184805256089 sim_compute_robot_state-npc1_median 0.06497788429260254 sim_compute_robot_state-npc1_min 0.06268687546253204 sim_compute_robot_state-npc2_max 0.06666476279497147 sim_compute_robot_state-npc2_mean 0.06360742023443794 sim_compute_robot_state-npc2_median 0.06347146178736832 sim_compute_robot_state-npc2_min 0.06006406247615814 sim_compute_robot_state-npc3_max 0.06873992830514908 sim_compute_robot_state-npc3_mean 0.062457322570552296 sim_compute_robot_state-npc3_median 0.061446210917304546 sim_compute_robot_state-npc3_min 0.05877676154627944 sim_compute_sim_state_max 0.03912883251905441 sim_compute_sim_state_mean 0.03621509282789412 sim_compute_sim_state_median 0.03608030743069119 sim_compute_sim_state_min 0.034224468119004196 sim_physics_max 0.03732902353460139 sim_physics_mean 0.03488952919035106 sim_physics_median 0.035753533244132996 sim_physics_min 0.030976007966434255 sim_render-ego_max 0.06073927879333496 sim_render-ego_mean 0.05784474539034294 sim_render-ego_median 0.059655066692467895 sim_render-ego_min 0.05343508720397949 simulation-passed 1 survival_time_max 1.800000000000001 survival_time_mean 1.670000000000001 survival_time_min 1.6000000000000008
No reset possible 196352408jiang peng Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 16:08:07+00:00 2019-04-24 16:27:13+00:00 0:19:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.3614583993086016 survival_time_median 14.950000000000076 deviation-center-line_median 1.011969887428033 in-drivable-lane_median 4.050000000000022
other stats agent_compute-ego_max 0.1598956060409546 agent_compute-ego_mean 0.15148377784093223 agent_compute-ego_median 0.15054130872090657 agent_compute-ego_min 0.14709660689036053 deviation-center-line_max 1.0119709059919424 deviation-center-line_mean 1.0119700704341597 deviation-center-line_min 1.0119697838947566 deviation-heading_max 6.81542792438532 deviation-heading_mean 6.815427924385318 deviation-heading_median 6.815427924385319 deviation-heading_min 6.815427924385317 driven_any_max 4.390824152784936 driven_any_mean 4.390824152784928 driven_any_median 4.390824152784926 driven_any_min 4.390824152784922 driven_lanedir_consec_max -1.361452200425545 driven_lanedir_consec_mean -1.3614594960339783 driven_lanedir_consec_min -1.3614696049818191 driven_lanedir_max -2.315814608416598 driven_lanedir_mean -2.3158178509092298 driven_lanedir_median -2.3158179462767055 driven_lanedir_min -2.315821760973971 in-drivable-lane_max 4.050000000000022 in-drivable-lane_mean 4.050000000000022 in-drivable-lane_min 4.050000000000022 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.021572516759236653, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.05964197556177775, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1598956060409546, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.09057121435801188, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.036399687925974526, "sim_compute_performance-ego": 0.0645939326286316, "sim_compute_robot_state-ego": 0.06739850362141928}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.01991275389989217, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.055619425773620605, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15054130872090657, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08550422350565592, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.03461433172225952, "sim_compute_performance-ego": 0.060862067540486654, "sim_compute_robot_state-ego": 0.06464402119318645}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.0227192751566569, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.05227709293365478, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14709660689036053, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08453777392705282, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.0324534805615743, "sim_compute_performance-ego": 0.06008465846379598, "sim_compute_robot_state-ego": 0.06337079683939616}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.02073789596557617, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05345597267150879, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1507964595158895, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08323804537455241, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03365492264429728, "sim_compute_performance-ego": 0.05843373139699301, "sim_compute_robot_state-ego": 0.061187469959259035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.021671339670817056, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05433263619740804, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1490889080365499, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08287293831507365, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03443942228953044, "sim_compute_performance-ego": 0.05962692022323608, "sim_compute_robot_state-ego": 0.06259946505228678}}set_robot_commands_max 0.09057121435801188 set_robot_commands_mean 0.08534483909606934 set_robot_commands_median 0.08453777392705282 set_robot_commands_min 0.08287293831507365 sim_compute_performance-ego_max 0.0645939326286316 sim_compute_performance-ego_mean 0.06072026205062867 sim_compute_performance-ego_median 0.06008465846379598 sim_compute_performance-ego_min 0.05843373139699301 sim_compute_robot_state-ego_max 0.06739850362141928 sim_compute_robot_state-ego_mean 0.06384005133310955 sim_compute_robot_state-ego_median 0.06337079683939616 sim_compute_robot_state-ego_min 0.061187469959259035 sim_compute_sim_state_max 0.036399687925974526 sim_compute_sim_state_mean 0.03431236902872722 sim_compute_sim_state_median 0.03443942228953044 sim_compute_sim_state_min 0.0324534805615743 sim_physics_max 0.0227192751566569 sim_physics_mean 0.02132275629043579 sim_physics_median 0.021572516759236653 sim_physics_min 0.01991275389989217 sim_render-ego_max 0.05964197556177775 sim_render-ego_mean 0.055065420627593994 sim_render-ego_median 0.05433263619740804 sim_render-ego_min 0.05227709293365478 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 196172441Jacopo Tani random_agent aido2-LFV-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 16:00:16+00:00 2019-04-24 16:07:33+00:00 0:07:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1541722662308637 agent_compute-ego_mean 0.14105841998097784 agent_compute-ego_median 0.14301128685474396 agent_compute-ego_min 0.12514332105528633 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03183397706949486, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.053228126381928066, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12514332105528633, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07910378474109578, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03169357551718658, "sim_compute_performance-ego": 0.0575536107117275, "sim_compute_robot_state-ego": 0.06288284625647203, "sim_compute_robot_state-npc0": 0.05926032786099416, "sim_compute_robot_state-npc1": 0.062190883564499186, "sim_compute_robot_state-npc2": 0.059115949666725016, "sim_compute_robot_state-npc3": 0.05974612146053674}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.036421006376093086, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05723117698322643, "in-drivable-lane": 0, "agent_compute-ego": 0.14816570823842828, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08868620070544156, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.034401861104098236, "sim_compute_performance-ego": 0.06298248876224864, "sim_compute_robot_state-ego": 0.06720532070506703, "sim_compute_robot_state-npc0": 0.0602415149862116, "sim_compute_robot_state-npc1": 0.06216125596653332, "sim_compute_robot_state-npc2": 0.06045000661503185, "sim_compute_robot_state-npc3": 0.0607436786998402}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03472467528449164, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.057921049329969616, "in-drivable-lane": 0, "agent_compute-ego": 0.13479951752556696, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08741679191589355, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.0339816517300076, "sim_compute_performance-ego": 0.06245938407050239, "sim_compute_robot_state-ego": 0.06489686436123318, "sim_compute_robot_state-npc0": 0.06228818363613552, "sim_compute_robot_state-npc1": 0.057481278313530816, "sim_compute_robot_state-npc2": 0.058454709582858616, "sim_compute_robot_state-npc3": 0.05905161433749729}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03775148093700409, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05717900395393371, "in-drivable-lane": 0, "agent_compute-ego": 0.14301128685474396, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08775918185710907, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03630910317103068, "sim_compute_performance-ego": 0.06261032819747925, "sim_compute_robot_state-ego": 0.0670339862505595, "sim_compute_robot_state-npc0": 0.06330413619677226, "sim_compute_robot_state-npc1": 0.06531499822934468, "sim_compute_robot_state-npc2": 0.0635429173707962, "sim_compute_robot_state-npc3": 0.06405578056971233}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04144018187242396, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06363601544324089, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1541722662308637, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09426636555615592, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03965626043431899, "sim_compute_performance-ego": 0.06721100035835714, "sim_compute_robot_state-ego": 0.0707895790829378, "sim_compute_robot_state-npc0": 0.06897460362490486, "sim_compute_robot_state-npc1": 0.06929055732839248, "sim_compute_robot_state-npc2": 0.06957321657853968, "sim_compute_robot_state-npc3": 0.06832823332618265}}set_robot_commands_max 0.09426636555615592 set_robot_commands_mean 0.08744646495513918 set_robot_commands_median 0.08775918185710907 set_robot_commands_min 0.07910378474109578 sim_compute_performance-ego_max 0.06721100035835714 sim_compute_performance-ego_mean 0.06256336242006298 sim_compute_performance-ego_median 0.06261032819747925 sim_compute_performance-ego_min 0.0575536107117275 sim_compute_robot_state-ego_max 0.0707895790829378 sim_compute_robot_state-ego_mean 0.0665617193312539 sim_compute_robot_state-ego_median 0.0670339862505595 sim_compute_robot_state-ego_min 0.06288284625647203 sim_compute_robot_state-npc0_max 0.06897460362490486 sim_compute_robot_state-npc0_mean 0.06281375326100368 sim_compute_robot_state-npc0_median 0.06228818363613552 sim_compute_robot_state-npc0_min 0.05926032786099416 sim_compute_robot_state-npc1_max 0.06929055732839248 sim_compute_robot_state-npc1_mean 0.06328779468046009 sim_compute_robot_state-npc1_median 0.062190883564499186 sim_compute_robot_state-npc1_min 0.057481278313530816 sim_compute_robot_state-npc2_max 0.06957321657853968 sim_compute_robot_state-npc2_mean 0.062227359962790274 sim_compute_robot_state-npc2_median 0.06045000661503185 sim_compute_robot_state-npc2_min 0.058454709582858616 sim_compute_robot_state-npc3_max 0.06832823332618265 sim_compute_robot_state-npc3_mean 0.06238508567875384 sim_compute_robot_state-npc3_median 0.0607436786998402 sim_compute_robot_state-npc3_min 0.05905161433749729 sim_compute_sim_state_max 0.03965626043431899 sim_compute_sim_state_mean 0.035208490391328416 sim_compute_sim_state_median 0.034401861104098236 sim_compute_sim_state_min 0.03169357551718658 sim_physics_max 0.04144018187242396 sim_physics_mean 0.036434264307901525 sim_physics_median 0.036421006376093086 sim_physics_min 0.03183397706949486 sim_render-ego_max 0.06363601544324089 sim_render-ego_mean 0.05783907441845974 sim_render-ego_median 0.05723117698322643 sim_render-ego_min 0.053228126381928066 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 196002442Jacopo Tani random_agent aido2-LFV-sim-validationstep1-simulation host-error no ip-172-31-40-253-87532019-04-24 15:53:59+00:00 2019-04-24 16:00:04+00:00 0:06:05 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19600-596141', 'ps', '-q', 'solution']' returned non-zero exit status 255.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19600-596141', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19600-596141', 'ps', '-q', 'solution']' returned non-zero exit status 255.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195682472Liam Paull challenge-aido_LF-template-random aido2-LFV-sim-validationstep1-simulation success no ip-172-31-40-253-87532019-04-24 15:46:36+00:00 2019-04-24 15:53:44+00:00 0:07:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9097625228344608 survival_time_median 2.3999999999999995 deviation-center-line_median 0.09850417100304978 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1546134352684021 agent_compute-ego_mean 0.1350650254254689 agent_compute-ego_median 0.13513643542925516 agent_compute-ego_min 0.11055598169002892 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10656223356403702 deviation-center-line_min 0.07952733817751276 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.23093022559873316 deviation-heading_median 0.23417405060778035 deviation-heading_min 0.1984807025035913 driven_any_max 1.4367438864906794 driven_any_mean 1.0309070915612302 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162903 driven_lanedir_consec_max 0.9542194653539162 driven_lanedir_consec_mean 0.8288426551719738 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542194653539162 driven_lanedir_mean 0.8288426551719738 driven_lanedir_median 0.9097625228344608 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4199999999999989 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025502110427280643, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04354498521336969, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11055598169002892, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.06911620104087973, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.02672722204676214, "sim_compute_performance-ego": 0.04683126593535801, "sim_compute_robot_state-ego": 0.050087024580757575, "sim_compute_robot_state-npc0": 0.04905750166695073, "sim_compute_robot_state-npc1": 0.04754478076718888, "sim_compute_robot_state-npc2": 0.04760256803260659, "sim_compute_robot_state-npc3": 0.047255115688971755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03697912259535356, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05733460187911987, "in-drivable-lane": 0, "agent_compute-ego": 0.1546134352684021, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0947674729607322, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.034484061327847565, "sim_compute_performance-ego": 0.06187916885722767, "sim_compute_robot_state-ego": 0.0627707459709861, "sim_compute_robot_state-npc0": 0.06419169902801514, "sim_compute_robot_state-npc1": 0.06933406266299161, "sim_compute_robot_state-npc2": 0.0669265931302851, "sim_compute_robot_state-npc3": 0.06452401659705422}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03610721694098579, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0555137316385905, "in-drivable-lane": 0, "agent_compute-ego": 0.13218936920166016, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.0820310115814209, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.0343876149919298, "sim_compute_performance-ego": 0.0602475643157959, "sim_compute_robot_state-ego": 0.06064306365119086, "sim_compute_robot_state-npc0": 0.061753103468153214, "sim_compute_robot_state-npc1": 0.06167136828104655, "sim_compute_robot_state-npc2": 0.061061588923136394, "sim_compute_robot_state-npc3": 0.06005226771036784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03396996855735779, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05705278615156809, "in-drivable-lane": 0, "agent_compute-ego": 0.13513643542925516, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08031327525774638, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03543361028035482, "sim_compute_performance-ego": 0.06203560531139374, "sim_compute_robot_state-ego": 0.06017932792504629, "sim_compute_robot_state-npc0": 0.06160147488117218, "sim_compute_robot_state-npc1": 0.06009587645530701, "sim_compute_robot_state-npc2": 0.060023615757624306, "sim_compute_robot_state-npc3": 0.061084831754366554}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03984739499933579, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05592121797449449, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.142829905537998, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09003116102779612, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03528426324619966, "sim_compute_performance-ego": 0.06323949379079483, "sim_compute_robot_state-ego": 0.06813467951381907, "sim_compute_robot_state-npc0": 0.06308111373115988, "sim_compute_robot_state-npc1": 0.06322667879216812, "sim_compute_robot_state-npc2": 0.06151847979601692, "sim_compute_robot_state-npc3": 0.0637709007543676}}set_robot_commands_max 0.0947674729607322 set_robot_commands_mean 0.08325182437371506 set_robot_commands_median 0.0820310115814209 set_robot_commands_min 0.06911620104087973 sim_compute_performance-ego_max 0.06323949379079483 sim_compute_performance-ego_mean 0.05884661964211403 sim_compute_performance-ego_median 0.06187916885722767 sim_compute_performance-ego_min 0.04683126593535801 sim_compute_robot_state-ego_max 0.06813467951381907 sim_compute_robot_state-ego_mean 0.06036296832835999 sim_compute_robot_state-ego_median 0.06064306365119086 sim_compute_robot_state-ego_min 0.050087024580757575 sim_compute_robot_state-npc0_max 0.06419169902801514 sim_compute_robot_state-npc0_mean 0.059936978555090226 sim_compute_robot_state-npc0_median 0.061753103468153214 sim_compute_robot_state-npc0_min 0.04905750166695073 sim_compute_robot_state-npc1_max 0.06933406266299161 sim_compute_robot_state-npc1_mean 0.06037455339174043 sim_compute_robot_state-npc1_median 0.06167136828104655 sim_compute_robot_state-npc1_min 0.04754478076718888 sim_compute_robot_state-npc2_max 0.0669265931302851 sim_compute_robot_state-npc2_mean 0.059426569127933856 sim_compute_robot_state-npc2_median 0.061061588923136394 sim_compute_robot_state-npc2_min 0.04760256803260659 sim_compute_robot_state-npc3_max 0.06452401659705422 sim_compute_robot_state-npc3_mean 0.059337426501025595 sim_compute_robot_state-npc3_median 0.061084831754366554 sim_compute_robot_state-npc3_min 0.047255115688971755 sim_compute_sim_state_max 0.03543361028035482 sim_compute_sim_state_mean 0.0332633543786188 sim_compute_sim_state_median 0.034484061327847565 sim_compute_sim_state_min 0.02672722204676214 sim_physics_max 0.03984739499933579 sim_physics_mean 0.034481162704062714 sim_physics_median 0.03610721694098579 sim_physics_min 0.025502110427280643 sim_render-ego_max 0.05733460187911987 sim_render-ego_mean 0.05387346457142853 sim_render-ego_median 0.05592121797449449 sim_render-ego_min 0.04354498521336969 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 195432533Liam Paull baseline-IL-sim-tensorflow aido2-LFV-sim-validationstep1-simulation error no ip-172-31-40-253-87532019-04-24 15:43:23+00:00 2019-04-24 15:46:23+00:00 0:03:00 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 195252547Andrea Censi challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 15:38:13+00:00 2019-04-24 15:43:10+00:00 0:04:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07498381012364437 agent_compute-ego_mean 0.061791318183360665 agent_compute-ego_median 0.06837395783309098 agent_compute-ego_min 0.04440556122706486 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.026818912203718976, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05909850829985083, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07028384906489675, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09885229133978124, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03837167344442228, "sim_compute_performance-ego": 0.06633821347864663, "sim_compute_robot_state-ego": 0.07184248435788038}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015956603563748874, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.04058733353248009, "in-drivable-lane": 0, "agent_compute-ego": 0.04440556122706486, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.06110667265378512, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.026875761839059684, "sim_compute_performance-ego": 0.04403714950268085, "sim_compute_robot_state-ego": 0.046525964370140664}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01594496787862575, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.042287623628656915, "in-drivable-lane": 0, "agent_compute-ego": 0.050909412668106405, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.06783390552439589, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.026401443684354743, "sim_compute_performance-ego": 0.04434988346505672, "sim_compute_robot_state-ego": 0.046313169154715034}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.028442739130376454, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.057905529881571674, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06837395783309098, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09772366743821365, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03576009876125461, "sim_compute_performance-ego": 0.06295866756648807, "sim_compute_robot_state-ego": 0.06628987553355457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.028086919533578975, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06223119560040926, "in-drivable-lane": 0, "agent_compute-ego": 0.07498381012364437, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.08474430285002056, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.036459427130849736, "sim_compute_performance-ego": 0.06617559884723864, "sim_compute_robot_state-ego": 0.07818855737384997}}set_robot_commands_max 0.09885229133978124 set_robot_commands_mean 0.08205216796123929 set_robot_commands_median 0.08474430285002056 set_robot_commands_min 0.06110667265378512 sim_compute_performance-ego_max 0.06633821347864663 sim_compute_performance-ego_mean 0.05677190257202218 sim_compute_performance-ego_median 0.06295866756648807 sim_compute_performance-ego_min 0.04403714950268085 sim_compute_robot_state-ego_max 0.07818855737384997 sim_compute_robot_state-ego_mean 0.061832010158028125 sim_compute_robot_state-ego_median 0.06628987553355457 sim_compute_robot_state-ego_min 0.046313169154715034 sim_compute_sim_state_max 0.03837167344442228 sim_compute_sim_state_mean 0.03277368097198821 sim_compute_sim_state_median 0.03576009876125461 sim_compute_sim_state_min 0.026401443684354743 sim_physics_max 0.028442739130376454 sim_physics_mean 0.02305002846200981 sim_physics_median 0.026818912203718976 sim_physics_min 0.01594496787862575 sim_render-ego_max 0.06223119560040926 sim_render-ego_mean 0.05242203818859374 sim_render-ego_median 0.057905529881571674 sim_render-ego_min 0.04058733353248009 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 194962595Julian Zilly baseline-IL-logs-tensorflow aido2-LFVI-sim-validationstep1-simulation success no ip-172-31-40-253-87532019-04-24 15:25:27+00:00 2019-04-24 15:37:44+00:00 0:12:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24078993638235957 survival_time_median 5.1999999999999895 deviation-center-line_median 0.27374860136762763 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2339747571028196 agent_compute-ego_mean 0.21747453087478297 agent_compute-ego_median 0.22069514714754543 agent_compute-ego_min 0.19247620380841768 deviation-center-line_max 0.28661156372076985 deviation-center-line_mean 0.2642549129187078 deviation-center-line_min 0.2386550711810428 deviation-heading_max 2.1589213832840572 deviation-heading_mean 2.0436204663806157 deviation-heading_median 2.0324383108132853 deviation-heading_min 1.9591987880454211 driven_any_max 0.2851947209782123 driven_any_mean 0.2790080254672388 driven_any_median 0.27879609124800264 driven_any_min 0.27103970319867854 driven_lanedir_consec_max 0.24838332330330437 driven_lanedir_consec_mean 0.24137609014412037 driven_lanedir_consec_min 0.23259433434817375 driven_lanedir_max 0.24838332330330437 driven_lanedir_mean 0.24137609014412037 driven_lanedir_median 0.24078993638235957 driven_lanedir_min 0.23259433434817375 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.2851947209782123, "sim_physics": 0.03627394712888277, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24838332330330437, "sim_render-ego": 0.0548252509190486, "in-drivable-lane": 0, "agent_compute-ego": 0.19247620380841768, "deviation-heading": 2.0324383108132853, "set_robot_commands": 0.07933220267295837, "deviation-center-line": 0.27374860136762763, "driven_lanedir_consec": 0.24838332330330437, "sim_compute_sim_state": 0.034129016674481906, "sim_compute_performance-ego": 0.05865486768575815, "sim_compute_robot_state-ego": 0.06013408074012169, "sim_compute_robot_state-npc0": 0.05743389633985666, "sim_compute_robot_state-npc1": 0.05827895953105046, "sim_compute_robot_state-npc2": 0.058668127426734336, "sim_compute_robot_state-npc3": 0.05949495847408588}, "udem1-1-0": {"driven_any": 0.27879609124800264, "sim_physics": 0.042502799859413735, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24078993638235957, "sim_render-ego": 0.06418214623744671, "in-drivable-lane": 0, "agent_compute-ego": 0.22069514714754543, "deviation-heading": 1.9591987880454211, "set_robot_commands": 0.09349609567568852, "deviation-center-line": 0.2386550711810428, "driven_lanedir_consec": 0.24078993638235957, "sim_compute_sim_state": 0.03422155747046837, "sim_compute_performance-ego": 0.06426471471786499, "sim_compute_robot_state-ego": 0.06293508868951064, "sim_compute_robot_state-npc0": 0.06346854338279137, "sim_compute_robot_state-npc1": 0.06402310270529527, "sim_compute_robot_state-npc2": 0.07470872539740342, "sim_compute_robot_state-npc3": 0.06180584889191847}, "udem1-2-0": {"driven_any": 0.27682988157580996, "sim_physics": 0.04729834343623189, "survival_time": 5.14999999999999, "driven_lanedir": 0.23805978974523656, "sim_render-ego": 0.05780326509938657, "in-drivable-lane": 0, "agent_compute-ego": 0.22901765351156583, "deviation-heading": 2.1589213832840572, "set_robot_commands": 0.09092150382625248, "deviation-center-line": 0.28661156372076985, "driven_lanedir_consec": 0.23805978974523656, "sim_compute_sim_state": 0.03739272506491652, "sim_compute_performance-ego": 0.06221029827895674, "sim_compute_robot_state-ego": 0.06691611854775438, "sim_compute_robot_state-npc0": 0.0642149008593513, "sim_compute_robot_state-npc1": 0.06393769412364775, "sim_compute_robot_state-npc2": 0.06431649726571388, "sim_compute_robot_state-npc3": 0.0673774584983159}, "udem1-3-0": {"driven_any": 0.27103970319867854, "sim_physics": 0.04463226061600905, "survival_time": 5.1999999999999895, "driven_lanedir": 0.23259433434817375, "sim_render-ego": 0.061039541776363664, "in-drivable-lane": 0, "agent_compute-ego": 0.2339747571028196, "deviation-heading": 2.0478095571218655, "set_robot_commands": 0.09166873876865092, "deviation-center-line": 0.24202549248903907, "driven_lanedir_consec": 0.23259433434817375, "sim_compute_sim_state": 0.03550848135581383, "sim_compute_performance-ego": 0.06345481597460233, "sim_compute_robot_state-ego": 0.067149451145759, "sim_compute_robot_state-npc0": 0.06685582032570472, "sim_compute_robot_state-npc1": 0.06635696383622977, "sim_compute_robot_state-npc2": 0.06561647699429439, "sim_compute_robot_state-npc3": 0.06510194677572984}, "udem1-4-0": {"driven_any": 0.28317973033549043, "sim_physics": 0.039749584945977905, "survival_time": 5.09999999999999, "driven_lanedir": 0.2470530669415276, "sim_render-ego": 0.05665295965531293, "in-drivable-lane": 0, "agent_compute-ego": 0.21120889280356617, "deviation-heading": 2.019734292638449, "set_robot_commands": 0.08932233791725308, "deviation-center-line": 0.2802338358350595, "driven_lanedir_consec": 0.2470530669415276, "sim_compute_sim_state": 0.03491462913213992, "sim_compute_performance-ego": 0.062403452162649115, "sim_compute_robot_state-ego": 0.068099017236747, "sim_compute_robot_state-npc0": 0.06152116317375034, "sim_compute_robot_state-npc1": 0.06042606222863291, "sim_compute_robot_state-npc2": 0.06172675011204738, "sim_compute_robot_state-npc3": 0.06222932478960823}}set_robot_commands_max 0.09349609567568852 set_robot_commands_mean 0.08894817577216067 set_robot_commands_median 0.09092150382625248 set_robot_commands_min 0.07933220267295837 sim_compute_performance-ego_max 0.06426471471786499 sim_compute_performance-ego_mean 0.062197629763966256 sim_compute_performance-ego_median 0.062403452162649115 sim_compute_performance-ego_min 0.05865486768575815 sim_compute_robot_state-ego_max 0.068099017236747 sim_compute_robot_state-ego_mean 0.06504675127197854 sim_compute_robot_state-ego_median 0.06691611854775438 sim_compute_robot_state-ego_min 0.06013408074012169 sim_compute_robot_state-npc0_max 0.06685582032570472 sim_compute_robot_state-npc0_mean 0.06269886481629088 sim_compute_robot_state-npc0_median 0.06346854338279137 sim_compute_robot_state-npc0_min 0.05743389633985666 sim_compute_robot_state-npc1_max 0.06635696383622977 sim_compute_robot_state-npc1_mean 0.06260455648497124 sim_compute_robot_state-npc1_median 0.06393769412364775 sim_compute_robot_state-npc1_min 0.05827895953105046 sim_compute_robot_state-npc2_max 0.07470872539740342 sim_compute_robot_state-npc2_mean 0.06500731543923868 sim_compute_robot_state-npc2_median 0.06431649726571388 sim_compute_robot_state-npc2_min 0.058668127426734336 sim_compute_robot_state-npc3_max 0.0673774584983159 sim_compute_robot_state-npc3_mean 0.06320190748593166 sim_compute_robot_state-npc3_median 0.06222932478960823 sim_compute_robot_state-npc3_min 0.05949495847408588 sim_compute_sim_state_max 0.03739272506491652 sim_compute_sim_state_mean 0.035233281939564105 sim_compute_sim_state_median 0.03491462913213992 sim_compute_sim_state_min 0.034129016674481906 sim_physics_max 0.04729834343623189 sim_physics_mean 0.04209138719730308 sim_physics_median 0.042502799859413735 sim_physics_min 0.03627394712888277 sim_render-ego_max 0.06418214623744671 sim_render-ego_mean 0.05890063273751169 sim_render-ego_median 0.05780326509938657 sim_render-ego_min 0.0548252509190486 simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.169999999999989 survival_time_min 5.09999999999999
No reset possible 194822612Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 15:17:45+00:00 2019-04-24 15:25:12+00:00 0:07:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.0853638586245085 agent_compute-ego_mean 0.06938268166733949 agent_compute-ego_median 0.06661159564287235 agent_compute-ego_min 0.06049669292611136 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.04783789986058285, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.0621215443862112, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.0731792550337942, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.0949362127404464, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03958251099837454, "sim_compute_performance-ego": 0.0664754215039705, "sim_compute_robot_state-ego": 0.07279266558195416, "sim_compute_robot_state-npc0": 0.06849034209000437, "sim_compute_robot_state-npc1": 0.0685557440707558, "sim_compute_robot_state-npc2": 0.06896580896879498, "sim_compute_robot_state-npc3": 0.07128783527173493}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.03217861526890805, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05248031490727475, "in-drivable-lane": 0, "agent_compute-ego": 0.0853638586245085, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.0786763115933067, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03219301449625116, "sim_compute_performance-ego": 0.055254108027408, "sim_compute_robot_state-ego": 0.05723403629503752, "sim_compute_robot_state-npc0": 0.0574670716335899, "sim_compute_robot_state-npc1": 0.05644242387068899, "sim_compute_robot_state-npc2": 0.058407024333351536, "sim_compute_robot_state-npc3": 0.05642494402433697}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.03942015843513685, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06090879440307617, "in-drivable-lane": 0, "agent_compute-ego": 0.06661159564287235, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.09241930032387756, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03513320898398375, "sim_compute_performance-ego": 0.06542691206320739, "sim_compute_robot_state-ego": 0.06684115605476575, "sim_compute_robot_state-npc0": 0.06390907214238094, "sim_compute_robot_state-npc1": 0.06440764818436061, "sim_compute_robot_state-npc2": 0.06297533328716572, "sim_compute_robot_state-npc3": 0.06310478234902406}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03996586799621582, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.055537848405435054, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06049669292611136, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.0700848807751293, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.0295665700670699, "sim_compute_performance-ego": 0.051040075194667765, "sim_compute_robot_state-ego": 0.05787099583048216, "sim_compute_robot_state-npc0": 0.05355944096202582, "sim_compute_robot_state-npc1": 0.0574068888811998, "sim_compute_robot_state-npc2": 0.07310125189767756, "sim_compute_robot_state-npc3": 0.05034568276203854}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.033702091737227005, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.05720732428810813, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.061262006109411064, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.0836100849238309, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03164386749267578, "sim_compute_performance-ego": 0.06134053793820468, "sim_compute_robot_state-ego": 0.06411918726834384, "sim_compute_robot_state-npc0": 0.05848690596493808, "sim_compute_robot_state-npc1": 0.06109767068516125, "sim_compute_robot_state-npc2": 0.05950979752974077, "sim_compute_robot_state-npc3": 0.05833216146989302}}set_robot_commands_max 0.0949362127404464 set_robot_commands_mean 0.08394535807131817 set_robot_commands_median 0.0836100849238309 set_robot_commands_min 0.0700848807751293 sim_compute_performance-ego_max 0.0664754215039705 sim_compute_performance-ego_mean 0.059907410945491665 sim_compute_performance-ego_median 0.06134053793820468 sim_compute_performance-ego_min 0.051040075194667765 sim_compute_robot_state-ego_max 0.07279266558195416 sim_compute_robot_state-ego_mean 0.06377160820611669 sim_compute_robot_state-ego_median 0.06411918726834384 sim_compute_robot_state-ego_min 0.05723403629503752 sim_compute_robot_state-npc0_max 0.06849034209000437 sim_compute_robot_state-npc0_mean 0.06038256655858783 sim_compute_robot_state-npc0_median 0.05848690596493808 sim_compute_robot_state-npc0_min 0.05355944096202582 sim_compute_robot_state-npc1_max 0.0685557440707558 sim_compute_robot_state-npc1_mean 0.06158207513843329 sim_compute_robot_state-npc1_median 0.06109767068516125 sim_compute_robot_state-npc1_min 0.05644242387068899 sim_compute_robot_state-npc2_max 0.07310125189767756 sim_compute_robot_state-npc2_mean 0.06459184320334613 sim_compute_robot_state-npc2_median 0.06297533328716572 sim_compute_robot_state-npc2_min 0.058407024333351536 sim_compute_robot_state-npc3_max 0.07128783527173493 sim_compute_robot_state-npc3_mean 0.0598990811754055 sim_compute_robot_state-npc3_median 0.05833216146989302 sim_compute_robot_state-npc3_min 0.05034568276203854 sim_compute_sim_state_max 0.03958251099837454 sim_compute_sim_state_mean 0.03362383440767102 sim_compute_sim_state_median 0.03219301449625116 sim_compute_sim_state_min 0.0295665700670699 sim_physics_max 0.04783789986058285 sim_physics_mean 0.03862092665961412 sim_physics_median 0.03942015843513685 sim_physics_min 0.03217861526890805 sim_render-ego_max 0.0621215443862112 sim_render-ego_mean 0.057651165278021055 sim_render-ego_median 0.05720732428810813 sim_render-ego_min 0.05248031490727475 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 194572676Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 15:00:31+00:00 2019-04-24 15:17:05+00:00 0:16:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2390782847963888 survival_time_median 9.45 deviation-center-line_median 0.7996369883729112 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0855947423864294 agent_compute-ego_mean 0.08263168127684023 agent_compute-ego_median 0.08206518061526187 agent_compute-ego_min 0.07974015721734964 deviation-center-line_max 1.326849724219893 deviation-center-line_mean 0.7805830782952385 deviation-center-line_min 0.3266250262292886 deviation-heading_max 4.821464452811479 deviation-heading_mean 3.025687851140577 deviation-heading_median 2.3571948646211687 deviation-heading_min 1.4724537935256203 driven_any_max 2.355587692885021 driven_any_mean 1.6141616563570669 driven_any_median 1.4717070880124108 driven_any_min 0.8341460589103251 driven_lanedir_consec_max 1.7137347836911068 driven_lanedir_consec_mean 1.2748476557769046 driven_lanedir_consec_min 0.783679837840317 driven_lanedir_max 1.952412601435258 driven_lanedir_mean 1.3922302526786683 driven_lanedir_median 1.4206499533359225 driven_lanedir_min 0.783679837840317 in-drivable-lane_max 1.8000000000000131 in-drivable-lane_mean 0.5600000000000055 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8341460589103251, "sim_physics": 0.026699596697145753, "survival_time": 5.549999999999988, "driven_lanedir": 0.783679837840317, "sim_render-ego": 0.06511349291414828, "in-drivable-lane": 0, "agent_compute-ego": 0.08206518061526187, "deviation-heading": 1.4724537935256203, "set_robot_commands": 0.10553153141124828, "deviation-center-line": 0.3266250262292886, "driven_lanedir_consec": 0.783679837840317, "sim_compute_sim_state": 0.039752298647219, "sim_compute_performance-ego": 0.07239093651642671, "sim_compute_robot_state-ego": 0.07597657366915866}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0822965656561436, "sim_physics": 0.02640453554549307, "survival_time": 13.250000000000052, "driven_lanedir": 1.5653305859854552, "sim_render-ego": 0.06442041577033276, "in-drivable-lane": 1.8000000000000131, "agent_compute-ego": 0.07974015721734964, "deviation-heading": 4.477752000057642, "set_robot_commands": 0.10360386056720086, "deviation-center-line": 0.935102338839758, "driven_lanedir_consec": 1.2170954192207888, "sim_compute_sim_state": 0.0402601790878008, "sim_compute_performance-ego": 0.07089900250704784, "sim_compute_robot_state-ego": 0.07475502805889778}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355587692885021, "sim_physics": 0.02674367507298787, "survival_time": 14.950000000000076, "driven_lanedir": 1.952412601435258, "sim_render-ego": 0.0676773452758789, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.0838705595334371, "deviation-heading": 4.821464452811479, "set_robot_commands": 0.10840525150299073, "deviation-center-line": 1.326849724219893, "driven_lanedir_consec": 1.7137347836911068, "sim_compute_sim_state": 0.04170779705047607, "sim_compute_performance-ego": 0.07589867194493612, "sim_compute_robot_state-ego": 0.07788331826527914}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3270708763214338, "sim_physics": 0.02948928715889914, "survival_time": 8.549999999999986, "driven_lanedir": 1.2390782847963888, "sim_render-ego": 0.06693468595805921, "in-drivable-lane": 0, "agent_compute-ego": 0.08188776663172315, "deviation-heading": 2.3571948646211687, "set_robot_commands": 0.106526381788198, "deviation-center-line": 0.5147013138143418, "driven_lanedir_consec": 1.2390782847963888, "sim_compute_sim_state": 0.04469027574996502, "sim_compute_performance-ego": 0.073516207131726, "sim_compute_robot_state-ego": 0.07726025023655585}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4717070880124108, "sim_physics": 0.027649146539193613, "survival_time": 9.45, "driven_lanedir": 1.4206499533359225, "sim_render-ego": 0.06622515658222178, "in-drivable-lane": 0, "agent_compute-ego": 0.0855947423864294, "deviation-heading": 1.999574144686976, "set_robot_commands": 0.10832600492648978, "deviation-center-line": 0.7996369883729112, "driven_lanedir_consec": 1.4206499533359225, "sim_compute_sim_state": 0.0410684933738103, "sim_compute_performance-ego": 0.07439345531362705, "sim_compute_robot_state-ego": 0.07829716848948645}}set_robot_commands_max 0.10840525150299073 set_robot_commands_mean 0.10647860603922554 set_robot_commands_median 0.106526381788198 set_robot_commands_min 0.10360386056720086 sim_compute_performance-ego_max 0.07589867194493612 sim_compute_performance-ego_mean 0.07341965468275274 sim_compute_performance-ego_median 0.073516207131726 sim_compute_performance-ego_min 0.07089900250704784 sim_compute_robot_state-ego_max 0.07829716848948645 sim_compute_robot_state-ego_mean 0.07683446774387556 sim_compute_robot_state-ego_median 0.07726025023655585 sim_compute_robot_state-ego_min 0.07475502805889778 sim_compute_sim_state_max 0.04469027574996502 sim_compute_sim_state_mean 0.04149580878185424 sim_compute_sim_state_median 0.0410684933738103 sim_compute_sim_state_min 0.039752298647219 sim_physics_max 0.02948928715889914 sim_physics_mean 0.02739724820274389 sim_physics_median 0.02674367507298787 sim_physics_min 0.02640453554549307 sim_render-ego_max 0.0676773452758789 sim_render-ego_mean 0.06607421930012819 sim_render-ego_median 0.06622515658222178 sim_render-ego_min 0.06442041577033276 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.35000000000002 survival_time_min 5.549999999999988
No reset possible 194242681Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validationstep1-simulation host-error no ip-172-31-40-253-87532019-04-24 14:47:31+00:00 2019-04-24 15:00:08+00:00 0:12:37 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19424-360383', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19424-360383', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19424-360383', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 194102703Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 14:29:41+00:00 2019-04-24 14:46:17+00:00 0:16:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9727108592813948 survival_time_median 12.850000000000048 deviation-center-line_median 0.761048943529541 in-drivable-lane_median 1.9499999999999984
other stats agent_compute-ego_max 0.09049132585525511 agent_compute-ego_mean 0.0876766812766182 agent_compute-ego_median 0.08906856621846114 agent_compute-ego_min 0.08475666046142578 deviation-center-line_max 1.0432590027232411 deviation-center-line_mean 0.6539613542013432 deviation-center-line_min 0.23633618623314967 deviation-heading_max 5.602350814067378 deviation-heading_mean 3.4539987129596867 deviation-heading_median 3.316296220266602 deviation-heading_min 0.7328703934623456 driven_any_max 2.355602829213546 driven_any_mean 1.5996287934599316 driven_any_median 2.017973422825478 driven_any_min 0.5047152234020883 driven_lanedir_consec_max 1.5550851234990266 driven_lanedir_consec_mean 0.885395276761136 driven_lanedir_consec_min 0.21579573089532308 driven_lanedir_max 1.7560277011272911 driven_lanedir_mean 1.1399048205951356 driven_lanedir_median 1.297235969461067 driven_lanedir_min 0.4560124029730479 in-drivable-lane_max 3.250000000000046 in-drivable-lane_mean 1.7500000000000135 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5047152234020883, "sim_physics": 0.02724400588444301, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4835661900929602, "sim_render-ego": 0.06225199018205915, "in-drivable-lane": 0, "agent_compute-ego": 0.08475666046142578, "deviation-heading": 0.7328703934623456, "set_robot_commands": 0.1052504403250558, "deviation-center-line": 0.23633618623314967, "driven_lanedir_consec": 0.4835661900929602, "sim_compute_sim_state": 0.040557364055088585, "sim_compute_performance-ego": 0.07004343441554478, "sim_compute_robot_state-ego": 0.07339226177760533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7644450402240477, "sim_physics": 0.03168146917135409, "survival_time": 5.04999999999999, "driven_lanedir": 0.4560124029730479, "sim_render-ego": 0.0682828426361084, "in-drivable-lane": 0.5499999999999989, "agent_compute-ego": 0.08906856621846114, "deviation-heading": 3.143217442499128, "set_robot_commands": 0.11771757295816251, "deviation-center-line": 0.4035304482516808, "driven_lanedir_consec": 0.21579573089532308, "sim_compute_sim_state": 0.0418436857733396, "sim_compute_performance-ego": 0.07545051480283832, "sim_compute_robot_state-ego": 0.086978279718078}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.017973422825478, "sim_physics": 0.025122742708554992, "survival_time": 12.850000000000048, "driven_lanedir": 1.297235969461067, "sim_render-ego": 0.06405186467597457, "in-drivable-lane": 3.000000000000025, "agent_compute-ego": 0.08483301433607762, "deviation-heading": 4.475258694502978, "set_robot_commands": 0.10294260217985754, "deviation-center-line": 0.761048943529541, "driven_lanedir_consec": 0.9727108592813948, "sim_compute_sim_state": 0.04034114626131169, "sim_compute_performance-ego": 0.07103813946942875, "sim_compute_robot_state-ego": 0.07363374595048362}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.355602829213546, "sim_physics": 0.026942397753397625, "survival_time": 14.950000000000076, "driven_lanedir": 1.7066818393213112, "sim_render-ego": 0.06825488011042277, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.08923383951187133, "deviation-heading": 3.316296220266602, "set_robot_commands": 0.1142033100128174, "deviation-center-line": 1.0432590027232411, "driven_lanedir_consec": 1.1998184800369764, "sim_compute_sim_state": 0.04248972733815511, "sim_compute_performance-ego": 0.07597947120666504, "sim_compute_robot_state-ego": 0.07934315045674642}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3554074516344987, "sim_physics": 0.029539368152618407, "survival_time": 14.950000000000076, "driven_lanedir": 1.7560277011272911, "sim_render-ego": 0.06844930013020833, "in-drivable-lane": 1.9499999999999984, "agent_compute-ego": 0.09049132585525511, "deviation-heading": 5.602350814067378, "set_robot_commands": 0.11411439418792724, "deviation-center-line": 0.8256321902691033, "driven_lanedir_consec": 1.5550851234990266, "sim_compute_sim_state": 0.04387976090113322, "sim_compute_performance-ego": 0.07516746441523234, "sim_compute_robot_state-ego": 0.08032707929611206}}set_robot_commands_max 0.11771757295816251 set_robot_commands_mean 0.1108456639327641 set_robot_commands_median 0.11411439418792724 set_robot_commands_min 0.10294260217985754 sim_compute_performance-ego_max 0.07597947120666504 sim_compute_performance-ego_mean 0.07353580486194185 sim_compute_performance-ego_median 0.07516746441523234 sim_compute_performance-ego_min 0.07004343441554478 sim_compute_robot_state-ego_max 0.086978279718078 sim_compute_robot_state-ego_mean 0.07873490343980509 sim_compute_robot_state-ego_median 0.07934315045674642 sim_compute_robot_state-ego_min 0.07339226177760533 sim_compute_sim_state_max 0.04387976090113322 sim_compute_sim_state_mean 0.04182233686580565 sim_compute_sim_state_median 0.0418436857733396 sim_compute_sim_state_min 0.04034114626131169 sim_physics_max 0.03168146917135409 sim_physics_mean 0.028105996734073622 sim_physics_median 0.02724400588444301 sim_physics_min 0.025122742708554992 sim_render-ego_max 0.06844930013020833 sim_render-ego_mean 0.06625817554695465 sim_render-ego_median 0.06825488011042277 sim_render-ego_min 0.06225199018205915 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.260000000000035 survival_time_min 3.4999999999999956
No reset possible 194032716jiang peng test for ppo aido2-LF-sim-validationstep1-simulation error no ip-172-31-40-253-87532019-04-24 14:28:53+00:00 2019-04-24 14:29:28+00:00 0:00:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 194012723jiang peng test for ppo aido2-LFVI-sim-testingstep1-simulation error no ip-172-31-40-253-87532019-04-24 14:28:16+00:00 2019-04-24 14:28:47+00:00 0:00:31 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 193932734Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testingstep1-simulation failed no ip-172-31-40-253-87532019-04-24 14:25:56+00:00 2019-04-24 14:27:31+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 193852750Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation failed no ip-172-31-40-253-87532019-04-24 14:23:42+00:00 2019-04-24 14:25:32+00:00 0:01:50 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 193782758Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 14:15:23+00:00 2019-04-24 14:23:13+00:00 0:07:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07807032685530813 agent_compute-ego_mean 0.07163914353370543 agent_compute-ego_median 0.07136160280646348 agent_compute-ego_min 0.06528810744589948 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.03887772560119629, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06004735900134575, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07136160280646348, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09271339381613382, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03768218435892245, "sim_compute_performance-ego": 0.06592468226828226, "sim_compute_robot_state-ego": 0.07143566957334192, "sim_compute_robot_state-npc0": 0.06622624688032197, "sim_compute_robot_state-npc1": 0.06860819967781626, "sim_compute_robot_state-npc2": 0.0697040179880654, "sim_compute_robot_state-npc3": 0.06927786803827053}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.04159861344557542, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06485530046316293, "in-drivable-lane": 0, "agent_compute-ego": 0.07329783989832951, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.10672835203317496, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03978232237008902, "sim_compute_performance-ego": 0.07476277534778301, "sim_compute_robot_state-ego": 0.07905668478745681, "sim_compute_robot_state-npc0": 0.07244434723487267, "sim_compute_robot_state-npc1": 0.06936828906719501, "sim_compute_robot_state-npc2": 0.07407968777876633, "sim_compute_robot_state-npc3": 0.07023386771862324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.037998189317419176, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05680508816495855, "in-drivable-lane": 0, "agent_compute-ego": 0.06528810744589948, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08692908794321913, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.034730145271788256, "sim_compute_performance-ego": 0.06698129532185007, "sim_compute_robot_state-ego": 0.06960776511659013, "sim_compute_robot_state-npc0": 0.06252454189544028, "sim_compute_robot_state-npc1": 0.0619679866953099, "sim_compute_robot_state-npc2": 0.06478108243739351, "sim_compute_robot_state-npc3": 0.06375412230796003}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.04168727109720419, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.058603876239650854, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07017784066252657, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09384791929643232, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03736779715988662, "sim_compute_performance-ego": 0.06450553778763655, "sim_compute_robot_state-ego": 0.07199124189523551, "sim_compute_robot_state-npc0": 0.06584103814848177, "sim_compute_robot_state-npc1": 0.06720221959627591, "sim_compute_robot_state-npc2": 0.06694121675176935, "sim_compute_robot_state-npc3": 0.06651066161774016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.03889967893299304, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.06705553908097117, "in-drivable-lane": 0, "agent_compute-ego": 0.07807032685530813, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.113752239628842, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.04143612635763068, "sim_compute_performance-ego": 0.07126144358986303, "sim_compute_robot_state-ego": 0.07604816085413883, "sim_compute_robot_state-npc0": 0.07285335816835102, "sim_compute_robot_state-npc1": 0.07331727052989759, "sim_compute_robot_state-npc2": 0.07382347081836901, "sim_compute_robot_state-npc3": 0.07250292050211053}}set_robot_commands_max 0.113752239628842 set_robot_commands_mean 0.09879419854356045 set_robot_commands_median 0.09384791929643232 set_robot_commands_min 0.08692908794321913 sim_compute_performance-ego_max 0.07476277534778301 sim_compute_performance-ego_mean 0.06868714686308298 sim_compute_performance-ego_median 0.06698129532185007 sim_compute_performance-ego_min 0.06450553778763655 sim_compute_robot_state-ego_max 0.07905668478745681 sim_compute_robot_state-ego_mean 0.07362790444535264 sim_compute_robot_state-ego_median 0.07199124189523551 sim_compute_robot_state-ego_min 0.06960776511659013 sim_compute_robot_state-npc0_max 0.07285335816835102 sim_compute_robot_state-npc0_mean 0.06797790646549355 sim_compute_robot_state-npc0_median 0.06622624688032197 sim_compute_robot_state-npc0_min 0.06252454189544028 sim_compute_robot_state-npc1_max 0.07331727052989759 sim_compute_robot_state-npc1_mean 0.06809279311329894 sim_compute_robot_state-npc1_median 0.06860819967781626 sim_compute_robot_state-npc1_min 0.0619679866953099 sim_compute_robot_state-npc2_max 0.07407968777876633 sim_compute_robot_state-npc2_mean 0.06986589515487271 sim_compute_robot_state-npc2_median 0.0697040179880654 sim_compute_robot_state-npc2_min 0.06478108243739351 sim_compute_robot_state-npc3_max 0.07250292050211053 sim_compute_robot_state-npc3_mean 0.0684558880369409 sim_compute_robot_state-npc3_median 0.06927786803827053 sim_compute_robot_state-npc3_min 0.06375412230796003 sim_compute_sim_state_max 0.04143612635763068 sim_compute_sim_state_mean 0.0381997151036634 sim_compute_sim_state_median 0.03768218435892245 sim_compute_sim_state_min 0.034730145271788256 sim_physics_max 0.04168727109720419 sim_physics_mean 0.039812295678877625 sim_physics_median 0.03889967893299304 sim_physics_min 0.037998189317419176 sim_render-ego_max 0.06705553908097117 sim_render-ego_mean 0.06147343259001785 sim_render-ego_median 0.06004735900134575 sim_render-ego_min 0.05680508816495855 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 193392856Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-87532019-04-24 14:00:43+00:00 2019-04-24 14:14:57+00:00 0:14:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4039182046133516 survival_time_median 6.0499999999999865 deviation-center-line_median 0.12834284865142567 in-drivable-lane_median 0.1999999999999993
other stats agent_compute-ego_max 0.097411790064403 agent_compute-ego_mean 0.09389725029483632 agent_compute-ego_median 0.09480514471558318 agent_compute-ego_min 0.08694877532812265 deviation-center-line_max 0.24889091987959264 deviation-center-line_mean 0.15084695278550847 deviation-center-line_min 0.09539870755879196 deviation-heading_max 1.597882297465416 deviation-heading_mean 1.511934603749452 deviation-heading_median 1.517819533315793 deviation-heading_min 1.3887219978165422 driven_any_max 1.176686677822138 driven_any_mean 0.5604551334082368 driven_any_median 0.4626530672552668 driven_any_min 0.18540307403509393 driven_lanedir_consec_max 0.6210755496938636 driven_lanedir_consec_mean 0.3787097479178759 driven_lanedir_consec_min 0.13620976040099775 driven_lanedir_max 0.6210755496938636 driven_lanedir_mean 0.3787097479178759 driven_lanedir_median 0.4039182046133516 driven_lanedir_min 0.13620976040099775 in-drivable-lane_max 7.7000000000000925 in-drivable-lane_mean 1.7400000000000175 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.176686677822138, "sim_physics": 0.02234923839569092, "survival_time": 14.950000000000076, "driven_lanedir": 0.513896820786814, "sim_render-ego": 0.053674218654632566, "in-drivable-lane": 7.7000000000000925, "agent_compute-ego": 0.094722261428833, "deviation-heading": 1.517819533315793, "set_robot_commands": 0.08633750120798747, "deviation-center-line": 0.1663865822553756, "driven_lanedir_consec": 0.513896820786814, "sim_compute_sim_state": 0.033629053433736164, "sim_compute_performance-ego": 0.05865503311157227, "sim_compute_robot_state-ego": 0.06081237395604452}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.326020347093651, "sim_physics": 0.024197041303261942, "survival_time": 4.3499999999999925, "driven_lanedir": 0.21844840409435273, "sim_render-ego": 0.060576057982170715, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09480514471558318, "deviation-heading": 1.5916407269831905, "set_robot_commands": 0.09179669413073308, "deviation-center-line": 0.09539870755879196, "driven_lanedir_consec": 0.21844840409435273, "sim_compute_sim_state": 0.03769062305318898, "sim_compute_performance-ego": 0.06878803242212055, "sim_compute_robot_state-ego": 0.07319627685108404}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18540307403509393, "sim_physics": 0.023857648556049053, "survival_time": 2.5999999999999988, "driven_lanedir": 0.13620976040099775, "sim_render-ego": 0.055918445953956016, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08694877532812265, "deviation-heading": 1.3887219978165422, "set_robot_commands": 0.08821726303834182, "deviation-center-line": 0.12834284865142567, "driven_lanedir_consec": 0.13620976040099775, "sim_compute_sim_state": 0.03768445895268367, "sim_compute_performance-ego": 0.06195701085604154, "sim_compute_robot_state-ego": 0.06541630854973426}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6515125008350344, "sim_physics": 0.025687896070026216, "survival_time": 8.399999999999984, "driven_lanedir": 0.6210755496938636, "sim_render-ego": 0.05978421795935858, "in-drivable-lane": 0, "agent_compute-ego": 0.097411790064403, "deviation-heading": 1.597882297465416, "set_robot_commands": 0.09401241370609828, "deviation-center-line": 0.24889091987959264, "driven_lanedir_consec": 0.6210755496938636, "sim_compute_sim_state": 0.03821849681082226, "sim_compute_performance-ego": 0.06639935147194635, "sim_compute_robot_state-ego": 0.07005349085444496}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4626530672552668, "sim_physics": 0.024533338783201103, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4039182046133516, "sim_render-ego": 0.05828101575867203, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09559827993723972, "deviation-heading": 1.4636084631663184, "set_robot_commands": 0.0937976068701626, "deviation-center-line": 0.11521570558235653, "driven_lanedir_consec": 0.4039182046133516, "sim_compute_sim_state": 0.038234779657411185, "sim_compute_performance-ego": 0.06714525695674675, "sim_compute_robot_state-ego": 0.07003683098091566}}set_robot_commands_max 0.09401241370609828 set_robot_commands_mean 0.09083229579066464 set_robot_commands_median 0.09179669413073308 set_robot_commands_min 0.08633750120798747 sim_compute_performance-ego_max 0.06878803242212055 sim_compute_performance-ego_mean 0.06458893696368548 sim_compute_performance-ego_median 0.06639935147194635 sim_compute_performance-ego_min 0.05865503311157227 sim_compute_robot_state-ego_max 0.07319627685108404 sim_compute_robot_state-ego_mean 0.0679030562384447 sim_compute_robot_state-ego_median 0.07003683098091566 sim_compute_robot_state-ego_min 0.06081237395604452 sim_compute_sim_state_max 0.038234779657411185 sim_compute_sim_state_mean 0.03709148238156845 sim_compute_sim_state_median 0.03769062305318898 sim_compute_sim_state_min 0.033629053433736164 sim_physics_max 0.025687896070026216 sim_physics_mean 0.024125032621645847 sim_physics_median 0.024197041303261942 sim_physics_min 0.02234923839569092 sim_render-ego_max 0.060576057982170715 sim_render-ego_mean 0.05764679126175798 sim_render-ego_median 0.05828101575867203 sim_render-ego_min 0.053674218654632566 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.270000000000008 survival_time_min 2.5999999999999988
No reset possible 192952880Andrea Daniele minimal_agent (Python 3) aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-87532019-04-24 13:49:17+00:00 2019-04-24 14:00:13+00:00 0:10:56 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 192942890Diego Charrez Python template aido2-AMOD-service_qualitystep2-scoring success yes ip-172-31-40-253-87532019-04-24 13:48:51+00:00 2019-04-24 13:49:04+00:00 0:00:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -33.17545856640668
other stats efficiency -66.47467426562682 fleet_size -1000000000
No reset possible 192872890Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation success yes ip-172-31-40-253-87532019-04-24 13:43:54+00:00 2019-04-24 13:48:21+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 192812933Bhairav Mehta Baseline solution using reinforcement learning aido2-LF-sim-validationstep1-simulation error no ip-172-31-40-253-87532019-04-24 13:42:33+00:00 2019-04-24 13:43:38+00:00 0:01:05 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 192432945Bhairav Mehta Baseline solution using reinforcement learning aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-87532019-04-24 13:19:34+00:00 2019-04-24 13:42:13+00:00 0:22:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1651857623593327 survival_time_median 1.4000000000000006 deviation-center-line_median 0.06465650495748072 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.19901881047657555 agent_compute-ego_mean 0.11667164814603195 agent_compute-ego_median 0.09573156356811524 agent_compute-ego_min 0.09552938938140867 deviation-center-line_max 0.07097828106274057 deviation-center-line_mean 0.06501420343948 deviation-center-line_min 0.0607455583203757 deviation-heading_max 0.6623766203255034 deviation-heading_mean 0.5919492523516129 deviation-heading_median 0.5902852156980753 deviation-heading_min 0.4988504879142927 driven_any_max 0.2807253201932719 driven_any_mean 0.2233057634455732 driven_any_median 0.2110832728958442 driven_any_min 0.2010165844836755 driven_lanedir_consec_max 0.2474551693742808 driven_lanedir_consec_mean 0.17960954689906 driven_lanedir_consec_min 0.15569451329555184 driven_lanedir_max 0.2474551693742808 driven_lanedir_mean 0.17960954689906 driven_lanedir_median 0.1651857623593327 driven_lanedir_min 0.15569451329555184 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21007767778695144, "sim_physics": 0.013856300285884311, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16148975210895689, "sim_render-ego": 0.03610062599182129, "in-drivable-lane": 0, "agent_compute-ego": 0.09750168664114817, "deviation-heading": 0.6623766203255034, "set_robot_commands": 0.05536232675824847, "deviation-center-line": 0.06465650495748072, "driven_lanedir_consec": 0.16148975210895689, "sim_compute_sim_state": 0.02328458854130336, "sim_compute_performance-ego": 0.03804023776735578, "sim_compute_robot_state-ego": 0.03953593969345093}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21362596186812308, "sim_physics": 0.02856167725154332, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16822253735717785, "sim_render-ego": 0.07164544718606132, "in-drivable-lane": 0, "agent_compute-ego": 0.19901881047657555, "deviation-heading": 0.640499048695913, "set_robot_commands": 0.10969794648034233, "deviation-center-line": 0.06277082804192674, "driven_lanedir_consec": 0.16822253735717785, "sim_compute_sim_state": 0.04467505216598511, "sim_compute_performance-ego": 0.07766037327902657, "sim_compute_robot_state-ego": 0.08294106381280082}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2807253201932719, "sim_physics": 0.013943974177042644, "survival_time": 1.5000000000000009, "driven_lanedir": 0.2474551693742808, "sim_render-ego": 0.035147913297017414, "in-drivable-lane": 0, "agent_compute-ego": 0.09552938938140867, "deviation-heading": 0.4988504879142927, "set_robot_commands": 0.05349222819010416, "deviation-center-line": 0.07097828106274057, "driven_lanedir_consec": 0.2474551693742808, "sim_compute_sim_state": 0.022923676172892253, "sim_compute_performance-ego": 0.038200934727986656, "sim_compute_robot_state-ego": 0.03988165060679118}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2110832728958442, "sim_physics": 0.013167812274052547, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1651857623593327, "sim_render-ego": 0.03491045878483699, "in-drivable-lane": 0, "agent_compute-ego": 0.09557679066291222, "deviation-heading": 0.5902852156980753, "set_robot_commands": 0.05342562382037823, "deviation-center-line": 0.06591984481487626, "driven_lanedir_consec": 0.1651857623593327, "sim_compute_sim_state": 0.021875583208524264, "sim_compute_performance-ego": 0.03726129348461445, "sim_compute_robot_state-ego": 0.03857152278606708}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2010165844836755, "sim_physics": 0.014638128280639647, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15569451329555184, "sim_render-ego": 0.03585442543029785, "in-drivable-lane": 0, "agent_compute-ego": 0.09573156356811524, "deviation-heading": 0.56773488912428, "set_robot_commands": 0.05601282119750976, "deviation-center-line": 0.0607455583203757, "driven_lanedir_consec": 0.15569451329555184, "sim_compute_sim_state": 0.03985376358032226, "sim_compute_performance-ego": 0.0378919506072998, "sim_compute_robot_state-ego": 0.03975972175598144}}set_robot_commands_max 0.10969794648034233 set_robot_commands_mean 0.06559818928931659 set_robot_commands_median 0.05536232675824847 set_robot_commands_min 0.05342562382037823 sim_compute_performance-ego_max 0.07766037327902657 sim_compute_performance-ego_mean 0.045810957973256655 sim_compute_performance-ego_median 0.03804023776735578 sim_compute_performance-ego_min 0.03726129348461445 sim_compute_robot_state-ego_max 0.08294106381280082 sim_compute_robot_state-ego_mean 0.04813797973101829 sim_compute_robot_state-ego_median 0.03975972175598144 sim_compute_robot_state-ego_min 0.03857152278606708 sim_compute_sim_state_max 0.04467505216598511 sim_compute_sim_state_mean 0.030522532733805452 sim_compute_sim_state_median 0.02328458854130336 sim_compute_sim_state_min 0.021875583208524264 sim_physics_max 0.02856167725154332 sim_physics_mean 0.016833578453832494 sim_physics_median 0.013943974177042644 sim_physics_min 0.013167812274052547 sim_render-ego_max 0.07164544718606132 sim_render-ego_mean 0.04273177413800698 sim_render-ego_median 0.03585442543029785 sim_render-ego_min 0.03491045878483699 simulation-passed 1 survival_time_max 1.5000000000000009 survival_time_mean 1.3700000000000006 survival_time_min 1.2500000000000004
No reset possible
Manfred Diaz
Maxim Scherbakov
Liam Paull 🇨🇦
Andrea Censi 🇨ðŸ‡
jiang peng
Jacopo Tani
Julian Zilly
Konstantin Chaika
Rami Al-Naim 🇷🇺
Bhairav Mehta
Alexander Karavaev
Andrea Daniele 🇮🇹
Diego Charrez 🇵🇪