Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 18939
2881
Andrea Daniele 🇮🇹minimal_agent (Python 3) aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-10821
2019-04-21 01:53:33+00:00 2019-04-21 02:14:39+00:00 0:21:06 Waited 1200 seconds [...] Waited 1200 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18932
2873
Peter Almasi 🇭🇺challenge-aido_LF-template-pytorch aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 22:11:41+00:00 2019-04-20 22:17:49+00:00 0:06:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.11191421876824714 survival_time_median 1.3000000000000005 deviation-center-line_median 0.05047315617198433 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.1755272516837487 agent_compute-ego_mean 0.17024521570939286 agent_compute-ego_median 0.1734602451324463 agent_compute-ego_min 0.1558463848554171 deviation-center-line_max 0.05332790702120703 deviation-center-line_mean 0.04828383589301521 deviation-center-line_min 0.04003009371859556 deviation-heading_max 0.7047572878774514 deviation-heading_mean 0.6754536272719036 deviation-heading_median 0.682437498056471 deviation-heading_min 0.6220693865191721 driven_any_max 0.17955234139640197 driven_any_mean 0.17065472009187962 driven_any_median 0.17534271106761237 driven_any_min 0.1561345645124972 driven_lanedir_consec_max 0.11693545197416544 driven_lanedir_consec_mean 0.10594568393441706 driven_lanedir_consec_min 0.09183643626345828 driven_lanedir_max 0.11693545197416544 driven_lanedir_mean 0.10594568393441706 driven_lanedir_median 0.11191421876824714 driven_lanedir_min 0.09183643626345828 in-drivable-lane_max 0.15000000000000013 in-drivable-lane_mean 0.07000000000000006 in-drivable-lane_min 0.05000000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17534271106761237, "sim_physics": 0.0173569550881019, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11191421876824714, "sim_render-ego": 0.07126146096449631, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1558463848554171, "deviation-heading": 0.682437498056471, "set_robot_commands": 0.07025986451369065, "deviation-center-line": 0.05047315617198433, "driven_lanedir_consec": 0.11191421876824714, "sim_compute_sim_state": 0.041597568071805514, "sim_compute_performance-ego": 0.07147579926710862, "sim_compute_robot_state-ego": 0.06762014902555026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1561345645124972, "sim_physics": 0.016497440338134765, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09183643626345828, "sim_render-ego": 0.07638587951660156, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17236032485961914, "deviation-heading": 0.6893431409321791, "set_robot_commands": 0.08055398941040039, "deviation-center-line": 0.0450490143539439, "driven_lanedir_consec": 0.09183643626345828, "sim_compute_sim_state": 0.0462408447265625, "sim_compute_performance-ego": 0.07705565452575684, "sim_compute_robot_state-ego": 0.07429775238037109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17766025267632216, "sim_physics": 0.016812627132122334, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11371907408986016, "sim_render-ego": 0.07615273732405442, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1734602451324463, "deviation-heading": 0.7047572878774514, "set_robot_commands": 0.08059836350954495, "deviation-center-line": 0.05332790702120703, "driven_lanedir_consec": 0.11371907408986016, "sim_compute_sim_state": 0.04658357913677509, "sim_compute_performance-ego": 0.07829547845400296, "sim_compute_robot_state-ego": 0.06973749857682449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17955234139640197, "sim_physics": 0.017363410729628343, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11693545197416544, "sim_render-ego": 0.07682331708761361, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17403187201573295, "deviation-heading": 0.6786608229742447, "set_robot_commands": 0.08097297411698562, "deviation-center-line": 0.052539008199345226, "driven_lanedir_consec": 0.11693545197416544, "sim_compute_sim_state": 0.04531824588775635, "sim_compute_performance-ego": 0.0757670861024123, "sim_compute_robot_state-ego": 0.07037185705625094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16458373080656435, "sim_physics": 0.017946206606351413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09532323857635427, "sim_render-ego": 0.07759645351996788, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1755272516837487, "deviation-heading": 0.6220693865191721, "set_robot_commands": 0.08018977825458233, "deviation-center-line": 0.04003009371859556, "driven_lanedir_consec": 0.09532323857635427, "sim_compute_sim_state": 0.046010264983543984, "sim_compute_performance-ego": 0.07845391676976131, "sim_compute_robot_state-ego": 0.06982406286092904}}set_robot_commands_max 0.08097297411698562 set_robot_commands_mean 0.0785149939610408 set_robot_commands_median 0.08055398941040039 set_robot_commands_min 0.07025986451369065 sim_compute_performance-ego_max 0.07845391676976131 sim_compute_performance-ego_mean 0.07620958702380841 sim_compute_performance-ego_median 0.07705565452575684 sim_compute_performance-ego_min 0.07147579926710862 sim_compute_robot_state-ego_max 0.07429775238037109 sim_compute_robot_state-ego_mean 0.07037026397998516 sim_compute_robot_state-ego_median 0.06982406286092904 sim_compute_robot_state-ego_min 0.06762014902555026 sim_compute_sim_state_max 0.04658357913677509 sim_compute_sim_state_mean 0.04515010056128869 sim_compute_sim_state_median 0.046010264983543984 sim_compute_sim_state_min 0.041597568071805514 sim_physics_max 0.017946206606351413 sim_physics_mean 0.017195327978867754 sim_physics_median 0.0173569550881019 sim_physics_min 0.016497440338134765 sim_render-ego_max 0.07759645351996788 sim_render-ego_mean 0.07564396968254676 sim_render-ego_median 0.07638587951660156 sim_render-ego_min 0.07126146096449631 simulation-passed 1 survival_time_max 1.3000000000000005 survival_time_mean 1.2900000000000005 survival_time_min 1.2500000000000004
No reset possible 18919
2371
Liam Paull 🇨🇦minimal_agent (Python 3) aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 15:29:34+00:00 2019-04-20 15:50:40+00:00 0:21:06 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18908
2383
Andrea Censi 🇨🇭Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 15:21:43+00:00 2019-04-20 15:29:27+00:00 0:07:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.11247199025262589 survival_time_median 3.899999999999994 deviation-center-line_median 0.08907797758531803 in-drivable-lane_median 1.649999999999998
other stats agent_compute-ego_max 0.22956278132296157 agent_compute-ego_mean 0.21039411123783552 agent_compute-ego_median 0.20170932244031856 agent_compute-ego_min 0.19885550226484025 deviation-center-line_max 0.13621415181600496 deviation-center-line_mean 0.07969501278940369 deviation-center-line_min 0.021590985025984354 deviation-heading_max 2.555155969874982 deviation-heading_mean 1.376322081199179 deviation-heading_median 1.5241715054005778 deviation-heading_min 0.6088141534897106 driven_any_max 0.5300192766528421 driven_any_mean 0.2891972168632916 driven_any_median 0.2865998420337463 driven_any_min 0.12692449675861783 driven_lanedir_consec_max 0.1897492561653622 driven_lanedir_consec_mean 0.10467192777677171 driven_lanedir_consec_min 0.03805788210227301 driven_lanedir_max 0.1897492561653622 driven_lanedir_mean 0.10467192777677171 driven_lanedir_median 0.11247199025262589 driven_lanedir_min 0.03805788210227301 in-drivable-lane_max 3.0499999999999927 in-drivable-lane_mean 1.5899999999999976 in-drivable-lane_min 0.6000000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.34811841852316067, "sim_physics": 0.018413453266538423, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1170327786366725, "sim_render-ego": 0.06351124007126381, "in-drivable-lane": 1.999999999999997, "agent_compute-ego": 0.22956278132296157, "deviation-heading": 1.571521555605618, "set_robot_commands": 0.08001428911055641, "deviation-center-line": 0.08907797758531803, "driven_lanedir_consec": 0.1170327786366725, "sim_compute_sim_state": 0.038376671144332006, "sim_compute_performance-ego": 0.06109570360731805, "sim_compute_robot_state-ego": 0.061701314202670395}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.12692449675861783, "sim_physics": 0.015330112341678505, "survival_time": 1.6500000000000008, "driven_lanedir": 0.03805788210227301, "sim_render-ego": 0.05590404886187929, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22268403660167344, "deviation-heading": 0.6219472216250064, "set_robot_commands": 0.07622601769187233, "deviation-center-line": 0.021590985025984354, "driven_lanedir_consec": 0.03805788210227301, "sim_compute_sim_state": 0.03434751250527122, "sim_compute_performance-ego": 0.05845223051128966, "sim_compute_robot_state-ego": 0.05833252993496982}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15432405034809102, "sim_physics": 0.01615648137198554, "survival_time": 1.800000000000001, "driven_lanedir": 0.06604773172692502, "sim_render-ego": 0.05896757046381632, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1991589135593838, "deviation-heading": 0.6088141534897106, "set_robot_commands": 0.07590526342391968, "deviation-center-line": 0.023813216105749095, "driven_lanedir_consec": 0.06604773172692502, "sim_compute_sim_state": 0.03910002443525526, "sim_compute_performance-ego": 0.06118657191594442, "sim_compute_robot_state-ego": 0.06596505641937256}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5300192766528421, "sim_physics": 0.017281838825770786, "survival_time": 6.649999999999984, "driven_lanedir": 0.1897492561653622, "sim_render-ego": 0.06487683066748139, "in-drivable-lane": 3.0499999999999927, "agent_compute-ego": 0.19885550226484025, "deviation-heading": 2.555155969874982, "set_robot_commands": 0.07686415830052885, "deviation-center-line": 0.13621415181600496, "driven_lanedir_consec": 0.1897492561653622, "sim_compute_sim_state": 0.04020292776867859, "sim_compute_performance-ego": 0.06445308197709851, "sim_compute_robot_state-ego": 0.06410300104241622}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2865998420337463, "sim_physics": 0.01844105965051895, "survival_time": 3.899999999999994, "driven_lanedir": 0.11247199025262589, "sim_render-ego": 0.06866835325192182, "in-drivable-lane": 1.649999999999998, "agent_compute-ego": 0.20170932244031856, "deviation-heading": 1.5241715054005778, "set_robot_commands": 0.08018503739283635, "deviation-center-line": 0.12777873341396204, "driven_lanedir_consec": 0.11247199025262589, "sim_compute_sim_state": 0.04217664706401336, "sim_compute_performance-ego": 0.06725991383577004, "sim_compute_robot_state-ego": 0.06672521737905648}}set_robot_commands_max 0.08018503739283635 set_robot_commands_mean 0.07783895318394271 set_robot_commands_median 0.07686415830052885 set_robot_commands_min 0.07590526342391968 sim_compute_performance-ego_max 0.06725991383577004 sim_compute_performance-ego_mean 0.06248950036948413 sim_compute_performance-ego_median 0.06118657191594442 sim_compute_performance-ego_min 0.05845223051128966 sim_compute_robot_state-ego_max 0.06672521737905648 sim_compute_robot_state-ego_mean 0.0633654237956971 sim_compute_robot_state-ego_median 0.06410300104241622 sim_compute_robot_state-ego_min 0.05833252993496982 sim_compute_sim_state_max 0.04217664706401336 sim_compute_sim_state_mean 0.03884075658351009 sim_compute_sim_state_median 0.03910002443525526 sim_compute_sim_state_min 0.03434751250527122 sim_physics_max 0.01844105965051895 sim_physics_mean 0.017124589091298444 sim_physics_median 0.017281838825770786 sim_physics_min 0.015330112341678505 sim_render-ego_max 0.06866835325192182 sim_render-ego_mean 0.06238560866327253 sim_render-ego_median 0.06351124007126381 sim_render-ego_min 0.05590404886187929 simulation-passed 1 survival_time_max 6.649999999999984 survival_time_mean 3.6699999999999946 survival_time_min 1.6500000000000008
No reset possible 18897
2399
Liam Paull 🇨🇦random_agent aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 15:09:35+00:00 2019-04-20 15:21:05+00:00 0:11:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.1358110767144423 agent_compute-ego_mean 0.12871490683335862 agent_compute-ego_median 0.13142449297803513 agent_compute-ego_min 0.12112933491903638 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.032348042442685083, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05828919486394004, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12112933491903638, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07937391977461558, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.033805744988577704, "sim_compute_performance-ego": 0.059729856158059744, "sim_compute_robot_state-ego": 0.061964243177383665, "sim_compute_robot_state-npc0": 0.06653381150866312, "sim_compute_robot_state-npc1": 0.06225595020112537, "sim_compute_robot_state-npc2": 0.06197604300483825, "sim_compute_robot_state-npc3": 0.0608350398048522}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0289000810361376, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05846678041944317, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12276969703973507, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07689466663435393, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03358077067954868, "sim_compute_performance-ego": 0.05765668083639706, "sim_compute_robot_state-ego": 0.061356268677057006, "sim_compute_robot_state-npc0": 0.06374151566449333, "sim_compute_robot_state-npc1": 0.0626369644613827, "sim_compute_robot_state-npc2": 0.06213228842791389, "sim_compute_robot_state-npc3": 0.061867288514679555}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03178478056384671, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.0643421180786625, "in-drivable-lane": 0, "agent_compute-ego": 0.13243993251554428, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07832372188568115, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03444923508551813, "sim_compute_performance-ego": 0.06204770072813957, "sim_compute_robot_state-ego": 0.06329319169444422, "sim_compute_robot_state-npc0": 0.07188112505020634, "sim_compute_robot_state-npc1": 0.06321747841373566, "sim_compute_robot_state-npc2": 0.06397807598114014, "sim_compute_robot_state-npc3": 0.06355402161998133}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030408656343500665, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06329697750984355, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13142449297803513, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07870741854322717, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03613143271588264, "sim_compute_performance-ego": 0.06200778737981269, "sim_compute_robot_state-ego": 0.062181546332988336, "sim_compute_robot_state-npc0": 0.07307469591181329, "sim_compute_robot_state-npc1": 0.06552526545017323, "sim_compute_robot_state-npc2": 0.06436348468699354, "sim_compute_robot_state-npc3": 0.06315989443596373}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028423235966609076, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06350184862430279, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1358110767144423, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07942234094326313, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035882963584019587, "sim_compute_performance-ego": 0.06393837928771973, "sim_compute_robot_state-ego": 0.06371964399631207, "sim_compute_robot_state-npc0": 0.07033420984561627, "sim_compute_robot_state-npc1": 0.06583285331726074, "sim_compute_robot_state-npc2": 0.06416187378076407, "sim_compute_robot_state-npc3": 0.0639522855098431}}set_robot_commands_max 0.07942234094326313 set_robot_commands_mean 0.07854441355622818 set_robot_commands_median 0.07870741854322717 set_robot_commands_min 0.07689466663435393 sim_compute_performance-ego_max 0.06393837928771973 sim_compute_performance-ego_mean 0.06107608087802576 sim_compute_performance-ego_median 0.06200778737981269 sim_compute_performance-ego_min 0.05765668083639706 sim_compute_robot_state-ego_max 0.06371964399631207 sim_compute_robot_state-ego_mean 0.06250297877563707 sim_compute_robot_state-ego_median 0.062181546332988336 sim_compute_robot_state-ego_min 0.061356268677057006 sim_compute_robot_state-npc0_max 0.07307469591181329 sim_compute_robot_state-npc0_mean 0.06911307159615848 sim_compute_robot_state-npc0_median 0.07033420984561627 sim_compute_robot_state-npc0_min 0.06374151566449333 sim_compute_robot_state-npc1_max 0.06583285331726074 sim_compute_robot_state-npc1_mean 0.06389370236873554 sim_compute_robot_state-npc1_median 0.06321747841373566 sim_compute_robot_state-npc1_min 0.06225595020112537 sim_compute_robot_state-npc2_max 0.06436348468699354 sim_compute_robot_state-npc2_mean 0.06332235317632998 sim_compute_robot_state-npc2_median 0.06397807598114014 sim_compute_robot_state-npc2_min 0.06197604300483825 sim_compute_robot_state-npc3_max 0.0639522855098431 sim_compute_robot_state-npc3_mean 0.06267370597706398 sim_compute_robot_state-npc3_median 0.06315989443596373 sim_compute_robot_state-npc3_min 0.0608350398048522 sim_compute_sim_state_max 0.03613143271588264 sim_compute_sim_state_mean 0.03477002941070935 sim_compute_sim_state_median 0.03444923508551813 sim_compute_sim_state_min 0.03358077067954868 sim_physics_max 0.032348042442685083 sim_physics_mean 0.030372959270555826 sim_physics_median 0.030408656343500665 sim_physics_min 0.028423235966609076 sim_render-ego_max 0.0643421180786625 sim_render-ego_mean 0.061579383899238414 sim_render-ego_median 0.06329697750984355 sim_render-ego_min 0.05828919486394004 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18891
2403
Victor Guerra 🇫🇷Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 15:04:07+00:00 2019-04-20 15:09:06+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.20556632151961465 survival_time_median 1.4500000000000006 deviation-center-line_median 0.06994044370857125 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.26153947567117625 agent_compute-ego_mean 0.22869314952045436 agent_compute-ego_median 0.22361311117808025 agent_compute-ego_min 0.213343464095017 deviation-center-line_max 0.07669250776113018 deviation-center-line_mean 0.07160668220801261 deviation-center-line_min 0.06791691982833267 deviation-heading_max 0.5901923974852719 deviation-heading_mean 0.5713163752740655 deviation-heading_median 0.5666610127927063 deviation-heading_min 0.5607033748867222 driven_any_max 0.2612721115059313 driven_any_mean 0.2442842938461624 driven_any_median 0.24938148330345272 driven_any_min 0.22865027540201327 driven_lanedir_consec_max 0.2220276984544096 driven_lanedir_consec_mean 0.20296426976676205 driven_lanedir_consec_min 0.18472875904318983 driven_lanedir_max 0.2220276984544096 driven_lanedir_mean 0.20296426976676205 driven_lanedir_median 0.20556632151961465 driven_lanedir_min 0.18472875904318983 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24938148330345272, "sim_physics": 0.01591504853347252, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2094504208098762, "sim_render-ego": 0.061864326740133355, "in-drivable-lane": 0, "agent_compute-ego": 0.213343464095017, "deviation-heading": 0.5642012047668415, "set_robot_commands": 0.072527342829211, "deviation-center-line": 0.07540396161746522, "driven_lanedir_consec": 0.2094504208098762, "sim_compute_sim_state": 0.03764547150710534, "sim_compute_performance-ego": 0.059238992888351966, "sim_compute_robot_state-ego": 0.060590456271993706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2612721115059313, "sim_physics": 0.016680034001668294, "survival_time": 1.5000000000000009, "driven_lanedir": 0.2220276984544096, "sim_render-ego": 0.06391087373097738, "in-drivable-lane": 0, "agent_compute-ego": 0.22361311117808025, "deviation-heading": 0.5666610127927063, "set_robot_commands": 0.07613540490468343, "deviation-center-line": 0.07669250776113018, "driven_lanedir_consec": 0.2220276984544096, "sim_compute_sim_state": 0.03977625370025635, "sim_compute_performance-ego": 0.06539766788482666, "sim_compute_robot_state-ego": 0.06364773909250895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23115721589580013, "sim_physics": 0.016020221369607106, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19304814900671996, "sim_render-ego": 0.06635648863656181, "in-drivable-lane": 0, "agent_compute-ego": 0.22832959038870676, "deviation-heading": 0.5607033748867222, "set_robot_commands": 0.07907892976488386, "deviation-center-line": 0.06994044370857125, "driven_lanedir_consec": 0.19304814900671996, "sim_compute_sim_state": 0.040159872600010464, "sim_compute_performance-ego": 0.06570615087236677, "sim_compute_robot_state-ego": 0.06404322385787964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2509603831236146, "sim_physics": 0.014795780181884766, "survival_time": 1.4500000000000006, "driven_lanedir": 0.20556632151961465, "sim_render-ego": 0.05511673565568595, "in-drivable-lane": 0, "agent_compute-ego": 0.26153947567117625, "deviation-heading": 0.5748238864387858, "set_robot_commands": 0.07643742396913726, "deviation-center-line": 0.06807957812456367, "driven_lanedir_consec": 0.20556632151961465, "sim_compute_sim_state": 0.03290213387587975, "sim_compute_performance-ego": 0.056869416401304045, "sim_compute_robot_state-ego": 0.0587696124767435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22865027540201327, "sim_physics": 0.016343346663883755, "survival_time": 1.4000000000000006, "driven_lanedir": 0.18472875904318983, "sim_render-ego": 0.063167291028159, "in-drivable-lane": 0, "agent_compute-ego": 0.21664010626929148, "deviation-heading": 0.5901923974852719, "set_robot_commands": 0.07736426591873169, "deviation-center-line": 0.06791691982833267, "driven_lanedir_consec": 0.18472875904318983, "sim_compute_sim_state": 0.03828024012701852, "sim_compute_performance-ego": 0.059997618198394775, "sim_compute_robot_state-ego": 0.06340195451463972}}set_robot_commands_max 0.07907892976488386 set_robot_commands_mean 0.07630867347732945 set_robot_commands_median 0.07643742396913726 set_robot_commands_min 0.072527342829211 sim_compute_performance-ego_max 0.06570615087236677 sim_compute_performance-ego_mean 0.06144196924904884 sim_compute_performance-ego_median 0.059997618198394775 sim_compute_performance-ego_min 0.056869416401304045 sim_compute_robot_state-ego_max 0.06404322385787964 sim_compute_robot_state-ego_mean 0.0620905972427531 sim_compute_robot_state-ego_median 0.06340195451463972 sim_compute_robot_state-ego_min 0.0587696124767435 sim_compute_sim_state_max 0.040159872600010464 sim_compute_sim_state_mean 0.03775279436205409 sim_compute_sim_state_median 0.03828024012701852 sim_compute_sim_state_min 0.03290213387587975 sim_physics_max 0.016680034001668294 sim_physics_mean 0.01595088615010329 sim_physics_median 0.016020221369607106 sim_physics_min 0.014795780181884766 sim_render-ego_max 0.06635648863656181 sim_render-ego_mean 0.0620831431583035 sim_render-ego_median 0.063167291028159 sim_render-ego_min 0.05511673565568595 simulation-passed 1 survival_time_max 1.5000000000000009 survival_time_mean 1.4400000000000006 survival_time_min 1.4000000000000006
No reset possible 18875
2412
jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:41:12+00:00 2019-04-20 15:03:54+00:00 0:22:42 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18873
2429
Andrea Censi 🇨🇭random_agent aido2-LF-sim-validation
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:40:20+00:00 2019-04-20 14:41:00+00:00 0:00:40 The container "solut [...] The container "solution" exited with code 2.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18849
2449
Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:18:37+00:00 2019-04-20 14:39:39+00:00 0:21:02 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18837
2468
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 14:12:26+00:00 2019-04-20 14:18:11+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.147100035349528 agent_compute-ego_mean 0.14302958891134995 agent_compute-ego_median 0.14488736188636636 agent_compute-ego_min 0.13789587511735804 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.017227793639560916, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06361848903152179, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14488736188636636, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07918151369634664, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04132444453689287, "sim_compute_performance-ego": 0.06285821716740446, "sim_compute_robot_state-ego": 0.06482858927744739}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016426118937405674, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06400883197784424, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13928248123689133, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07570694251493974, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.040614507415077904, "sim_compute_performance-ego": 0.0661563819104975, "sim_compute_robot_state-ego": 0.06625695120204579}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01635711987813314, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0687200387318929, "in-drivable-lane": 0, "agent_compute-ego": 0.147100035349528, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07663857671949599, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04238822725084093, "sim_compute_performance-ego": 0.06603004137674967, "sim_compute_robot_state-ego": 0.06619995435078939}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0158309539159139, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06251895427703857, "in-drivable-lane": 0, "agent_compute-ego": 0.14598219096660614, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07659447689851125, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03888757526874542, "sim_compute_performance-ego": 0.06411096453666687, "sim_compute_robot_state-ego": 0.06288864711920421}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01748075204737046, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05958183372721953, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13789587511735804, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07796917242162368, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03873582096660838, "sim_compute_performance-ego": 0.06160100067363066, "sim_compute_robot_state-ego": 0.061562299728393555}}set_robot_commands_max 0.07918151369634664 set_robot_commands_mean 0.07721813645018345 set_robot_commands_median 0.07663857671949599 set_robot_commands_min 0.07570694251493974 sim_compute_performance-ego_max 0.0661563819104975 sim_compute_performance-ego_mean 0.06415132113298984 sim_compute_performance-ego_median 0.06411096453666687 sim_compute_performance-ego_min 0.06160100067363066 sim_compute_robot_state-ego_max 0.06625695120204579 sim_compute_robot_state-ego_mean 0.06434728833557607 sim_compute_robot_state-ego_median 0.06482858927744739 sim_compute_robot_state-ego_min 0.061562299728393555 sim_compute_sim_state_max 0.04238822725084093 sim_compute_sim_state_mean 0.040390115087633106 sim_compute_sim_state_median 0.040614507415077904 sim_compute_sim_state_min 0.03873582096660838 sim_physics_max 0.01748075204737046 sim_physics_mean 0.01666454768367682 sim_physics_median 0.016426118937405674 sim_physics_min 0.0158309539159139 sim_render-ego_max 0.0687200387318929 sim_render-ego_mean 0.06368962954910341 sim_render-ego_median 0.06361848903152179 sim_render-ego_min 0.05958183372721953 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18819
2491
Liam Paull 🇨🇦challenge-aido_LF-template-pytorch aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 14:05:46+00:00 2019-04-20 14:12:13+00:00 0:06:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07617252815778475 survival_time_median 1.5500000000000007 deviation-center-line_median 0.04048056165941895 in-drivable-lane_median 0.4500000000000004
other stats agent_compute-ego_max 0.29052980192776384 agent_compute-ego_mean 0.24237868662380177 agent_compute-ego_median 0.2267857982266334 agent_compute-ego_min 0.1898632720112801 deviation-center-line_max 0.04184896901467821 deviation-center-line_mean 0.03519630061303873 deviation-center-line_min 0.024611763779202683 deviation-heading_max 0.6982639153859251 deviation-heading_mean 0.6633133247330315 deviation-heading_median 0.6701850748064416 deviation-heading_min 0.6184228278775682 driven_any_max 0.1721846168024769 driven_any_mean 0.15445150119305456 driven_any_median 0.1464155045396709 driven_any_min 0.14382001725597784 driven_lanedir_consec_max 0.08827801441789962 driven_lanedir_consec_mean 0.06668609862754557 driven_lanedir_consec_min 0.04511978828829033 driven_lanedir_max 0.08827801441789962 driven_lanedir_mean 0.06668609862754557 driven_lanedir_median 0.07617252815778475 driven_lanedir_min 0.04511978828829033 in-drivable-lane_max 0.5000000000000004 in-drivable-lane_mean 0.37000000000000033 in-drivable-lane_min 0.15000000000000013 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1721846168024769, "sim_physics": 0.016135324131358753, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07624819349723877, "sim_render-ego": 0.05885149493361965, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2895600506753633, "deviation-heading": 0.6982639153859251, "set_robot_commands": 0.07949478698499275, "deviation-center-line": 0.04184896901467821, "driven_lanedir_consec": 0.07624819349723877, "sim_compute_sim_state": 0.03721739306594386, "sim_compute_performance-ego": 0.059123689478093926, "sim_compute_robot_state-ego": 0.061240217902443626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1462622179076868, "sim_physics": 0.01612964043250451, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07617252815778475, "sim_render-ego": 0.0636527629999014, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2151545102779682, "deviation-heading": 0.6750181006448601, "set_robot_commands": 0.07746760661785419, "deviation-center-line": 0.04048056165941895, "driven_lanedir_consec": 0.07617252815778475, "sim_compute_sim_state": 0.04117463185237004, "sim_compute_performance-ego": 0.07082676887512207, "sim_compute_robot_state-ego": 0.06428461808424729}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1635751494594604, "sim_physics": 0.015957371941928207, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08827801441789962, "sim_render-ego": 0.05922250089974239, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.29052980192776384, "deviation-heading": 0.6546767049503628, "set_robot_commands": 0.07848315403379243, "deviation-center-line": 0.04110876608328455, "driven_lanedir_consec": 0.08827801441789962, "sim_compute_sim_state": 0.03632246214767982, "sim_compute_performance-ego": 0.060080717349874566, "sim_compute_robot_state-ego": 0.0635603378558981}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14382001725597784, "sim_physics": 0.015401055735926476, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04761196877651441, "sim_render-ego": 0.06503632760817005, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2267857982266334, "deviation-heading": 0.6184228278775682, "set_robot_commands": 0.0791727804368542, "deviation-center-line": 0.024611763779202683, "driven_lanedir_consec": 0.04761196877651441, "sim_compute_sim_state": 0.04139204179086993, "sim_compute_performance-ego": 0.06379931972872827, "sim_compute_robot_state-ego": 0.06457917921004756}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1464155045396709, "sim_physics": 0.0168711319565773, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04511978828829033, "sim_render-ego": 0.06311016529798508, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1898632720112801, "deviation-heading": 0.6701850748064416, "set_robot_commands": 0.07685405761003494, "deviation-center-line": 0.027931442528609268, "driven_lanedir_consec": 0.04511978828829033, "sim_compute_sim_state": 0.040560588240623474, "sim_compute_performance-ego": 0.06962587684392929, "sim_compute_robot_state-ego": 0.0638752430677414}}set_robot_commands_max 0.07949478698499275 set_robot_commands_mean 0.0782944771367057 set_robot_commands_median 0.07848315403379243 set_robot_commands_min 0.07685405761003494 sim_compute_performance-ego_max 0.07082676887512207 sim_compute_performance-ego_mean 0.06469127445514963 sim_compute_performance-ego_median 0.06379931972872827 sim_compute_performance-ego_min 0.059123689478093926 sim_compute_robot_state-ego_max 0.06457917921004756 sim_compute_robot_state-ego_mean 0.06350791922407559 sim_compute_robot_state-ego_median 0.0638752430677414 sim_compute_robot_state-ego_min 0.061240217902443626 sim_compute_sim_state_max 0.04139204179086993 sim_compute_sim_state_mean 0.03933342341949743 sim_compute_sim_state_median 0.040560588240623474 sim_compute_sim_state_min 0.03632246214767982 sim_physics_max 0.0168711319565773 sim_physics_mean 0.016098904839659048 sim_physics_median 0.01612964043250451 sim_physics_min 0.015401055735926476 sim_render-ego_max 0.06503632760817005 sim_render-ego_mean 0.06197465034788372 sim_render-ego_median 0.06311016529798508 sim_render-ego_min 0.05885149493361965 simulation-passed 1 survival_time_max 1.6500000000000008 survival_time_mean 1.510000000000001 survival_time_min 1.3000000000000005
No reset possible 18814
2502
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:04:43+00:00 2019-04-20 14:05:20+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18809
2508
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:03:22+00:00 2019-04-20 14:04:01+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18805
2524
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:02:32+00:00 2019-04-20 14:03:15+00:00 0:00:43 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18800
2528
Liam Paull 🇨🇦baseline-IL-sim-tensorflow aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 14:01:21+00:00 2019-04-20 14:02:00+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18795
2533
Liam Paull 🇨🇦baseline-IL-sim-tensorflow aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-10821
2019-04-20 13:59:49+00:00 2019-04-20 14:01:02+00:00 0:01:13 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18791
2538
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 13:58:18+00:00 2019-04-20 13:59:42+00:00 0:01:24 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18785
2547
Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 13:52:26+00:00 2019-04-20 13:58:11+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06837857686556302 agent_compute-ego_mean 0.06324729536278857 agent_compute-ego_median 0.06230368112262927 agent_compute-ego_min 0.05982690904198623 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.015988126033689917, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05560826092231565, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05982690904198623, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07376204467401272, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03679167061317258, "sim_compute_performance-ego": 0.05859388374700779, "sim_compute_robot_state-ego": 0.05924658659027844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015073565336374136, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06510995901547946, "in-drivable-lane": 0, "agent_compute-ego": 0.06837857686556302, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07569446930518517, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03964824859912579, "sim_compute_performance-ego": 0.06352994992182805, "sim_compute_robot_state-ego": 0.06184382622058575}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.016405460682321103, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06238535617260223, "in-drivable-lane": 0, "agent_compute-ego": 0.06209851833100014, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07414666135260399, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04091781250973965, "sim_compute_performance-ego": 0.06521190988256577, "sim_compute_robot_state-ego": 0.06516265361867052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019290132836981135, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.062005111149379184, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06362879145276415, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07574909597962767, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.037744307256006936, "sim_compute_performance-ego": 0.06202136815249265, "sim_compute_robot_state-ego": 0.06280749184744698}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015118027988233064, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.057852092542146384, "in-drivable-lane": 0, "agent_compute-ego": 0.06230368112262927, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0731806755065918, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03518446495658473, "sim_compute_performance-ego": 0.05705845355987549, "sim_compute_robot_state-ego": 0.06119707383607563}}set_robot_commands_max 0.07574909597962767 set_robot_commands_mean 0.07450658936360428 set_robot_commands_median 0.07414666135260399 set_robot_commands_min 0.0731806755065918 sim_compute_performance-ego_max 0.06521190988256577 sim_compute_performance-ego_mean 0.06128311305275395 sim_compute_performance-ego_median 0.06202136815249265 sim_compute_performance-ego_min 0.05705845355987549 sim_compute_robot_state-ego_max 0.06516265361867052 sim_compute_robot_state-ego_mean 0.06205152642261147 sim_compute_robot_state-ego_median 0.06184382622058575 sim_compute_robot_state-ego_min 0.05924658659027844 sim_compute_sim_state_max 0.04091781250973965 sim_compute_sim_state_mean 0.038057300786925936 sim_compute_sim_state_median 0.037744307256006936 sim_compute_sim_state_min 0.03518446495658473 sim_physics_max 0.019290132836981135 sim_physics_mean 0.01637506257551987 sim_physics_median 0.015988126033689917 sim_physics_min 0.015073565336374136 sim_render-ego_max 0.06510995901547946 sim_render-ego_mean 0.060592155960384586 sim_render-ego_median 0.062005111149379184 sim_render-ego_min 0.05560826092231565 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18779
2568
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 13:40:58+00:00 2019-04-20 13:52:20+00:00 0:11:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.06708021902702224 agent_compute-ego_mean 0.06545611082544443 agent_compute-ego_median 0.06476375931187679 agent_compute-ego_min 0.06412087245420976 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.029381380583110607, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06069188117980957, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06476375931187679, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07813492072255988, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03367972373962402, "sim_compute_performance-ego": 0.059500415701615184, "sim_compute_robot_state-ego": 0.06111644192745811, "sim_compute_robot_state-npc0": 0.06773849537498072, "sim_compute_robot_state-npc1": 0.06433553444711786, "sim_compute_robot_state-npc2": 0.06252800037986354, "sim_compute_robot_state-npc3": 0.0614631125801488}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.025292402819583292, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05999714449832314, "in-drivable-lane": 0, "agent_compute-ego": 0.06461959136159796, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07469566872245387, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.033848894269842854, "sim_compute_performance-ego": 0.060574933102256374, "sim_compute_robot_state-ego": 0.06083666023455168, "sim_compute_robot_state-npc0": 0.06699762218876888, "sim_compute_robot_state-npc1": 0.06398110640676398, "sim_compute_robot_state-npc2": 0.059915279087267424, "sim_compute_robot_state-npc3": 0.06033654589402048}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029245352133726463, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06674707852877103, "in-drivable-lane": 0, "agent_compute-ego": 0.0666961119725154, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07817372297629333, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.0365605109777206, "sim_compute_performance-ego": 0.061934385544214494, "sim_compute_robot_state-ego": 0.062493171447362654, "sim_compute_robot_state-npc0": 0.06935306084461701, "sim_compute_robot_state-npc1": 0.06355736194512783, "sim_compute_robot_state-npc2": 0.06296925055675018, "sim_compute_robot_state-npc3": 0.06322112450232872}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03178271441392495, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06664459470292212, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06708021902702224, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07886022581181056, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.036158894149350446, "sim_compute_performance-ego": 0.06364378794817857, "sim_compute_robot_state-ego": 0.06369463490768218, "sim_compute_robot_state-npc0": 0.07210025988834005, "sim_compute_robot_state-npc1": 0.06726036944859465, "sim_compute_robot_state-npc2": 0.06590350580887055, "sim_compute_robot_state-npc3": 0.06305516605645838}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02591666850176725, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06158557805148038, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06412087245420976, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07380058006806807, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03510407968000932, "sim_compute_performance-ego": 0.06186426227742976, "sim_compute_robot_state-ego": 0.06613113121552901, "sim_compute_robot_state-npc0": 0.06919363411990079, "sim_compute_robot_state-npc1": 0.06544293056834828, "sim_compute_robot_state-npc2": 0.06257736682891846, "sim_compute_robot_state-npc3": 0.0635662241415544}}set_robot_commands_max 0.07886022581181056 set_robot_commands_mean 0.07673302366023714 set_robot_commands_median 0.07813492072255988 set_robot_commands_min 0.07380058006806807 sim_compute_performance-ego_max 0.06364378794817857 sim_compute_performance-ego_mean 0.06150355691473888 sim_compute_performance-ego_median 0.06186426227742976 sim_compute_performance-ego_min 0.059500415701615184 sim_compute_robot_state-ego_max 0.06613113121552901 sim_compute_robot_state-ego_mean 0.06285440794651673 sim_compute_robot_state-ego_median 0.062493171447362654 sim_compute_robot_state-ego_min 0.06083666023455168 sim_compute_robot_state-npc0_max 0.07210025988834005 sim_compute_robot_state-npc0_mean 0.0690766144833215 sim_compute_robot_state-npc0_median 0.06919363411990079 sim_compute_robot_state-npc0_min 0.06699762218876888 sim_compute_robot_state-npc1_max 0.06726036944859465 sim_compute_robot_state-npc1_mean 0.06491546056319052 sim_compute_robot_state-npc1_median 0.06433553444711786 sim_compute_robot_state-npc1_min 0.06355736194512783 sim_compute_robot_state-npc2_max 0.06590350580887055 sim_compute_robot_state-npc2_mean 0.06277868053233403 sim_compute_robot_state-npc2_median 0.06257736682891846 sim_compute_robot_state-npc2_min 0.059915279087267424 sim_compute_robot_state-npc3_max 0.0635662241415544 sim_compute_robot_state-npc3_mean 0.062328434634902154 sim_compute_robot_state-npc3_median 0.06305516605645838 sim_compute_robot_state-npc3_min 0.06033654589402048 sim_compute_sim_state_max 0.0365605109777206 sim_compute_sim_state_mean 0.03507042056330946 sim_compute_sim_state_median 0.03510407968000932 sim_compute_sim_state_min 0.03367972373962402 sim_physics_max 0.03178271441392495 sim_physics_mean 0.028323703690422513 sim_physics_median 0.029245352133726463 sim_physics_min 0.025292402819583292 sim_render-ego_max 0.06674707852877103 sim_render-ego_mean 0.06313325539226125 sim_render-ego_median 0.06158557805148038 sim_render-ego_min 0.05999714449832314 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 18728
2685
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation host-error no idsc-rudolf-10821
2019-04-20 11:01:23+00:00 2019-04-20 11:22:00+00:00 0:20:37 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2685/step1-simulation-idsc-rudolf-10821-job18728/tmp/tmpx0u4ww3l/attempts/udem1-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18714
2685
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 10:44:48+00:00 2019-04-20 11:00:44+00:00 0:15:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5899772317367831 survival_time_median 4.099999999999993 deviation-center-line_median 0.32376686922317166 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06711235467125387 agent_compute-ego_mean 0.06398172338789826 agent_compute-ego_median 0.0633036014510364 agent_compute-ego_min 0.06066203600651509 deviation-center-line_max 0.6423475263601296 deviation-center-line_mean 0.3476615135079574 deviation-center-line_min 0.07490284011542553 deviation-heading_max 2.7176918923677467 deviation-heading_mean 1.20858162122072 deviation-heading_median 0.8520617880510254 deviation-heading_min 0.6915673569711595 driven_any_max 1.7770096165437566 driven_any_mean 0.7929367160513807 driven_any_median 0.6118882329745925 driven_any_min 0.21811189564873917 driven_lanedir_consec_max 1.3491642604706673 driven_lanedir_consec_mean 0.6814092350659805 driven_lanedir_consec_min 0.17200423330345238 driven_lanedir_max 1.360088302919181 driven_lanedir_mean 0.6840964427094461 driven_lanedir_median 0.5899772317367831 driven_lanedir_min 0.17200423330345238 in-drivable-lane_max 1.9500000000000275 in-drivable-lane_mean 0.3900000000000056 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1315209229644638, "sim_physics": 0.02685081314396214, "survival_time": 7.399999999999982, "driven_lanedir": 1.1122221723007792, "sim_render-ego": 0.05435363988618593, "in-drivable-lane": 0, "agent_compute-ego": 0.06066203600651509, "deviation-heading": 1.0559384392497824, "set_robot_commands": 0.07281863045048069, "deviation-center-line": 0.6423475263601296, "driven_lanedir_consec": 1.1097101765319646, "sim_compute_sim_state": 0.0321593155732026, "sim_compute_performance-ego": 0.05647471949860856, "sim_compute_robot_state-ego": 0.05753874295466655, "sim_compute_robot_state-npc0": 0.06230617697174485, "sim_compute_robot_state-npc1": 0.05724788678658975, "sim_compute_robot_state-npc2": 0.05650285450187889, "sim_compute_robot_state-npc3": 0.05684794284201957}, "udem1-1-0": {"driven_any": 0.21811189564873917, "sim_physics": 0.024855924375129467, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17200423330345238, "sim_render-ego": 0.055684291955196495, "in-drivable-lane": 0, "agent_compute-ego": 0.063029484315352, "deviation-heading": 0.7256486294638864, "set_robot_commands": 0.0704216668100068, "deviation-center-line": 0.07490284011542553, "driven_lanedir_consec": 0.17200423330345238, "sim_compute_sim_state": 0.03083630764123165, "sim_compute_performance-ego": 0.0550781452294552, "sim_compute_robot_state-ego": 0.05719228946801388, "sim_compute_robot_state-npc0": 0.0565370935382265, "sim_compute_robot_state-npc1": 0.05413271441604152, "sim_compute_robot_state-npc2": 0.05294420502402566, "sim_compute_robot_state-npc3": 0.05317378044128418}, "udem1-2-0": {"driven_any": 0.6118882329745925, "sim_physics": 0.03209590621110869, "survival_time": 4.099999999999993, "driven_lanedir": 0.5899772317367831, "sim_render-ego": 0.057874851110504895, "in-drivable-lane": 0, "agent_compute-ego": 0.0633036014510364, "deviation-heading": 0.8520617880510254, "set_robot_commands": 0.07298767857435273, "deviation-center-line": 0.32376686922317166, "driven_lanedir_consec": 0.5899772317367831, "sim_compute_sim_state": 0.03125531208224413, "sim_compute_performance-ego": 0.05712775486271556, "sim_compute_robot_state-ego": 0.05781227495612168, "sim_compute_robot_state-npc0": 0.06349147238382478, "sim_compute_robot_state-npc1": 0.05860752012671494, "sim_compute_robot_state-npc2": 0.0590835344500658, "sim_compute_robot_state-npc3": 0.05820568887198844}, "udem1-3-0": {"driven_any": 0.2261529121253515, "sim_physics": 0.026296545477474436, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18619027328703508, "sim_render-ego": 0.05908659626455868, "in-drivable-lane": 0, "agent_compute-ego": 0.06711235467125387, "deviation-heading": 0.6915673569711595, "set_robot_commands": 0.07497168288511388, "deviation-center-line": 0.07700650382450831, "driven_lanedir_consec": 0.18619027328703508, "sim_compute_sim_state": 0.031647072118871356, "sim_compute_performance-ego": 0.057404125438017005, "sim_compute_robot_state-ego": 0.0575098570655374, "sim_compute_robot_state-npc0": 0.062865229213939, "sim_compute_robot_state-npc1": 0.05728265117196476, "sim_compute_robot_state-npc2": 0.05619502768797033, "sim_compute_robot_state-npc3": 0.05847001776975744}, "udem1-4-0": {"driven_any": 1.7770096165437566, "sim_physics": 0.026932731073858455, "survival_time": 11.350000000000026, "driven_lanedir": 1.360088302919181, "sim_render-ego": 0.058090380109879415, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.0658011404953339, "deviation-heading": 2.7176918923677467, "set_robot_commands": 0.07444879031916547, "deviation-center-line": 0.6202838280165518, "driven_lanedir_consec": 1.3491642604706673, "sim_compute_sim_state": 0.03297592574804365, "sim_compute_performance-ego": 0.058337537202541, "sim_compute_robot_state-ego": 0.058552855437022475, "sim_compute_robot_state-npc0": 0.06375794578753904, "sim_compute_robot_state-npc1": 0.058883256324062265, "sim_compute_robot_state-npc2": 0.05782269486246655, "sim_compute_robot_state-npc3": 0.058283487605628466}}set_robot_commands_max 0.07497168288511388 set_robot_commands_mean 0.07312968980782392 set_robot_commands_median 0.07298767857435273 set_robot_commands_min 0.0704216668100068 sim_compute_performance-ego_max 0.058337537202541 sim_compute_performance-ego_mean 0.05688445644626746 sim_compute_performance-ego_median 0.05712775486271556 sim_compute_performance-ego_min 0.0550781452294552 sim_compute_robot_state-ego_max 0.058552855437022475 sim_compute_robot_state-ego_mean 0.057721203976272395 sim_compute_robot_state-ego_median 0.05753874295466655 sim_compute_robot_state-ego_min 0.05719228946801388 sim_compute_robot_state-npc0_max 0.06375794578753904 sim_compute_robot_state-npc0_mean 0.06179158357905483 sim_compute_robot_state-npc0_median 0.062865229213939 sim_compute_robot_state-npc0_min 0.0565370935382265 sim_compute_robot_state-npc1_max 0.058883256324062265 sim_compute_robot_state-npc1_mean 0.057230805765074645 sim_compute_robot_state-npc1_median 0.05728265117196476 sim_compute_robot_state-npc1_min 0.05413271441604152 sim_compute_robot_state-npc2_max 0.0590835344500658 sim_compute_robot_state-npc2_mean 0.05650966330528144 sim_compute_robot_state-npc2_median 0.05650285450187889 sim_compute_robot_state-npc2_min 0.05294420502402566 sim_compute_robot_state-npc3_max 0.05847001776975744 sim_compute_robot_state-npc3_mean 0.056996183506135625 sim_compute_robot_state-npc3_median 0.05820568887198844 sim_compute_robot_state-npc3_min 0.05317378044128418 sim_compute_sim_state_max 0.03297592574804365 sim_compute_sim_state_mean 0.031774786632718675 sim_compute_sim_state_median 0.031647072118871356 sim_compute_sim_state_min 0.03083630764123165 sim_physics_max 0.03209590621110869 sim_physics_mean 0.02740638405630664 sim_physics_median 0.02685081314396214 sim_physics_min 0.024855924375129467 sim_render-ego_max 0.05908659626455868 sim_render-ego_mean 0.05701795186526508 sim_render-ego_median 0.057874851110504895 sim_render-ego_min 0.05435363988618593 simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 5.24 survival_time_min 1.6500000000000008
No reset possible 18706
2649
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 10:34:32+00:00 2019-04-20 10:44:35+00:00 0:10:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.06373329651661408 agent_compute-ego_mean 0.06237163881491002 agent_compute-ego_median 0.06281297857111151 agent_compute-ego_min 0.060694890273244755 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.028623091547112716, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05354533195495605, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.060694890273244755, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.0750978294171785, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03136128626371685, "sim_compute_performance-ego": 0.05420975936086554, "sim_compute_robot_state-ego": 0.05656764130843313, "sim_compute_robot_state-npc0": 0.06009885135449861, "sim_compute_robot_state-npc1": 0.055945823067112974, "sim_compute_robot_state-npc2": 0.05573086738586426, "sim_compute_robot_state-npc3": 0.05529412972299677}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02713011440477873, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0561322852184898, "in-drivable-lane": 0, "agent_compute-ego": 0.061524303335892525, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07312418912586413, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.032612242196735586, "sim_compute_performance-ego": 0.055430092309650625, "sim_compute_robot_state-ego": 0.05635232674448114, "sim_compute_robot_state-npc0": 0.0648197939521388, "sim_compute_robot_state-npc1": 0.06190901680996543, "sim_compute_robot_state-npc2": 0.058993188958419, "sim_compute_robot_state-npc3": 0.057937063668903555}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.029878683579273712, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06087960952367538, "in-drivable-lane": 0, "agent_compute-ego": 0.06373329651661408, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0749667974618765, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03485455879798302, "sim_compute_performance-ego": 0.06350204883477627, "sim_compute_robot_state-ego": 0.06267653367458245, "sim_compute_robot_state-npc0": 0.0669403809767503, "sim_compute_robot_state-npc1": 0.06135258919153458, "sim_compute_robot_state-npc2": 0.06292522259247608, "sim_compute_robot_state-npc3": 0.0615850962125338}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03167856579095545, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.062461708632993024, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06309272537768727, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07468783687537825, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.0349195809431479, "sim_compute_performance-ego": 0.06044760220487353, "sim_compute_robot_state-ego": 0.06183425137694453, "sim_compute_robot_state-npc0": 0.0705918526985276, "sim_compute_robot_state-npc1": 0.06491127148480483, "sim_compute_robot_state-npc2": 0.061978125236403774, "sim_compute_robot_state-npc3": 0.06249930153430348}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02665380456230857, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.060398746620525016, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06281297857111151, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07410057566382668, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.034333581274205986, "sim_compute_performance-ego": 0.06012424013831399, "sim_compute_robot_state-ego": 0.060959815979003906, "sim_compute_robot_state-npc0": 0.06841706687753851, "sim_compute_robot_state-npc1": 0.06341333280910146, "sim_compute_robot_state-npc2": 0.061252729459242386, "sim_compute_robot_state-npc3": 0.06116603179411455}}set_robot_commands_max 0.0750978294171785 set_robot_commands_mean 0.07439544570882481 set_robot_commands_median 0.07468783687537825 set_robot_commands_min 0.07312418912586413 sim_compute_performance-ego_max 0.06350204883477627 sim_compute_performance-ego_mean 0.05874274856969599 sim_compute_performance-ego_median 0.06012424013831399 sim_compute_performance-ego_min 0.05420975936086554 sim_compute_robot_state-ego_max 0.06267653367458245 sim_compute_robot_state-ego_mean 0.05967811381668904 sim_compute_robot_state-ego_median 0.060959815979003906 sim_compute_robot_state-ego_min 0.05635232674448114 sim_compute_robot_state-npc0_max 0.0705918526985276 sim_compute_robot_state-npc0_mean 0.06617358917189076 sim_compute_robot_state-npc0_median 0.0669403809767503 sim_compute_robot_state-npc0_min 0.06009885135449861 sim_compute_robot_state-npc1_max 0.06491127148480483 sim_compute_robot_state-npc1_mean 0.06150640667250386 sim_compute_robot_state-npc1_median 0.06190901680996543 sim_compute_robot_state-npc1_min 0.055945823067112974 sim_compute_robot_state-npc2_max 0.06292522259247608 sim_compute_robot_state-npc2_mean 0.060176026726481105 sim_compute_robot_state-npc2_median 0.061252729459242386 sim_compute_robot_state-npc2_min 0.05573086738586426 sim_compute_robot_state-npc3_max 0.06249930153430348 sim_compute_robot_state-npc3_mean 0.059696324586570426 sim_compute_robot_state-npc3_median 0.06116603179411455 sim_compute_robot_state-npc3_min 0.05529412972299677 sim_compute_sim_state_max 0.0349195809431479 sim_compute_sim_state_mean 0.033616249895157865 sim_compute_sim_state_median 0.034333581274205986 sim_compute_sim_state_min 0.03136128626371685 sim_physics_max 0.03167856579095545 sim_physics_mean 0.028792851976885837 sim_physics_median 0.028623091547112716 sim_physics_min 0.02665380456230857 sim_render-ego_max 0.062461708632993024 sim_render-ego_mean 0.058683536390127855 sim_render-ego_median 0.060398746620525016 sim_render-ego_min 0.05354533195495605 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 18697
2661
Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-10821
2019-04-20 10:16:16+00:00 2019-04-20 10:34:25+00:00 0:18:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7569634097878868 survival_time_median 5.14999999999999 deviation-center-line_median 0.4529888653437758 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05895541993198016 agent_compute-ego_mean 0.057263236268946395 agent_compute-ego_median 0.05724251848980061 agent_compute-ego_min 0.05507721662521362 deviation-center-line_max 1.1749953599507068 deviation-center-line_mean 0.47897544841416606 deviation-center-line_min 0.06826179920421413 deviation-heading_max 3.784897446289332 deviation-heading_mean 1.4711054625874742 deviation-heading_median 0.98045330364767 deviation-heading_min 0.6694695765082032 driven_any_max 2.3556684298839334 driven_any_mean 0.945633182526677 driven_any_median 0.7806439229755167 driven_any_min 0.21007220778022476 driven_lanedir_consec_max 2.1732611959936747 driven_lanedir_consec_mean 0.8822773340763386 driven_lanedir_consec_min 0.16110760340739727 driven_lanedir_max 2.1756350388990997 driven_lanedir_mean 0.8829069559010421 driven_lanedir_median 0.7569634097878868 driven_lanedir_min 0.16110760340739727 in-drivable-lane_max 0.34999999999999876 in-drivable-lane_mean 0.06999999999999976 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1556281369293635, "sim_physics": 0.026169786390089832, "survival_time": 7.549999999999981, "driven_lanedir": 1.1328409436600602, "sim_render-ego": 0.05177836228680137, "in-drivable-lane": 0, "agent_compute-ego": 0.05895541993198016, "deviation-heading": 1.1981299153715863, "set_robot_commands": 0.0707974670738574, "deviation-center-line": 0.624713557469308, "driven_lanedir_consec": 1.1320666774419674, "sim_compute_sim_state": 0.03148902173073876, "sim_compute_performance-ego": 0.052901580633706605, "sim_compute_robot_state-ego": 0.05448048004251442, "sim_compute_robot_state-npc0": 0.05739914660422218, "sim_compute_robot_state-npc1": 0.05493222956625831, "sim_compute_robot_state-npc2": 0.05418053683855676, "sim_compute_robot_state-npc3": 0.05508388272973875}, "udem1-1-0": {"driven_any": 0.21007220778022476, "sim_physics": 0.02427510917186737, "survival_time": 1.6000000000000008, "driven_lanedir": 0.16110760340739727, "sim_render-ego": 0.05174197256565094, "in-drivable-lane": 0, "agent_compute-ego": 0.05636325478553772, "deviation-heading": 0.7225770711205787, "set_robot_commands": 0.07094917446374893, "deviation-center-line": 0.06826179920421413, "driven_lanedir_consec": 0.16110760340739727, "sim_compute_sim_state": 0.030063845217227936, "sim_compute_performance-ego": 0.05106150358915329, "sim_compute_robot_state-ego": 0.0524461641907692, "sim_compute_robot_state-npc0": 0.0547826811671257, "sim_compute_robot_state-npc1": 0.05242941528558731, "sim_compute_robot_state-npc2": 0.05184563994407654, "sim_compute_robot_state-npc3": 0.052342742681503296}, "udem1-2-0": {"driven_any": 0.7806439229755167, "sim_physics": 0.02866572083778752, "survival_time": 5.14999999999999, "driven_lanedir": 0.7569634097878868, "sim_render-ego": 0.05227465768462246, "in-drivable-lane": 0, "agent_compute-ego": 0.05724251848980061, "deviation-heading": 0.98045330364767, "set_robot_commands": 0.07053534035543793, "deviation-center-line": 0.4529888653437758, "driven_lanedir_consec": 0.7569634097878868, "sim_compute_sim_state": 0.03044474935068667, "sim_compute_performance-ego": 0.05185165451568307, "sim_compute_robot_state-ego": 0.0530724548599095, "sim_compute_robot_state-npc0": 0.05611554164330936, "sim_compute_robot_state-npc1": 0.05494008943872544, "sim_compute_robot_state-npc2": 0.05289458534092579, "sim_compute_robot_state-npc3": 0.05341728451182541}, "udem1-3-0": {"driven_any": 0.2261532150643467, "sim_physics": 0.02621598804698271, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1879877837507662, "sim_render-ego": 0.052560069981743306, "in-drivable-lane": 0, "agent_compute-ego": 0.05867777151219985, "deviation-heading": 0.6694695765082032, "set_robot_commands": 0.0705703286563649, "deviation-center-line": 0.07391766010282552, "driven_lanedir_consec": 0.1879877837507662, "sim_compute_sim_state": 0.030936227125280043, "sim_compute_performance-ego": 0.05078234392053941, "sim_compute_robot_state-ego": 0.05368704655591179, "sim_compute_robot_state-npc0": 0.055308082524467915, "sim_compute_robot_state-npc1": 0.052408667171702665, "sim_compute_robot_state-npc2": 0.053267499979804546, "sim_compute_robot_state-npc3": 0.05410484706654268}, "udem1-4-0": {"driven_any": 2.3556684298839334, "sim_physics": 0.02451245705286662, "survival_time": 14.950000000000076, "driven_lanedir": 2.1756350388990997, "sim_render-ego": 0.050719804763793945, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05507721662521362, "deviation-heading": 3.784897446289332, "set_robot_commands": 0.06991410652796427, "deviation-center-line": 1.1749953599507068, "driven_lanedir_consec": 2.1732611959936747, "sim_compute_sim_state": 0.03015389362970988, "sim_compute_performance-ego": 0.052684072653452554, "sim_compute_robot_state-ego": 0.05361494541168213, "sim_compute_robot_state-npc0": 0.056517126560211184, "sim_compute_robot_state-npc1": 0.05402307113011678, "sim_compute_robot_state-npc2": 0.05383498271306355, "sim_compute_robot_state-npc3": 0.05389678001403809}}set_robot_commands_max 0.07094917446374893 set_robot_commands_mean 0.07055328341547469 set_robot_commands_median 0.0705703286563649 set_robot_commands_min 0.06991410652796427 sim_compute_performance-ego_max 0.052901580633706605 sim_compute_performance-ego_mean 0.05185623106250699 sim_compute_performance-ego_median 0.05185165451568307 sim_compute_performance-ego_min 0.05078234392053941 sim_compute_robot_state-ego_max 0.05448048004251442 sim_compute_robot_state-ego_mean 0.05346021821215741 sim_compute_robot_state-ego_median 0.05361494541168213 sim_compute_robot_state-ego_min 0.0524461641907692 sim_compute_robot_state-npc0_max 0.05739914660422218 sim_compute_robot_state-npc0_mean 0.05602451569986727 sim_compute_robot_state-npc0_median 0.05611554164330936 sim_compute_robot_state-npc0_min 0.0547826811671257 sim_compute_robot_state-npc1_max 0.05494008943872544 sim_compute_robot_state-npc1_mean 0.0537466945184781 sim_compute_robot_state-npc1_median 0.05402307113011678 sim_compute_robot_state-npc1_min 0.052408667171702665 sim_compute_robot_state-npc2_max 0.05418053683855676 sim_compute_robot_state-npc2_mean 0.05320464896328543 sim_compute_robot_state-npc2_median 0.053267499979804546 sim_compute_robot_state-npc2_min 0.05184563994407654 sim_compute_robot_state-npc3_max 0.05508388272973875 sim_compute_robot_state-npc3_mean 0.05376910740072964 sim_compute_robot_state-npc3_median 0.05389678001403809 sim_compute_robot_state-npc3_min 0.052342742681503296 sim_compute_sim_state_max 0.03148902173073876 sim_compute_sim_state_mean 0.030617547410728654 sim_compute_sim_state_median 0.03044474935068667 sim_compute_sim_state_min 0.030063845217227936 sim_physics_max 0.02866572083778752 sim_physics_mean 0.025967812299918812 sim_physics_median 0.026169786390089832 sim_physics_min 0.02427510917186737 sim_render-ego_max 0.052560069981743306 sim_render-ego_mean 0.0518149734565224 sim_render-ego_median 0.05177836228680137 sim_render-ego_min 0.050719804763793945 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.19000000000001 survival_time_min 1.6000000000000008
No reset possible 18680
2694
Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 09:54:27+00:00 2019-04-20 10:15:36+00:00 0:21:09 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18675
2698
Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 09:38:01+00:00 2019-04-20 09:53:58+00:00 0:15:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4815980559959536 survival_time_median 3.8499999999999943 deviation-center-line_median 0.23830823642185708 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05885589122772217 agent_compute-ego_mean 0.05777585908761111 agent_compute-ego_median 0.05827163095059602 agent_compute-ego_min 0.055669881502787275 deviation-center-line_max 0.689319188683665 deviation-center-line_mean 0.3516970841645242 deviation-center-line_min 0.0617285052614659 deviation-heading_max 3.202119035997067 deviation-heading_mean 1.3439542601474346 deviation-heading_median 0.9612719961366532 deviation-heading_min 0.7086877401907453 driven_any_max 1.8332233566719396 driven_any_mean 0.8138227792512552 driven_any_median 0.5717087289574438 driven_any_min 0.19400436941882152 driven_lanedir_consec_max 1.3671717862768835 driven_lanedir_consec_mean 0.6821907831098335 driven_lanedir_consec_min 0.14436378503763603 driven_lanedir_max 1.373958070081588 driven_lanedir_mean 0.6841767034940824 driven_lanedir_median 0.4815980559959536 driven_lanedir_min 0.14436378503763603 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.4800000000000056 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1475890170100271, "sim_physics": 0.02475247224171956, "survival_time": 7.499999999999981, "driven_lanedir": 1.1259563487477773, "sim_render-ego": 0.05102372964223226, "in-drivable-lane": 0, "agent_compute-ego": 0.055669881502787275, "deviation-heading": 1.1266639642126148, "set_robot_commands": 0.07072511831919352, "deviation-center-line": 0.6211574840637624, "driven_lanedir_consec": 1.1228130306312358, "sim_compute_sim_state": 0.02953587532043457, "sim_compute_performance-ego": 0.05202654679616292, "sim_compute_robot_state-ego": 0.05338795026143392, "sim_compute_robot_state-npc0": 0.05568091074625651, "sim_compute_robot_state-npc1": 0.05363128185272217, "sim_compute_robot_state-npc2": 0.05209211031595866, "sim_compute_robot_state-npc3": 0.05321952978769938}, "udem1-1-0": {"driven_any": 0.19400436941882152, "sim_physics": 0.026282612482706705, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14436378503763603, "sim_render-ego": 0.05355116526285807, "in-drivable-lane": 0, "agent_compute-ego": 0.05885589122772217, "deviation-heading": 0.7086877401907453, "set_robot_commands": 0.07084172566731771, "deviation-center-line": 0.0617285052614659, "driven_lanedir_consec": 0.14436378503763603, "sim_compute_sim_state": 0.031938783327738446, "sim_compute_performance-ego": 0.05100995699564616, "sim_compute_robot_state-ego": 0.05347025394439697, "sim_compute_robot_state-npc0": 0.05931520462036133, "sim_compute_robot_state-npc1": 0.05570268630981445, "sim_compute_robot_state-npc2": 0.055336197217305504, "sim_compute_robot_state-npc3": 0.05458062489827474}, "udem1-2-0": {"driven_any": 0.5717087289574438, "sim_physics": 0.030887430364435368, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4815980559959536, "sim_render-ego": 0.05551463597780698, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05858634663866712, "deviation-heading": 0.9612719961366532, "set_robot_commands": 0.0730011494128735, "deviation-center-line": 0.23830823642185708, "driven_lanedir_consec": 0.4815980559959536, "sim_compute_sim_state": 0.03217026784822538, "sim_compute_performance-ego": 0.054524886143672, "sim_compute_robot_state-ego": 0.05655317182664747, "sim_compute_robot_state-npc0": 0.05896931809264344, "sim_compute_robot_state-npc1": 0.05667837254412762, "sim_compute_robot_state-npc2": 0.05693208706843388, "sim_compute_robot_state-npc3": 0.056973596671959024}, "udem1-3-0": {"driven_any": 0.32258842419804373, "sim_physics": 0.026266310525977093, "survival_time": 2.3, "driven_lanedir": 0.29500725760745783, "sim_render-ego": 0.052415293195973274, "in-drivable-lane": 0, "agent_compute-ego": 0.05827163095059602, "deviation-heading": 0.7210285642000925, "set_robot_commands": 0.07114940622578496, "deviation-center-line": 0.1479720063918705, "driven_lanedir_consec": 0.29500725760745783, "sim_compute_sim_state": 0.030197179835775623, "sim_compute_performance-ego": 0.055375897366067635, "sim_compute_robot_state-ego": 0.054640189461086106, "sim_compute_robot_state-npc0": 0.05782346103502357, "sim_compute_robot_state-npc1": 0.058458680691926376, "sim_compute_robot_state-npc2": 0.05521162696506666, "sim_compute_robot_state-npc3": 0.05534725603849992}, "udem1-4-0": {"driven_any": 1.8332233566719396, "sim_physics": 0.025689952393882293, "survival_time": 11.700000000000031, "driven_lanedir": 1.373958070081588, "sim_render-ego": 0.05512827481978979, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.05749554511828301, "deviation-heading": 3.202119035997067, "set_robot_commands": 0.07270824399768797, "deviation-center-line": 0.689319188683665, "driven_lanedir_consec": 1.3671717862768835, "sim_compute_sim_state": 0.03182157797691149, "sim_compute_performance-ego": 0.05519170536954179, "sim_compute_robot_state-ego": 0.055922386992690906, "sim_compute_robot_state-npc0": 0.05963351991441515, "sim_compute_robot_state-npc1": 0.05692523666936109, "sim_compute_robot_state-npc2": 0.056228812943156965, "sim_compute_robot_state-npc3": 0.05656739789196569}}set_robot_commands_max 0.0730011494128735 set_robot_commands_mean 0.07168512872457153 set_robot_commands_median 0.07114940622578496 set_robot_commands_min 0.07072511831919352 sim_compute_performance-ego_max 0.055375897366067635 sim_compute_performance-ego_mean 0.053625798534218096 sim_compute_performance-ego_median 0.054524886143672 sim_compute_performance-ego_min 0.05100995699564616 sim_compute_robot_state-ego_max 0.05655317182664747 sim_compute_robot_state-ego_mean 0.05479479049725108 sim_compute_robot_state-ego_median 0.054640189461086106 sim_compute_robot_state-ego_min 0.05338795026143392 sim_compute_robot_state-npc0_max 0.05963351991441515 sim_compute_robot_state-npc0_mean 0.05828448288174 sim_compute_robot_state-npc0_median 0.05896931809264344 sim_compute_robot_state-npc0_min 0.05568091074625651 sim_compute_robot_state-npc1_max 0.058458680691926376 sim_compute_robot_state-npc1_mean 0.056279251613590354 sim_compute_robot_state-npc1_median 0.05667837254412762 sim_compute_robot_state-npc1_min 0.05363128185272217 sim_compute_robot_state-npc2_max 0.05693208706843388 sim_compute_robot_state-npc2_mean 0.05516016690198433 sim_compute_robot_state-npc2_median 0.055336197217305504 sim_compute_robot_state-npc2_min 0.05209211031595866 sim_compute_robot_state-npc3_max 0.056973596671959024 sim_compute_robot_state-npc3_mean 0.05533768105767976 sim_compute_robot_state-npc3_median 0.05534725603849992 sim_compute_robot_state-npc3_min 0.05321952978769938 sim_compute_sim_state_max 0.03217026784822538 sim_compute_sim_state_mean 0.0311327368618171 sim_compute_sim_state_median 0.03182157797691149 sim_compute_sim_state_min 0.02953587532043457 sim_physics_max 0.030887430364435368 sim_physics_mean 0.026775755601744205 sim_physics_median 0.026266310525977093 sim_physics_min 0.02475247224171956 sim_render-ego_max 0.05551463597780698 sim_render-ego_mean 0.053526619779732075 sim_render-ego_median 0.05355116526285807 sim_render-ego_min 0.05102372964223226 simulation-passed 1 survival_time_max 11.700000000000031 survival_time_mean 5.370000000000002 survival_time_min 1.5000000000000009
No reset possible 18667
2716
jiang peng test for ppo aido2-LF-sim-validation
step1-simulation error no idsc-rudolf-10821
2019-04-20 09:36:45+00:00 2019-04-20 09:37:32+00:00 0:00:47 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18658
2734
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation failed no idsc-rudolf-10821
2019-04-20 09:34:50+00:00 2019-04-20 09:36:30+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18637
2770
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 09:13:23+00:00 2019-04-20 09:34:38+00:00 0:21:15 Waited 1202 seconds [...] Waited 1202 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18633
2786
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-10821
2019-04-20 09:12:29+00:00 2019-04-20 09:13:10+00:00 0:00:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18628
2799
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation failed no idsc-rudolf-10821
2019-04-20 09:10:43+00:00 2019-04-20 09:12:23+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18616
2826
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-10821
2019-04-20 08:58:25+00:00 2019-04-20 09:09:57+00:00 0:11:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.15176679106319652 agent_compute-ego_mean 0.1474475082004143 agent_compute-ego_median 0.1475031606612667 agent_compute-ego_min 0.14416522421735398 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03314940513126434, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06742359721471393, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1485359101068406, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07965538615272158, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.036819855372111, "sim_compute_performance-ego": 0.06480169296264648, "sim_compute_robot_state-ego": 0.06515134705437554, "sim_compute_robot_state-npc0": 0.0729422720651778, "sim_compute_robot_state-npc1": 0.06783550504654173, "sim_compute_robot_state-npc2": 0.06573582830883208, "sim_compute_robot_state-npc3": 0.06650729784889826}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02927701613482307, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06444712246165556, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.15176679106319652, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0786118226892808, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03771744989881329, "sim_compute_performance-ego": 0.06253400503420363, "sim_compute_robot_state-ego": 0.06531494739008885, "sim_compute_robot_state-npc0": 0.07126713734047085, "sim_compute_robot_state-npc1": 0.06722489992777507, "sim_compute_robot_state-npc2": 0.06417310471628226, "sim_compute_robot_state-npc3": 0.06580688906650917}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03168646366365494, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06424474716186523, "in-drivable-lane": 0, "agent_compute-ego": 0.1475031606612667, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07886987732302758, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03628068201003536, "sim_compute_performance-ego": 0.06169951731158841, "sim_compute_robot_state-ego": 0.06255608989346412, "sim_compute_robot_state-npc0": 0.07119865571298907, "sim_compute_robot_state-npc1": 0.06673589060383459, "sim_compute_robot_state-npc2": 0.06541012179466986, "sim_compute_robot_state-npc3": 0.06349037539574408}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0310861810724786, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0658963107048197, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14416522421735398, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07541620224080187, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03452622890472412, "sim_compute_performance-ego": 0.06442137221072583, "sim_compute_robot_state-ego": 0.0637407328220124, "sim_compute_robot_state-npc0": 0.07165385053512897, "sim_compute_robot_state-npc1": 0.06397009656784382, "sim_compute_robot_state-npc2": 0.06427996970237569, "sim_compute_robot_state-npc3": 0.06360648540740317}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027818097518040583, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06506128494556133, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14526645495341375, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0786575720860408, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03536455906354464, "sim_compute_performance-ego": 0.06468304303976205, "sim_compute_robot_state-ego": 0.06580075850853553, "sim_compute_robot_state-npc0": 0.07152285025669979, "sim_compute_robot_state-npc1": 0.06728803652983445, "sim_compute_robot_state-npc2": 0.06525050218288715, "sim_compute_robot_state-npc3": 0.0648796008183406}}set_robot_commands_max 0.07965538615272158 set_robot_commands_mean 0.07824217209837453 set_robot_commands_median 0.0786575720860408 set_robot_commands_min 0.07541620224080187 sim_compute_performance-ego_max 0.06480169296264648 sim_compute_performance-ego_mean 0.06362792611178528 sim_compute_performance-ego_median 0.06442137221072583 sim_compute_performance-ego_min 0.06169951731158841 sim_compute_robot_state-ego_max 0.06580075850853553 sim_compute_robot_state-ego_mean 0.06451277513369529 sim_compute_robot_state-ego_median 0.06515134705437554 sim_compute_robot_state-ego_min 0.06255608989346412 sim_compute_robot_state-npc0_max 0.0729422720651778 sim_compute_robot_state-npc0_mean 0.07171695318209328 sim_compute_robot_state-npc0_median 0.07152285025669979 sim_compute_robot_state-npc0_min 0.07119865571298907 sim_compute_robot_state-npc1_max 0.06783550504654173 sim_compute_robot_state-npc1_mean 0.06661088573516594 sim_compute_robot_state-npc1_median 0.06722489992777507 sim_compute_robot_state-npc1_min 0.06397009656784382 sim_compute_robot_state-npc2_max 0.06573582830883208 sim_compute_robot_state-npc2_mean 0.06496990534100941 sim_compute_robot_state-npc2_median 0.06525050218288715 sim_compute_robot_state-npc2_min 0.06417310471628226 sim_compute_robot_state-npc3_max 0.06650729784889826 sim_compute_robot_state-npc3_mean 0.06485812970737906 sim_compute_robot_state-npc3_median 0.0648796008183406 sim_compute_robot_state-npc3_min 0.06349037539574408 sim_compute_sim_state_max 0.03771744989881329 sim_compute_sim_state_mean 0.03614175504984568 sim_compute_sim_state_median 0.03628068201003536 sim_compute_sim_state_min 0.03452622890472412 sim_physics_max 0.03314940513126434 sim_physics_mean 0.030603432704052302 sim_physics_median 0.0310861810724786 sim_physics_min 0.027818097518040583 sim_render-ego_max 0.06742359721471393 sim_render-ego_mean 0.06541461249772315 sim_render-ego_median 0.06506128494556133 sim_render-ego_min 0.06424474716186523 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible