Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 23031
2365
Andrea Censi 🇨🇭random_agent aido2-LFV-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 05:36:03+00:00 2019-05-17 05:42:24+00:00 0:06:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.07108789020114475 agent_compute-ego_mean 0.06995683109661073 agent_compute-ego_median 0.06966183866773333 agent_compute-ego_min 0.06926796938243665 deviation-center-line_max 0.1743913456502906 deviation-center-line_mean 0.12651756552531995 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599273 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811214 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589035 driven_any_mean 1.0272530755098266 driven_any_median 1.0243289631429708 driven_any_min 0.4119037580118998 driven_lanedir_consec_max 1.2433038249708377 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708377 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0627402111336037, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03231476412879096, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.07108789020114475, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.049708154466417104, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.020234540656760888, "sim_compute_performance-ego": 0.03477398112968162, "sim_compute_robot_state-ego": 0.03682752008791323, "sim_compute_robot_state-npc0": 0.03599355397401033, "sim_compute_robot_state-npc1": 0.035869086230242694, "sim_compute_robot_state-npc2": 0.035851377028006094, "sim_compute_robot_state-npc3": 0.03580885463290744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.07280925750732421, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.031942253112792966, "in-drivable-lane": 0, "agent_compute-ego": 0.07018970489501954, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.049176483154296874, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.020061540603637695, "sim_compute_performance-ego": 0.03576681137084961, "sim_compute_robot_state-ego": 0.036793603897094726, "sim_compute_robot_state-npc0": 0.035769624710083006, "sim_compute_robot_state-npc1": 0.03580754280090332, "sim_compute_robot_state-npc2": 0.0355344009399414, "sim_compute_robot_state-npc3": 0.03565446853637695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.0674737535024944, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03167616379888434, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.06926796938243665, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.04879066818638852, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.019949138164520264, "sim_compute_performance-ego": 0.03532219874231439, "sim_compute_robot_state-ego": 0.0368588974601344, "sim_compute_robot_state-npc0": 0.03626827817214163, "sim_compute_robot_state-npc1": 0.03563693636342099, "sim_compute_robot_state-npc2": 0.035378374551471914, "sim_compute_robot_state-npc3": 0.03526064910386738}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.06942792180218274, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.032035939301116555, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06957675233671937, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.048632452759561656, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.02011463008349455, "sim_compute_performance-ego": 0.03492539743833904, "sim_compute_robot_state-ego": 0.03687596924697296, "sim_compute_robot_state-npc0": 0.03608697879163525, "sim_compute_robot_state-npc1": 0.035879886603053614, "sim_compute_robot_state-npc2": 0.03519369680670243, "sim_compute_robot_state-npc3": 0.03551515446433538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.06571062122072492, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.032172160489218574, "in-drivable-lane": 0, "agent_compute-ego": 0.06966183866773333, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.04888168403080532, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02003272090639387, "sim_compute_performance-ego": 0.03535022905894688, "sim_compute_robot_state-ego": 0.03664192131587437, "sim_compute_robot_state-npc0": 0.03549613271440778, "sim_compute_robot_state-npc1": 0.035582542419433594, "sim_compute_robot_state-npc2": 0.036325769765036445, "sim_compute_robot_state-npc3": 0.035104726042066305}}set_robot_commands_max 0.049708154466417104 set_robot_commands_mean 0.049037888519493894 set_robot_commands_median 0.04888168403080532 set_robot_commands_min 0.048632452759561656 sim_compute_performance-ego_max 0.03576681137084961 sim_compute_performance-ego_mean 0.03522772354802631 sim_compute_performance-ego_median 0.03532219874231439 sim_compute_performance-ego_min 0.03477398112968162 sim_compute_robot_state-ego_max 0.03687596924697296 sim_compute_robot_state-ego_mean 0.03679958240159793 sim_compute_robot_state-ego_median 0.03682752008791323 sim_compute_robot_state-ego_min 0.03664192131587437 sim_compute_robot_state-npc0_max 0.03626827817214163 sim_compute_robot_state-npc0_mean 0.035922913672455606 sim_compute_robot_state-npc0_median 0.03599355397401033 sim_compute_robot_state-npc0_min 0.03549613271440778 sim_compute_robot_state-npc1_max 0.035879886603053614 sim_compute_robot_state-npc1_mean 0.035755198883410846 sim_compute_robot_state-npc1_median 0.03580754280090332 sim_compute_robot_state-npc1_min 0.035582542419433594 sim_compute_robot_state-npc2_max 0.036325769765036445 sim_compute_robot_state-npc2_mean 0.035656723818231664 sim_compute_robot_state-npc2_median 0.0355344009399414 sim_compute_robot_state-npc2_min 0.03519369680670243 sim_compute_robot_state-npc3_max 0.03580885463290744 sim_compute_robot_state-npc3_mean 0.03546877055591069 sim_compute_robot_state-npc3_median 0.03551515446433538 sim_compute_robot_state-npc3_min 0.035104726042066305 sim_compute_sim_state_max 0.020234540656760888 sim_compute_sim_state_mean 0.020078514082961452 sim_compute_sim_state_median 0.020061540603637695 sim_compute_sim_state_min 0.019949138164520264 sim_physics_max 0.07280925750732421 sim_physics_mean 0.06763235303326601 sim_physics_median 0.0674737535024944 sim_physics_min 0.0627402111336037 sim_render-ego_max 0.03231476412879096 sim_render-ego_mean 0.032028256166160674 sim_render-ego_median 0.032035939301116555 sim_render-ego_min 0.03167616379888434 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 23018
2379
Liam Paull 🇨🇦minimal_agent_python2 (Python 2) aido2-LFVI-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 05:15:09+00:00 2019-05-17 05:35:49+00:00 0:20:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4674075261701268 survival_time_median 3.699999999999995 deviation-center-line_median 0.2037212999690195 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03325364806435325 agent_compute-ego_mean 0.03248116808109725 agent_compute-ego_median 0.03249249395155749 agent_compute-ego_min 0.03171076625585556 deviation-center-line_max 0.5183621890690367 deviation-center-line_mean 0.2365365432439713 deviation-center-line_min 0.1001276403534276 deviation-heading_max 1.8192903310562811 deviation-heading_mean 0.7195980419067693 deviation-heading_median 0.5070424162880826 deviation-heading_min 0.2495279988048577 driven_any_max 2.764827318571964 driven_any_mean 1.0818349506618754 driven_any_median 1.0098273192909006 driven_any_min 0.3648701917101222 driven_lanedir_consec_max 1.9044523873117627 driven_lanedir_consec_mean 0.759860328609196 driven_lanedir_consec_min 0.3272146444894328 driven_lanedir_max 1.9045033171069223 driven_lanedir_mean 0.7732651243581526 driven_lanedir_median 0.6173586051289615 driven_lanedir_min 0.3272146444894328 in-drivable-lane_max 3.7999999999999887 in-drivable-lane_mean 0.8633333333333326 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.0745156563080109, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.03236122174305959, "in-drivable-lane": 0, "agent_compute-ego": 0.03265463983690416, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.0503698426323968, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.02011624542442528, "sim_compute_performance-ego": 0.03496484069136886, "sim_compute_robot_state-ego": 0.03762842298627974, "sim_compute_robot_state-npc0": 0.03583744195130494, "sim_compute_robot_state-npc1": 0.03586632926184852, "sim_compute_robot_state-npc2": 0.035856824737411364, "sim_compute_robot_state-npc3": 0.0356718956887185}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.07845770990526355, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.033194181081411, "in-drivable-lane": 0, "agent_compute-ego": 0.03251635061727988, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.04980333431346996, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.02019351237529033, "sim_compute_performance-ego": 0.03543474223162677, "sim_compute_robot_state-ego": 0.03666121250874287, "sim_compute_robot_state-npc0": 0.03604819967940047, "sim_compute_robot_state-npc1": 0.03637819032411318, "sim_compute_robot_state-npc2": 0.03577627362431707, "sim_compute_robot_state-npc3": 0.03522409619511785}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.07417537518684438, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.032225002516184424, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.03249249395155749, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.04979640284910897, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.020267006577245446, "sim_compute_performance-ego": 0.03495922783352681, "sim_compute_robot_state-ego": 0.036905681850104934, "sim_compute_robot_state-npc0": 0.035924575186723116, "sim_compute_robot_state-npc1": 0.035870032594693416, "sim_compute_robot_state-npc2": 0.03551517101313105, "sim_compute_robot_state-npc3": 0.035530475591192184}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.07485942815610876, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.03220597237192523, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.03318822695946818, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.04974684665340404, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.019947052001953125, "sim_compute_performance-ego": 0.03493750157780672, "sim_compute_robot_state-ego": 0.03710156335880619, "sim_compute_robot_state-npc0": 0.035641705178465516, "sim_compute_robot_state-npc1": 0.035823090538304514, "sim_compute_robot_state-npc2": 0.03584593628089466, "sim_compute_robot_state-npc3": 0.03538878675530718}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.07681906223297119, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.03885068744421005, "in-drivable-lane": 0, "agent_compute-ego": 0.03171076625585556, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.04921960085630417, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.020246252417564392, "sim_compute_performance-ego": 0.03485196828842163, "sim_compute_robot_state-ego": 0.03700580447912216, "sim_compute_robot_state-npc0": 0.036048732697963715, "sim_compute_robot_state-npc1": 0.035823799669742584, "sim_compute_robot_state-npc2": 0.03538917750120163, "sim_compute_robot_state-npc3": 0.03562343865633011}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.07560531814377029, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.0325054441179548, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.03228118512537572, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.04974115978587757, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.02013089130451153, "sim_compute_performance-ego": 0.03501032234786393, "sim_compute_robot_state-ego": 0.03754183224269322, "sim_compute_robot_state-npc0": 0.03613819085158311, "sim_compute_robot_state-npc1": 0.03584871973310198, "sim_compute_robot_state-npc2": 0.035907172537469244, "sim_compute_robot_state-npc3": 0.035959866139795876}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.08429012876568419, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.032016566305449516, "in-drivable-lane": 0, "agent_compute-ego": 0.03210632006327311, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.05069940740411931, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.020017732273448597, "sim_compute_performance-ego": 0.035054069576841415, "sim_compute_robot_state-ego": 0.03721287395014907, "sim_compute_robot_state-npc0": 0.03573886914686723, "sim_compute_robot_state-npc1": 0.03514311169133042, "sim_compute_robot_state-npc2": 0.03541539293346983, "sim_compute_robot_state-npc3": 0.03537081227158055}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.08329488780047442, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.032906983349774335, "in-drivable-lane": 0, "agent_compute-ego": 0.03230967714979842, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.049454150973139585, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.020055413246154785, "sim_compute_performance-ego": 0.034874278145867424, "sim_compute_robot_state-ego": 0.03645615319947939, "sim_compute_robot_state-npc0": 0.036023574906426506, "sim_compute_robot_state-npc1": 0.03639141933338062, "sim_compute_robot_state-npc2": 0.035136261501827755, "sim_compute_robot_state-npc3": 0.03566246741526836}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.07417799631754557, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.03232115109761556, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.03224224726359049, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.04958165168762207, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.01997259775797526, "sim_compute_performance-ego": 0.03564883550008138, "sim_compute_robot_state-ego": 0.03666954676310221, "sim_compute_robot_state-npc0": 0.03607378641764323, "sim_compute_robot_state-npc1": 0.035685946146647135, "sim_compute_robot_state-npc2": 0.03681977907816569, "sim_compute_robot_state-npc3": 0.03548841794331869}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.08800168939538904, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.03270205291541847, "in-drivable-lane": 0, "agent_compute-ego": 0.03261435998452676, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.05241576400963035, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.02051653733124604, "sim_compute_performance-ego": 0.03505168089995513, "sim_compute_robot_state-ego": 0.03714143907701647, "sim_compute_robot_state-npc0": 0.0360848517031283, "sim_compute_robot_state-npc1": 0.03589751913740828, "sim_compute_robot_state-npc2": 0.03582440840231406, "sim_compute_robot_state-npc3": 0.035611867904663086}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.07976305869317823, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.033283695097892516, "in-drivable-lane": 0, "agent_compute-ego": 0.032740116119384766, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.050033015589560234, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.02035190213111139, "sim_compute_performance-ego": 0.035315490538074125, "sim_compute_robot_state-ego": 0.03675145487631521, "sim_compute_robot_state-npc0": 0.03580281811375772, "sim_compute_robot_state-npc1": 0.035977778896208734, "sim_compute_robot_state-npc2": 0.03605051194467852, "sim_compute_robot_state-npc3": 0.03647822718466482}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.0765990649952608, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.032596987836501175, "in-drivable-lane": 0, "agent_compute-ego": 0.032210770775290096, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.0509188455693862, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.020020071197958553, "sim_compute_performance-ego": 0.03494712885688333, "sim_compute_robot_state-ego": 0.037166714668273926, "sim_compute_robot_state-npc0": 0.03556365125319537, "sim_compute_robot_state-npc1": 0.03597136806039249, "sim_compute_robot_state-npc2": 0.03540610565858729, "sim_compute_robot_state-npc3": 0.035819011576035446}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.0788203375680106, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.03307132266816639, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.03251548494611468, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.050716456912812735, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.020835985456194195, "sim_compute_performance-ego": 0.03617973554702032, "sim_compute_robot_state-ego": 0.03723642712547665, "sim_compute_robot_state-npc0": 0.037023700986589705, "sim_compute_robot_state-npc1": 0.03657564889817011, "sim_compute_robot_state-npc2": 0.03627385866074335, "sim_compute_robot_state-npc3": 0.03619758061000279}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.0743726671558537, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.03265874679774454, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.032381234103686186, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.049474980733166, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.020176982226437084, "sim_compute_performance-ego": 0.03520908094432256, "sim_compute_robot_state-ego": 0.03739174098184664, "sim_compute_robot_state-npc0": 0.03607236522517792, "sim_compute_robot_state-npc1": 0.035593029570906126, "sim_compute_robot_state-npc2": 0.03538371438849462, "sim_compute_robot_state-npc3": 0.03540828783218175}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.08021905476396735, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.03222511031410911, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.03325364806435325, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.050864347002723, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.01981769095767628, "sim_compute_performance-ego": 0.03505371917377819, "sim_compute_robot_state-ego": 0.03682995384389704, "sim_compute_robot_state-npc0": 0.03555477478287437, "sim_compute_robot_state-npc1": 0.03556106307289817, "sim_compute_robot_state-npc2": 0.0361792499368841, "sim_compute_robot_state-npc3": 0.0358753962950273}}set_robot_commands_max 0.05241576400963035 set_robot_commands_mean 0.0501890537981814 set_robot_commands_median 0.04980333431346996 set_robot_commands_min 0.04921960085630417 sim_compute_performance-ego_max 0.03617973554702032 sim_compute_performance-ego_mean 0.03516617481022924 sim_compute_performance-ego_median 0.03505168089995513 sim_compute_performance-ego_min 0.03485196828842163 sim_compute_robot_state-ego_max 0.03762842298627974 sim_compute_robot_state-ego_mean 0.03704672146075372 sim_compute_robot_state-ego_median 0.03710156335880619 sim_compute_robot_state-ego_min 0.03645615319947939 sim_compute_robot_state-npc0_max 0.037023700986589705 sim_compute_robot_state-npc0_mean 0.03597181587207342 sim_compute_robot_state-npc0_median 0.036023574906426506 sim_compute_robot_state-npc0_min 0.03555477478287437 sim_compute_robot_state-npc1_max 0.03657564889817011 sim_compute_robot_state-npc1_mean 0.03589380312860976 sim_compute_robot_state-npc1_median 0.03586632926184852 sim_compute_robot_state-npc1_min 0.03514311169133042 sim_compute_robot_state-npc2_max 0.03681977907816569 sim_compute_robot_state-npc2_mean 0.035785322546639346 sim_compute_robot_state-npc2_median 0.03582440840231406 sim_compute_robot_state-npc2_min 0.035136261501827755 sim_compute_robot_state-npc3_max 0.03647822718466482 sim_compute_robot_state-npc3_mean 0.035687375203946964 sim_compute_robot_state-npc3_median 0.03562343865633011 sim_compute_robot_state-npc3_min 0.03522409619511785 sim_compute_sim_state_max 0.020835985456194195 sim_compute_sim_state_mean 0.020177724845279486 sim_compute_sim_state_median 0.02013089130451153 sim_compute_sim_state_min 0.01981769095767628 sim_physics_max 0.08800168939538904 sim_physics_mean 0.07826476235922221 sim_physics_median 0.07681906223297119 sim_physics_min 0.07417537518684438 sim_render-ego_max 0.03885068744421005 sim_render-ego_mean 0.03300834171049445 sim_render-ego_median 0.032596987836501175 sim_render-ego_min 0.032016566305449516 simulation-passed 1 survival_time_max 9.55 survival_time_mean 3.939999999999995 survival_time_min 1.5500000000000007
No reset possible 22968
2448
Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 04:16:15+00:00 2019-05-17 05:14:42+00:00 0:58:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.355676207214709 survival_time_median 14.950000000000076 deviation-center-line_median 1.002134440312669 in-drivable-lane_median 4.050000000000024
other stats agent_compute-ego_max 0.08804394324620565 agent_compute-ego_mean 0.08726267194747923 agent_compute-ego_median 0.08715522289276123 agent_compute-ego_min 0.08640182971954345 deviation-center-line_max 1.5296442653166566 deviation-center-line_mean 0.8536767524476552 deviation-center-line_min 0.2656525762859935 deviation-heading_max 8.682256325592228 deviation-heading_mean 6.927230740477735 deviation-heading_median 7.090641611385013 deviation-heading_min 5.52174661383955 driven_any_max 4.378506444052824 driven_any_mean 4.378506444052809 driven_any_median 4.378506444052808 driven_any_min 4.378506444052796 driven_lanedir_consec_max -1.2728379671211965 driven_lanedir_consec_mean -1.352643582087815 driven_lanedir_consec_min -1.388190292394527 driven_lanedir_max -1.3477913186786226 driven_lanedir_mean -2.005867861365606 driven_lanedir_median -2.260637650975249 driven_lanedir_min -2.7253255736285684 in-drivable-lane_max 7.60000000000004 in-drivable-lane_mean 4.9200000000000275 in-drivable-lane_min 2.100000000000011 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.06691507339477538, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.0320353372891744, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08773498217264811, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.04895198663075765, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.019980932076772057, "sim_compute_performance-ego": 0.034768020311991374, "sim_compute_robot_state-ego": 0.0368092155456543, "sim_compute_robot_state-npc0": 0.03571815331776937, "sim_compute_robot_state-npc1": 0.03559604485829671, "sim_compute_robot_state-npc2": 0.03534209410349528, "sim_compute_robot_state-npc3": 0.03534570058186849}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.06592342217763265, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03232653458913167, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08760421673456828, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.049942440191904705, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.020406312147776287, "sim_compute_performance-ego": 0.035073644320170086, "sim_compute_robot_state-ego": 0.03683694839477539, "sim_compute_robot_state-npc0": 0.03574262301127116, "sim_compute_robot_state-npc1": 0.035724650224049886, "sim_compute_robot_state-npc2": 0.03557552099227905, "sim_compute_robot_state-npc3": 0.03576503992080689}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06603608290354411, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.03230990489323934, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08695316394170126, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.048811421394348145, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.020166085561116535, "sim_compute_performance-ego": 0.034819173812866214, "sim_compute_robot_state-ego": 0.03656471093495687, "sim_compute_robot_state-npc0": 0.03628172477086385, "sim_compute_robot_state-npc1": 0.03566601435343424, "sim_compute_robot_state-npc2": 0.035728437105814616, "sim_compute_robot_state-npc3": 0.0355171545346578}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.0675003719329834, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.03248183886210124, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.08791068077087402, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.04991426467895508, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.020283076763153076, "sim_compute_performance-ego": 0.03513687372207642, "sim_compute_robot_state-ego": 0.03665859619776408, "sim_compute_robot_state-npc0": 0.03604266007741292, "sim_compute_robot_state-npc1": 0.03588028907775879, "sim_compute_robot_state-npc2": 0.03555025815963745, "sim_compute_robot_state-npc3": 0.03566125392913819}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.06647817691167196, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03240268309911092, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.08804394324620565, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.049210122426350915, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.0202068829536438, "sim_compute_performance-ego": 0.03479743719100952, "sim_compute_robot_state-ego": 0.03665672620137533, "sim_compute_robot_state-npc0": 0.03564338604609171, "sim_compute_robot_state-npc1": 0.03575398921966553, "sim_compute_robot_state-npc2": 0.035478333632151283, "sim_compute_robot_state-npc3": 0.0355373485883077}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06545099258422851, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.03185211737950643, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.08640182971954345, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.049461113611857094, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.020181787808736164, "sim_compute_performance-ego": 0.034665056069691974, "sim_compute_robot_state-ego": 0.03654384692509969, "sim_compute_robot_state-npc0": 0.035563241640726724, "sim_compute_robot_state-npc1": 0.03565384308497111, "sim_compute_robot_state-npc2": 0.0352836012840271, "sim_compute_robot_state-npc3": 0.03542617638905843}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.06692968606948853, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.031893750031789146, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08707944711049398, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.0486759090423584, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.020210254987080893, "sim_compute_performance-ego": 0.03518201430638631, "sim_compute_robot_state-ego": 0.03665552775065104, "sim_compute_robot_state-npc0": 0.03562407811482748, "sim_compute_robot_state-npc1": 0.03645795583724976, "sim_compute_robot_state-npc2": 0.035356604258219404, "sim_compute_robot_state-npc3": 0.035545984109242756}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.0661188260714213, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.032050597667694095, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.08796389738718668, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.0491202187538147, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.020187315940856935, "sim_compute_performance-ego": 0.03487899621327718, "sim_compute_robot_state-ego": 0.03681859413782756, "sim_compute_robot_state-npc0": 0.03570538520812988, "sim_compute_robot_state-npc1": 0.036769155661265054, "sim_compute_robot_state-npc2": 0.03545811494191488, "sim_compute_robot_state-npc3": 0.03562698443730672}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.06536930958429972, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03206898132960002, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.08663775126139323, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.04865646918614706, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.02010954777399699, "sim_compute_performance-ego": 0.03476674159367879, "sim_compute_robot_state-ego": 0.03670417388280233, "sim_compute_robot_state-npc0": 0.03544912020365397, "sim_compute_robot_state-npc1": 0.035543406009674074, "sim_compute_robot_state-npc2": 0.035284396012624106, "sim_compute_robot_state-npc3": 0.03549855470657349}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06676714102427164, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.03214550574620565, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.0869089968999227, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.04901083469390869, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.02038749059041341, "sim_compute_performance-ego": 0.03495707591374715, "sim_compute_robot_state-ego": 0.03751779635747274, "sim_compute_robot_state-npc0": 0.03550026257832845, "sim_compute_robot_state-npc1": 0.035844080448150635, "sim_compute_robot_state-npc2": 0.035581978956858315, "sim_compute_robot_state-npc3": 0.035668092568715414}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06567803223927816, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.032221238613128665, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.08742235024770101, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.04925671259562175, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.020126797358194982, "sim_compute_performance-ego": 0.03469544410705566, "sim_compute_robot_state-ego": 0.036454696655273434, "sim_compute_robot_state-npc0": 0.03552056392033895, "sim_compute_robot_state-npc1": 0.03564504861831665, "sim_compute_robot_state-npc2": 0.03543694734573364, "sim_compute_robot_state-npc3": 0.035484859943389895}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06600751717885335, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.032186501026153565, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.0867678173383077, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.048815788427988685, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.02021359364191691, "sim_compute_performance-ego": 0.03477487881978353, "sim_compute_robot_state-ego": 0.03674472411473592, "sim_compute_robot_state-npc0": 0.03560601313908895, "sim_compute_robot_state-npc1": 0.035868821938832604, "sim_compute_robot_state-npc2": 0.03537476857503255, "sim_compute_robot_state-npc3": 0.035578418572743735}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.06662119626998901, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.0322514812151591, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.08749290704727172, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.04887799580891927, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.020183809598286948, "sim_compute_performance-ego": 0.034828532536824545, "sim_compute_robot_state-ego": 0.03672581434249878, "sim_compute_robot_state-npc0": 0.03559701124827067, "sim_compute_robot_state-npc1": 0.03663534879684448, "sim_compute_robot_state-npc2": 0.03549665451049805, "sim_compute_robot_state-npc3": 0.035417293707529704}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.06569416046142579, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.03226106961568197, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.08715522289276123, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.04868130286534627, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.020106682777404784, "sim_compute_performance-ego": 0.03493185838063558, "sim_compute_robot_state-ego": 0.03669173081715902, "sim_compute_robot_state-npc0": 0.035437649885813396, "sim_compute_robot_state-npc1": 0.035773420333862306, "sim_compute_robot_state-npc2": 0.03529057661692302, "sim_compute_robot_state-npc3": 0.035618983904520674}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06480865955352783, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03216062148412069, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.0868628724416097, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.0488236403465271, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.020078457991282144, "sim_compute_performance-ego": 0.03492203632990519, "sim_compute_robot_state-ego": 0.036640957196553546, "sim_compute_robot_state-npc0": 0.03551154295603434, "sim_compute_robot_state-npc1": 0.035988214015960696, "sim_compute_robot_state-npc2": 0.03572889407475789, "sim_compute_robot_state-npc3": 0.035588428179423016}}set_robot_commands_max 0.049942440191904705 set_robot_commands_mean 0.04908068137698704 set_robot_commands_median 0.04895198663075765 set_robot_commands_min 0.04865646918614706 sim_compute_performance-ego_max 0.03518201430638631 sim_compute_performance-ego_mean 0.034879852241939964 sim_compute_performance-ego_median 0.034828532536824545 sim_compute_performance-ego_min 0.034665056069691974 sim_compute_robot_state-ego_max 0.03751779635747274 sim_compute_robot_state-ego_mean 0.03673493729697334 sim_compute_robot_state-ego_median 0.03669173081715902 sim_compute_robot_state-ego_min 0.036454696655273434 sim_compute_robot_state-npc0_max 0.03628172477086385 sim_compute_robot_state-npc0_mean 0.035662894407908124 sim_compute_robot_state-npc0_median 0.03560601313908895 sim_compute_robot_state-npc0_min 0.035437649885813396 sim_compute_robot_state-npc1_max 0.036769155661265054 sim_compute_robot_state-npc1_mean 0.03592001883188883 sim_compute_robot_state-npc1_median 0.035773420333862306 sim_compute_robot_state-npc1_min 0.035543406009674074 sim_compute_robot_state-npc2_max 0.03572889407475789 sim_compute_robot_state-npc2_mean 0.035464478704664446 sim_compute_robot_state-npc2_median 0.03545811494191488 sim_compute_robot_state-npc2_min 0.0352836012840271 sim_compute_robot_state-npc3_max 0.03576503992080689 sim_compute_robot_state-npc3_mean 0.035552018271552195 sim_compute_robot_state-npc3_median 0.035545984109242756 sim_compute_robot_state-npc3_min 0.03534570058186849 sim_compute_sim_state_max 0.020406312147776287 sim_compute_sim_state_mean 0.020188601864708795 sim_compute_sim_state_median 0.020183809598286948 sim_compute_sim_state_min 0.019980932076772057 sim_physics_max 0.0675003719329834 sim_physics_mean 0.06615324322382608 sim_physics_median 0.06603608290354411 sim_physics_min 0.06480865955352783 sim_render-ego_max 0.03248183886210124 sim_render-ego_mean 0.03217654418945312 sim_render-ego_median 0.032186501026153565 sim_render-ego_min 0.03185211737950643 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 22963
2452
Liam Paull 🇨🇦Baseline solution using ROS aido2-LF-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 04:14:15+00:00 2019-05-17 04:15:54+00:00 0:01:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22960
2459
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LFV-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 04:13:20+00:00 2019-05-17 04:13:55+00:00 0:00:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22959
2463
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LFVI-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 04:12:25+00:00 2019-05-17 04:13:00+00:00 0:00:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22958
2464
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LFVI-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 04:11:25+00:00 2019-05-17 04:12:03+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22937
2496
Liam Paull 🇨🇦challenge-aido_LF-template-pytorch aido2-LFV-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 04:06:21+00:00 2019-05-17 04:11:12+00:00 0:04:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.18462163174115975 survival_time_median 1.4000000000000006 deviation-center-line_median 0.10242050828714276 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0918498577610139 agent_compute-ego_mean 0.0877973462151516 agent_compute-ego_median 0.0870335266507905 agent_compute-ego_min 0.08591562968034011 deviation-center-line_max 0.12388456028300555 deviation-center-line_mean 0.09961552829332249 deviation-center-line_min 0.06292184880895119 deviation-heading_max 0.9961070879711966 deviation-heading_mean 0.691725876684593 deviation-heading_median 0.7407725106573577 deviation-heading_min 0.4114779821994308 driven_any_max 0.2521476033920123 driven_any_mean 0.2138777757498796 driven_any_median 0.2232733064885143 driven_any_min 0.16067815824576104 driven_lanedir_consec_max 0.20422993493719543 driven_lanedir_consec_mean 0.1612975228306234 driven_lanedir_consec_min 0.1099402554110811 driven_lanedir_max 0.20422993493719543 driven_lanedir_mean 0.1612975228306234 driven_lanedir_median 0.18462163174115975 driven_lanedir_min 0.1099402554110811 in-drivable-lane_max 0.05000000000000005 in-drivable-lane_mean 0.010000000000000007 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2521476033920123, "sim_physics": 0.07526690729202763, "survival_time": 1.5500000000000007, "driven_lanedir": 0.18462163174115975, "sim_render-ego": 0.03263758843944919, "in-drivable-lane": 0, "agent_compute-ego": 0.0918498577610139, "deviation-heading": 0.851950795271246, "set_robot_commands": 0.05013842736521075, "deviation-center-line": 0.10242050828714276, "driven_lanedir_consec": 0.18462163174115975, "sim_compute_sim_state": 0.020666014763616743, "sim_compute_performance-ego": 0.03527385957779423, "sim_compute_robot_state-ego": 0.03692400070928758, "sim_compute_robot_state-npc0": 0.0360320306593372, "sim_compute_robot_state-npc1": 0.0356013544144169, "sim_compute_robot_state-npc2": 0.03537808695147114, "sim_compute_robot_state-npc3": 0.03559207147167575}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19365533008821492, "sim_physics": 0.06972313844240628, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11143334839777096, "sim_render-ego": 0.031462788581848145, "in-drivable-lane": 0, "agent_compute-ego": 0.08591562968034011, "deviation-heading": 0.9961070879711966, "set_robot_commands": 0.04872022225306584, "deviation-center-line": 0.08673331400608461, "driven_lanedir_consec": 0.11143334839777096, "sim_compute_sim_state": 0.020786505479079027, "sim_compute_performance-ego": 0.035025138121384844, "sim_compute_robot_state-ego": 0.03679655148432805, "sim_compute_robot_state-npc0": 0.03546291131239671, "sim_compute_robot_state-npc1": 0.035904416671166055, "sim_compute_robot_state-npc2": 0.03574784902425913, "sim_compute_robot_state-npc3": 0.036683119260347806}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23963448053489536, "sim_physics": 0.07407041253714726, "survival_time": 1.4500000000000006, "driven_lanedir": 0.20422993493719543, "sim_render-ego": 0.03266346865686877, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0870335266507905, "deviation-heading": 0.4114779821994308, "set_robot_commands": 0.049198380832014416, "deviation-center-line": 0.12388456028300555, "driven_lanedir_consec": 0.20422993493719543, "sim_compute_sim_state": 0.020156745252938105, "sim_compute_performance-ego": 0.03547442370447619, "sim_compute_robot_state-ego": 0.03726058992846259, "sim_compute_robot_state-npc0": 0.03607349560178559, "sim_compute_robot_state-npc1": 0.03683723252395104, "sim_compute_robot_state-npc2": 0.03568990477200212, "sim_compute_robot_state-npc3": 0.03604187636539854}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2232733064885143, "sim_physics": 0.078384986945561, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19626244366590972, "sim_render-ego": 0.032181807926722934, "in-drivable-lane": 0, "agent_compute-ego": 0.08729584727968488, "deviation-heading": 0.45832100732373365, "set_robot_commands": 0.05292860099247524, "deviation-center-line": 0.1221174100814283, "driven_lanedir_consec": 0.19626244366590972, "sim_compute_sim_state": 0.0202486515045166, "sim_compute_performance-ego": 0.03467951502118792, "sim_compute_robot_state-ego": 0.036733780588422506, "sim_compute_robot_state-npc0": 0.03607603481837681, "sim_compute_robot_state-npc1": 0.03549815075738089, "sim_compute_robot_state-npc2": 0.03573700359889439, "sim_compute_robot_state-npc3": 0.03577016932623727}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16067815824576104, "sim_physics": 0.07047385970751445, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1099402554110811, "sim_render-ego": 0.03201073408126831, "in-drivable-lane": 0, "agent_compute-ego": 0.08689186970392863, "deviation-heading": 0.7407725106573577, "set_robot_commands": 0.053324749072392784, "deviation-center-line": 0.06292184880895119, "driven_lanedir_consec": 0.1099402554110811, "sim_compute_sim_state": 0.020307868719100952, "sim_compute_performance-ego": 0.03475903471310934, "sim_compute_robot_state-ego": 0.036930590867996216, "sim_compute_robot_state-npc0": 0.03577272097269694, "sim_compute_robot_state-npc1": 0.035823434591293335, "sim_compute_robot_state-npc2": 0.03545685609181722, "sim_compute_robot_state-npc3": 0.03616296251614889}}set_robot_commands_max 0.053324749072392784 set_robot_commands_mean 0.05086207610303181 set_robot_commands_median 0.05013842736521075 set_robot_commands_min 0.04872022225306584 sim_compute_performance-ego_max 0.03547442370447619 sim_compute_performance-ego_mean 0.035042394227590506 sim_compute_performance-ego_median 0.035025138121384844 sim_compute_performance-ego_min 0.03467951502118792 sim_compute_robot_state-ego_max 0.03726058992846259 sim_compute_robot_state-ego_mean 0.03692910271569939 sim_compute_robot_state-ego_median 0.03692400070928758 sim_compute_robot_state-ego_min 0.036733780588422506 sim_compute_robot_state-npc0_max 0.03607603481837681 sim_compute_robot_state-npc0_mean 0.03588343867291865 sim_compute_robot_state-npc0_median 0.0360320306593372 sim_compute_robot_state-npc0_min 0.03546291131239671 sim_compute_robot_state-npc1_max 0.03683723252395104 sim_compute_robot_state-npc1_mean 0.03593291779164164 sim_compute_robot_state-npc1_median 0.035823434591293335 sim_compute_robot_state-npc1_min 0.03549815075738089 sim_compute_robot_state-npc2_max 0.03574784902425913 sim_compute_robot_state-npc2_mean 0.035601940087688806 sim_compute_robot_state-npc2_median 0.03568990477200212 sim_compute_robot_state-npc2_min 0.03537808695147114 sim_compute_robot_state-npc3_max 0.036683119260347806 sim_compute_robot_state-npc3_mean 0.03605003978796165 sim_compute_robot_state-npc3_median 0.03604187636539854 sim_compute_robot_state-npc3_min 0.03559207147167575 sim_compute_sim_state_max 0.020786505479079027 sim_compute_sim_state_mean 0.02043315714385029 sim_compute_sim_state_median 0.020307868719100952 sim_compute_sim_state_min 0.020156745252938105 sim_physics_max 0.078384986945561 sim_physics_mean 0.07358386098493133 sim_physics_median 0.07407041253714726 sim_physics_min 0.06972313844240628 sim_render-ego_max 0.03266346865686877 sim_render-ego_mean 0.03219127753723147 sim_render-ego_median 0.032181807926722934 sim_render-ego_min 0.031462788581848145 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.3800000000000006 survival_time_min 1.2000000000000004
No reset possible 22930
2505
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LFV-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 04:05:24+00:00 2019-05-17 04:06:06+00:00 0:00:42 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22899
2555
Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 03:47:19+00:00 2019-05-17 04:05:11+00:00 0:17:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.03742229496991193 agent_compute-ego_mean 0.03638843934469992 agent_compute-ego_median 0.03618979921527937 agent_compute-ego_min 0.035584424817284875 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.08035716091293886, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.033124561769416534, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.03629562366439635, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.04968200534223074, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.02012667311243264, "sim_compute_performance-ego": 0.035464913012033486, "sim_compute_robot_state-ego": 0.03670555999480098, "sim_compute_robot_state-npc0": 0.036115198250276495, "sim_compute_robot_state-npc1": 0.035699591579207456, "sim_compute_robot_state-npc2": 0.035554067198052465, "sim_compute_robot_state-npc3": 0.03559443462325866}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.08102898244504575, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.03292521723994502, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03742229496991193, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.0495759646097819, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.0200940591317636, "sim_compute_performance-ego": 0.034829016085024235, "sim_compute_robot_state-ego": 0.03654141779299135, "sim_compute_robot_state-npc0": 0.03691785423843949, "sim_compute_robot_state-npc1": 0.035407949376989295, "sim_compute_robot_state-npc2": 0.03579236842967846, "sim_compute_robot_state-npc3": 0.03599068853590223}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.08541112679701585, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.03318473925957313, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.03701631533793914, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.04960502416659624, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.02023177880507249, "sim_compute_performance-ego": 0.03534883107894506, "sim_compute_robot_state-ego": 0.037145556547702886, "sim_compute_robot_state-npc0": 0.0360112067980644, "sim_compute_robot_state-npc1": 0.03599198659261068, "sim_compute_robot_state-npc2": 0.03587466631180201, "sim_compute_robot_state-npc3": 0.03572233823629526}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.08158576697633978, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.032063676599870646, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.036123271574053845, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.04996559494420102, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.02051862080891927, "sim_compute_performance-ego": 0.03502932766027618, "sim_compute_robot_state-ego": 0.03726878500821298, "sim_compute_robot_state-npc0": 0.03603535786009671, "sim_compute_robot_state-npc1": 0.03562447062709875, "sim_compute_robot_state-npc2": 0.035507331814682276, "sim_compute_robot_state-npc3": 0.03619996706644694}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.08198060160097868, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.03197870047196098, "in-drivable-lane": 0, "agent_compute-ego": 0.03628433269003163, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.049159817073656166, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.01976142758908479, "sim_compute_performance-ego": 0.034766072812287704, "sim_compute_robot_state-ego": 0.036811631658802864, "sim_compute_robot_state-npc0": 0.0351786820784859, "sim_compute_robot_state-npc1": 0.03617349914882494, "sim_compute_robot_state-npc2": 0.035586916882058846, "sim_compute_robot_state-npc3": 0.035502381946729576}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.08073924569522634, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.03248116783067292, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.03599894981758267, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.05010882078432569, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.020437993255316044, "sim_compute_performance-ego": 0.03527142487320246, "sim_compute_robot_state-ego": 0.03728824970768947, "sim_compute_robot_state-npc0": 0.036380704711465275, "sim_compute_robot_state-npc1": 0.03583891718995338, "sim_compute_robot_state-npc2": 0.03576194538789637, "sim_compute_robot_state-npc3": 0.035927195175021305}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.07922847781862531, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.03256455319268363, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.036003969396863664, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.05034008877617972, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.01994077478136335, "sim_compute_performance-ego": 0.034859599385942734, "sim_compute_robot_state-ego": 0.036635584490639826, "sim_compute_robot_state-npc0": 0.03551873649869646, "sim_compute_robot_state-npc1": 0.03626098121915545, "sim_compute_robot_state-npc2": 0.03612312759671892, "sim_compute_robot_state-npc3": 0.035678916318075994}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.08417885924038822, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.033338608807080415, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.036171178295187754, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.048654706510778974, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.02019320448783979, "sim_compute_performance-ego": 0.03470016179019458, "sim_compute_robot_state-ego": 0.03662954617853034, "sim_compute_robot_state-npc0": 0.03585578970713158, "sim_compute_robot_state-npc1": 0.03622668410000736, "sim_compute_robot_state-npc2": 0.035563341558796084, "sim_compute_robot_state-npc3": 0.03537048052435052}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.07614908939184145, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.03238085813300554, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.035584424817284875, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.04925437860710676, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.02023070634797562, "sim_compute_performance-ego": 0.03496678485426792, "sim_compute_robot_state-ego": 0.03726999704227891, "sim_compute_robot_state-npc0": 0.036080948142118235, "sim_compute_robot_state-npc1": 0.035573890042859456, "sim_compute_robot_state-npc2": 0.035724426424780555, "sim_compute_robot_state-npc3": 0.03547574198523233}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.0902637059871967, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.034405763332660384, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03708419433006874, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.04944897614992582, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.020515955411470853, "sim_compute_performance-ego": 0.03589354111598088, "sim_compute_robot_state-ego": 0.03766464270078219, "sim_compute_robot_state-npc0": 0.03635778793921837, "sim_compute_robot_state-npc1": 0.03625757877643292, "sim_compute_robot_state-npc2": 0.03604723856999324, "sim_compute_robot_state-npc3": 0.03682374954223633}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.07627735455830892, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.0331515375773112, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03578185717264811, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.05011655489603679, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.02048972447713216, "sim_compute_performance-ego": 0.03607481320699056, "sim_compute_robot_state-ego": 0.03696616808573405, "sim_compute_robot_state-npc0": 0.03663914362589518, "sim_compute_robot_state-npc1": 0.035787041982014975, "sim_compute_robot_state-npc2": 0.03595687866210937, "sim_compute_robot_state-npc3": 0.03647539774576823}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.08107545262291319, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.03523479189191546, "in-drivable-lane": 0, "agent_compute-ego": 0.0366175061180478, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.04895338558015369, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.0201894896371024, "sim_compute_performance-ego": 0.03483440762474423, "sim_compute_robot_state-ego": 0.03691003436133975, "sim_compute_robot_state-npc0": 0.036101182301839195, "sim_compute_robot_state-npc1": 0.03586201440720331, "sim_compute_robot_state-npc2": 0.03554148901076544, "sim_compute_robot_state-npc3": 0.035480101903279625}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.08145460971566133, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.03230021166246991, "in-drivable-lane": 1.15, "agent_compute-ego": 0.036010187725688134, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.049340259197146394, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.02007085223530614, "sim_compute_performance-ego": 0.03510226205337879, "sim_compute_robot_state-ego": 0.03774099017298499, "sim_compute_robot_state-npc0": 0.035571270210798395, "sim_compute_robot_state-npc1": 0.03568903789963833, "sim_compute_robot_state-npc2": 0.03596586959306584, "sim_compute_robot_state-npc3": 0.035720841829166856}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.07910509620394025, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.033354265349251885, "in-drivable-lane": 0, "agent_compute-ego": 0.03724268504551479, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.04872101545333862, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.020237437316349575, "sim_compute_performance-ego": 0.03456952742167881, "sim_compute_robot_state-ego": 0.03654638358524868, "sim_compute_robot_state-npc0": 0.03564871209008353, "sim_compute_robot_state-npc1": 0.03666795151574271, "sim_compute_robot_state-npc2": 0.03581427676337106, "sim_compute_robot_state-npc3": 0.03531798294612339}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.08990004950878668, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.03241805936775956, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.03618979921527937, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0500799861608767, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.02028620944303625, "sim_compute_performance-ego": 0.03464384172476974, "sim_compute_robot_state-ego": 0.03777953690173579, "sim_compute_robot_state-npc0": 0.03697453760633282, "sim_compute_robot_state-npc1": 0.035994221182430494, "sim_compute_robot_state-npc2": 0.03542656991996017, "sim_compute_robot_state-npc3": 0.03537311273462632}}set_robot_commands_max 0.05034008877617972 set_robot_commands_mean 0.049533771883489015 set_robot_commands_median 0.0495759646097819 set_robot_commands_min 0.048654706510778974 sim_compute_performance-ego_max 0.03607481320699056 sim_compute_performance-ego_mean 0.03509030164664782 sim_compute_performance-ego_median 0.03496678485426792 sim_compute_performance-ego_min 0.03456952742167881 sim_compute_robot_state-ego_max 0.03777953690173579 sim_compute_robot_state-ego_mean 0.037060272281965 sim_compute_robot_state-ego_median 0.03696616808573405 sim_compute_robot_state-ego_min 0.03654141779299135 sim_compute_robot_state-npc0_max 0.03697453760633282 sim_compute_robot_state-npc0_mean 0.036092474137262805 sim_compute_robot_state-npc0_median 0.036080948142118235 sim_compute_robot_state-npc0_min 0.0351786820784859 sim_compute_robot_state-npc1_max 0.03666795151574271 sim_compute_robot_state-npc1_mean 0.03593705437601131 sim_compute_robot_state-npc1_median 0.03586201440720331 sim_compute_robot_state-npc1_min 0.035407949376989295 sim_compute_robot_state-npc2_max 0.03612312759671892 sim_compute_robot_state-npc2_mean 0.03574936760824874 sim_compute_robot_state-npc2_median 0.03576194538789637 sim_compute_robot_state-npc2_min 0.03542656991996017 sim_compute_robot_state-npc3_max 0.03682374954223633 sim_compute_robot_state-npc3_mean 0.03577688874083424 sim_compute_robot_state-npc3_median 0.035678916318075994 sim_compute_robot_state-npc3_min 0.03531798294612339 sim_compute_sim_state_max 0.02051862080891927 sim_compute_sim_state_mean 0.020221660456011 sim_compute_sim_state_median 0.02023070634797562 sim_compute_sim_state_min 0.01976142758908479 sim_physics_max 0.0902637059871967 sim_physics_mean 0.08191570529834717 sim_physics_median 0.08107545262291319 sim_physics_min 0.07614908939184145 sim_render-ego_max 0.03523479189191546 sim_render-ego_mean 0.03299378083237182 sim_render-ego_median 0.03292521723994502 sim_render-ego_min 0.03197870047196098 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 22889
2569
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 03:40:42+00:00 2019-05-17 03:47:11+00:00 0:06:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4702323960536803 survival_time_median 2.849999999999998 deviation-center-line_median 0.13623952041905 in-drivable-lane_median 0.7999999999999976
other stats agent_compute-ego_max 0.03779195877442877 agent_compute-ego_mean 0.03681586798109114 agent_compute-ego_median 0.037035801471808016 agent_compute-ego_min 0.035714680688423026 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.16546426353561405 deviation-center-line_min 0.07144385614371519 deviation-heading_max 1.2111022380750738 deviation-heading_mean 0.8262001110734373 deviation-heading_median 0.7978002362162198 deviation-heading_min 0.39989969254594865 driven_any_max 1.093753441791869 driven_any_mean 0.7182169120135662 driven_any_median 0.8072381933001392 driven_any_min 0.29795781475632777 driven_lanedir_consec_max 0.6735785385729686 driven_lanedir_consec_mean 0.4271077107010905 driven_lanedir_consec_min 0.2312609677194346 driven_lanedir_max 0.6758329617605024 driven_lanedir_mean 0.4275585953385973 driven_lanedir_median 0.4702323960536803 driven_lanedir_min 0.2312609677194346 in-drivable-lane_max 1.6499999999999957 in-drivable-lane_mean 0.7199999999999979 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.08055917038974991, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0334306136671319, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.03779195877442877, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.05053520777139319, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.0206080545862037, "sim_compute_performance-ego": 0.03636457259396473, "sim_compute_robot_state-ego": 0.03748877938971462, "sim_compute_robot_state-npc0": 0.036684073597551825, "sim_compute_robot_state-npc1": 0.03617731347141496, "sim_compute_robot_state-npc2": 0.03640941252191383, "sim_compute_robot_state-npc3": 0.03649904354509101}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.08085169615568938, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.03390152366073043, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03748759516963252, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.04984658735769766, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.01988202554208261, "sim_compute_performance-ego": 0.03515081935458713, "sim_compute_robot_state-ego": 0.03711208590754756, "sim_compute_robot_state-npc0": 0.03536667647185149, "sim_compute_robot_state-npc1": 0.03545565958376284, "sim_compute_robot_state-npc2": 0.03602329889933268, "sim_compute_robot_state-npc3": 0.035760720570882164}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.08364306046412541, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.03340426775125357, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.037035801471808016, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.049314236029600486, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.02023207224332369, "sim_compute_performance-ego": 0.03491252813583765, "sim_compute_robot_state-ego": 0.03708287080128988, "sim_compute_robot_state-npc0": 0.03640468303973858, "sim_compute_robot_state-npc1": 0.03626149128644894, "sim_compute_robot_state-npc2": 0.03598411877950033, "sim_compute_robot_state-npc3": 0.03566101575509096}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.08188403698436, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.032592827813667166, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.035714680688423026, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.04929082017195852, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.020541027972572727, "sim_compute_performance-ego": 0.034901255055477746, "sim_compute_robot_state-ego": 0.03681282411541855, "sim_compute_robot_state-npc0": 0.03608720344409608, "sim_compute_robot_state-npc1": 0.03574798818220172, "sim_compute_robot_state-npc2": 0.035442076231303965, "sim_compute_robot_state-npc3": 0.03543125955682052}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.08179230275361435, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.032389412755551544, "in-drivable-lane": 0, "agent_compute-ego": 0.03604930380116338, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.048672416935796325, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.019954505174056343, "sim_compute_performance-ego": 0.034504330676534904, "sim_compute_robot_state-ego": 0.03714302311772886, "sim_compute_robot_state-npc0": 0.03553101290827212, "sim_compute_robot_state-npc1": 0.036603077598240066, "sim_compute_robot_state-npc2": 0.036380135494729744, "sim_compute_robot_state-npc3": 0.03550966926242994}}set_robot_commands_max 0.05053520777139319 set_robot_commands_mean 0.04953185365328923 set_robot_commands_median 0.049314236029600486 set_robot_commands_min 0.048672416935796325 sim_compute_performance-ego_max 0.03636457259396473 sim_compute_performance-ego_mean 0.03516670116328043 sim_compute_performance-ego_median 0.03491252813583765 sim_compute_performance-ego_min 0.034504330676534904 sim_compute_robot_state-ego_max 0.03748877938971462 sim_compute_robot_state-ego_mean 0.0371279166663399 sim_compute_robot_state-ego_median 0.03711208590754756 sim_compute_robot_state-ego_min 0.03681282411541855 sim_compute_robot_state-npc0_max 0.036684073597551825 sim_compute_robot_state-npc0_mean 0.03601472989230202 sim_compute_robot_state-npc0_median 0.03608720344409608 sim_compute_robot_state-npc0_min 0.03536667647185149 sim_compute_robot_state-npc1_max 0.036603077598240066 sim_compute_robot_state-npc1_mean 0.036049106024413705 sim_compute_robot_state-npc1_median 0.03617731347141496 sim_compute_robot_state-npc1_min 0.03545565958376284 sim_compute_robot_state-npc2_max 0.03640941252191383 sim_compute_robot_state-npc2_mean 0.03604780838535611 sim_compute_robot_state-npc2_median 0.03602329889933268 sim_compute_robot_state-npc2_min 0.035442076231303965 sim_compute_robot_state-npc3_max 0.03649904354509101 sim_compute_robot_state-npc3_mean 0.035772341738062916 sim_compute_robot_state-npc3_median 0.03566101575509096 sim_compute_robot_state-npc3_min 0.03543125955682052 sim_compute_sim_state_max 0.0206080545862037 sim_compute_sim_state_mean 0.02024353710364781 sim_compute_sim_state_median 0.02023207224332369 sim_compute_sim_state_min 0.01988202554208261 sim_physics_max 0.08364306046412541 sim_physics_mean 0.08174605334950782 sim_physics_median 0.08179230275361435 sim_physics_min 0.08055917038974991 sim_render-ego_max 0.03390152366073043 sim_render-ego_mean 0.03314372912966693 sim_render-ego_median 0.03340426775125357 sim_render-ego_min 0.032389412755551544 simulation-passed 1 survival_time_max 4.149999999999993 survival_time_mean 2.679999999999997 survival_time_min 1.1500000000000004
No reset possible 22887
2574
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 03:39:45+00:00 2019-05-17 03:40:22+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22885
2577
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 03:39:02+00:00 2019-05-17 03:39:38+00:00 0:00:36 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22884
2578
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation host-error yes nutonomy-P50-9747
2019-05-17 03:38:45+00:00 2019-05-17 03:38:55+00:00 0:00:10 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fip4%2F129.132.0.37%2Ftcp%2F4001%2Fipfs%2FQmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
allow_host_network=allow_host_network, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
res = client.swarm_connect(peer)
File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
return value(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
result = func(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
return func(self, *args, **merged)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
files, headers, data, timeout=timeout)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
self._do_raise_for_status(res)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
six.raise_from(exceptions.ErrorResponse(msg, error), error)
File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9 failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID W5P8PZ> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22882
2582
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 03:37:22+00:00 2019-05-17 03:38:37+00:00 0:01:15 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22870
2601
FANG MEIYI 🇸🇬baseline-IL-logs-tensorflow aido2-LF-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 03:25:04+00:00 2019-05-17 03:37:08+00:00 0:12:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2047179735285702 survival_time_median 14.950000000000076 deviation-center-line_median 0.387887210596401 in-drivable-lane_median 1.2999999999999998
other stats agent_compute-ego_max 0.08128599188793664 agent_compute-ego_mean 0.08075380373153525 agent_compute-ego_median 0.08055917819341024 agent_compute-ego_min 0.0803881523877206 deviation-center-line_max 0.7567448241113871 deviation-center-line_mean 0.45188386673954273 deviation-center-line_min 0.20973936054620676 deviation-heading_max 2.730052148382567 deviation-heading_mean 1.8316575392778272 deviation-heading_median 1.6033474770558855 deviation-heading_min 1.0827259728141294 driven_any_max 3.1435521190582616 driven_any_mean 2.439026555216875 driven_any_median 2.7932338466706583 driven_any_min 1.6032262160278477 driven_lanedir_consec_max 3.128556391011591 driven_lanedir_consec_mean 2.169636264922683 driven_lanedir_consec_min 1.248590441428972 driven_lanedir_max 3.128556391011591 driven_lanedir_mean 2.1707743283451775 driven_lanedir_median 2.2047179735285702 driven_lanedir_min 1.2542807585414442 in-drivable-lane_max 2.9999999999999893 in-drivable-lane_mean 1.2799999999999978 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7932338466706583, "sim_physics": 0.03968904574712118, "survival_time": 14.950000000000076, "driven_lanedir": 2.2047179735285702, "sim_render-ego": 0.03284593343734741, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.08105300982793172, "deviation-heading": 2.4472602070364977, "set_robot_commands": 0.04948453267415365, "deviation-center-line": 0.5763065820447865, "driven_lanedir_consec": 2.2047179735285702, "sim_compute_sim_state": 0.020168079535166424, "sim_compute_performance-ego": 0.03507746934890747, "sim_compute_robot_state-ego": 0.03708443959554037}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1435521190582616, "sim_physics": 0.03766788085301717, "survival_time": 14.950000000000076, "driven_lanedir": 3.128556391011591, "sim_render-ego": 0.03181162118911743, "in-drivable-lane": 0, "agent_compute-ego": 0.08055917819341024, "deviation-heading": 1.2949018911000556, "set_robot_commands": 0.04910489479700724, "deviation-center-line": 0.387887210596401, "driven_lanedir_consec": 3.128556391011591, "sim_compute_sim_state": 0.020180350144704182, "sim_compute_performance-ego": 0.035196402072906495, "sim_compute_robot_state-ego": 0.03707608540852864}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9850147294870277, "sim_physics": 0.03953489065170288, "survival_time": 14.950000000000076, "driven_lanedir": 2.9618686891784956, "sim_render-ego": 0.03249676783879598, "in-drivable-lane": 0, "agent_compute-ego": 0.08048268636067708, "deviation-heading": 1.6033474770558855, "set_robot_commands": 0.050098876953125, "deviation-center-line": 0.7567448241113871, "driven_lanedir_consec": 2.9618686891784956, "sim_compute_sim_state": 0.020256613890329997, "sim_compute_performance-ego": 0.03530977090199788, "sim_compute_robot_state-ego": 0.036726176738739014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6032262160278477, "sim_physics": 0.03830061287715517, "survival_time": 8.699999999999989, "driven_lanedir": 1.2542807585414442, "sim_render-ego": 0.03214742534462063, "in-drivable-lane": 1.2999999999999998, "agent_compute-ego": 0.08128599188793664, "deviation-heading": 2.730052148382567, "set_robot_commands": 0.049446906166515134, "deviation-center-line": 0.3287413563989324, "driven_lanedir_consec": 1.248590441428972, "sim_compute_sim_state": 0.020128447433997845, "sim_compute_performance-ego": 0.03529350236914624, "sim_compute_robot_state-ego": 0.03702182742370956}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6701058648405809, "sim_physics": 0.03935129966961562, "survival_time": 8.449999999999985, "driven_lanedir": 1.3044478294657864, "sim_render-ego": 0.032391845827271955, "in-drivable-lane": 2.0999999999999996, "agent_compute-ego": 0.0803881523877206, "deviation-heading": 1.0827259728141294, "set_robot_commands": 0.04934476395330486, "deviation-center-line": 0.20973936054620676, "driven_lanedir_consec": 1.3044478294657864, "sim_compute_sim_state": 0.02014771438914643, "sim_compute_performance-ego": 0.034906631390723954, "sim_compute_robot_state-ego": 0.037079389278705306}}set_robot_commands_max 0.050098876953125 set_robot_commands_mean 0.04949599490882118 set_robot_commands_median 0.049446906166515134 set_robot_commands_min 0.04910489479700724 sim_compute_performance-ego_max 0.03530977090199788 sim_compute_performance-ego_mean 0.035156755216736404 sim_compute_performance-ego_median 0.035196402072906495 sim_compute_performance-ego_min 0.034906631390723954 sim_compute_robot_state-ego_max 0.03708443959554037 sim_compute_robot_state-ego_mean 0.03699758368904458 sim_compute_robot_state-ego_median 0.03707608540852864 sim_compute_robot_state-ego_min 0.036726176738739014 sim_compute_sim_state_max 0.020256613890329997 sim_compute_sim_state_mean 0.02017624107866898 sim_compute_sim_state_median 0.020168079535166424 sim_compute_sim_state_min 0.020128447433997845 sim_physics_max 0.03968904574712118 sim_physics_mean 0.0389087459597224 sim_physics_median 0.03935129966961562 sim_physics_min 0.03766788085301717 sim_render-ego_max 0.03284593343734741 sim_render-ego_mean 0.03233871872743068 sim_render-ego_median 0.032391845827271955 sim_render-ego_min 0.03181162118911743 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.400000000000045 survival_time_min 8.449999999999985
No reset possible 22865
2609
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 03:18:25+00:00 2019-05-17 03:24:50+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.36592094708219225 survival_time_median 2.5999999999999988 deviation-center-line_median 0.16987818035809085 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.036033982322329565 agent_compute-ego_mean 0.035580784577344954 agent_compute-ego_median 0.03549784229647729 agent_compute-ego_min 0.035384426654224664 deviation-center-line_max 0.2294363663374862 deviation-center-line_mean 0.14972083567701736 deviation-center-line_min 0.06426934298501713 deviation-heading_max 0.6986268167330368 deviation-heading_mean 0.4280304166285303 deviation-heading_median 0.41847631252347706 deviation-heading_min 0.2596285487829774 driven_any_max 1.2972979671834337 driven_any_mean 0.7173901327940211 driven_any_median 0.7336463183586153 driven_any_min 0.26903550091980144 driven_lanedir_consec_max 0.97716132702229 driven_lanedir_consec_mean 0.5227475277218055 driven_lanedir_consec_min 0.2407721645627201 driven_lanedir_max 0.97716132702229 driven_lanedir_mean 0.5227475277218055 driven_lanedir_median 0.36592094708219225 driven_lanedir_min 0.2407721645627201 in-drivable-lane_max 1.8999999999999944 in-drivable-lane_mean 0.5799999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.06425212470578476, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.03172797888097629, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.035384426654224664, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.05006741470014545, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.020184684807146094, "sim_compute_performance-ego": 0.035045623779296875, "sim_compute_robot_state-ego": 0.03666523476721535, "sim_compute_robot_state-npc0": 0.03584330518480758, "sim_compute_robot_state-npc1": 0.03535757266299825, "sim_compute_robot_state-npc2": 0.035563515945219656, "sim_compute_robot_state-npc3": 0.03558785814634511}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.07316749542951584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.032245710492134094, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03554913401603699, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.04888872057199478, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.020513661205768585, "sim_compute_performance-ego": 0.03484707325696945, "sim_compute_robot_state-ego": 0.03649450093507767, "sim_compute_robot_state-npc0": 0.03744514286518097, "sim_compute_robot_state-npc1": 0.03577517718076706, "sim_compute_robot_state-npc2": 0.035743094980716705, "sim_compute_robot_state-npc3": 0.035655342042446136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.07391206576273991, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.03258846814815815, "in-drivable-lane": 0, "agent_compute-ego": 0.03543853759765625, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.05111523316456722, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.020197882102085993, "sim_compute_performance-ego": 0.03460453106806828, "sim_compute_robot_state-ego": 0.03668263325324425, "sim_compute_robot_state-npc0": 0.03632806356136616, "sim_compute_robot_state-npc1": 0.036078498913691595, "sim_compute_robot_state-npc2": 0.03537161075151884, "sim_compute_robot_state-npc3": 0.035523249552800104}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.07106066006486134, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.03224970192037603, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.03549784229647729, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.05000109570000761, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.020966047881751933, "sim_compute_performance-ego": 0.03530040094929357, "sim_compute_robot_state-ego": 0.03710851361674647, "sim_compute_robot_state-npc0": 0.03622047875517158, "sim_compute_robot_state-npc1": 0.03586344821478731, "sim_compute_robot_state-npc2": 0.036135768377652734, "sim_compute_robot_state-npc3": 0.03598164486628707}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.06928290639604841, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.0322984740847633, "in-drivable-lane": 0, "agent_compute-ego": 0.036033982322329565, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.048945097696213496, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.01988219079517183, "sim_compute_performance-ego": 0.035658677419026695, "sim_compute_robot_state-ego": 0.03672887030101958, "sim_compute_robot_state-npc0": 0.03588950066339402, "sim_compute_robot_state-npc1": 0.03622439929417202, "sim_compute_robot_state-npc2": 0.03554842585609073, "sim_compute_robot_state-npc3": 0.03567535536629813}}set_robot_commands_max 0.05111523316456722 set_robot_commands_mean 0.04980351236658571 set_robot_commands_median 0.05000109570000761 set_robot_commands_min 0.04888872057199478 sim_compute_performance-ego_max 0.035658677419026695 sim_compute_performance-ego_mean 0.03509126129453098 sim_compute_performance-ego_median 0.035045623779296875 sim_compute_performance-ego_min 0.03460453106806828 sim_compute_robot_state-ego_max 0.03710851361674647 sim_compute_robot_state-ego_mean 0.036735950574660656 sim_compute_robot_state-ego_median 0.03668263325324425 sim_compute_robot_state-ego_min 0.03649450093507767 sim_compute_robot_state-npc0_max 0.03744514286518097 sim_compute_robot_state-npc0_mean 0.03634529820598406 sim_compute_robot_state-npc0_median 0.03622047875517158 sim_compute_robot_state-npc0_min 0.03584330518480758 sim_compute_robot_state-npc1_max 0.03622439929417202 sim_compute_robot_state-npc1_mean 0.03585981925328324 sim_compute_robot_state-npc1_median 0.03586344821478731 sim_compute_robot_state-npc1_min 0.03535757266299825 sim_compute_robot_state-npc2_max 0.036135768377652734 sim_compute_robot_state-npc2_mean 0.03567248318223973 sim_compute_robot_state-npc2_median 0.035563515945219656 sim_compute_robot_state-npc2_min 0.03537161075151884 sim_compute_robot_state-npc3_max 0.03598164486628707 sim_compute_robot_state-npc3_mean 0.0356846899948353 sim_compute_robot_state-npc3_median 0.035655342042446136 sim_compute_robot_state-npc3_min 0.035523249552800104 sim_compute_sim_state_max 0.020966047881751933 sim_compute_sim_state_mean 0.020348893358384888 sim_compute_sim_state_median 0.020197882102085993 sim_compute_sim_state_min 0.01988219079517183 sim_physics_max 0.07391206576273991 sim_physics_mean 0.07033505047179005 sim_physics_median 0.07106066006486134 sim_physics_min 0.06425212470578476 sim_render-ego_max 0.03258846814815815 sim_render-ego_mean 0.03222206670528157 sim_render-ego_median 0.03224970192037603 sim_render-ego_min 0.03172797888097629 simulation-passed 1 survival_time_max 4.6499999999999915 survival_time_mean 2.6899999999999973 survival_time_min 1.0500000000000005
No reset possible 22829
2680
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 02:32:00+00:00 2019-05-17 03:18:18+00:00 0:46:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8978797544254031 survival_time_median 14.950000000000076 deviation-center-line_median 0.9053887635539783 in-drivable-lane_median 1.8500000000000183
other stats agent_compute-ego_max 0.0410152276357015 agent_compute-ego_mean 0.03902189303630465 agent_compute-ego_median 0.03871884584426879 agent_compute-ego_min 0.038430514335632326 deviation-center-line_max 1.1827260995852698 deviation-center-line_mean 0.7986541810975463 deviation-center-line_min 0.3265371245987829 deviation-heading_max 7.287015811488866 deviation-heading_mean 4.666623975752733 deviation-heading_median 5.24216003320387 deviation-heading_min 0.7992649948727001 driven_any_max 2.349068078523283 driven_any_mean 1.7996518530968126 driven_any_median 2.34856485195945 driven_any_min 0.6446759124755118 driven_lanedir_consec_max 2.022275049294276 driven_lanedir_consec_mean 0.9983701823540848 driven_lanedir_consec_min 0.24750745880541647 driven_lanedir_max 2.022275049294276 driven_lanedir_mean 1.2452160723074783 driven_lanedir_median 1.2939518100970635 driven_lanedir_min 0.4639779886949782 in-drivable-lane_max 4.600000000000008 in-drivable-lane_mean 1.83666666666667 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6446759124755118, "sim_physics": 0.07152023476161314, "survival_time": 4.449999999999992, "driven_lanedir": 0.5085655977799672, "sim_render-ego": 0.03475114468778117, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04037911972303069, "deviation-heading": 1.4529882919224093, "set_robot_commands": 0.051434168654881166, "deviation-center-line": 0.3265371245987829, "driven_lanedir_consec": 0.5085655977799672, "sim_compute_sim_state": 0.021465130066603756, "sim_compute_performance-ego": 0.03671217232607723, "sim_compute_robot_state-ego": 0.0388655448227786, "sim_compute_robot_state-npc0": 0.037628476539354645, "sim_compute_robot_state-npc1": 0.037997476170572, "sim_compute_robot_state-npc2": 0.037983546096287416, "sim_compute_robot_state-npc3": 0.03745567396785436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486643617000205, "sim_physics": 0.07059879144032796, "survival_time": 14.950000000000076, "driven_lanedir": 1.6486043873428429, "sim_render-ego": 0.0341278338432312, "in-drivable-lane": 1.8500000000000183, "agent_compute-ego": 0.03871884584426879, "deviation-heading": 7.129794909194173, "set_robot_commands": 0.05224060455958048, "deviation-center-line": 0.9648410879914784, "driven_lanedir_consec": 1.241300151966395, "sim_compute_sim_state": 0.02162352164586385, "sim_compute_performance-ego": 0.037071423530578615, "sim_compute_robot_state-ego": 0.03855469783147176, "sim_compute_robot_state-npc0": 0.03772365172704061, "sim_compute_robot_state-npc1": 0.03797820011774699, "sim_compute_robot_state-npc2": 0.03778666734695434, "sim_compute_robot_state-npc3": 0.037799630959828696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3486169895288564, "sim_physics": 0.07009765227635702, "survival_time": 14.950000000000076, "driven_lanedir": 1.2939518100970635, "sim_render-ego": 0.0339020037651062, "in-drivable-lane": 3.6000000000000068, "agent_compute-ego": 0.03865463813145956, "deviation-heading": 7.287015811488866, "set_robot_commands": 0.05201335430145264, "deviation-center-line": 0.8795195010110861, "driven_lanedir_consec": 0.8589812116333073, "sim_compute_sim_state": 0.02135192632675171, "sim_compute_performance-ego": 0.037140968640645346, "sim_compute_robot_state-ego": 0.03826268513997396, "sim_compute_robot_state-npc0": 0.03766241312026977, "sim_compute_robot_state-npc1": 0.037969391345977786, "sim_compute_robot_state-npc2": 0.03790225505828857, "sim_compute_robot_state-npc3": 0.03786034901936849}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485874889438167, "sim_physics": 0.07178265810012817, "survival_time": 14.950000000000076, "driven_lanedir": 1.2931001153650192, "sim_render-ego": 0.033975416819254554, "in-drivable-lane": 4.600000000000008, "agent_compute-ego": 0.03949803511301676, "deviation-heading": 5.370937819382867, "set_robot_commands": 0.05218669732411702, "deviation-center-line": 1.006528047271139, "driven_lanedir_consec": 0.8939800674811287, "sim_compute_sim_state": 0.02141225814819336, "sim_compute_performance-ego": 0.037219637235005695, "sim_compute_robot_state-ego": 0.03861245393753051, "sim_compute_robot_state-npc0": 0.037773265838623046, "sim_compute_robot_state-npc1": 0.03796491543451945, "sim_compute_robot_state-npc2": 0.03787972132364909, "sim_compute_robot_state-npc3": 0.037599267164866126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6454831015144277, "sim_physics": 0.06520662362548127, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6333644034153836, "sim_render-ego": 0.03432203709394082, "in-drivable-lane": 0, "agent_compute-ego": 0.038747395592174314, "deviation-heading": 0.7992649948727001, "set_robot_commands": 0.05194716892023196, "deviation-center-line": 0.3583495808721403, "driven_lanedir_consec": 0.6333644034153836, "sim_compute_sim_state": 0.0214436465296252, "sim_compute_performance-ego": 0.03692472118070756, "sim_compute_robot_state-ego": 0.038184683898399616, "sim_compute_robot_state-npc0": 0.03824785111964434, "sim_compute_robot_state-npc1": 0.037701946565474584, "sim_compute_robot_state-npc2": 0.03785560048859695, "sim_compute_robot_state-npc3": 0.03727758067777787}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.071188250223395, "sim_physics": 0.07013532263892037, "survival_time": 6.999999999999983, "driven_lanedir": 0.5566436956560228, "sim_render-ego": 0.03421661513192313, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.03853212084089007, "deviation-heading": 3.3917851165100856, "set_robot_commands": 0.05223367043903896, "deviation-center-line": 0.5658477439972391, "driven_lanedir_consec": 0.28889244118302204, "sim_compute_sim_state": 0.02150033371789115, "sim_compute_performance-ego": 0.03702266727175031, "sim_compute_robot_state-ego": 0.03955997228622436, "sim_compute_robot_state-npc0": 0.037786456516810826, "sim_compute_robot_state-npc1": 0.03810385465621948, "sim_compute_robot_state-npc2": 0.03775852067129953, "sim_compute_robot_state-npc3": 0.03770705461502075}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9106108218985782, "sim_physics": 0.07075324654579163, "survival_time": 5.999999999999987, "driven_lanedir": 0.8619235094803662, "sim_render-ego": 0.034204667806625365, "in-drivable-lane": 0, "agent_compute-ego": 0.03856101234753927, "deviation-heading": 1.4794498745455007, "set_robot_commands": 0.05223226348559062, "deviation-center-line": 0.4781765916297879, "driven_lanedir_consec": 0.8619235094803662, "sim_compute_sim_state": 0.021222678820292155, "sim_compute_performance-ego": 0.03742044369379679, "sim_compute_robot_state-ego": 0.038370126485824586, "sim_compute_robot_state-npc0": 0.038155738512674967, "sim_compute_robot_state-npc1": 0.03773999015490214, "sim_compute_robot_state-npc2": 0.03849217096964518, "sim_compute_robot_state-npc3": 0.03814038435618083}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7658832312059227, "sim_physics": 0.07007530623791265, "survival_time": 5.09999999999999, "driven_lanedir": 0.4639779886949782, "sim_render-ego": 0.034153386658313224, "in-drivable-lane": 0.55, "agent_compute-ego": 0.0410152276357015, "deviation-heading": 2.9457570883426687, "set_robot_commands": 0.05136306379355636, "deviation-center-line": 0.4726268180199212, "driven_lanedir_consec": 0.24750745880541647, "sim_compute_sim_state": 0.021163631887996897, "sim_compute_performance-ego": 0.03677391772176705, "sim_compute_robot_state-ego": 0.0386196117775113, "sim_compute_robot_state-npc0": 0.0377655076045616, "sim_compute_robot_state-npc1": 0.03828177966323553, "sim_compute_robot_state-npc2": 0.03792843397925882, "sim_compute_robot_state-npc3": 0.03819968653660195}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3488046627326997, "sim_physics": 0.06894954919815063, "survival_time": 14.950000000000076, "driven_lanedir": 1.948707000596421, "sim_render-ego": 0.0339596144358317, "in-drivable-lane": 0.7000000000000031, "agent_compute-ego": 0.038630271752675374, "deviation-heading": 5.829305210448549, "set_robot_commands": 0.05206413427988688, "deviation-center-line": 1.1081301352868396, "driven_lanedir_consec": 1.4215317188111218, "sim_compute_sim_state": 0.02140802303949992, "sim_compute_performance-ego": 0.0367464025815328, "sim_compute_robot_state-ego": 0.03812904755274455, "sim_compute_robot_state-npc0": 0.037823726336161295, "sim_compute_robot_state-npc1": 0.037701642513275145, "sim_compute_robot_state-npc2": 0.037548521359761555, "sim_compute_robot_state-npc3": 0.03755371809005737}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348675149610332, "sim_physics": 0.07312440554300945, "survival_time": 14.950000000000076, "driven_lanedir": 1.375361041512425, "sim_render-ego": 0.03416662931442261, "in-drivable-lane": 3.3000000000000114, "agent_compute-ego": 0.038430514335632326, "deviation-heading": 7.070502895800575, "set_robot_commands": 0.05176014423370361, "deviation-center-line": 0.787762859460344, "driven_lanedir_consec": 1.1917471920683638, "sim_compute_sim_state": 0.02143421729405721, "sim_compute_performance-ego": 0.03715886036554973, "sim_compute_robot_state-ego": 0.038602335453033446, "sim_compute_robot_state-npc0": 0.03778303225835165, "sim_compute_robot_state-npc1": 0.03799190203348795, "sim_compute_robot_state-npc2": 0.03770037015279134, "sim_compute_robot_state-npc3": 0.03789130846659342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.349068078523283, "sim_physics": 0.0679710292816162, "survival_time": 14.950000000000076, "driven_lanedir": 1.8444163179922024, "sim_render-ego": 0.034144775072733564, "in-drivable-lane": 1.900000000000003, "agent_compute-ego": 0.0387628165880839, "deviation-heading": 5.24216003320387, "set_robot_commands": 0.05228164037068685, "deviation-center-line": 0.9985419346867458, "driven_lanedir_consec": 1.8444163179922024, "sim_compute_sim_state": 0.021434213320414227, "sim_compute_performance-ego": 0.03699474414189657, "sim_compute_robot_state-ego": 0.03842739661534627, "sim_compute_robot_state-npc0": 0.03781946023305257, "sim_compute_robot_state-npc1": 0.037896774609883624, "sim_compute_robot_state-npc2": 0.03782220602035522, "sim_compute_robot_state-npc3": 0.037617974281311035}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3490417922239817, "sim_physics": 0.06689083258310954, "survival_time": 14.950000000000076, "driven_lanedir": 2.022275049294276, "sim_render-ego": 0.03363688309987386, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03905247767766317, "deviation-heading": 4.1972179821626705, "set_robot_commands": 0.051466715335845944, "deviation-center-line": 1.0386131686552715, "driven_lanedir_consec": 2.022275049294276, "sim_compute_sim_state": 0.02125149647394816, "sim_compute_performance-ego": 0.03679918845494588, "sim_compute_robot_state-ego": 0.038499943415323895, "sim_compute_robot_state-npc0": 0.03752013921737671, "sim_compute_robot_state-npc1": 0.03754080931345622, "sim_compute_robot_state-npc2": 0.03782504717508952, "sim_compute_robot_state-npc3": 0.0378455909093221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8183701846397415, "sim_physics": 0.06720255884489788, "survival_time": 11.65000000000003, "driven_lanedir": 1.254122761820048, "sim_render-ego": 0.03446632802742233, "in-drivable-lane": 1.7999999999999952, "agent_compute-ego": 0.038507359222281136, "deviation-heading": 4.736929297442443, "set_robot_commands": 0.05190430792616161, "deviation-center-line": 0.9053887635539783, "driven_lanedir_consec": 1.0799769557365442, "sim_compute_sim_state": 0.02147573053581009, "sim_compute_performance-ego": 0.037211633035553374, "sim_compute_robot_state-ego": 0.0384113716976837, "sim_compute_robot_state-npc0": 0.038171670979184655, "sim_compute_robot_state-npc1": 0.03806118596776872, "sim_compute_robot_state-npc2": 0.03799399899822448, "sim_compute_robot_state-npc3": 0.037845064130463825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.34856485195945, "sim_physics": 0.06996794859568278, "survival_time": 14.950000000000076, "driven_lanedir": 1.362205116595515, "sim_render-ego": 0.033998185793558754, "in-drivable-lane": 3.90000000000001, "agent_compute-ego": 0.03921487967173259, "deviation-heading": 5.909834507439167, "set_robot_commands": 0.05122409184773763, "deviation-center-line": 0.906223259843169, "driven_lanedir_consec": 0.9832109052383768, "sim_compute_sim_state": 0.02130258083343506, "sim_compute_performance-ego": 0.03670088132222493, "sim_compute_robot_state-ego": 0.038633507092793784, "sim_compute_robot_state-npc0": 0.0376745859781901, "sim_compute_robot_state-npc1": 0.03781512896219889, "sim_compute_robot_state-npc2": 0.03762899080912272, "sim_compute_robot_state-npc3": 0.03756457567214966}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3485429192721696, "sim_physics": 0.07104145447413127, "survival_time": 14.950000000000076, "driven_lanedir": 1.6110222889696435, "sim_render-ego": 0.03418943723042806, "in-drivable-lane": 2.0000000000000107, "agent_compute-ego": 0.03862368106842041, "deviation-heading": 7.156415803534466, "set_robot_commands": 0.05231973965962728, "deviation-center-line": 1.1827260995852698, "driven_lanedir_consec": 0.8978797544254031, "sim_compute_sim_state": 0.021568671862284346, "sim_compute_performance-ego": 0.037292234897613526, "sim_compute_robot_state-ego": 0.03868702173233032, "sim_compute_robot_state-npc0": 0.03792251348495483, "sim_compute_robot_state-npc1": 0.038045072555541994, "sim_compute_robot_state-npc2": 0.038802358309427895, "sim_compute_robot_state-npc3": 0.038144535223642986}}set_robot_commands_max 0.05231973965962728 set_robot_commands_mean 0.05191145100880659 set_robot_commands_median 0.05201335430145264 set_robot_commands_min 0.05122409184773763 sim_compute_performance-ego_max 0.03742044369379679 sim_compute_performance-ego_mean 0.03701265975997636 sim_compute_performance-ego_median 0.03702266727175031 sim_compute_performance-ego_min 0.03670088132222493 sim_compute_robot_state-ego_max 0.03955997228622436 sim_compute_robot_state-ego_mean 0.03856135998259804 sim_compute_robot_state-ego_median 0.03855469783147176 sim_compute_robot_state-ego_min 0.03812904755274455 sim_compute_robot_state-npc0_max 0.03824785111964434 sim_compute_robot_state-npc0_mean 0.03783056596441677 sim_compute_robot_state-npc0_median 0.03778303225835165 sim_compute_robot_state-npc0_min 0.03752013921737671 sim_compute_robot_state-npc1_max 0.03828177966323553 sim_compute_robot_state-npc1_mean 0.037919338004284035 sim_compute_robot_state-npc1_median 0.037969391345977786 sim_compute_robot_state-npc1_min 0.03754080931345622 sim_compute_robot_state-npc2_max 0.038802358309427895 sim_compute_robot_state-npc2_mean 0.037927227250583506 sim_compute_robot_state-npc2_median 0.03785560048859695 sim_compute_robot_state-npc2_min 0.037548521359761555 sim_compute_robot_state-npc3_max 0.03819968653660195 sim_compute_robot_state-npc3_mean 0.03776682627140263 sim_compute_robot_state-npc3_median 0.037799630959828696 sim_compute_robot_state-npc3_min 0.03727758067777787 sim_compute_sim_state_max 0.02162352164586385 sim_compute_sim_state_mean 0.021403870700177803 sim_compute_sim_state_median 0.021434213320414227 sim_compute_sim_state_min 0.021163631887996897 sim_physics_max 0.07312440554300945 sim_physics_mean 0.06968784094314201 sim_physics_median 0.07009765227635702 sim_physics_min 0.06520662362548127 sim_render-ego_max 0.03475114468778117 sim_render-ego_mean 0.03414766391869643 sim_render-ego_median 0.034153386658313224 sim_render-ego_min 0.03363688309987386 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.540000000000044 survival_time_min 4.3499999999999925
No reset possible 22789
2907
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 02:00:20+00:00 2019-05-17 02:31:40+00:00 0:31:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.466627654289285 survival_time_median 6.099999999999986 deviation-center-line_median 0.33341663981606123 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1145672897497813 agent_compute-ego_mean 0.11280293562696216 agent_compute-ego_median 0.11285812714520622 agent_compute-ego_min 0.1089727467504041 deviation-center-line_max 1.0678270161928525 deviation-center-line_mean 0.3924833225550088 deviation-center-line_min 0.16662188238079648 deviation-heading_max 3.00376928154286 deviation-heading_mean 1.182722648012555 deviation-heading_median 0.8526023258587172 deviation-heading_min 0.3980684508158633 driven_any_max 2.553475024767484 driven_any_mean 1.0539409492023473 driven_any_median 1.0073534337261636 driven_any_min 0.3609526397352217 driven_lanedir_consec_max 2.3199839675073 driven_lanedir_consec_mean 0.7711579392535753 driven_lanedir_consec_min 0.3359040954329422 driven_lanedir_max 2.320009778733091 driven_lanedir_mean 0.7846552677152641 driven_lanedir_median 0.6115512044452298 driven_lanedir_min 0.3359040954329422 in-drivable-lane_max 6.899999999999996 in-drivable-lane_mean 1.2566666666666677 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.391700043905229, "sim_physics": 0.07472640635019326, "survival_time": 8.299999999999983, "driven_lanedir": 1.3851647080326188, "sim_render-ego": 0.0320512013263013, "in-drivable-lane": 0, "agent_compute-ego": 0.11344962953084922, "deviation-heading": 0.7900143744696351, "set_robot_commands": 0.05085933208465576, "deviation-center-line": 0.531419937088551, "driven_lanedir_consec": 1.384801018742178, "sim_compute_sim_state": 0.02019425903458193, "sim_compute_performance-ego": 0.03522699281393764, "sim_compute_robot_state-ego": 0.03668254111186568, "sim_compute_robot_state-npc0": 0.037042319056499434, "sim_compute_robot_state-npc1": 0.036260652254862955, "sim_compute_robot_state-npc2": 0.035822931542453994, "sim_compute_robot_state-npc3": 0.03556485492062856}, "udem1-1-0": {"driven_any": 0.4483038438306956, "sim_physics": 0.07672588167519405, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226836157735168, "sim_render-ego": 0.032529978916562834, "in-drivable-lane": 0, "agent_compute-ego": 0.1089727467504041, "deviation-heading": 0.9834096544692096, "set_robot_commands": 0.051750832590563546, "deviation-center-line": 0.2083887780063803, "driven_lanedir_consec": 0.4226836157735168, "sim_compute_sim_state": 0.01996939757774616, "sim_compute_performance-ego": 0.0342238319331202, "sim_compute_robot_state-ego": 0.036735357909367, "sim_compute_robot_state-npc0": 0.036544059884959255, "sim_compute_robot_state-npc1": 0.036746131962743296, "sim_compute_robot_state-npc2": 0.035865578158148406, "sim_compute_robot_state-npc3": 0.035821347401059904}, "udem1-2-0": {"driven_any": 2.1691284131233446, "sim_physics": 0.07492982079001034, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728103279359904, "sim_render-ego": 0.032491230497173236, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.11285812714520622, "deviation-heading": 0.8643309130348766, "set_robot_commands": 0.050339698791503906, "deviation-center-line": 0.6335547372660157, "driven_lanedir_consec": 1.7727850975910913, "sim_compute_sim_state": 0.02034455467672909, "sim_compute_performance-ego": 0.03525847360199573, "sim_compute_robot_state-ego": 0.03692989162370271, "sim_compute_robot_state-npc0": 0.035881539887072995, "sim_compute_robot_state-npc1": 0.03620606684217266, "sim_compute_robot_state-npc2": 0.03559434928146063, "sim_compute_robot_state-npc3": 0.03572536543303845}, "udem1-3-0": {"driven_any": 2.553475024767484, "sim_physics": 0.07631842692693075, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009778733091, "sim_render-ego": 0.032252218723297116, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.1128422753016154, "deviation-heading": 0.8526023258587172, "set_robot_commands": 0.049665621916453045, "deviation-center-line": 1.0678270161928525, "driven_lanedir_consec": 2.3199839675073, "sim_compute_sim_state": 0.02014336347579956, "sim_compute_performance-ego": 0.03529156843821208, "sim_compute_robot_state-ego": 0.037095634937286376, "sim_compute_robot_state-npc0": 0.03570375521977742, "sim_compute_robot_state-npc1": 0.03610529104868571, "sim_compute_robot_state-npc2": 0.035761168797810876, "sim_compute_robot_state-npc3": 0.03622866948445638}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.07703253201075963, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.0313941021354831, "in-drivable-lane": 0, "agent_compute-ego": 0.1122927714367302, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.04979231406231316, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.02075913974217006, "sim_compute_performance-ego": 0.0344166950303681, "sim_compute_robot_state-ego": 0.0367360309678681, "sim_compute_robot_state-npc0": 0.036418204404869856, "sim_compute_robot_state-npc1": 0.03638648500247878, "sim_compute_robot_state-npc2": 0.03645906642991669, "sim_compute_robot_state-npc3": 0.03611574854169573}, "udem1-5-0": {"driven_any": 1.042294034462269, "sim_physics": 0.07612440131959461, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977853477095068, "sim_render-ego": 0.032426256982107014, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.11339807321154882, "deviation-heading": 2.060706771196367, "set_robot_commands": 0.0514897864962381, "deviation-center-line": 0.33341663981606123, "driven_lanedir_consec": 0.3977853477095068, "sim_compute_sim_state": 0.0203024565227448, "sim_compute_performance-ego": 0.03575714239998469, "sim_compute_robot_state-ego": 0.03699760777609689, "sim_compute_robot_state-npc0": 0.03603220553625198, "sim_compute_robot_state-npc1": 0.03633174063667419, "sim_compute_robot_state-npc2": 0.0357469225686694, "sim_compute_robot_state-npc3": 0.03591345983838278}, "udem1-6-0": {"driven_any": 0.8064449781297804, "sim_physics": 0.08537807368268871, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035057918243635, "sim_render-ego": 0.032685725375859426, "in-drivable-lane": 0, "agent_compute-ego": 0.11433415220241354, "deviation-heading": 0.4192648649548546, "set_robot_commands": 0.04979162023525045, "deviation-center-line": 0.4521049008644824, "driven_lanedir_consec": 0.8035057918243635, "sim_compute_sim_state": 0.019968651761912336, "sim_compute_performance-ego": 0.0350173001337533, "sim_compute_robot_state-ego": 0.03725468751155969, "sim_compute_robot_state-npc0": 0.03576721567096132, "sim_compute_robot_state-npc1": 0.03590624982660467, "sim_compute_robot_state-npc2": 0.03526998770357383, "sim_compute_robot_state-npc3": 0.03538241049255988}, "udem1-7-0": {"driven_any": 1.0073534337261636, "sim_physics": 0.08103795716019928, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835123128772164, "sim_render-ego": 0.032775183193019176, "in-drivable-lane": 0, "agent_compute-ego": 0.11410353809106544, "deviation-heading": 2.2471929051607855, "set_robot_commands": 0.050079926115567566, "deviation-center-line": 0.3798478400382373, "driven_lanedir_consec": 0.8699557215089209, "sim_compute_sim_state": 0.02000480010861256, "sim_compute_performance-ego": 0.03539958938223417, "sim_compute_robot_state-ego": 0.03694274386421579, "sim_compute_robot_state-npc0": 0.035558735738035106, "sim_compute_robot_state-npc1": 0.03653781922137151, "sim_compute_robot_state-npc2": 0.035670589228145415, "sim_compute_robot_state-npc3": 0.035717876231084106}, "udem1-8-0": {"driven_any": 1.0248237349996017, "sim_physics": 0.07631153445090016, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115512044452298, "sim_render-ego": 0.03288006974804786, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.11227964778100293, "deviation-heading": 2.0843969428116633, "set_robot_commands": 0.05090678122735793, "deviation-center-line": 0.4228099488267053, "driven_lanedir_consec": 0.6115512044452298, "sim_compute_sim_state": 0.020218643449967908, "sim_compute_performance-ego": 0.0359232694871964, "sim_compute_robot_state-ego": 0.03716015046642673, "sim_compute_robot_state-npc0": 0.03560947410521969, "sim_compute_robot_state-npc1": 0.03608220046566379, "sim_compute_robot_state-npc2": 0.03563206618832004, "sim_compute_robot_state-npc3": 0.03557609550414547}, "udem1-9-0": {"driven_any": 0.44830384366262993, "sim_physics": 0.08678409559973355, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199663087821, "sim_render-ego": 0.032657199892504464, "in-drivable-lane": 0, "agent_compute-ego": 0.11270154344624486, "deviation-heading": 0.7843859210886422, "set_robot_commands": 0.04949124517111943, "deviation-center-line": 0.19267161522996132, "driven_lanedir_consec": 0.4319199663087821, "sim_compute_sim_state": 0.020164699390016753, "sim_compute_performance-ego": 0.03502658317829001, "sim_compute_robot_state-ego": 0.03722565338529389, "sim_compute_robot_state-npc0": 0.03597389007436818, "sim_compute_robot_state-npc1": 0.036136195577424146, "sim_compute_robot_state-npc2": 0.035704781269205024, "sim_compute_robot_state-npc3": 0.03587900359055091}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.07937508821487427, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.03244545559088389, "in-drivable-lane": 0, "agent_compute-ego": 0.1145672897497813, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.04971388975779215, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.019728243350982663, "sim_compute_performance-ego": 0.035220980644226074, "sim_compute_robot_state-ego": 0.03813609480857849, "sim_compute_robot_state-npc0": 0.03553371628125509, "sim_compute_robot_state-npc1": 0.03562937180201212, "sim_compute_robot_state-npc2": 0.03530546526114146, "sim_compute_robot_state-npc3": 0.0352599173784256}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.07699596656943267, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.03253709145312039, "in-drivable-lane": 0, "agent_compute-ego": 0.11096872473662754, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.05006668702611383, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.020104664676594285, "sim_compute_performance-ego": 0.03569423027758328, "sim_compute_robot_state-ego": 0.03685567963798091, "sim_compute_robot_state-npc0": 0.036649546533260705, "sim_compute_robot_state-npc1": 0.035206466350915296, "sim_compute_robot_state-npc2": 0.03696849211206976, "sim_compute_robot_state-npc3": 0.035574859043337265}, "udem1-12-0": {"driven_any": 1.5489327489516758, "sim_physics": 0.07977798451548038, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.03216033396513566, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.11212264454883078, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.05000009096187094, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.020557235116543976, "sim_compute_performance-ego": 0.03532131340192712, "sim_compute_robot_state-ego": 0.03672677667244621, "sim_compute_robot_state-npc0": 0.03568084214044654, "sim_compute_robot_state-npc1": 0.03599237099937771, "sim_compute_robot_state-npc2": 0.03542442166286966, "sim_compute_robot_state-npc3": 0.03605055809020996}, "udem1-13-0": {"driven_any": 0.9898831334126, "sim_physics": 0.0766534686088562, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517705220330678, "sim_render-ego": 0.03249402046203613, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.11407612760861714, "deviation-heading": 1.323248045391386, "set_robot_commands": 0.050547532240549725, "deviation-center-line": 0.3285033071320674, "driven_lanedir_consec": 0.6517705220330678, "sim_compute_sim_state": 0.02088234623273214, "sim_compute_performance-ego": 0.03519213596979777, "sim_compute_robot_state-ego": 0.03679651816685994, "sim_compute_robot_state-npc0": 0.036435035864512126, "sim_compute_robot_state-npc1": 0.03674241105715434, "sim_compute_robot_state-npc2": 0.03615872859954834, "sim_compute_robot_state-npc3": 0.03597831726074219}, "udem1-14-0": {"driven_any": 1.2432024907546595, "sim_physics": 0.08267429851045545, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551162589851884, "sim_render-ego": 0.032208700308063686, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.11307674286349507, "deviation-heading": 3.00376928154286, "set_robot_commands": 0.04945273047325595, "deviation-center-line": 0.4491548536824948, "driven_lanedir_consec": 0.466627654289285, "sim_compute_sim_state": 0.020314541439082, "sim_compute_performance-ego": 0.03505162904726579, "sim_compute_robot_state-ego": 0.036812140637596184, "sim_compute_robot_state-npc0": 0.035848046309195906, "sim_compute_robot_state-npc1": 0.03563666983738842, "sim_compute_robot_state-npc2": 0.03561194791089768, "sim_compute_robot_state-npc3": 0.03557354011791664}}set_robot_commands_max 0.051750832590563546 set_robot_commands_mean 0.050263205943373704 set_robot_commands_median 0.05006668702611383 set_robot_commands_min 0.04945273047325595 sim_compute_performance-ego_max 0.0359232694871964 sim_compute_performance-ego_mean 0.035201449049326164 sim_compute_performance-ego_median 0.03522699281393764 sim_compute_performance-ego_min 0.0342238319331202 sim_compute_robot_state-ego_max 0.03813609480857849 sim_compute_robot_state-ego_mean 0.037005833965142974 sim_compute_robot_state-ego_median 0.03692989162370271 sim_compute_robot_state-ego_min 0.03668254111186568 sim_compute_robot_state-npc0_max 0.037042319056499434 sim_compute_robot_state-npc0_mean 0.036045239113779035 sim_compute_robot_state-npc0_median 0.035881539887072995 sim_compute_robot_state-npc0_min 0.03553371628125509 sim_compute_robot_state-npc1_max 0.036746131962743296 sim_compute_robot_state-npc1_mean 0.03612707485903531 sim_compute_robot_state-npc1_median 0.036136195577424146 sim_compute_robot_state-npc1_min 0.035206466350915296 sim_compute_robot_state-npc2_max 0.03696849211206976 sim_compute_robot_state-npc2_mean 0.03579976644761542 sim_compute_robot_state-npc2_median 0.035704781269205024 sim_compute_robot_state-npc2_min 0.03526998770357383 sim_compute_robot_state-npc3_max 0.03622866948445638 sim_compute_robot_state-npc3_mean 0.03575746822188226 sim_compute_robot_state-npc3_median 0.03572536543303845 sim_compute_robot_state-npc3_min 0.0352599173784256 sim_compute_sim_state_max 0.02088234623273214 sim_compute_sim_state_mean 0.020243799770414416 sim_compute_sim_state_median 0.02019425903458193 sim_compute_sim_state_min 0.019728243350982663 sim_physics_max 0.08678409559973355 sim_physics_mean 0.07872306242568688 sim_physics_median 0.07699596656943267 sim_physics_min 0.07472640635019326 sim_render-ego_max 0.03288006974804786 sim_render-ego_mean 0.03239925123797302 sim_render-ego_median 0.032491230497173236 sim_render-ego_min 0.0313941021354831 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.366666666666666 survival_time_min 2.3999999999999995
No reset possible 22762
2812
Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agent aido2-LFVI-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 01:40:43+00:00 2019-05-17 02:00:00+00:00 0:19:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.08159929589380192 agent_compute-ego_mean 0.08010377164327694 agent_compute-ego_median 0.08003342151641846 agent_compute-ego_min 0.07928786958966937 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.08039326305630841, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.03314140476757967, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08159929589380192, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.04966377608383758, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.020306713973419575, "sim_compute_performance-ego": 0.03539970856678637, "sim_compute_robot_state-ego": 0.037084582485730135, "sim_compute_robot_state-npc0": 0.035739889627770534, "sim_compute_robot_state-npc1": 0.03630760651600512, "sim_compute_robot_state-npc2": 0.0357013593746137, "sim_compute_robot_state-npc3": 0.035717182521578635}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.08258347000394549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.032463175909859796, "in-drivable-lane": 0, "agent_compute-ego": 0.07928786958966937, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.05332995312554496, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.02017475025994437, "sim_compute_performance-ego": 0.03517709459577288, "sim_compute_robot_state-ego": 0.038001571382795064, "sim_compute_robot_state-npc0": 0.035616116864340644, "sim_compute_robot_state-npc1": 0.03524276188441685, "sim_compute_robot_state-npc2": 0.03519161258425031, "sim_compute_robot_state-npc3": 0.03580080611365182}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.07807530477208999, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.032518366008128935, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07988288333115068, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.04902837345901045, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.020172135343829407, "sim_compute_performance-ego": 0.034621984055898725, "sim_compute_robot_state-ego": 0.036765927249945485, "sim_compute_robot_state-npc0": 0.03594156144892128, "sim_compute_robot_state-npc1": 0.03580017228728359, "sim_compute_robot_state-npc2": 0.03524832586640293, "sim_compute_robot_state-npc3": 0.03578958233583321}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.08323693772157033, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.031805604696273804, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.08027418951193492, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.04937850932280222, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.02008016407489777, "sim_compute_performance-ego": 0.03473569949467977, "sim_compute_robot_state-ego": 0.03652379413445791, "sim_compute_robot_state-npc0": 0.03618775308132171, "sim_compute_robot_state-npc1": 0.03762519359588623, "sim_compute_robot_state-npc2": 0.035242716471354164, "sim_compute_robot_state-npc3": 0.03505929311116537}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.08134789693923224, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.03196892284211658, "in-drivable-lane": 0, "agent_compute-ego": 0.0800223918188186, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.04880211466834659, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.020555087498256137, "sim_compute_performance-ego": 0.03469797543116978, "sim_compute_robot_state-ego": 0.03695090611775717, "sim_compute_robot_state-npc0": 0.03562206313723609, "sim_compute_robot_state-npc1": 0.03553233827863421, "sim_compute_robot_state-npc2": 0.036879721141996835, "sim_compute_robot_state-npc3": 0.035250255039760044}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.07828552851419963, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.032346581270594796, "in-drivable-lane": 2, "agent_compute-ego": 0.07985001695370246, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.04947011342305623, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.020055976456510808, "sim_compute_performance-ego": 0.0348404638781519, "sim_compute_robot_state-ego": 0.03698831118509441, "sim_compute_robot_state-npc0": 0.035535041443602054, "sim_compute_robot_state-npc1": 0.03580024999058889, "sim_compute_robot_state-npc2": 0.03540664233133464, "sim_compute_robot_state-npc3": 0.035461218771106466}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.08338028944811775, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.03251639616142199, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08026771175051198, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.04923785311504475, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02232622405857716, "sim_compute_performance-ego": 0.035184874117953104, "sim_compute_robot_state-ego": 0.03701603528365348, "sim_compute_robot_state-npc0": 0.03561289333602757, "sim_compute_robot_state-npc1": 0.03568504157575589, "sim_compute_robot_state-npc2": 0.03570443218194165, "sim_compute_robot_state-npc3": 0.035498359828319365}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.08709868431091308, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.033323841094970705, "in-drivable-lane": 0, "agent_compute-ego": 0.07979367733001709, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.049545788764953615, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.020580053329467773, "sim_compute_performance-ego": 0.03516577243804932, "sim_compute_robot_state-ego": 0.03687504768371582, "sim_compute_robot_state-npc0": 0.03555574417114258, "sim_compute_robot_state-npc1": 0.035804734230041504, "sim_compute_robot_state-npc2": 0.03564877986907959, "sim_compute_robot_state-npc3": 0.03580949306488037}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.07779416671166053, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03210646372575026, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08046816404049213, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.04947532140291654, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02012214293846717, "sim_compute_performance-ego": 0.034948188524979815, "sim_compute_robot_state-ego": 0.036595862645369306, "sim_compute_robot_state-npc0": 0.035439317043011, "sim_compute_robot_state-npc1": 0.03622367748847374, "sim_compute_robot_state-npc2": 0.035384599979107194, "sim_compute_robot_state-npc3": 0.035491764545440674}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.0902965160516592, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03250425595503587, "in-drivable-lane": 0, "agent_compute-ego": 0.0803055213047908, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05005935522226187, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.020062694182762734, "sim_compute_performance-ego": 0.03438243499168983, "sim_compute_robot_state-ego": 0.03647946394406832, "sim_compute_robot_state-npc0": 0.03703382382026085, "sim_compute_robot_state-npc1": 0.03621357220869798, "sim_compute_robot_state-npc2": 0.03600981602301964, "sim_compute_robot_state-npc3": 0.03533339500427246}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.08259116519581187, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.032793218439275566, "in-drivable-lane": 0, "agent_compute-ego": 0.08003342151641846, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.04836073788729581, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02011871337890625, "sim_compute_performance-ego": 0.036095922643488106, "sim_compute_robot_state-ego": 0.037366541949185456, "sim_compute_robot_state-npc0": 0.03634566610509699, "sim_compute_robot_state-npc1": 0.03557113083926114, "sim_compute_robot_state-npc2": 0.03476527604189786, "sim_compute_robot_state-npc3": 0.03528240593996915}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.07718895435333252, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03232187747955322, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08034112930297851, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.04935735702514649, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.020695905685424804, "sim_compute_performance-ego": 0.03499733924865723, "sim_compute_robot_state-ego": 0.03668574810028076, "sim_compute_robot_state-npc0": 0.035890660285949706, "sim_compute_robot_state-npc1": 0.036248397827148435, "sim_compute_robot_state-npc2": 0.036390581130981446, "sim_compute_robot_state-npc3": 0.03597043037414551}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.08086198187888936, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.032052126336604994, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08007775976302776, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.04924366575606326, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.020305258162478183, "sim_compute_performance-ego": 0.03488607863162426, "sim_compute_robot_state-ego": 0.03684472530446154, "sim_compute_robot_state-npc0": 0.03568622152856056, "sim_compute_robot_state-npc1": 0.035876045835779066, "sim_compute_robot_state-npc2": 0.035549747182967814, "sim_compute_robot_state-npc3": 0.03592645614705187}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.07821430151279156, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.032327088025900036, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.07935063655559833, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.04900371569853563, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.020174053999093864, "sim_compute_performance-ego": 0.035804798969855674, "sim_compute_robot_state-ego": 0.037469955591055065, "sim_compute_robot_state-npc0": 0.035777467947739824, "sim_compute_robot_state-npc1": 0.03577268582123976, "sim_compute_robot_state-npc2": 0.03603301598475529, "sim_compute_robot_state-npc3": 0.03566525074151846}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.07785161109197708, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03313965116228376, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08000190598624093, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.04924586613972982, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.020072230838593982, "sim_compute_performance-ego": 0.03490605581374395, "sim_compute_robot_state-ego": 0.03721928369431268, "sim_compute_robot_state-npc0": 0.035785790852137976, "sim_compute_robot_state-npc1": 0.03596053350539435, "sim_compute_robot_state-npc2": 0.03561942463829404, "sim_compute_robot_state-npc3": 0.03556650706699916}}set_robot_commands_max 0.05332995312554496 set_robot_commands_mean 0.04954683340630306 set_robot_commands_median 0.04935735702514649 set_robot_commands_min 0.04836073788729581 sim_compute_performance-ego_max 0.036095922643488106 sim_compute_performance-ego_mean 0.03505629276016672 sim_compute_performance-ego_median 0.034948188524979815 sim_compute_performance-ego_min 0.03438243499168983 sim_compute_robot_state-ego_max 0.038001571382795064 sim_compute_robot_state-ego_mean 0.03699118378345884 sim_compute_robot_state-ego_median 0.03695090611775717 sim_compute_robot_state-ego_min 0.03647946394406832 sim_compute_robot_state-npc0_max 0.03703382382026085 sim_compute_robot_state-npc0_mean 0.03585133404620796 sim_compute_robot_state-npc0_median 0.035739889627770534 sim_compute_robot_state-npc0_min 0.035439317043011 sim_compute_robot_state-npc1_max 0.03762519359588623 sim_compute_robot_state-npc1_mean 0.03597760945897378 sim_compute_robot_state-npc1_median 0.035804734230041504 sim_compute_robot_state-npc1_min 0.03524276188441685 sim_compute_robot_state-npc2_max 0.036879721141996835 sim_compute_robot_state-npc2_mean 0.03565173672013314 sim_compute_robot_state-npc2_median 0.03561942463829404 sim_compute_robot_state-npc2_min 0.03476527604189786 sim_compute_robot_state-npc3_max 0.03597043037414551 sim_compute_robot_state-npc3_mean 0.03557482670704617 sim_compute_robot_state-npc3_median 0.03556650706699916 sim_compute_robot_state-npc3_min 0.03505929311116537 sim_compute_sim_state_max 0.02232622405857716 sim_compute_sim_state_mean 0.020386806945375337 sim_compute_sim_state_median 0.020174053999093864 sim_compute_sim_state_min 0.020055976456510808 sim_physics_max 0.0902965160516592 sim_physics_mean 0.08128000477083328 sim_physics_median 0.08086198187888936 sim_physics_min 0.07718895435333252 sim_render-ego_max 0.033323841094970705 sim_render-ego_mean 0.03248859825835667 sim_render-ego_median 0.032463175909859796 sim_render-ego_min 0.031805604696273804 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible 22758
2814
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 01:27:44+00:00 2019-05-17 01:40:05+00:00 0:12:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.10099507669212504 in-drivable-lane_median 0.4499999999999984
other stats agent_compute-ego_max 0.08406064033508301 agent_compute-ego_mean 0.07988255274132959 agent_compute-ego_median 0.07933453952564913 agent_compute-ego_min 0.0790115197499593 deviation-center-line_max 0.2838635700333795 deviation-center-line_mean 0.12786165368054708 deviation-center-line_min 0.07112529346797256 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3391682685652287 deviation-heading_median 0.32928385103533875 deviation-heading_min 0.19401296908406307 driven_any_max 2.1706243860917107 driven_any_mean 0.9759490378276146 driven_any_median 1.0117660515775693 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 1.919400421063832 driven_lanedir_consec_mean 0.6896171461819246 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 1.919400421063832 driven_lanedir_mean 0.6896171461819246 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.5899999999999982 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.04049600053716589, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.031716991353918006, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0811302970956873, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.04913304028687654, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.01991147465176053, "sim_compute_performance-ego": 0.03488934481585467, "sim_compute_robot_state-ego": 0.036982571637188946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.03971535551781748, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.032250380983539655, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07924856391607546, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.048740022322710824, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.020247945598527495, "sim_compute_performance-ego": 0.035019977419984104, "sim_compute_robot_state-ego": 0.03704035515878715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.04346682043636546, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0321493008557488, "in-drivable-lane": 0, "agent_compute-ego": 0.0793310614193187, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.048760259852689856, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.01981369186850155, "sim_compute_performance-ego": 0.03513449781081256, "sim_compute_robot_state-ego": 0.0368345344767851}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.04195998191833496, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0321730899810791, "in-drivable-lane": 0, "agent_compute-ego": 0.08406064033508301, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.048550891876220706, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.019958391189575195, "sim_compute_performance-ego": 0.03463831901550293, "sim_compute_robot_state-ego": 0.037802114486694335}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.04047008405757856, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.032347522204435326, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07919234263746044, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.04951326454742045, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02020062977754617, "sim_compute_performance-ego": 0.035157816319526, "sim_compute_robot_state-ego": 0.03743522076667109}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.039853100873986066, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03202736621000329, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.07905399556062659, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0493373627565345, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02004294979329012, "sim_compute_performance-ego": 0.03492199644750478, "sim_compute_robot_state-ego": 0.03737764942402742}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.03865353124482291, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03234850083078657, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.07902286733899798, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05145572338785444, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.02010388033730643, "sim_compute_performance-ego": 0.035251736640930176, "sim_compute_robot_state-ego": 0.03658502868243626}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.043501240866524835, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03156669934590658, "in-drivable-lane": 0, "agent_compute-ego": 0.07913316999162946, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.04841228893824986, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.019844021115984236, "sim_compute_performance-ego": 0.03483070646013532, "sim_compute_robot_state-ego": 0.03708867799668085}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.040710578530521714, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03310443587222342, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0804105007042319, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.04984473778029619, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.02015957185777567, "sim_compute_performance-ego": 0.03570150520841954, "sim_compute_robot_state-ego": 0.03691873712054754}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.040827699141068895, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.032064628601074216, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.0796168717471036, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.04901751171458851, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.020396601070057262, "sim_compute_performance-ego": 0.03529777093367143, "sim_compute_robot_state-ego": 0.03697701800953258}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.04015307302598829, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03219540707476727, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08070238534506265, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.049953943723207946, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.020804346381843863, "sim_compute_performance-ego": 0.03524313034949365, "sim_compute_robot_state-ego": 0.03696220261710031}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.04150243316377912, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.032655341284615655, "in-drivable-lane": 0, "agent_compute-ego": 0.07958959681647164, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.04946574994495937, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02003248248781477, "sim_compute_performance-ego": 0.03582922901426043, "sim_compute_robot_state-ego": 0.03692769152777536}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.03949393945581773, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03157952720043706, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0790115197499593, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.049213591743918025, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.020080739376591702, "sim_compute_performance-ego": 0.03513287562949985, "sim_compute_robot_state-ego": 0.036904162051630954}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.041203048494127065, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.03177572179723669, "in-drivable-lane": 0, "agent_compute-ego": 0.07939993893658673, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.04966685507032606, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.01999495647571705, "sim_compute_performance-ego": 0.034668163016990376, "sim_compute_robot_state-ego": 0.03711348109775119}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.03860734958274692, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03195470454646092, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07933453952564913, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.04893013309029972, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.020009875297546387, "sim_compute_performance-ego": 0.03540206890480191, "sim_compute_robot_state-ego": 0.03710757751090854}}set_robot_commands_max 0.05145572338785444 set_robot_commands_mean 0.04933302513574354 set_robot_commands_median 0.049213591743918025 set_robot_commands_min 0.04841228893824986 sim_compute_performance-ego_max 0.03582922901426043 sim_compute_performance-ego_mean 0.03514127586582585 sim_compute_performance-ego_median 0.03513449781081256 sim_compute_performance-ego_min 0.03463831901550293 sim_compute_robot_state-ego_max 0.037802114486694335 sim_compute_robot_state-ego_mean 0.03707046817096784 sim_compute_robot_state-ego_median 0.036982571637188946 sim_compute_robot_state-ego_min 0.03658502868243626 sim_compute_sim_state_max 0.020804346381843863 sim_compute_sim_state_mean 0.02010677048532256 sim_compute_sim_state_median 0.02004294979329012 sim_compute_sim_state_min 0.01981369186850155 sim_physics_max 0.043501240866524835 sim_physics_mean 0.04070761578977639 sim_physics_median 0.04049600053716589 sim_physics_min 0.03860734958274692 sim_render-ego_max 0.03310443587222342 sim_render-ego_mean 0.03212730787614884 sim_render-ego_median 0.0321493008557488 sim_render-ego_min 0.03156669934590658 simulation-passed 1 survival_time_max 5.09999999999999 survival_time_mean 2.503333333333331 survival_time_min 0.8500000000000002
No reset possible 22757
2818
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation host-error yes nutonomy-P50-9747
2019-05-17 01:27:27+00:00 2019-05-17 01:27:37+00:00 0:00:10 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fdns4%2Fipfs.duckietown.org%2Ftcp%2F4001%2Fipfs%2FQmPyoL4ZwaTYtGsvFG8A5fG85tQH5sCHWtexkNVjqa52iK
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
allow_host_network=allow_host_network, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
res = client.swarm_connect(peer)
File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
return value(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
result = func(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
return func(self, *args, **merged)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
files, headers, data, timeout=timeout)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
self._do_raise_for_status(res)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
six.raise_from(exceptions.ErrorResponse(msg, error), error)
File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmPyoL4ZwaTYtGsvFG8A5fG85tQH5sCHWtexkNVjqa52iK failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID PyoL4Z> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22755
2819
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation host-error yes nutonomy-P50-9747
2019-05-17 01:27:07+00:00 2019-05-17 01:27:13+00:00 0:00:06 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fip4%2F129.132.0.37%2Ftcp%2F4001%2Fipfs%2FQmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
allow_host_network=allow_host_network, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
res = client.swarm_connect(peer)
File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
return value(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
result = func(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
return func(self, *args, **merged)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
files, headers, data, timeout=timeout)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
self._do_raise_for_status(res)
File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
six.raise_from(exceptions.ErrorResponse(msg, error), error)
File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9 failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID W5P8PZ> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22751
2831
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 01:26:16+00:00 2019-05-17 01:26:53+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22747
2840
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 01:25:18+00:00 2019-05-17 01:25:55+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22742
2847
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 01:24:00+00:00 2019-05-17 01:24:37+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22740
2848
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error yes nutonomy-P50-9747
2019-05-17 01:22:50+00:00 2019-05-17 01:23:27+00:00 0:00:37 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22730
2868
Peter Almasi 🇭🇺Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 01:09:08+00:00 2019-05-17 01:22:15+00:00 0:13:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5885414934234479 survival_time_median 2.25 deviation-center-line_median 0.10447263985717296 in-drivable-lane_median 0.5500000000000005
other stats agent_compute-ego_max 0.09468683382359946 agent_compute-ego_mean 0.09196903335644628 agent_compute-ego_median 0.09206134665246105 agent_compute-ego_min 0.09005194618588402 deviation-center-line_max 0.37621264593942727 deviation-center-line_mean 0.13059434128418543 deviation-center-line_min 0.06640840348138048 deviation-heading_max 1.988397647695644 deviation-heading_mean 0.7450004069261837 deviation-heading_median 0.5319310251869941 deviation-heading_min 0.19281043566106773 driven_any_max 2.3167988054662683 driven_any_mean 1.1012220956993768 driven_any_median 1.0034715487370909 driven_any_min 0.5889231238681565 driven_lanedir_consec_max 1.7731298647407658 driven_lanedir_consec_mean 0.5997903291955192 driven_lanedir_consec_min 0.2492937117080367 driven_lanedir_max 1.7785263612624065 driven_lanedir_mean 0.641868673177321 driven_lanedir_median 0.6064968425890118 driven_lanedir_min 0.26263992171444817 in-drivable-lane_max 1.6499999999999977 in-drivable-lane_mean 0.6833333333333329 in-drivable-lane_min 0.1499999999999997 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.015424119834213, "sim_physics": 0.03895984626397854, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6855046563537921, "sim_render-ego": 0.032237320411496045, "in-drivable-lane": 0.5, "agent_compute-ego": 0.09468683382359946, "deviation-heading": 0.3146134204397484, "set_robot_commands": 0.05036472111213498, "deviation-center-line": 0.08876804179724099, "driven_lanedir_consec": 0.6855046563537921, "sim_compute_sim_state": 0.020140438545040967, "sim_compute_performance-ego": 0.034891291362483326, "sim_compute_robot_state-ego": 0.03731899726681593}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0811996820971026, "sim_physics": 0.040049958229064944, "survival_time": 2.499999999999999, "driven_lanedir": 0.3417519223721328, "sim_render-ego": 0.03209218978881836, "in-drivable-lane": 1.549999999999999, "agent_compute-ego": 0.0912215280532837, "deviation-heading": 0.24495495950787743, "set_robot_commands": 0.05241588115692139, "deviation-center-line": 0.06640840348138048, "driven_lanedir_consec": 0.3417519223721328, "sim_compute_sim_state": 0.020667943954467773, "sim_compute_performance-ego": 0.03544701099395752, "sim_compute_robot_state-ego": 0.036734180450439455}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.998660052051846, "sim_physics": 0.04028624912788128, "survival_time": 2.8999999999999977, "driven_lanedir": 0.556497982243314, "sim_render-ego": 0.03255771768504176, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.09212851113286512, "deviation-heading": 1.988397647695644, "set_robot_commands": 0.05037529304109771, "deviation-center-line": 0.19899178061285744, "driven_lanedir_consec": 0.35446847716043406, "sim_compute_sim_state": 0.020399775998345734, "sim_compute_performance-ego": 0.0355105893365268, "sim_compute_robot_state-ego": 0.037551645574898554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5889231238681565, "sim_physics": 0.04017601994907155, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3111750075470283, "sim_render-ego": 0.0316315118004294, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09072012761059928, "deviation-heading": 0.916867991087866, "set_robot_commands": 0.049167240367216224, "deviation-center-line": 0.10447263985717296, "driven_lanedir_consec": 0.2492937117080367, "sim_compute_sim_state": 0.020003346835865694, "sim_compute_performance-ego": 0.03595089211183436, "sim_compute_robot_state-ego": 0.037491924622479605}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9572780127028024, "sim_physics": 0.03917511304219564, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4464615982778133, "sim_render-ego": 0.03281348092215402, "in-drivable-lane": 0.9500000000000002, "agent_compute-ego": 0.09369607198806036, "deviation-heading": 0.19281043566106773, "set_robot_commands": 0.053569243067786806, "deviation-center-line": 0.08291428856941858, "driven_lanedir_consec": 0.4464615982778133, "sim_compute_sim_state": 0.020928621292114254, "sim_compute_performance-ego": 0.03633812495640346, "sim_compute_robot_state-ego": 0.03854982058207194}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3167988054662683, "sim_physics": 0.039170085167398255, "survival_time": 4.899999999999991, "driven_lanedir": 1.7785263612624065, "sim_render-ego": 0.032392745115319074, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09079765543645742, "deviation-heading": 1.6832008610634357, "set_robot_commands": 0.049745975708474915, "deviation-center-line": 0.37621264593942727, "driven_lanedir_consec": 1.7731298647407658, "sim_compute_sim_state": 0.020246354901060765, "sim_compute_performance-ego": 0.03559680617585474, "sim_compute_robot_state-ego": 0.036950821779212176}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9841715436990536, "sim_physics": 0.040805816650390625, "survival_time": 2.1000000000000005, "driven_lanedir": 0.5079943433524821, "sim_render-ego": 0.03209971813928513, "in-drivable-lane": 0.8500000000000001, "agent_compute-ego": 0.09005194618588402, "deviation-heading": 0.32945499107350396, "set_robot_commands": 0.05027244772229876, "deviation-center-line": 0.07761654864312081, "driven_lanedir_consec": 0.5079943433524821, "sim_compute_sim_state": 0.020858758971804663, "sim_compute_performance-ego": 0.03530928634461902, "sim_compute_robot_state-ego": 0.036822585832505}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6087946046105039, "sim_physics": 0.04201486706733704, "survival_time": 1.6000000000000008, "driven_lanedir": 0.26263992171444817, "sim_render-ego": 0.033352114260196686, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09230123460292816, "deviation-heading": 0.4417737502963447, "set_robot_commands": 0.04986698180437088, "deviation-center-line": 0.06733815764720119, "driven_lanedir_consec": 0.26263992171444817, "sim_compute_sim_state": 0.0199410617351532, "sim_compute_performance-ego": 0.03540212661027908, "sim_compute_robot_state-ego": 0.03710438311100006}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.1933998133228594, "sim_physics": 0.04129302501678467, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8809374204081752, "sim_render-ego": 0.03276078059123112, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09204561893756572, "deviation-heading": 0.4067278067046391, "set_robot_commands": 0.04974098388965313, "deviation-center-line": 0.08575798987317822, "driven_lanedir_consec": 0.8781058713701944, "sim_compute_sim_state": 0.02065509557723999, "sim_compute_performance-ego": 0.03599970157329853, "sim_compute_robot_state-ego": 0.03733115929823656}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9918847554228204, "sim_physics": 0.04007272720336914, "survival_time": 2.25, "driven_lanedir": 0.6064968425890118, "sim_render-ego": 0.032299539777967665, "in-drivable-lane": 0.4499999999999995, "agent_compute-ego": 0.09245450231764052, "deviation-heading": 0.7563061787136699, "set_robot_commands": 0.050040112601386175, "deviation-center-line": 0.10780199688895407, "driven_lanedir_consec": 0.5885414934234479, "sim_compute_sim_state": 0.02005506091647678, "sim_compute_performance-ego": 0.035206270217895505, "sim_compute_robot_state-ego": 0.0376078552669949}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9093569820232807, "sim_physics": 0.04011066555976868, "survival_time": 2.000000000000001, "driven_lanedir": 0.3680406089872187, "sim_render-ego": 0.032709598541259766, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.0910205066204071, "deviation-heading": 0.31701735635158956, "set_robot_commands": 0.050066953897476195, "deviation-center-line": 0.07016829513471222, "driven_lanedir_consec": 0.3680406089872187, "sim_compute_sim_state": 0.020284026861190796, "sim_compute_performance-ego": 0.03497624397277832, "sim_compute_robot_state-ego": 0.03744492530822754}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0307605485359177, "sim_physics": 0.04092670546637641, "survival_time": 2.25, "driven_lanedir": 0.6546656167898023, "sim_render-ego": 0.03234973483615451, "in-drivable-lane": 0.45, "agent_compute-ego": 0.09253588252597383, "deviation-heading": 0.7960414391210141, "set_robot_commands": 0.04949850506252713, "deviation-center-line": 0.1393907642699906, "driven_lanedir_consec": 0.6322304263470951, "sim_compute_sim_state": 0.02002632353040907, "sim_compute_performance-ego": 0.03515705002678765, "sim_compute_robot_state-ego": 0.03809114032321506}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7569757882184522, "sim_physics": 0.037990452330789445, "survival_time": 4.049999999999994, "driven_lanedir": 0.748673569379265, "sim_render-ego": 0.03264433954968864, "in-drivable-lane": 1.6499999999999977, "agent_compute-ego": 0.09146052525367264, "deviation-heading": 1.0013052229641988, "set_robot_commands": 0.049963144608485846, "deviation-center-line": 0.20018959449728585, "driven_lanedir_consec": 0.6081542545118002, "sim_compute_sim_state": 0.02015013164944119, "sim_compute_performance-ego": 0.0349487316461257, "sim_compute_robot_state-ego": 0.037048027839189694}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0812320549002832, "sim_physics": 0.04058742990680769, "survival_time": 2.549999999999999, "driven_lanedir": 0.7866871619296378, "sim_render-ego": 0.03241820896373076, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.09206134665246105, "deviation-heading": 1.2536030180251625, "set_robot_commands": 0.05006611580942191, "deviation-center-line": 0.17448299281046964, "driven_lanedir_consec": 0.6253146234708695, "sim_compute_sim_state": 0.020345154930563533, "sim_compute_performance-ego": 0.0355070104785994, "sim_compute_robot_state-ego": 0.03725889617321538}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.0034715487370909, "sim_physics": 0.04146402815113897, "survival_time": 2.3, "driven_lanedir": 0.6919770844532871, "sim_render-ego": 0.03263040729190992, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.09235320920529572, "deviation-heading": 0.5319310251869941, "set_robot_commands": 0.05017643389494523, "deviation-center-line": 0.11840097924037146, "driven_lanedir_consec": 0.6752231641422584, "sim_compute_sim_state": 0.02023744064828624, "sim_compute_performance-ego": 0.03545595251995584, "sim_compute_robot_state-ego": 0.03760224321614141}}set_robot_commands_max 0.053569243067786806 set_robot_commands_mean 0.05035533558294648 set_robot_commands_median 0.05006611580942191 set_robot_commands_min 0.049167240367216224 sim_compute_performance-ego_max 0.03633812495640346 sim_compute_performance-ego_mean 0.03544647255515995 sim_compute_performance-ego_median 0.03544701099395752 sim_compute_performance-ego_min 0.034891291362483326 sim_compute_robot_state-ego_max 0.03854982058207194 sim_compute_robot_state-ego_mean 0.03739390710964288 sim_compute_robot_state-ego_median 0.03733115929823656 sim_compute_robot_state-ego_min 0.036734180450439455 sim_compute_sim_state_max 0.020928621292114254 sim_compute_sim_state_mean 0.02032930242316405 sim_compute_sim_state_median 0.020246354901060765 sim_compute_sim_state_min 0.0199410617351532 sim_physics_max 0.04201486706733704 sim_physics_mean 0.04020553260882352 sim_physics_median 0.04017601994907155 sim_physics_min 0.037990452330789445 sim_render-ego_max 0.033352114260196686 sim_render-ego_mean 0.03246596051164553 sim_render-ego_median 0.03241820896373076 sim_render-ego_min 0.0316315118004294 simulation-passed 1 survival_time_max 4.899999999999991 survival_time_mean 2.523333333333332 survival_time_min 1.6000000000000008
No reset possible 22713
2920
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LF-sim-testing
step1-simulation success yes nutonomy-P50-9747
2019-05-17 00:58:31+00:00 2019-05-17 01:08:41+00:00 0:10:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07158673794245063 survival_time_median 1.3500000000000003 deviation-center-line_median 0.06608240685201971 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0899724077295374 agent_compute-ego_mean 0.08744085143696093 agent_compute-ego_median 0.08724072817209605 agent_compute-ego_min 0.0846339225769043 deviation-center-line_max 0.12472209448104056 deviation-center-line_mean 0.07825262092019689 deviation-center-line_min 0.04927027945218111 deviation-heading_max 0.9205106098327462 deviation-heading_mean 0.7906993837132256 deviation-heading_median 0.8408022352329987 deviation-heading_min 0.4854931921059073 driven_any_max 0.20104404950498284 driven_any_mean 0.1532752282483308 driven_any_median 0.1470390884460707 driven_any_min 0.09322908353936342 driven_lanedir_consec_max 0.14052137816915788 driven_lanedir_consec_mean 0.0810999113480628 driven_lanedir_consec_min 0.03111203047955735 driven_lanedir_max 0.14052137816915788 driven_lanedir_mean 0.0810999113480628 driven_lanedir_median 0.07158673794245063 driven_lanedir_min 0.03111203047955735 in-drivable-lane_max 0.8500000000000005 in-drivable-lane_mean 0.1700000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2005656054822796, "sim_physics": 0.04052538871765136, "survival_time": 2.000000000000001, "driven_lanedir": 0.0517787602083688, "sim_render-ego": 0.03202379941940307, "in-drivable-lane": 0.8500000000000005, "agent_compute-ego": 0.08904731869697571, "deviation-heading": 0.7141433377212214, "set_robot_commands": 0.05031598806381225, "deviation-center-line": 0.06122970154255067, "driven_lanedir_consec": 0.0517787602083688, "sim_compute_sim_state": 0.020115262269973753, "sim_compute_performance-ego": 0.0355165958404541, "sim_compute_robot_state-ego": 0.036825031042099}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20104404950498284, "sim_physics": 0.04064951837062836, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12896244607290286, "sim_render-ego": 0.035058289766311646, "in-drivable-lane": 0, "agent_compute-ego": 0.08627792447805405, "deviation-heading": 0.9204725877249657, "set_robot_commands": 0.04903363436460495, "deviation-center-line": 0.06608240685201971, "driven_lanedir_consec": 0.12896244607290286, "sim_compute_sim_state": 0.019657492637634277, "sim_compute_performance-ego": 0.034907467663288116, "sim_compute_robot_state-ego": 0.03708796948194504}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09322908353936342, "sim_physics": 0.04007787931533087, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0564597012955006, "sim_render-ego": 0.03156052316938128, "in-drivable-lane": 0, "agent_compute-ego": 0.08740444410414923, "deviation-heading": 0.6950216693210383, "set_robot_commands": 0.04851889610290527, "deviation-center-line": 0.0942554393901761, "driven_lanedir_consec": 0.0564597012955006, "sim_compute_sim_state": 0.020133563450404575, "sim_compute_performance-ego": 0.03488615580967495, "sim_compute_robot_state-ego": 0.03732814107622419}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17817856557718134, "sim_physics": 0.043682298352641445, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07158673794245063, "sim_render-ego": 0.03262079146600539, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08743914481132262, "deviation-heading": 0.9053006068378135, "set_robot_commands": 0.04946755593822848, "deviation-center-line": 0.05715555530998222, "driven_lanedir_consec": 0.07158673794245063, "sim_compute_sim_state": 0.020297535004154328, "sim_compute_performance-ego": 0.03506059031332693, "sim_compute_robot_state-ego": 0.03723992070844097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17789848299222463, "sim_physics": 0.04174615355098949, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08828905286060929, "sim_render-ego": 0.03254326652078068, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.08948341537924374, "deviation-heading": 0.9205106098327462, "set_robot_commands": 0.0497132890364703, "deviation-center-line": 0.05863399460166732, "driven_lanedir_consec": 0.08828905286060929, "sim_compute_sim_state": 0.019999034264508418, "sim_compute_performance-ego": 0.03478666614083683, "sim_compute_robot_state-ego": 0.036934824550853056}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1895834778167244, "sim_physics": 0.04251188845247836, "survival_time": 1.850000000000001, "driven_lanedir": 0.03111203047955735, "sim_render-ego": 0.032652358751039244, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.08724072817209605, "deviation-heading": 0.8618383903122427, "set_robot_commands": 0.0494433931402258, "deviation-center-line": 0.05833395362900171, "driven_lanedir_consec": 0.03111203047955735, "sim_compute_sim_state": 0.02009951746141588, "sim_compute_performance-ego": 0.03608305389816697, "sim_compute_robot_state-ego": 0.037755618224272855}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1869026551080358, "sim_physics": 0.043224544236154266, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14052137816915788, "sim_render-ego": 0.032302198988018616, "in-drivable-lane": 0, "agent_compute-ego": 0.08890543561993224, "deviation-heading": 0.8408022352329987, "set_robot_commands": 0.04980723785631584, "deviation-center-line": 0.11416869572164154, "driven_lanedir_consec": 0.14052137816915788, "sim_compute_sim_state": 0.020109422279126717, "sim_compute_performance-ego": 0.035104802160552055, "sim_compute_robot_state-ego": 0.03764958092660615}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1033870023337533, "sim_physics": 0.04260275477454776, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07007326041275697, "sim_render-ego": 0.031496013913835795, "in-drivable-lane": 0, "agent_compute-ego": 0.08638300214494977, "deviation-heading": 0.6360732372271093, "set_robot_commands": 0.04900170507885161, "deviation-center-line": 0.09116414622074204, "driven_lanedir_consec": 0.07007326041275697, "sim_compute_sim_state": 0.020231315067836216, "sim_compute_performance-ego": 0.03564092091151646, "sim_compute_robot_state-ego": 0.03713761057172503}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.13082081850917188, "sim_physics": 0.04172055537884052, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0665814714006201, "sim_render-ego": 0.03256851893204909, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08723572584298941, "deviation-heading": 0.8497151398181275, "set_robot_commands": 0.050502502001248874, "deviation-center-line": 0.04927027945218111, "driven_lanedir_consec": 0.0665814714006201, "sim_compute_sim_state": 0.02027481335860032, "sim_compute_performance-ego": 0.03563515956585224, "sim_compute_robot_state-ego": 0.037157691442049466}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.10687096842728164, "sim_physics": 0.0429112720489502, "survival_time": 1.2500000000000004, "driven_lanedir": 0.05642687544065117, "sim_render-ego": 0.032940006256103514, "in-drivable-lane": 0, "agent_compute-ego": 0.08817813873291015, "deviation-heading": 0.8078099529903776, "set_robot_commands": 0.04909526824951172, "deviation-center-line": 0.08683705894284759, "driven_lanedir_consec": 0.05642687544065117, "sim_compute_sim_state": 0.01993614196777344, "sim_compute_performance-ego": 0.03569777488708496, "sim_compute_robot_state-ego": 0.03733397483825684}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1470390884460707, "sim_physics": 0.040786531236436635, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11622688714402264, "sim_render-ego": 0.03284203564679181, "in-drivable-lane": 0, "agent_compute-ego": 0.0899724077295374, "deviation-heading": 0.5939272917649253, "set_robot_commands": 0.049409716217606155, "deviation-center-line": 0.1159736520363788, "driven_lanedir_consec": 0.11622688714402264, "sim_compute_sim_state": 0.020615303957903827, "sim_compute_performance-ego": 0.034628347114280415, "sim_compute_robot_state-ego": 0.036817709604899086}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11764582676770426, "sim_physics": 0.042272366010225736, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06376296949631344, "sim_render-ego": 0.03640511402717003, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08700016828683707, "deviation-heading": 0.8390689861434011, "set_robot_commands": 0.0497518227650569, "deviation-center-line": 0.07371404618229968, "driven_lanedir_consec": 0.06376296949631344, "sim_compute_sim_state": 0.019874068406911995, "sim_compute_performance-ego": 0.03557021801288311, "sim_compute_robot_state-ego": 0.036955989324129544}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.19046622053232137, "sim_physics": 0.04110651156481575, "survival_time": 1.7000000000000008, "driven_lanedir": 0.09139504586964198, "sim_render-ego": 0.03390188076916863, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.08593611857470344, "deviation-heading": 0.8766157187457224, "set_robot_commands": 0.04977672941544477, "deviation-center-line": 0.061370071819003794, "driven_lanedir_consec": 0.09139504586964198, "sim_compute_sim_state": 0.020363569259643555, "sim_compute_performance-ego": 0.03553156992968391, "sim_compute_robot_state-ego": 0.036627979839549345}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13990225046977053, "sim_physics": 0.041807212829589845, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07383233252907173, "sim_render-ego": 0.031493520736694335, "in-drivable-lane": 0, "agent_compute-ego": 0.0846339225769043, "deviation-heading": 0.9136977999197856, "set_robot_commands": 0.04899620056152344, "deviation-center-line": 0.06087821762142067, "driven_lanedir_consec": 0.07383233252907173, "sim_compute_sim_state": 0.020046863555908203, "sim_compute_performance-ego": 0.03481867790222168, "sim_compute_robot_state-ego": 0.036924924850463864}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.13559432821809636, "sim_physics": 0.04209183692932129, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10948972089931663, "sim_render-ego": 0.03202202796936035, "in-drivable-lane": 0, "agent_compute-ego": 0.08647487640380859, "deviation-heading": 0.4854931921059073, "set_robot_commands": 0.04931802749633789, "deviation-center-line": 0.12472209448104056, "driven_lanedir_consec": 0.10948972089931663, "sim_compute_sim_state": 0.019855756759643555, "sim_compute_performance-ego": 0.034697961807250974, "sim_compute_robot_state-ego": 0.03684240341186523}}set_robot_commands_max 0.050502502001248874 set_robot_commands_mean 0.04947679775254295 set_robot_commands_median 0.0494433931402258 set_robot_commands_min 0.04851889610290527 sim_compute_performance-ego_max 0.03608305389816697 sim_compute_performance-ego_mean 0.035237730797138246 sim_compute_performance-ego_median 0.035104802160552055 sim_compute_performance-ego_min 0.034628347114280415 sim_compute_robot_state-ego_max 0.037755618224272855 sim_compute_robot_state-ego_mean 0.03710795799289198 sim_compute_robot_state-ego_median 0.03708796948194504 sim_compute_robot_state-ego_min 0.036627979839549345 sim_compute_sim_state_max 0.020615303957903827 sim_compute_sim_state_mean 0.0201073106467626 sim_compute_sim_state_median 0.020109422279126717 sim_compute_sim_state_min 0.019657492637634277 sim_physics_max 0.043682298352641445 sim_physics_mean 0.041847780784573456 sim_physics_median 0.041807212829589845 sim_physics_min 0.04007787931533087 sim_render-ego_max 0.03640511402717003 sim_render-ego_mean 0.03282868975547423 sim_render-ego_median 0.03256851893204909 sim_render-ego_min 0.031493520736694335 simulation-passed 1 survival_time_max 2.000000000000001 survival_time_mean 1.4566666666666672 survival_time_min 1.0500000000000005
No reset possible 22707
2929
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFVI-sim-validation
step1-simulation success yes nutonomy-P50-9747
2019-05-17 00:52:58+00:00 2019-05-17 00:58:03+00:00 0:05:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.20453316292280643 survival_time_median 1.4500000000000006 deviation-center-line_median 0.1065996517661108 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.09194540208385836 agent_compute-ego_mean 0.08903485944469484 agent_compute-ego_median 0.08843268394470215 agent_compute-ego_min 0.08747576872507731 deviation-center-line_max 0.13401789425715713 deviation-center-line_mean 0.10617555620835892 deviation-center-line_min 0.06588707467883789 deviation-heading_max 0.924065884293969 deviation-heading_mean 0.6496683954885244 deviation-heading_median 0.6374844357576805 deviation-heading_min 0.4232817057268506 driven_any_max 0.2687247005644067 driven_any_mean 0.23277262815534047 driven_any_median 0.23720898108388672 driven_any_min 0.19084113241363876 driven_lanedir_consec_max 0.21365027801071124 driven_lanedir_consec_mean 0.18901484195870985 driven_lanedir_consec_min 0.15227991498091664 driven_lanedir_max 0.21365027801071124 driven_lanedir_mean 0.18901484195870985 driven_lanedir_median 0.20453316292280643 driven_lanedir_min 0.15227991498091664 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.2687247005644067, "sim_physics": 0.08053725765597436, "survival_time": 1.5500000000000007, "driven_lanedir": 0.2052858398503823, "sim_render-ego": 0.032356316043484594, "in-drivable-lane": 0, "agent_compute-ego": 0.09194540208385836, "deviation-heading": 0.8016715314787447, "set_robot_commands": 0.05055078383414976, "deviation-center-line": 0.1065996517661108, "driven_lanedir_consec": 0.2052858398503823, "sim_compute_sim_state": 0.020283506762596867, "sim_compute_performance-ego": 0.03480807427437075, "sim_compute_robot_state-ego": 0.03698015213012695, "sim_compute_robot_state-npc0": 0.03548542145759829, "sim_compute_robot_state-npc1": 0.03505106895200668, "sim_compute_robot_state-npc2": 0.035350776487781156, "sim_compute_robot_state-npc3": 0.035224030094762}, "udem1-1-0": {"driven_any": 0.23720898108388672, "sim_physics": 0.0838818961176379, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16932501402873257, "sim_render-ego": 0.03314875734263453, "in-drivable-lane": 0, "agent_compute-ego": 0.08794723708054115, "deviation-heading": 0.924065884293969, "set_robot_commands": 0.05214738023692164, "deviation-center-line": 0.10124575035370076, "driven_lanedir_consec": 0.16932501402873257, "sim_compute_sim_state": 0.020609165060109104, "sim_compute_performance-ego": 0.03446468813665982, "sim_compute_robot_state-ego": 0.03667653840163659, "sim_compute_robot_state-npc0": 0.03626825069559032, "sim_compute_robot_state-npc1": 0.03661921106535813, "sim_compute_robot_state-npc2": 0.036330445059414566, "sim_compute_robot_state-npc3": 0.03677774297780004}, "udem1-2-0": {"driven_any": 0.2389609237721994, "sim_physics": 0.09283319314320884, "survival_time": 1.5000000000000009, "driven_lanedir": 0.21365027801071124, "sim_render-ego": 0.032239278157552086, "in-drivable-lane": 0, "agent_compute-ego": 0.08747576872507731, "deviation-heading": 0.4618384201853773, "set_robot_commands": 0.04832928180694581, "deviation-center-line": 0.13401789425715713, "driven_lanedir_consec": 0.21365027801071124, "sim_compute_sim_state": 0.021012489000956217, "sim_compute_performance-ego": 0.03506945768992106, "sim_compute_robot_state-ego": 0.03687240282694499, "sim_compute_robot_state-npc0": 0.03633581797281901, "sim_compute_robot_state-npc1": 0.03664944966634114, "sim_compute_robot_state-npc2": 0.03629121780395508, "sim_compute_robot_state-npc3": 0.03658889929453532}, "udem1-3-0": {"driven_any": 0.22812740294257092, "sim_physics": 0.08507010766438075, "survival_time": 1.4000000000000006, "driven_lanedir": 0.20453316292280643, "sim_render-ego": 0.03265414919172015, "in-drivable-lane": 0, "agent_compute-ego": 0.0893732053892953, "deviation-heading": 0.4232817057268506, "set_robot_commands": 0.04877062354769025, "deviation-center-line": 0.123127409985988, "driven_lanedir_consec": 0.20453316292280643, "sim_compute_sim_state": 0.020934624331338064, "sim_compute_performance-ego": 0.03492919887815203, "sim_compute_robot_state-ego": 0.03662632192884173, "sim_compute_robot_state-npc0": 0.03582933970860073, "sim_compute_robot_state-npc1": 0.03566129718508039, "sim_compute_robot_state-npc2": 0.03558442422321865, "sim_compute_robot_state-npc3": 0.03591504267283848}, "udem1-4-0": {"driven_any": 0.19084113241363876, "sim_physics": 0.08167321205139161, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15227991498091664, "sim_render-ego": 0.03231807708740234, "in-drivable-lane": 0, "agent_compute-ego": 0.08843268394470215, "deviation-heading": 0.6374844357576805, "set_robot_commands": 0.050458002090454104, "deviation-center-line": 0.06588707467883789, "driven_lanedir_consec": 0.15227991498091664, "sim_compute_sim_state": 0.01998819351196289, "sim_compute_performance-ego": 0.03535227775573731, "sim_compute_robot_state-ego": 0.03708992958068848, "sim_compute_robot_state-npc0": 0.035353565216064455, "sim_compute_robot_state-npc1": 0.03569354057312012, "sim_compute_robot_state-npc2": 0.03507904052734375, "sim_compute_robot_state-npc3": 0.03496994972229004}}set_robot_commands_max 0.05214738023692164 set_robot_commands_mean 0.050051214303232304 set_robot_commands_median 0.050458002090454104 set_robot_commands_min 0.04832928180694581 sim_compute_performance-ego_max 0.03535227775573731 sim_compute_performance-ego_mean 0.034924739346968194 sim_compute_performance-ego_median 0.03492919887815203 sim_compute_performance-ego_min 0.03446468813665982 sim_compute_robot_state-ego_max 0.03708992958068848 sim_compute_robot_state-ego_mean 0.036849068973647744 sim_compute_robot_state-ego_median 0.03687240282694499 sim_compute_robot_state-ego_min 0.03662632192884173 sim_compute_robot_state-npc0_max 0.03633581797281901 sim_compute_robot_state-npc0_mean 0.03585447901013456 sim_compute_robot_state-npc0_median 0.03582933970860073 sim_compute_robot_state-npc0_min 0.035353565216064455 sim_compute_robot_state-npc1_max 0.03664944966634114 sim_compute_robot_state-npc1_mean 0.03593491348838129 sim_compute_robot_state-npc1_median 0.03569354057312012 sim_compute_robot_state-npc1_min 0.03505106895200668 sim_compute_robot_state-npc2_max 0.036330445059414566 sim_compute_robot_state-npc2_mean 0.03572718082034264 sim_compute_robot_state-npc2_median 0.03558442422321865 sim_compute_robot_state-npc2_min 0.03507904052734375 sim_compute_robot_state-npc3_max 0.03677774297780004 sim_compute_robot_state-npc3_mean 0.035895132952445175 sim_compute_robot_state-npc3_median 0.03591504267283848 sim_compute_robot_state-npc3_min 0.03496994972229004 sim_compute_sim_state_max 0.021012489000956217 sim_compute_sim_state_mean 0.020565595733392627 sim_compute_sim_state_median 0.020609165060109104 sim_compute_sim_state_min 0.01998819351196289 sim_physics_max 0.09283319314320884 sim_physics_mean 0.08479913332651869 sim_physics_median 0.0838818961176379 sim_physics_min 0.08053725765597436 sim_render-ego_max 0.03314875734263453 sim_render-ego_mean 0.03254331556455874 sim_render-ego_median 0.032356316043484594 sim_render-ego_min 0.032239278157552086 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.4300000000000004 survival_time_min 1.2500000000000004
No reset possible 22705
2936
Bhairav Mehta Baseline solution using reinforcement learning aido2-LFV-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 00:52:14+00:00 2019-05-17 00:52:50+00:00 0:00:36 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22703
2940
Bhairav Mehta Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation error yes nutonomy-P50-9747
2019-05-17 00:51:11+00:00 2019-05-17 00:51:53+00:00 0:00:42 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22685
3494
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-real-validation
eval0-videos success no nutonomy-P50-9747
2019-05-17 00:20:28+00:00 2019-05-17 00:50:44+00:00 0:30:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22628
3535
Peter Almasi 🇭🇺Baseline solution using reinforcement learning aido2-LF-real-validation
eval0-extractATs aborted no nutonomy-P50-9747
2019-05-16 23:57:01+00:00 2019-05-17 00:20:13+00:00 0:23:12 The result file is n [...] The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628:
File '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628/challenge-results/challenge_results.yaml' does not exist.
This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 22619
3535
Peter Almasi 🇭🇺Baseline solution using reinforcement learning aido2-LF-real-validation
eval0-videos success no nutonomy-P50-9747
2019-05-16 23:37:21+00:00 2019-05-16 23:56:39+00:00 0:19:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible