Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 192142981Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testingstep1-simulation timeout no nutonomy-P50-63182019-04-24 12:55:19+00:00 2019-04-24 14:01:07+00:00 1:05:48 I can see how the jo [...] I can see how the job 19214 is timeout because passed 3948 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 192102964Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testingstep1-simulation success no nutonomy-P50-63182019-04-24 12:35:44+00:00 2019-04-24 12:54:39+00:00 0:18:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5667290884960443 survival_time_median 14.950000000000076 deviation-center-line_median 0.398324515619486 in-drivable-lane_median 3.200000000000018
other stats agent_compute-ego_max 0.1167363399683043 agent_compute-ego_mean 0.11450816581953348 agent_compute-ego_median 0.11631455230074982 agent_compute-ego_min 0.11113672971725463 deviation-center-line_max 0.9346331265421992 deviation-center-line_mean 0.5654450530961703 deviation-center-line_min 0.18970047786435376 deviation-heading_max 6.016161144404485 deviation-heading_mean 2.3093260500374457 deviation-heading_median 1.3963345862077443 deviation-heading_min 1.313315170416522 driven_any_max 1.6929429087638026 driven_any_mean 1.453818242837175 driven_any_median 1.52323920285428 driven_any_min 0.9442529884243072 driven_lanedir_consec_max 1.5839289106952368 driven_lanedir_consec_mean 0.856514431924443 driven_lanedir_consec_min 0.5300766732460096 driven_lanedir_max 1.5839289106952368 driven_lanedir_mean 0.8604328547035124 driven_lanedir_median 0.5827543313206553 driven_lanedir_min 0.5300766732460096 in-drivable-lane_max 8.900000000000091 in-drivable-lane_mean 4.470000000000039 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.6929429087638026, "sim_physics": 0.01881798772907576, "survival_time": 14.950000000000076, "driven_lanedir": 1.0734160333678644, "sim_render-ego": 0.03516330687098679, "in-drivable-lane": 3.200000000000018, "agent_compute-ego": 0.11631455230074982, "deviation-heading": 6.016161144404485, "set_robot_commands": 0.05276405771440487, "deviation-center-line": 0.9076187546535042, "driven_lanedir_consec": 1.0698491622971285, "sim_compute_sim_state": 0.02170496481318139, "sim_compute_performance-ego": 0.03741805529514683, "sim_compute_robot_state-ego": 0.038864646866967445, "sim_compute_robot_state-npc0": 0.03858670422863402, "sim_compute_robot_state-npc1": 0.03844837759649475, "sim_compute_robot_state-npc2": 0.03848241643363417, "sim_compute_robot_state-npc3": 0.03895322534950282}, "udem1-1-0": {"driven_any": 0.9442529884243072, "sim_physics": 0.01869792161985885, "survival_time": 6.449999999999985, "driven_lanedir": 0.5827543313206553, "sim_render-ego": 0.0362623089043669, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.1167363399683043, "deviation-heading": 1.3963345862077443, "set_robot_commands": 0.05291020223336627, "deviation-center-line": 0.18970047786435376, "driven_lanedir_consec": 0.5667290884960443, "sim_compute_sim_state": 0.021647915359615355, "sim_compute_performance-ego": 0.037437817847081854, "sim_compute_robot_state-ego": 0.039199999136518136, "sim_compute_robot_state-npc0": 0.038642700328383336, "sim_compute_robot_state-npc1": 0.03886322827302208, "sim_compute_robot_state-npc2": 0.03840385666189268, "sim_compute_robot_state-npc3": 0.03818011468695116}, "udem1-2-0": {"driven_any": 1.52323920285428, "sim_physics": 0.017436470985412598, "survival_time": 14.950000000000076, "driven_lanedir": 0.5319883248877959, "sim_render-ego": 0.03397969802220662, "in-drivable-lane": 8.85000000000009, "agent_compute-ego": 0.11178709268569946, "deviation-heading": 1.323917909927847, "set_robot_commands": 0.05163753986358643, "deviation-center-line": 0.398324515619486, "driven_lanedir_consec": 0.5319883248877959, "sim_compute_sim_state": 0.021354300181070963, "sim_compute_performance-ego": 0.03648407300313314, "sim_compute_robot_state-ego": 0.03723074595133464, "sim_compute_robot_state-npc0": 0.03763383944829305, "sim_compute_robot_state-npc1": 0.037264169057210285, "sim_compute_robot_state-npc2": 0.03697995662689209, "sim_compute_robot_state-npc3": 0.03728773832321167}, "udem1-3-0": {"driven_any": 1.5115029157601982, "sim_physics": 0.018037375609079996, "survival_time": 14.950000000000076, "driven_lanedir": 0.5300766732460096, "sim_render-ego": 0.033592127958933515, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.11113672971725463, "deviation-heading": 1.313315170416522, "set_robot_commands": 0.05136369387308756, "deviation-center-line": 0.39694839080130834, "driven_lanedir_consec": 0.5300766732460096, "sim_compute_sim_state": 0.021049261887868244, "sim_compute_performance-ego": 0.03614336649576823, "sim_compute_robot_state-ego": 0.037852206230163575, "sim_compute_robot_state-npc0": 0.0374018398920695, "sim_compute_robot_state-npc1": 0.03703181425730387, "sim_compute_robot_state-npc2": 0.03684073527654013, "sim_compute_robot_state-npc3": 0.03721197366714477}, "udem1-4-0": {"driven_any": 1.5971531983832885, "sim_physics": 0.01833004792531331, "survival_time": 14.950000000000076, "driven_lanedir": 1.5839289106952368, "sim_render-ego": 0.03555997769037882, "in-drivable-lane": 0, "agent_compute-ego": 0.11656611442565916, "deviation-heading": 1.4969014392306297, "set_robot_commands": 0.05252784570058187, "deviation-center-line": 0.9346331265421992, "driven_lanedir_consec": 1.5839289106952368, "sim_compute_sim_state": 0.02190232038497925, "sim_compute_performance-ego": 0.03779081106185913, "sim_compute_robot_state-ego": 0.03919035275777181, "sim_compute_robot_state-npc0": 0.0395637853940328, "sim_compute_robot_state-npc1": 0.03867676655451457, "sim_compute_robot_state-npc2": 0.038220164775848386, "sim_compute_robot_state-npc3": 0.03915022850036621}}set_robot_commands_max 0.05291020223336627 set_robot_commands_mean 0.05224066787700539 set_robot_commands_median 0.05252784570058187 set_robot_commands_min 0.05136369387308756 sim_compute_performance-ego_max 0.03779081106185913 sim_compute_performance-ego_mean 0.03705482474059784 sim_compute_performance-ego_median 0.03741805529514683 sim_compute_performance-ego_min 0.03614336649576823 sim_compute_robot_state-ego_max 0.039199999136518136 sim_compute_robot_state-ego_mean 0.03846759018855112 sim_compute_robot_state-ego_median 0.038864646866967445 sim_compute_robot_state-ego_min 0.03723074595133464 sim_compute_robot_state-npc0_max 0.0395637853940328 sim_compute_robot_state-npc0_mean 0.038365773858282534 sim_compute_robot_state-npc0_median 0.03858670422863402 sim_compute_robot_state-npc0_min 0.0374018398920695 sim_compute_robot_state-npc1_max 0.03886322827302208 sim_compute_robot_state-npc1_mean 0.03805687114770911 sim_compute_robot_state-npc1_median 0.03844837759649475 sim_compute_robot_state-npc1_min 0.03703181425730387 sim_compute_robot_state-npc2_max 0.03848241643363417 sim_compute_robot_state-npc2_mean 0.03778542595496149 sim_compute_robot_state-npc2_median 0.038220164775848386 sim_compute_robot_state-npc2_min 0.03684073527654013 sim_compute_robot_state-npc3_max 0.03915022850036621 sim_compute_robot_state-npc3_mean 0.03815665610543533 sim_compute_robot_state-npc3_median 0.03818011468695116 sim_compute_robot_state-npc3_min 0.03721197366714477 sim_compute_sim_state_max 0.02190232038497925 sim_compute_sim_state_mean 0.02153175252534304 sim_compute_sim_state_median 0.021647915359615355 sim_compute_sim_state_min 0.021049261887868244 sim_physics_max 0.01881798772907576 sim_physics_mean 0.018263960773748103 sim_physics_median 0.01833004792531331 sim_physics_min 0.017436470985412598 sim_render-ego_max 0.0362623089043669 sim_render-ego_mean 0.03491148388937453 sim_render-ego_median 0.03516330687098679 sim_render-ego_min 0.033592127958933515 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.250000000000057 survival_time_min 6.449999999999985
No reset possible 192072970Andrea Censi minimal_agent (Python 3) aido2-LF-sim-testingstep1-simulation success no nutonomy-P50-63182019-04-24 12:25:38+00:00 2019-04-24 12:35:03+00:00 0:09:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.225306900765771 survival_time_median 10.750000000000018 deviation-center-line_median 0.40864173779456053 in-drivable-lane_median 1.7000000000000242
other stats agent_compute-ego_max 0.0867348936106592 agent_compute-ego_mean 0.08345531262366618 agent_compute-ego_median 0.08572825016798796 agent_compute-ego_min 0.0778980725002985 deviation-center-line_max 0.6491801892887803 deviation-center-line_mean 0.3683230725655418 deviation-center-line_min 0.1475671628461062 deviation-heading_max 2.2060076411946548 deviation-heading_mean 1.4163758252990906 deviation-heading_median 1.5250264276913703 deviation-heading_min 0.6970592634293067 driven_any_max 1.6057043265958648 driven_any_mean 1.3484469345214642 driven_any_median 1.5756972277649912 driven_any_min 0.9900494571900692 driven_lanedir_consec_max 1.4904214722299334 driven_lanedir_consec_mean 1.0721437270256324 driven_lanedir_consec_min 0.6474115509746436 driven_lanedir_max 1.4904214722299334 driven_lanedir_mean 1.0721437270256324 driven_lanedir_median 1.225306900765771 driven_lanedir_min 0.6474115509746436 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.4300000000000082 in-drivable-lane_min 0.25000000000000355 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.009685159587174011, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.032683751565946946, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.08090994855482801, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.05034639680985925, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.02030697829431767, "sim_compute_performance-ego": 0.03635436682392367, "sim_compute_robot_state-ego": 0.03723313311021105}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.0098324726967916, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.03163314213717941, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0778980725002985, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.04936342343796779, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.020098651412629735, "sim_compute_performance-ego": 0.034850752266654135, "sim_compute_robot_state-ego": 0.03722497668579547}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.010770679054773444, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.03512258486897422, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.0867348936106592, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.053249531262658634, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.02242362018123336, "sim_compute_performance-ego": 0.03762328036697456, "sim_compute_robot_state-ego": 0.0391962132646364}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.010620791413063229, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.034223288159037746, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.08600539828455725, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.053288547382798306, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.022112742135691088, "sim_compute_performance-ego": 0.037863556174344795, "sim_compute_robot_state-ego": 0.03890851042991461}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01055822769800822, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.03477518205289488, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.08572825016798796, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.052627379143679584, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.02206451142275775, "sim_compute_performance-ego": 0.038294965470278705, "sim_compute_robot_state-ego": 0.03911720823358606}}set_robot_commands_max 0.053288547382798306 set_robot_commands_mean 0.05177505560739272 set_robot_commands_median 0.052627379143679584 set_robot_commands_min 0.04936342343796779 sim_compute_performance-ego_max 0.038294965470278705 sim_compute_performance-ego_mean 0.03699738422043518 sim_compute_performance-ego_median 0.03762328036697456 sim_compute_performance-ego_min 0.034850752266654135 sim_compute_robot_state-ego_max 0.0391962132646364 sim_compute_robot_state-ego_mean 0.03833600834482871 sim_compute_robot_state-ego_median 0.03890851042991461 sim_compute_robot_state-ego_min 0.03722497668579547 sim_compute_sim_state_max 0.02242362018123336 sim_compute_sim_state_mean 0.02140130068932592 sim_compute_sim_state_median 0.02206451142275775 sim_compute_sim_state_min 0.020098651412629735 sim_physics_max 0.010770679054773444 sim_physics_mean 0.0102934660899621 sim_physics_median 0.01055822769800822 sim_physics_min 0.009685159587174011 sim_render-ego_max 0.03512258486897422 sim_render-ego_mean 0.033687589756806635 sim_render-ego_median 0.034223288159037746 sim_render-ego_min 0.03163314213717941 simulation-passed 1 survival_time_max 11.150000000000023 survival_time_mean 9.300000000000004 survival_time_min 6.849999999999984
No reset possible 192032912Thies Lennart Alff challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no nutonomy-P50-63182019-04-24 12:15:24+00:00 2019-04-24 12:25:25+00:00 0:10:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9155842498369492 survival_time_median 11.65000000000003 deviation-center-line_median 0.7444106618205801 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05405204217942035 agent_compute-ego_mean 0.05255583015438194 agent_compute-ego_median 0.05217398129976713 agent_compute-ego_min 0.05155584945187548 deviation-center-line_max 1.145185975143482 deviation-center-line_mean 0.7956077351488897 deviation-center-line_min 0.42131021260548374 deviation-heading_max 3.7454115672837145 deviation-heading_mean 2.0398681243929255 deviation-heading_median 1.835226355111387 deviation-heading_min 0.6665609404145512 driven_any_max 2.3532112511497623 driven_any_mean 1.5322948084395271 driven_any_median 1.8253548955381595 driven_any_min 0.6842416511385191 driven_lanedir_consec_max 1.7893431149620276 driven_lanedir_consec_mean 1.007348626849343 driven_lanedir_consec_min 0.6730551409975218 driven_lanedir_max 1.7893431149620276 driven_lanedir_mean 1.2113701741264316 driven_lanedir_median 1.098347280519953 driven_lanedir_min 0.6730551409975218 in-drivable-lane_max 3.950000000000036 in-drivable-lane_mean 1.490000000000009 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3532112511497623, "sim_physics": 0.010423000653584796, "survival_time": 14.950000000000076, "driven_lanedir": 1.5761769879956686, "sim_render-ego": 0.03662275234858195, "in-drivable-lane": 3.950000000000036, "agent_compute-ego": 0.05212221384048462, "deviation-heading": 3.149181188920488, "set_robot_commands": 0.05559446573257446, "deviation-center-line": 1.0672725524807631, "driven_lanedir_consec": 0.7388322822932306, "sim_compute_sim_state": 0.02353488286336263, "sim_compute_performance-ego": 0.04002222061157226, "sim_compute_robot_state-ego": 0.04138780117034912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8253548955381595, "sim_physics": 0.010597061189970744, "survival_time": 11.65000000000003, "driven_lanedir": 1.7893431149620276, "sim_render-ego": 0.036042396602712475, "in-drivable-lane": 0, "agent_compute-ego": 0.05155584945187548, "deviation-heading": 1.835226355111387, "set_robot_commands": 0.05632766735911881, "deviation-center-line": 1.145185975143482, "driven_lanedir_consec": 1.7893431149620276, "sim_compute_sim_state": 0.023084089991360773, "sim_compute_performance-ego": 0.04006559756692387, "sim_compute_robot_state-ego": 0.04101187579109945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9333537516789936, "sim_physics": 0.010359199320683712, "survival_time": 6.099999999999986, "driven_lanedir": 0.9199283461569858, "sim_render-ego": 0.03388729447224101, "in-drivable-lane": 0, "agent_compute-ego": 0.05405204217942035, "deviation-heading": 0.802960570234488, "set_robot_commands": 0.05202525170122991, "deviation-center-line": 0.5998592736941397, "driven_lanedir_consec": 0.9199283461569858, "sim_compute_sim_state": 0.0214318721020808, "sim_compute_performance-ego": 0.03722324723103007, "sim_compute_robot_state-ego": 0.038171342161835216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.011531651675046146, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.034738003552614985, "in-drivable-lane": 0, "agent_compute-ego": 0.05217398129976713, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.05357024957845499, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.022458411835052153, "sim_compute_performance-ego": 0.03764213834490095, "sim_compute_robot_state-ego": 0.03923833763206398}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8653124926922, "sim_physics": 0.010006036077226912, "survival_time": 11.900000000000034, "driven_lanedir": 1.098347280519953, "sim_render-ego": 0.03390322412763323, "in-drivable-lane": 3.5000000000000098, "agent_compute-ego": 0.052875064000362106, "deviation-heading": 3.7454115672837145, "set_robot_commands": 0.0519088887366928, "deviation-center-line": 0.7444106618205801, "driven_lanedir_consec": 0.9155842498369492, "sim_compute_sim_state": 0.021207324597014098, "sim_compute_performance-ego": 0.0369736837739704, "sim_compute_robot_state-ego": 0.03802905964250324}}set_robot_commands_max 0.05632766735911881 set_robot_commands_mean 0.05388530462161419 set_robot_commands_median 0.05357024957845499 set_robot_commands_min 0.0519088887366928 sim_compute_performance-ego_max 0.04006559756692387 sim_compute_performance-ego_mean 0.03838537750567951 sim_compute_performance-ego_median 0.03764213834490095 sim_compute_performance-ego_min 0.0369736837739704 sim_compute_robot_state-ego_max 0.04138780117034912 sim_compute_robot_state-ego_mean 0.0395676832795702 sim_compute_robot_state-ego_median 0.03923833763206398 sim_compute_robot_state-ego_min 0.03802905964250324 sim_compute_sim_state_max 0.02353488286336263 sim_compute_sim_state_mean 0.02234331627777409 sim_compute_sim_state_median 0.022458411835052153 sim_compute_sim_state_min 0.021207324597014098 sim_physics_max 0.011531651675046146 sim_physics_mean 0.010583389783302463 sim_physics_median 0.010423000653584796 sim_physics_min 0.010006036077226912 sim_render-ego_max 0.03662275234858195 sim_render-ego_mean 0.03503873422075673 sim_render-ego_median 0.034738003552614985 sim_render-ego_min 0.03388729447224101 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.830000000000023 survival_time_min 4.549999999999992
No reset possible 191982516Liam Paull challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:13:55+00:00 2019-04-24 12:15:03+00:00 0:01:08 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191922828Liam Paull challenge-aido_LF-template-random aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:11:06+00:00 2019-04-24 12:13:36+00:00 0:02:30 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 173, in main
make_video1(fn, out_video)
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
pg('video_aido', dict(filename=fn, output=output))
File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
model.init()
File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
block.init()
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
self.log = read_simulator_log_cbor(self.get_config('filename'))
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
render_time = read_perfomance(ld)
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
for i, ob in enumerate(read_topic2(ld, 'timing_information')):
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 173, in main
> make_video1(fn, out_video)
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
> pg('video_aido', dict(filename=fn, output=output))
> File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
> model.init()
> File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
> block.init()
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
> self.log = read_simulator_log_cbor(self.get_config('filename'))
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
> render_time = read_perfomance(ld)
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
> for i, ob in enumerate(read_topic2(ld, 'timing_information')):
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
> for ob in ld.objects:
> AttributeError: 'str' object has no attribute 'objects'
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191912831Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:10:05+00:00 2019-04-24 12:10:52+00:00 0:00:47 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191902843Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:08:28+00:00 2019-04-24 12:09:23+00:00 0:00:55 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191862868Peter Almasi Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:05:23+00:00 2019-04-24 12:07:56+00:00 0:02:33 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 173, in main
make_video1(fn, out_video)
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
pg('video_aido', dict(filename=fn, output=output))
File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
model.init()
File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
block.init()
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
self.log = read_simulator_log_cbor(self.get_config('filename'))
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
render_time = read_perfomance(ld)
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
for i, ob in enumerate(read_topic2(ld, 'timing_information')):
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 173, in main
> make_video1(fn, out_video)
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
> pg('video_aido', dict(filename=fn, output=output))
> File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
> model.init()
> File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
> block.init()
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
> self.log = read_simulator_log_cbor(self.get_config('filename'))
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
> render_time = read_perfomance(ld)
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
> for i, ob in enumerate(read_topic2(ld, 'timing_information')):
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
> for ob in ld.objects:
> AttributeError: 'str' object has no attribute 'objects'
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191852516Liam Paull challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:03:47+00:00 2019-04-24 12:04:49+00:00 0:01:02 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191792899Julian Zilly Baseline-IL-logs-tensorflow aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 12:00:35+00:00 2019-04-24 12:03:02+00:00 0:02:27 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 173, in main
make_video1(fn, out_video)
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
pg('video_aido', dict(filename=fn, output=output))
File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
model.init()
File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
block.init()
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
self.log = read_simulator_log_cbor(self.get_config('filename'))
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
render_time = read_perfomance(ld)
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
for i, ob in enumerate(read_topic2(ld, 'timing_information')):
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 173, in main
> make_video1(fn, out_video)
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
> pg('video_aido', dict(filename=fn, output=output))
> File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
> model.init()
> File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
> block.init()
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
> self.log = read_simulator_log_cbor(self.get_config('filename'))
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
> render_time = read_perfomance(ld)
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
> for i, ob in enumerate(read_topic2(ld, 'timing_information')):
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
> for ob in ld.objects:
> AttributeError: 'str' object has no attribute 'objects'
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191762920Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-24 11:57:45+00:00 2019-04-24 11:59:52+00:00 0:02:07 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 173, in main
make_video1(fn, out_video)
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
pg('video_aido', dict(filename=fn, output=output))
File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
model.init()
File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
block.init()
File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
self.log = read_simulator_log_cbor(self.get_config('filename'))
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
render_time = read_perfomance(ld)
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
for i, ob in enumerate(read_topic2(ld, 'timing_information')):
File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 173, in main
> make_video1(fn, out_video)
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
> pg('video_aido', dict(filename=fn, output=output))
> File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
> model.init()
> File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
> block.init()
> File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
> self.log = read_simulator_log_cbor(self.get_config('filename'))
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
> render_time = read_perfomance(ld)
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
> for i, ob in enumerate(read_topic2(ld, 'timing_information')):
> File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
> for ob in ld.objects:
> AttributeError: 'str' object has no attribute 'objects'
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191662917Claudio Ruch Python template aido2-AMOD-service_qualitystep2-scoring success yes nutonomy-P50-63182019-04-24 09:23:50+00:00 2019-04-24 09:35:39+00:00 0:11:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.26542305478577
other stats efficiency -63.02377221914047 fleet_size -1000000000
No reset possible 191362312Andrea Censi Python template aido2-AMOD-service_qualitystep1-simulation success yes nutonomy-P50-63182019-04-24 08:59:23+00:00 2019-04-24 09:23:06+00:00 0:23:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191352961Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validationstep1-simulation host-error no nutonomy-P50-63182019-04-24 08:57:40+00:00 2019-04-24 08:59:10+00:00 0:01:30 Error while running [...]
stderr | Pulling simulator ...
stderr | Pulling solution ...
stderr | Pulling evaluator ...
stderr | Pulling scenario_maker ... error
stderr |
stderr | ERROR: for simulator Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-simulator/manifests/2019_04_20_10_15_30: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr |
stderr | ERROR: for solution Get https://registry-1.docker.io/v2/julian121266/aido-submissions/manifests/2019_04_24_07_40_09: Get https://auth.docker.io/token?scope=repository%3Ajulian121266%2Faido-submissions%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr |
stderr | ERROR: for evaluator Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-evaluator/manifests/2019_04_20_10_15_18: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr |
stderr | ERROR: for scenario_maker Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-scenario_maker/manifests/2019_04_20_10_15_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-simulator/manifests/2019_04_20_10_15_30: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/julian121266/aido-submissions/manifests/2019_04_24_07_40_09: Get https://auth.docker.io/token?scope=repository%3Ajulian121266%2Faido-submissions%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-evaluator/manifests/2019_04_20_10_15_18: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lfv-sim-validation-step1-simulation-scenario_maker/manifests/2019_04_20_10_15_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lfv-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 191012921Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LF-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-23 22:30:43+00:00 2019-04-23 22:58:03+00:00 0:27:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0566858977432112 survival_time_median 1.5500000000000007 deviation-center-line_median 0.023148172805414476 in-drivable-lane_median 0.5500000000000005
other stats agent_compute-ego_max 0.09818818492274133 agent_compute-ego_mean 0.091763393855422 agent_compute-ego_median 0.09325681194182366 agent_compute-ego_min 0.08672705189935093 deviation-center-line_max 0.4143603141649533 deviation-center-line_mean 0.099432655391562 deviation-center-line_min 0.013250602252189114 deviation-heading_max 5.97404295840024 deviation-heading_mean 1.6296975851773374 deviation-heading_median 0.5645872376871222 deviation-heading_min 0.46340652718145225 driven_any_max 1.7144396805780229 driven_any_mean 0.4617436989834115 driven_any_median 0.1510553521954725 driven_any_min 0.1448083064525979 driven_lanedir_consec_max 0.5676263413936016 driven_lanedir_consec_mean 0.1526879226511613 driven_lanedir_consec_min 0.040683725717511 driven_lanedir_max 0.5676263413936016 driven_lanedir_mean 0.1526879226511613 driven_lanedir_median 0.0566858977432112 driven_lanedir_min 0.040683725717511 in-drivable-lane_max 7.200000000000043 in-drivable-lane_mean 1.880000000000009 in-drivable-lane_min 0.5000000000000003 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1448083064525979, "sim_physics": 0.010274664048225648, "survival_time": 1.5500000000000007, "driven_lanedir": 0.040683725717511, "sim_render-ego": 0.03575081209982595, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.09818818492274133, "deviation-heading": 0.46340652718145225, "set_robot_commands": 0.053619092510592554, "deviation-center-line": 0.013250602252189114, "driven_lanedir_consec": 0.040683725717511, "sim_compute_sim_state": 0.022027284868301883, "sim_compute_performance-ego": 0.038121054249425086, "sim_compute_robot_state-ego": 0.03839412812263735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1521701972305242, "sim_physics": 0.010777050449002174, "survival_time": 1.5500000000000007, "driven_lanedir": 0.057380457033182064, "sim_render-ego": 0.036004712504725304, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09325681194182366, "deviation-heading": 0.5940789334905884, "set_robot_commands": 0.05243767461469097, "deviation-center-line": 0.026623618713001788, "driven_lanedir_consec": 0.057380457033182064, "sim_compute_sim_state": 0.02207330734499039, "sim_compute_performance-ego": 0.03807761592249717, "sim_compute_robot_state-ego": 0.04076395496245353}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7144396805780229, "sim_physics": 0.010018366972605388, "survival_time": 14.950000000000076, "driven_lanedir": 0.5676263413936016, "sim_render-ego": 0.03551799217859904, "in-drivable-lane": 7.200000000000043, "agent_compute-ego": 0.09382350285847982, "deviation-heading": 5.97404295840024, "set_robot_commands": 0.05260050614674886, "deviation-center-line": 0.4143603141649533, "driven_lanedir_consec": 0.5676263413936016, "sim_compute_sim_state": 0.02173088788986206, "sim_compute_performance-ego": 0.03699928442637126, "sim_compute_robot_state-ego": 0.03879706859588623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1510553521954725, "sim_physics": 0.009541111607705393, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0566858977432112, "sim_render-ego": 0.033189465922694054, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.08682141765471428, "deviation-heading": 0.5645872376871222, "set_robot_commands": 0.04766164287444083, "deviation-center-line": 0.023148172805414476, "driven_lanedir_consec": 0.0566858977432112, "sim_compute_sim_state": 0.020038297099451863, "sim_compute_performance-ego": 0.034150808088241086, "sim_compute_robot_state-ego": 0.03549002831982028}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14624495846044025, "sim_physics": 0.0093549448868324, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04106319136830061, "sim_render-ego": 0.032924923403509734, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.08672705189935093, "deviation-heading": 0.5523722691272842, "set_robot_commands": 0.04776415331610318, "deviation-center-line": 0.019780569022251424, "driven_lanedir_consec": 0.04106319136830061, "sim_compute_sim_state": 0.018999749216540105, "sim_compute_performance-ego": 0.03366459649184655, "sim_compute_robot_state-ego": 0.03532898014989393}}set_robot_commands_max 0.053619092510592554 set_robot_commands_mean 0.05081661389251528 set_robot_commands_median 0.05243767461469097 set_robot_commands_min 0.04766164287444083 sim_compute_performance-ego_max 0.038121054249425086 sim_compute_performance-ego_mean 0.03620267183567623 sim_compute_performance-ego_median 0.03699928442637126 sim_compute_performance-ego_min 0.03366459649184655 sim_compute_robot_state-ego_max 0.04076395496245353 sim_compute_robot_state-ego_mean 0.03775483203013826 sim_compute_robot_state-ego_median 0.03839412812263735 sim_compute_robot_state-ego_min 0.03532898014989393 sim_compute_sim_state_max 0.02207330734499039 sim_compute_sim_state_mean 0.02097390528382926 sim_compute_sim_state_median 0.02173088788986206 sim_compute_sim_state_min 0.018999749216540105 sim_physics_max 0.010777050449002174 sim_physics_mean 0.0099932275928742 sim_physics_median 0.010018366972605388 sim_physics_min 0.0093549448868324 sim_render-ego_max 0.036004712504725304 sim_render-ego_mean 0.03467758122187081 sim_render-ego_median 0.03551799217859904 sim_render-ego_min 0.032924923403509734 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 4.210000000000016 survival_time_min 1.4500000000000006
No reset possible 190892916Claudio Ruch Python template aido2-AMOD-efficiencystep1-simulation aborted no nutonomy-P50-63182019-04-23 14:20:59+00:00 2019-04-23 14:20:59+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190872917Claudio Ruch Python template aido2-AMOD-service_qualitystep1-simulation aborted no nutonomy-P50-63182019-04-23 14:20:45+00:00 2019-04-23 14:20:45+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190692915Claudio Ruch Python template aido2-AMOD-service_qualitystep1-simulation host-error no nutonomy-P50-63182019-04-23 14:02:31+00:00 2019-04-23 14:02:32+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190672914Claudio Ruch Python template aido2-AMOD-efficiencystep1-simulation host-error no nutonomy-P50-63182019-04-23 14:02:17+00:00 2019-04-23 14:02:18+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190352907Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testingstep1-simulation host-error no nutonomy-P50-63182019-04-23 08:19:53+00:00 2019-04-23 09:45:22+00:00 1:25:29 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-nutonomy-P50-6318-job19035/tmp/tmpf0pr3qn3/attempts/udem1-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190222891Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation host-error no nutonomy-P50-63182019-04-22 17:31:12+00:00 2019-04-22 17:31:13+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190172892Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation host-error no nutonomy-P50-63182019-04-22 17:30:38+00:00 2019-04-22 17:30:39+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 190102889Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation host-error no nutonomy-P50-63182019-04-22 17:29:38+00:00 2019-04-22 17:29:38+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189952890Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation host-error no nutonomy-P50-63182019-04-22 17:28:46+00:00 2019-04-22 17:28:46+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189622889Diego Charrez Python template aido2-AMOD-efficiencystep1-simulation aborted no nutonomy-P50-63182019-04-22 16:52:46+00:00 2019-04-22 16:52:47+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189602890Diego Charrez Python template aido2-AMOD-service_qualitystep1-simulation aborted no nutonomy-P50-63182019-04-22 16:52:24+00:00 2019-04-22 16:52:25+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189482888Diego Charrez PredictorLast aido2-PREDstep1-simulation success no nutonomy-P50-63182019-04-22 15:24:35+00:00 2019-04-22 15:26:05+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11053343004933798 error_L2 0.01852605233087393
No reset possible 189462886Diego Charrez PredictorLast aido2-PREDstep1-simulation success no nutonomy-P50-63182019-04-21 23:18:41+00:00 2019-04-21 23:19:42+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12315509149471632 error_L2 0.02388587331016121
No reset possible 189372884Andrea Daniele minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation host-error no nutonomy-P50-63182019-04-21 01:53:23+00:00 2019-04-21 02:16:32+00:00 0:23:09 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-nutonomy-P50-6318-job18937/tmp/tmppnqhi3c_/attempts/udem1-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 189262363Andrea Censi random_agent aido2-LF-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 15:47:04+00:00 2019-04-20 15:53:02+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.07847550240429965 agent_compute-ego_mean 0.07532129587405485 agent_compute-ego_median 0.07661286872975967 agent_compute-ego_min 0.0710841566324234 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010749812396067494, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03584353428966594, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.07352245978589328, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.053785890903113025, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.02135303335369758, "sim_compute_performance-ego": 0.04108583702231353, "sim_compute_robot_state-ego": 0.039001109465113225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.010454194112257524, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03741995854811235, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.07847550240429965, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.05526195872913708, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022922261194749313, "sim_compute_performance-ego": 0.03936931219967929, "sim_compute_robot_state-ego": 0.04003148187290539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01055360370212131, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03638987541198731, "in-drivable-lane": 0, "agent_compute-ego": 0.07691149181789822, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05389268663194444, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02220055792066786, "sim_compute_performance-ego": 0.03862266540527344, "sim_compute_robot_state-ego": 0.03964676856994629}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010356391469637552, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03412485122680664, "in-drivable-lane": 0, "agent_compute-ego": 0.0710841566324234, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.050862908363342285, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02008754511674245, "sim_compute_performance-ego": 0.0355378786722819, "sim_compute_robot_state-ego": 0.036656235655148826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.011985989177928253, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.03601581208846148, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.07661286872975967, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05353331916472491, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.022491455078125, "sim_compute_performance-ego": 0.0375407057649949, "sim_compute_robot_state-ego": 0.039707730798160326}}set_robot_commands_max 0.05526195872913708 set_robot_commands_mean 0.053467352758452345 set_robot_commands_median 0.053785890903113025 set_robot_commands_min 0.050862908363342285 sim_compute_performance-ego_max 0.04108583702231353 sim_compute_performance-ego_mean 0.038431279812908614 sim_compute_performance-ego_median 0.03862266540527344 sim_compute_performance-ego_min 0.0355378786722819 sim_compute_robot_state-ego_max 0.04003148187290539 sim_compute_robot_state-ego_mean 0.039008665272254814 sim_compute_robot_state-ego_median 0.03964676856994629 sim_compute_robot_state-ego_min 0.036656235655148826 sim_compute_sim_state_max 0.022922261194749313 sim_compute_sim_state_mean 0.02181097053279644 sim_compute_sim_state_median 0.02220055792066786 sim_compute_sim_state_min 0.02008754511674245 sim_physics_max 0.011985989177928253 sim_physics_mean 0.010819998171602428 sim_physics_median 0.01055360370212131 sim_physics_min 0.010356391469637552 sim_render-ego_max 0.03741995854811235 sim_render-ego_mean 0.03595880631300674 sim_render-ego_median 0.03601581208846148 sim_render-ego_min 0.03412485122680664 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 189202370Liam Paull minimal_agent (Python 3) aido2-LF-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 15:34:44+00:00 2019-04-20 15:46:56+00:00 0:12:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.225306900765771 survival_time_median 10.750000000000018 deviation-center-line_median 0.40864173779456053 in-drivable-lane_median 1.7000000000000242
other stats agent_compute-ego_max 0.08812728593515795 agent_compute-ego_mean 0.08517162629955949 agent_compute-ego_median 0.084036683594739 agent_compute-ego_min 0.08258479806874365 deviation-center-line_max 0.6491801892887803 deviation-center-line_mean 0.3683230725655418 deviation-center-line_min 0.1475671628461062 deviation-heading_max 2.2060076411946548 deviation-heading_mean 1.4163758252990906 deviation-heading_median 1.5250264276913703 deviation-heading_min 0.6970592634293067 driven_any_max 1.6057043265958648 driven_any_mean 1.3484469345214642 driven_any_median 1.5756972277649912 driven_any_min 0.9900494571900692 driven_lanedir_consec_max 1.4904214722299334 driven_lanedir_consec_mean 1.0721437270256324 driven_lanedir_consec_min 0.6474115509746436 driven_lanedir_max 1.4904214722299334 driven_lanedir_mean 1.0721437270256324 driven_lanedir_median 1.225306900765771 driven_lanedir_min 0.6474115509746436 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.4300000000000082 in-drivable-lane_min 0.25000000000000355 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.011800373200889972, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.035857799241868715, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.08763486704380392, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.05084500724463154, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.02288418536563571, "sim_compute_performance-ego": 0.03817251431856224, "sim_compute_robot_state-ego": 0.040330020643824294}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.01061614238432724, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.03478332853665317, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08347449685535292, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.050823481413569765, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.021440939311563535, "sim_compute_performance-ego": 0.03698987160285894, "sim_compute_robot_state-ego": 0.03829749657289825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.010343208441285275, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.03498060179398199, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08258479806874365, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.0505630692024402, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.021038582506735765, "sim_compute_performance-ego": 0.03606793164137768, "sim_compute_robot_state-ego": 0.03721722572908273}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.011485782889432684, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.03645606928093489, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.08812728593515795, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.052772565220677574, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.022987060768659726, "sim_compute_performance-ego": 0.038085172342699626, "sim_compute_robot_state-ego": 0.0396013758903326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.010123433890166109, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.03528519802623325, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.084036683594739, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.05197797660474424, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.021580745776494343, "sim_compute_performance-ego": 0.037081881805702495, "sim_compute_robot_state-ego": 0.03834867035901105}}set_robot_commands_max 0.052772565220677574 set_robot_commands_mean 0.05139641993721267 set_robot_commands_median 0.05084500724463154 set_robot_commands_min 0.0505630692024402 sim_compute_performance-ego_max 0.03817251431856224 sim_compute_performance-ego_mean 0.037279474342240194 sim_compute_performance-ego_median 0.037081881805702495 sim_compute_performance-ego_min 0.03606793164137768 sim_compute_robot_state-ego_max 0.040330020643824294 sim_compute_robot_state-ego_mean 0.03875895783902979 sim_compute_robot_state-ego_median 0.03834867035901105 sim_compute_robot_state-ego_min 0.03721722572908273 sim_compute_sim_state_max 0.022987060768659726 sim_compute_sim_state_mean 0.021986302745817816 sim_compute_sim_state_median 0.021580745776494343 sim_compute_sim_state_min 0.021038582506735765 sim_physics_max 0.011800373200889972 sim_physics_mean 0.010873788161220256 sim_physics_median 0.01061614238432724 sim_physics_min 0.010123433890166109 sim_render-ego_max 0.03645606928093489 sim_render-ego_mean 0.0354725993759344 sim_render-ego_median 0.03528519802623325 sim_render-ego_min 0.03478332853665317 simulation-passed 1 survival_time_max 11.150000000000023 survival_time_mean 9.300000000000004 survival_time_min 6.849999999999984
No reset possible 189132376Liam Paull minimal_agent_python2 (Python 2) aido2-LF-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 15:26:10+00:00 2019-04-20 15:34:05+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2394590679116675 survival_time_median 5.549999999999988 deviation-center-line_median 0.04756896992501765 in-drivable-lane_median 0.9999999999999964
other stats agent_compute-ego_max 0.041902533522597304 agent_compute-ego_mean 0.03736311975900117 agent_compute-ego_median 0.036885912353928026 agent_compute-ego_min 0.03470991323660086 deviation-center-line_max 0.06628159589691172 deviation-center-line_mean 0.055053867384428454 deviation-center-line_min 0.04756874938348469 deviation-heading_max 0.3902119203851745 deviation-heading_mean 0.3724667982759654 deviation-heading_median 0.39020902164128224 deviation-heading_min 0.34585149487811473 driven_any_max 1.5771689201187185 driven_any_mean 1.343168920198914 driven_any_median 1.5771689201187176 driven_any_min 0.992168920319208 driven_lanedir_consec_max 1.344898529895705 driven_lanedir_consec_mean 1.047634910702065 driven_lanedir_consec_min 0.6544587706938922 driven_lanedir_max 1.344898529895705 driven_lanedir_mean 1.047634910702065 driven_lanedir_median 1.2394590679116675 driven_lanedir_min 0.6544587706938922 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.8799999999999969 in-drivable-lane_min 0.6999999999999975 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.011263665225770738, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.03670378194914923, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03548868828349643, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.054705656237072416, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.022000296248330012, "sim_compute_performance-ego": 0.03932187292310926, "sim_compute_robot_state-ego": 0.03913576735390557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.013611502117580838, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.0382725199063619, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.037828551398383245, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.05597290727827284, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.023330108986960515, "sim_compute_performance-ego": 0.04108754793802897, "sim_compute_robot_state-ego": 0.04224980539745755}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.011831083813229122, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.03776663273304432, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.036885912353928026, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.054838704633283185, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.023148117838679132, "sim_compute_performance-ego": 0.03931336574726277, "sim_compute_robot_state-ego": 0.0406155843992491}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.01410820892265251, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.04304786200995918, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.041902533522597304, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.06214830682084367, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.025850446374566707, "sim_compute_performance-ego": 0.0450153415267532, "sim_compute_robot_state-ego": 0.046095321844289966}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.012136261742394247, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.03501480334513896, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03470991323660086, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.05207692395459424, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.021089124249982404, "sim_compute_performance-ego": 0.03650569700979971, "sim_compute_robot_state-ego": 0.038599220482078755}}set_robot_commands_max 0.06214830682084367 set_robot_commands_mean 0.05594849978481327 set_robot_commands_median 0.054838704633283185 set_robot_commands_min 0.05207692395459424 sim_compute_performance-ego_max 0.0450153415267532 sim_compute_performance-ego_mean 0.04024876502899079 sim_compute_performance-ego_median 0.03932187292310926 sim_compute_performance-ego_min 0.03650569700979971 sim_compute_robot_state-ego_max 0.046095321844289966 sim_compute_robot_state-ego_mean 0.04133913989539619 sim_compute_robot_state-ego_median 0.0406155843992491 sim_compute_robot_state-ego_min 0.038599220482078755 sim_compute_sim_state_max 0.025850446374566707 sim_compute_sim_state_mean 0.023083618739703753 sim_compute_sim_state_median 0.023148117838679132 sim_compute_sim_state_min 0.021089124249982404 sim_physics_max 0.01410820892265251 sim_physics_mean 0.012590144364325493 sim_physics_median 0.012136261742394247 sim_physics_min 0.011263665225770738 sim_render-ego_max 0.04304786200995918 sim_render-ego_mean 0.03816111998873072 sim_render-ego_median 0.03776663273304432 sim_render-ego_min 0.03501480334513896 simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 4.769999999999992 survival_time_min 3.599999999999995
No reset possible 188872410jiang peng Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation host-error no nutonomy-P50-63182019-04-20 15:01:27+00:00 2019-04-20 15:25:47+00:00 0:24:20 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-nutonomy-P50-6318-job18887/tmp/tmpgio67it1/attempts/ETHZ_autolab_technical_track-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188832407Victor Guerra Baseline solution using reinforcement learning aido2-LFVI-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 14:51:11+00:00 2019-04-20 15:01:06+00:00 0:09:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.06092810812389593 survival_time_median 1.4500000000000006 deviation-center-line_median 0.02759984044858422 in-drivable-lane_median 0.4500000000000004
other stats agent_compute-ego_max 0.0975822169205238 agent_compute-ego_mean 0.09423203847022904 agent_compute-ego_median 0.09548007208725502 agent_compute-ego_min 0.08902104147549333 deviation-center-line_max 0.06309944562387113 deviation-center-line_mean 0.03391841014839599 deviation-center-line_min 0.02296796274949999 deviation-heading_max 1.624846446358105 deviation-heading_mean 0.7882865981193399 deviation-heading_median 0.5925601499045107 deviation-heading_min 0.5444366347877188 driven_any_max 0.5089678419080116 driven_any_mean 0.2299967746153256 driven_any_median 0.16541423175805248 driven_any_min 0.14793728273500953 driven_lanedir_consec_max 0.1814935724987703 driven_lanedir_consec_mean 0.08221973224724732 driven_lanedir_consec_min 0.05316019322444565 driven_lanedir_max 0.1814935724987703 driven_lanedir_mean 0.08221973224724732 driven_lanedir_median 0.06092810812389593 driven_lanedir_min 0.05316019322444565 in-drivable-lane_max 1.8999999999999977 in-drivable-lane_mean 0.7199999999999999 in-drivable-lane_min 0.4000000000000003 per-episodes details {"udem1-0-0": {"driven_any": 0.17154856958109754, "sim_physics": 0.017857387148100753, "survival_time": 1.4500000000000006, "driven_lanedir": 0.061322155459707206, "sim_render-ego": 0.03578634919791386, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.0975822169205238, "deviation-heading": 0.5444366347877188, "set_robot_commands": 0.052248223074551285, "deviation-center-line": 0.024948807959231437, "driven_lanedir_consec": 0.061322155459707206, "sim_compute_sim_state": 0.02041925232985924, "sim_compute_performance-ego": 0.03632778134839288, "sim_compute_robot_state-ego": 0.03829697082782614, "sim_compute_robot_state-npc0": 0.03794494168511752, "sim_compute_robot_state-npc1": 0.040565326296049975, "sim_compute_robot_state-npc2": 0.03670378389029667, "sim_compute_robot_state-npc3": 0.03759348803553088}, "udem1-1-0": {"driven_any": 0.16541423175805248, "sim_physics": 0.019592490689507847, "survival_time": 1.4500000000000006, "driven_lanedir": 0.054194631929417536, "sim_render-ego": 0.03719227067355452, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09548007208725502, "deviation-heading": 0.5555303031506756, "set_robot_commands": 0.050115667540451575, "deviation-center-line": 0.02296796274949999, "driven_lanedir_consec": 0.054194631929417536, "sim_compute_sim_state": 0.021159073402141702, "sim_compute_performance-ego": 0.03623147668509648, "sim_compute_robot_state-ego": 0.03810801177189268, "sim_compute_robot_state-npc0": 0.03758273453548037, "sim_compute_robot_state-npc1": 0.036629668597517345, "sim_compute_robot_state-npc2": 0.03682845214317585, "sim_compute_robot_state-npc3": 0.03730828186561321}, "udem1-2-0": {"driven_any": 0.5089678419080116, "sim_physics": 0.020619797152142193, "survival_time": 4.299999999999993, "driven_lanedir": 0.1814935724987703, "sim_render-ego": 0.035448925439701524, "in-drivable-lane": 1.8999999999999977, "agent_compute-ego": 0.09318192060603651, "deviation-heading": 1.624846446358105, "set_robot_commands": 0.05069619555806005, "deviation-center-line": 0.06309944562387113, "driven_lanedir_consec": 0.1814935724987703, "sim_compute_sim_state": 0.020944966826328012, "sim_compute_performance-ego": 0.037194057952526005, "sim_compute_robot_state-ego": 0.0382242479989695, "sim_compute_robot_state-npc0": 0.038759957912356355, "sim_compute_robot_state-npc1": 0.037526003150052806, "sim_compute_robot_state-npc2": 0.03841598921043928, "sim_compute_robot_state-npc3": 0.03828931132028269}, "udem1-3-0": {"driven_any": 0.14793728273500953, "sim_physics": 0.01903111594063895, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05316019322444565, "sim_render-ego": 0.03733496155057635, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09589494126183648, "deviation-heading": 0.5925601499045107, "set_robot_commands": 0.05114405495779855, "deviation-center-line": 0.02759984044858422, "driven_lanedir_consec": 0.05316019322444565, "sim_compute_sim_state": 0.020439743995666504, "sim_compute_performance-ego": 0.03663577352251325, "sim_compute_robot_state-ego": 0.037941387721470425, "sim_compute_robot_state-npc0": 0.03670712879725865, "sim_compute_robot_state-npc1": 0.03675229208809989, "sim_compute_robot_state-npc2": 0.03640735149383545, "sim_compute_robot_state-npc3": 0.036222645214625766}, "udem1-4-0": {"driven_any": 0.1561159470944568, "sim_physics": 0.016893362176829373, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06092810812389593, "sim_render-ego": 0.03505529206374596, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.08902104147549333, "deviation-heading": 0.6240594563956893, "set_robot_commands": 0.04975252315915864, "deviation-center-line": 0.030975993960793216, "driven_lanedir_consec": 0.06092810812389593, "sim_compute_sim_state": 0.020475782197097253, "sim_compute_performance-ego": 0.03525030201879041, "sim_compute_robot_state-ego": 0.03658233017757021, "sim_compute_robot_state-npc0": 0.03625397024483516, "sim_compute_robot_state-npc1": 0.03641501788435311, "sim_compute_robot_state-npc2": 0.03593328081328293, "sim_compute_robot_state-npc3": 0.03769337719884412}}set_robot_commands_max 0.052248223074551285 set_robot_commands_mean 0.050791332858004024 set_robot_commands_median 0.05069619555806005 set_robot_commands_min 0.04975252315915864 sim_compute_performance-ego_max 0.037194057952526005 sim_compute_performance-ego_mean 0.036327878305463815 sim_compute_performance-ego_median 0.03632778134839288 sim_compute_performance-ego_min 0.03525030201879041 sim_compute_robot_state-ego_max 0.03829697082782614 sim_compute_robot_state-ego_mean 0.037830589699545794 sim_compute_robot_state-ego_median 0.03810801177189268 sim_compute_robot_state-ego_min 0.03658233017757021 sim_compute_robot_state-npc0_max 0.038759957912356355 sim_compute_robot_state-npc0_mean 0.037449746635009606 sim_compute_robot_state-npc0_median 0.03758273453548037 sim_compute_robot_state-npc0_min 0.03625397024483516 sim_compute_robot_state-npc1_max 0.040565326296049975 sim_compute_robot_state-npc1_mean 0.03757766160321462 sim_compute_robot_state-npc1_median 0.03675229208809989 sim_compute_robot_state-npc1_min 0.03641501788435311 sim_compute_robot_state-npc2_max 0.03841598921043928 sim_compute_robot_state-npc2_mean 0.03685777151020604 sim_compute_robot_state-npc2_median 0.03670378389029667 sim_compute_robot_state-npc2_min 0.03593328081328293 sim_compute_robot_state-npc3_max 0.03828931132028269 sim_compute_robot_state-npc3_mean 0.03742142072697933 sim_compute_robot_state-npc3_median 0.03759348803553088 sim_compute_robot_state-npc3_min 0.036222645214625766 sim_compute_sim_state_max 0.021159073402141702 sim_compute_sim_state_mean 0.020687763750218545 sim_compute_sim_state_median 0.020475782197097253 sim_compute_sim_state_min 0.02041925232985924 sim_physics_max 0.020619797152142193 sim_physics_mean 0.018798830621443822 sim_physics_median 0.01903111594063895 sim_physics_min 0.016893362176829373 sim_render-ego_max 0.03733496155057635 sim_render-ego_mean 0.03616355978509844 sim_render-ego_median 0.03578634919791386 sim_render-ego_min 0.03505529206374596 simulation-passed 1 survival_time_max 4.299999999999993 survival_time_mean 2.009999999999999 survival_time_min 1.4000000000000006
No reset possible 188692424Andrea Censi random_agent aido2-LFVI-sim-testingstep1-simulation success no nutonomy-P50-63182019-04-20 14:40:16+00:00 2019-04-20 14:51:04+00:00 0:10:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.07642064018855019 agent_compute-ego_mean 0.07410015222392867 agent_compute-ego_median 0.07376965056074426 agent_compute-ego_min 0.07161430212167594 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.020118921522110228, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03672835183522058, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07642064018855019, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05247226215544201, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.020597298940022785, "sim_compute_performance-ego": 0.03748396086314368, "sim_compute_robot_state-ego": 0.038360921163407585, "sim_compute_robot_state-npc0": 0.037902703360905725, "sim_compute_robot_state-npc1": 0.03768914843362475, "sim_compute_robot_state-npc2": 0.03696482900589231, "sim_compute_robot_state-npc3": 0.03724719229198638}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.018747750450583064, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0357665968876259, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.07530118904861749, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.054036308737362135, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02044945604660932, "sim_compute_performance-ego": 0.03671340848885331, "sim_compute_robot_state-ego": 0.03905696027419146, "sim_compute_robot_state-npc0": 0.037486665389117074, "sim_compute_robot_state-npc1": 0.03719327496547325, "sim_compute_robot_state-npc2": 0.03793629478005802, "sim_compute_robot_state-npc3": 0.037454960392970665}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.020453387691128637, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.03698648175885601, "in-drivable-lane": 0, "agent_compute-ego": 0.07339497920005553, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.051473602171867125, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02102356187758907, "sim_compute_performance-ego": 0.03678620246148879, "sim_compute_robot_state-ego": 0.03853484507529966, "sim_compute_robot_state-npc0": 0.03739913817374937, "sim_compute_robot_state-npc1": 0.03743911943128032, "sim_compute_robot_state-npc2": 0.03696821966478901, "sim_compute_robot_state-npc3": 0.037113028187905586}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.020215978013708235, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03687588712002369, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.07376965056074426, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05184774195894282, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02141074677731129, "sim_compute_performance-ego": 0.03689016179835543, "sim_compute_robot_state-ego": 0.03809747797377566, "sim_compute_robot_state-npc0": 0.03840699094407102, "sim_compute_robot_state-npc1": 0.03701673416381187, "sim_compute_robot_state-npc2": 0.03742070654605297, "sim_compute_robot_state-npc3": 0.03738275741009002}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.017816561918992262, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.035238793263068564, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07161430212167594, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05146072461054875, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02061119904884925, "sim_compute_performance-ego": 0.03716789759122408, "sim_compute_robot_state-ego": 0.04019435093953059, "sim_compute_robot_state-npc0": 0.037153234848609336, "sim_compute_robot_state-npc1": 0.036724429864149824, "sim_compute_robot_state-npc2": 0.036514075902792126, "sim_compute_robot_state-npc3": 0.03677710203024057}}set_robot_commands_max 0.054036308737362135 set_robot_commands_mean 0.05225812792683256 set_robot_commands_median 0.05184774195894282 set_robot_commands_min 0.05146072461054875 sim_compute_performance-ego_max 0.03748396086314368 sim_compute_performance-ego_mean 0.03700832624061305 sim_compute_performance-ego_median 0.03689016179835543 sim_compute_performance-ego_min 0.03671340848885331 sim_compute_robot_state-ego_max 0.04019435093953059 sim_compute_robot_state-ego_mean 0.03884891108524099 sim_compute_robot_state-ego_median 0.03853484507529966 sim_compute_robot_state-ego_min 0.03809747797377566 sim_compute_robot_state-npc0_max 0.03840699094407102 sim_compute_robot_state-npc0_mean 0.03766974654329051 sim_compute_robot_state-npc0_median 0.037486665389117074 sim_compute_robot_state-npc0_min 0.037153234848609336 sim_compute_robot_state-npc1_max 0.03768914843362475 sim_compute_robot_state-npc1_mean 0.037212541371668 sim_compute_robot_state-npc1_median 0.03719327496547325 sim_compute_robot_state-npc1_min 0.036724429864149824 sim_compute_robot_state-npc2_max 0.03793629478005802 sim_compute_robot_state-npc2_mean 0.03716082517991689 sim_compute_robot_state-npc2_median 0.03696821966478901 sim_compute_robot_state-npc2_min 0.036514075902792126 sim_compute_robot_state-npc3_max 0.037454960392970665 sim_compute_robot_state-npc3_mean 0.03719500806263864 sim_compute_robot_state-npc3_median 0.03724719229198638 sim_compute_robot_state-npc3_min 0.03677710203024057 sim_compute_sim_state_max 0.02141074677731129 sim_compute_sim_state_mean 0.02081845253807634 sim_compute_sim_state_median 0.02061119904884925 sim_compute_sim_state_min 0.02044945604660932 sim_physics_max 0.020453387691128637 sim_physics_mean 0.019470519919304485 sim_physics_median 0.020118921522110228 sim_physics_min 0.017816561918992262 sim_render-ego_max 0.03698648175885601 sim_render-ego_mean 0.03631922217295895 sim_render-ego_median 0.03672835183522058 sim_render-ego_min 0.035238793263068564 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 188612437Andrea Censi random_agent aido2-LFVI-sim-validationstep1-simulation error no nutonomy-P50-63182019-04-20 14:37:29+00:00 2019-04-20 14:39:38+00:00 0:02:09 The container "solut [...] The container "solution" exited with code 2.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188582440Jacopo Tani random_agent aido2-LF-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 14:31:22+00:00 2019-04-20 14:37:17+00:00 0:05:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.09434343468059192 agent_compute-ego_mean 0.087806218084584 agent_compute-ego_median 0.08623242828081239 agent_compute-ego_min 0.0838811572860269 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010476625190590913, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03624717244562113, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08623242828081239, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05174827575683594, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.020832291189229715, "sim_compute_performance-ego": 0.03778077071567751, "sim_compute_robot_state-ego": 0.039909317808331186}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01140605861490423, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0391627387567, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.09434343468059192, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0534588098526001, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.026230806654149837, "sim_compute_performance-ego": 0.04117856784300371, "sim_compute_robot_state-ego": 0.04283022880554199}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.010488663779364691, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03543947537740071, "in-drivable-lane": 0, "agent_compute-ego": 0.08593063354492188, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.050969632466634114, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02249028417799208, "sim_compute_performance-ego": 0.03741103278266059, "sim_compute_robot_state-ego": 0.039588552051120336}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010944525400797524, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03734348217646281, "in-drivable-lane": 0, "agent_compute-ego": 0.08864343663056691, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05423585077126821, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.023032074173291523, "sim_compute_performance-ego": 0.03927519420782725, "sim_compute_robot_state-ego": 0.03998995820681254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.011057475033928366, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.03525807577020982, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0838811572860269, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05277440828435561, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.021640402429244095, "sim_compute_performance-ego": 0.03743113139096428, "sim_compute_robot_state-ego": 0.03823156917796416}}set_robot_commands_max 0.05423585077126821 set_robot_commands_mean 0.052637395426338794 set_robot_commands_median 0.05277440828435561 set_robot_commands_min 0.050969632466634114 sim_compute_performance-ego_max 0.04117856784300371 sim_compute_performance-ego_mean 0.03861533938802667 sim_compute_performance-ego_median 0.03778077071567751 sim_compute_performance-ego_min 0.03741103278266059 sim_compute_robot_state-ego_max 0.04283022880554199 sim_compute_robot_state-ego_mean 0.04010992520995404 sim_compute_robot_state-ego_median 0.039909317808331186 sim_compute_robot_state-ego_min 0.03823156917796416 sim_compute_sim_state_max 0.026230806654149837 sim_compute_sim_state_mean 0.022845171724781448 sim_compute_sim_state_median 0.02249028417799208 sim_compute_sim_state_min 0.020832291189229715 sim_physics_max 0.01140605861490423 sim_physics_mean 0.010874669603917144 sim_physics_median 0.010944525400797524 sim_physics_min 0.010476625190590913 sim_render-ego_max 0.0391627387567 sim_render-ego_mean 0.03669018890527889 sim_render-ego_median 0.03624717244562113 sim_render-ego_min 0.03525807577020982 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 188532444Jacopo Tani random_agent aido2-LFVI-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 14:20:15+00:00 2019-04-20 14:30:40+00:00 0:10:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.09332517935679507 agent_compute-ego_mean 0.08768605852613418 agent_compute-ego_median 0.08638361856049183 agent_compute-ego_min 0.08471206695802751 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02041324736580016, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03728787104288737, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08813226033770849, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05461582304939391, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.021936522589789495, "sim_compute_performance-ego": 0.03786597176203652, "sim_compute_robot_state-ego": 0.039135119271656825, "sim_compute_robot_state-npc0": 0.03998258757212805, "sim_compute_robot_state-npc1": 0.06425535489642431, "sim_compute_robot_state-npc2": 0.03873787607465472, "sim_compute_robot_state-npc3": 0.03926939812917558}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.01885600651011747, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.036599224688960055, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08638361856049183, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05234156870374493, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021137073928234624, "sim_compute_performance-ego": 0.03751258289112764, "sim_compute_robot_state-ego": 0.04093650275585698, "sim_compute_robot_state-npc0": 0.038003089381199257, "sim_compute_robot_state-npc1": 0.037781318028767906, "sim_compute_robot_state-npc2": 0.03828320783727309, "sim_compute_robot_state-npc3": 0.03912554535211301}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.020398605254388625, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.03585189388644311, "in-drivable-lane": 0, "agent_compute-ego": 0.08471206695802751, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05157653362520279, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.020805001258850098, "sim_compute_performance-ego": 0.036049000678523895, "sim_compute_robot_state-ego": 0.038526696543539726, "sim_compute_robot_state-npc0": 0.03680392619102232, "sim_compute_robot_state-npc1": 0.03707622712658298, "sim_compute_robot_state-npc2": 0.03652258842222152, "sim_compute_robot_state-npc3": 0.03738224121832078}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.020526530894827335, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.038027834384999376, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08587716741764799, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.052878034875748006, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02141706486965748, "sim_compute_performance-ego": 0.0374112864758106, "sim_compute_robot_state-ego": 0.03884070223950325, "sim_compute_robot_state-npc0": 0.038315841492186205, "sim_compute_robot_state-npc1": 0.03795748568595724, "sim_compute_robot_state-npc2": 0.03755057872609889, "sim_compute_robot_state-npc3": 0.03854513168334961}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.01882858001268827, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03881409076543955, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.09332517935679507, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05279438770734347, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021692963746877816, "sim_compute_performance-ego": 0.04066850130374615, "sim_compute_robot_state-ego": 0.042363134714273304, "sim_compute_robot_state-npc0": 0.043288854452279896, "sim_compute_robot_state-npc1": 0.040302822223076455, "sim_compute_robot_state-npc2": 0.03966762010867779, "sim_compute_robot_state-npc3": 0.03944506553503183}}set_robot_commands_max 0.05461582304939391 set_robot_commands_mean 0.05284126959228662 set_robot_commands_median 0.05279438770734347 set_robot_commands_min 0.05157653362520279 sim_compute_performance-ego_max 0.04066850130374615 sim_compute_performance-ego_mean 0.037901468622248954 sim_compute_performance-ego_median 0.03751258289112764 sim_compute_performance-ego_min 0.036049000678523895 sim_compute_robot_state-ego_max 0.042363134714273304 sim_compute_robot_state-ego_mean 0.03996043110496601 sim_compute_robot_state-ego_median 0.039135119271656825 sim_compute_robot_state-ego_min 0.038526696543539726 sim_compute_robot_state-npc0_max 0.043288854452279896 sim_compute_robot_state-npc0_mean 0.03927885981776315 sim_compute_robot_state-npc0_median 0.038315841492186205 sim_compute_robot_state-npc0_min 0.03680392619102232 sim_compute_robot_state-npc1_max 0.06425535489642431 sim_compute_robot_state-npc1_mean 0.043474641592161786 sim_compute_robot_state-npc1_median 0.03795748568595724 sim_compute_robot_state-npc1_min 0.03707622712658298 sim_compute_robot_state-npc2_max 0.03966762010867779 sim_compute_robot_state-npc2_mean 0.0381523742337852 sim_compute_robot_state-npc2_median 0.03828320783727309 sim_compute_robot_state-npc2_min 0.03652258842222152 sim_compute_robot_state-npc3_max 0.03944506553503183 sim_compute_robot_state-npc3_mean 0.03875347638359816 sim_compute_robot_state-npc3_median 0.03912554535211301 sim_compute_robot_state-npc3_min 0.03738224121832078 sim_compute_sim_state_max 0.021936522589789495 sim_compute_sim_state_mean 0.0213977252786819 sim_compute_sim_state_median 0.02141706486965748 sim_compute_sim_state_min 0.020805001258850098 sim_physics_max 0.020526530894827335 sim_physics_mean 0.019804594007564374 sim_physics_median 0.020398605254388625 sim_physics_min 0.01882858001268827 sim_render-ego_max 0.03881409076543955 sim_render-ego_mean 0.03731618295374589 sim_render-ego_median 0.03728787104288737 sim_render-ego_min 0.03585189388644311 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 188332476Liam Paull challenge-aido_LF-template-random aido2-LFVI-sim-validationstep1-simulation success no nutonomy-P50-63182019-04-20 14:09:25+00:00 2019-04-20 14:20:01+00:00 0:10:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.08777262155826275 agent_compute-ego_mean 0.08399169996561415 agent_compute-ego_median 0.08492079903097714 agent_compute-ego_min 0.07841839487590486 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.01812763062734453, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03302235073513455, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.07841839487590486, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.04784662761385479, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.019059014698815723, "sim_compute_performance-ego": 0.03355685491410513, "sim_compute_robot_state-ego": 0.035194646744501026, "sim_compute_robot_state-npc0": 0.03450962853810144, "sim_compute_robot_state-npc1": 0.034272409620739165, "sim_compute_robot_state-npc2": 0.03410719689868745, "sim_compute_robot_state-npc3": 0.034259516095358225}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.018849779577816233, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03592698246824975, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08492079903097714, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.051616210563510075, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02120043717178644, "sim_compute_performance-ego": 0.03688177875444001, "sim_compute_robot_state-ego": 0.039727580313589056, "sim_compute_robot_state-npc0": 0.03886940432529824, "sim_compute_robot_state-npc1": 0.03810362254872041, "sim_compute_robot_state-npc2": 0.03751382173276415, "sim_compute_robot_state-npc3": 0.037561313778746365}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.01998727936898508, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.036498250499848395, "in-drivable-lane": 0, "agent_compute-ego": 0.08557568057890862, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.052201009565784086, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.021219661158900106, "sim_compute_performance-ego": 0.03691581756837906, "sim_compute_robot_state-ego": 0.03920560498391428, "sim_compute_robot_state-npc0": 0.039055528179291754, "sim_compute_robot_state-npc1": 0.03829515749408353, "sim_compute_robot_state-npc2": 0.0377390653856339, "sim_compute_robot_state-npc3": 0.03816231604545347}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.019655904871352176, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03686620326752358, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08327100378401736, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05115500155915605, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02114657645529889, "sim_compute_performance-ego": 0.03643621536011391, "sim_compute_robot_state-ego": 0.03839274162941791, "sim_compute_robot_state-npc0": 0.03823674486038533, "sim_compute_robot_state-npc1": 0.03743646499958444, "sim_compute_robot_state-npc2": 0.03723434438096716, "sim_compute_robot_state-npc3": 0.03731003974346405}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.01815134286880493, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03621326501552875, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08777262155826275, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05294002019442045, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021429291138282187, "sim_compute_performance-ego": 0.03846594920525184, "sim_compute_robot_state-ego": 0.03962994538820707, "sim_compute_robot_state-npc0": 0.04098889460930458, "sim_compute_robot_state-npc1": 0.03861189347047072, "sim_compute_robot_state-npc2": 0.03842032872713529, "sim_compute_robot_state-npc3": 0.03895476231208214}}set_robot_commands_max 0.05294002019442045 set_robot_commands_mean 0.05115177389934509 set_robot_commands_median 0.051616210563510075 set_robot_commands_min 0.04784662761385479 sim_compute_performance-ego_max 0.03846594920525184 sim_compute_performance-ego_mean 0.03645132316045799 sim_compute_performance-ego_median 0.03688177875444001 sim_compute_performance-ego_min 0.03355685491410513 sim_compute_robot_state-ego_max 0.039727580313589056 sim_compute_robot_state-ego_mean 0.03843010381192587 sim_compute_robot_state-ego_median 0.03920560498391428 sim_compute_robot_state-ego_min 0.035194646744501026 sim_compute_robot_state-npc0_max 0.04098889460930458 sim_compute_robot_state-npc0_mean 0.03833204010247627 sim_compute_robot_state-npc0_median 0.03886940432529824 sim_compute_robot_state-npc0_min 0.03450962853810144 sim_compute_robot_state-npc1_max 0.03861189347047072 sim_compute_robot_state-npc1_mean 0.03734390962671966 sim_compute_robot_state-npc1_median 0.03810362254872041 sim_compute_robot_state-npc1_min 0.034272409620739165 sim_compute_robot_state-npc2_max 0.03842032872713529 sim_compute_robot_state-npc2_mean 0.03700295142503759 sim_compute_robot_state-npc2_median 0.03751382173276415 sim_compute_robot_state-npc2_min 0.03410719689868745 sim_compute_robot_state-npc3_max 0.03895476231208214 sim_compute_robot_state-npc3_mean 0.03724958959502085 sim_compute_robot_state-npc3_median 0.037561313778746365 sim_compute_robot_state-npc3_min 0.034259516095358225 sim_compute_sim_state_max 0.021429291138282187 sim_compute_sim_state_mean 0.020810996124616662 sim_compute_sim_state_median 0.02120043717178644 sim_compute_sim_state_min 0.019059014698815723 sim_physics_max 0.01998727936898508 sim_physics_mean 0.01895438746286059 sim_physics_median 0.018849779577816233 sim_physics_min 0.01812763062734453 sim_render-ego_max 0.03686620326752358 sim_render-ego_mean 0.03570541039725701 sim_render-ego_median 0.03621326501552875 sim_render-ego_min 0.03302235073513455 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 188292480Liam Paull challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation error no nutonomy-P50-63182019-04-20 14:08:15+00:00 2019-04-20 14:09:04+00:00 0:00:49 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 188262487Liam Paull challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-20 14:06:58+00:00 2019-04-20 14:08:07+00:00 0:01:09 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 187892541jiang peng test for ppo aido2-LF-sim-testingstep1-simulation error no nutonomy-P50-63182019-04-20 13:57:57+00:00 2019-04-20 14:06:51+00:00 0:08:54 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
