Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 19705
3014
Manfred Diaz challenge-aido_LF-template-pytorch aido2-LFVI-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 20:25:57+00:00 2019-04-24 20:27:17+00:00 0:01:20 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19692
2994
Manfred Diaz challenge-aido_LF-template-tensorflow aido2-LF-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 20:18:05+00:00 2019-04-24 20:20:20+00:00 0:02:15 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19678
2363
Andrea Censi  🇨ðŸ‡random_agent aido2-LF-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:39:31+00:00 2019-04-24 16:44:42+00:00 0:05:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.146159913804796 agent_compute-ego_mean 0.1306357454826073 agent_compute-ego_median 0.127136101325353 agent_compute-ego_min 0.1171217771137462 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021799303450674382, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05513229909932838, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12291461566709122, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08202693597325739, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.033973797312322654, "sim_compute_performance-ego": 0.060844385399008695, "sim_compute_robot_state-ego": 0.06317902960867253}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.0267084078355269, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06252001090483232, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13984631950205023, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09948571703650734, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03884972225535999, "sim_compute_performance-ego": 0.07197013226422397, "sim_compute_robot_state-ego": 0.07398979230360551}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.024480777316623265, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06600735982259115, "in-drivable-lane": 0, "agent_compute-ego": 0.146159913804796, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10860469606187607, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.039071342680189344, "sim_compute_performance-ego": 0.07083836131625705, "sim_compute_robot_state-ego": 0.07879983054267035}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.022840842604637143, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.057239179809888206, "in-drivable-lane": 0, "agent_compute-ego": 0.127136101325353, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08788324892520905, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03465354939301809, "sim_compute_performance-ego": 0.06373266379038493, "sim_compute_robot_state-ego": 0.06739363074302673}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.020640029626734117, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05358007024316227, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1171217771137462, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08153816882301779, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03209157901651719, "sim_compute_performance-ego": 0.057240899871377385, "sim_compute_robot_state-ego": 0.05971999729380888}}set_robot_commands_max 0.10860469606187607 set_robot_commands_mean 0.09190775336397353 set_robot_commands_median 0.08788324892520905 set_robot_commands_min 0.08153816882301779 sim_compute_performance-ego_max 0.07197013226422397 sim_compute_performance-ego_mean 0.0649252885282504 sim_compute_performance-ego_median 0.06373266379038493 sim_compute_performance-ego_min 0.057240899871377385 sim_compute_robot_state-ego_max 0.07879983054267035 sim_compute_robot_state-ego_mean 0.0686164560983568 sim_compute_robot_state-ego_median 0.06739363074302673 sim_compute_robot_state-ego_min 0.05971999729380888 sim_compute_sim_state_max 0.039071342680189344 sim_compute_sim_state_mean 0.035727998131481455 sim_compute_sim_state_median 0.03465354939301809 sim_compute_sim_state_min 0.03209157901651719 sim_physics_max 0.0267084078355269 sim_physics_mean 0.02329387216683916 sim_physics_median 0.022840842604637143 sim_physics_min 0.020640029626734117 sim_render-ego_max 0.06600735982259115 sim_render-ego_mean 0.05889578397596047 sim_render-ego_median 0.057239179809888206 sim_render-ego_min 0.05358007024316227 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19664
2376
Liam Paull  🇨🇦minimal_agent_python2 (Python 2) aido2-LF-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:31:52+00:00 2019-04-24 16:38:47+00:00 0:06:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2394590679116675 survival_time_median 5.549999999999988 deviation-center-line_median 0.04756896992501765 in-drivable-lane_median 0.9999999999999964
other stats agent_compute-ego_max 0.06080120533436268 agent_compute-ego_mean 0.05674019803156007 agent_compute-ego_median 0.05858040849367777 agent_compute-ego_min 0.04729885525173611 deviation-center-line_max 0.06628159589691172 deviation-center-line_mean 0.055053867384428454 deviation-center-line_min 0.04756874938348469 deviation-heading_max 0.3902119203851745 deviation-heading_mean 0.3724667982759654 deviation-heading_median 0.39020902164128224 deviation-heading_min 0.34585149487811473 driven_any_max 1.5771689201187185 driven_any_mean 1.343168920198914 driven_any_median 1.5771689201187176 driven_any_min 0.992168920319208 driven_lanedir_consec_max 1.344898529895705 driven_lanedir_consec_mean 1.047634910702065 driven_lanedir_consec_min 0.6544587706938922 driven_lanedir_max 1.344898529895705 driven_lanedir_mean 1.047634910702065 driven_lanedir_median 1.2394590679116675 driven_lanedir_min 0.6544587706938922 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.8799999999999969 in-drivable-lane_min 0.6999999999999975 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.018328246143129136, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.04567342665460375, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04729885525173611, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.07634370856814915, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.028959217998716567, "sim_compute_performance-ego": 0.05196664399570889, "sim_compute_robot_state-ego": 0.052758594353993736}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.02075156569480896, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.048990597327550255, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.05858040849367777, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.08188149333000183, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.03148198790020413, "sim_compute_performance-ego": 0.056338717540105186, "sim_compute_robot_state-ego": 0.06087335613038805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.02414747616192242, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.055670867095122464, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.06080120533436268, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.08714690938726202, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.03580607379878963, "sim_compute_performance-ego": 0.06349098575007808, "sim_compute_robot_state-ego": 0.06645583247279262}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.022008354599411424, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.05685419434899682, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.060476958214699686, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.0891155616657154, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.037205968891178165, "sim_compute_performance-ego": 0.06614921329257724, "sim_compute_robot_state-ego": 0.06737910090266047}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.02138212135246208, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.054149715750067086, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05654356286332414, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.08303632392539634, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03266031677658494, "sim_compute_performance-ego": 0.05911911070883811, "sim_compute_robot_state-ego": 0.05939056637050869}}set_robot_commands_max 0.0891155616657154 set_robot_commands_mean 0.08350479937530494 set_robot_commands_median 0.08303632392539634 set_robot_commands_min 0.07634370856814915 sim_compute_performance-ego_max 0.06614921329257724 sim_compute_performance-ego_mean 0.059412934257461504 sim_compute_performance-ego_median 0.05911911070883811 sim_compute_performance-ego_min 0.05196664399570889 sim_compute_robot_state-ego_max 0.06737910090266047 sim_compute_robot_state-ego_mean 0.06137149004606872 sim_compute_robot_state-ego_median 0.06087335613038805 sim_compute_robot_state-ego_min 0.052758594353993736 sim_compute_sim_state_max 0.037205968891178165 sim_compute_sim_state_mean 0.033222713073094684 sim_compute_sim_state_median 0.03266031677658494 sim_compute_sim_state_min 0.028959217998716567 sim_physics_max 0.02414747616192242 sim_physics_mean 0.021323552790346804 sim_physics_median 0.02138212135246208 sim_physics_min 0.018328246143129136 sim_render-ego_max 0.05685419434899682 sim_render-ego_mean 0.05226776023526808 sim_render-ego_median 0.054149715750067086 sim_render-ego_min 0.04567342665460375 simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 4.769999999999992 survival_time_min 3.599999999999995
No reset possible 19652
2391
Liam Paull  🇨🇦random_agent aido2-LF-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:26:46+00:00 2019-04-24 16:31:35+00:00 0:04:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.1373882982465956 agent_compute-ego_mean 0.12343515013850316 agent_compute-ego_median 0.12602374951044715 agent_compute-ego_min 0.10218766050518684 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015884790780409327, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04630233206838932, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.10218766050518684, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0695155161731648, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.029465747329424013, "sim_compute_performance-ego": 0.05035271284715185, "sim_compute_robot_state-ego": 0.05286209988144209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.018090562386946243, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05410419810901989, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.12874606522646817, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09384878115220505, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.033136606216430664, "sim_compute_performance-ego": 0.06034130399877375, "sim_compute_robot_state-ego": 0.06166459213603626}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.022486358218722875, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06256270938449436, "in-drivable-lane": 0, "agent_compute-ego": 0.1373882982465956, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10349630779690212, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.040295012791951496, "sim_compute_performance-ego": 0.06785844696892632, "sim_compute_robot_state-ego": 0.07331024275885688}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.021788289149602253, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05966062347094218, "in-drivable-lane": 0, "agent_compute-ego": 0.12602374951044715, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.086312601963679, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03531423211097717, "sim_compute_performance-ego": 0.06506861746311188, "sim_compute_robot_state-ego": 0.0645100325345993}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.021522437824922448, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05733862694572, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12282997720381791, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08976738242542043, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03517515168470495, "sim_compute_performance-ego": 0.06308009343988755, "sim_compute_robot_state-ego": 0.06306172118467443}}set_robot_commands_max 0.10349630779690212 set_robot_commands_mean 0.08858811790227428 set_robot_commands_median 0.08976738242542043 set_robot_commands_min 0.0695155161731648 sim_compute_performance-ego_max 0.06785844696892632 sim_compute_performance-ego_mean 0.06134023494357026 sim_compute_performance-ego_median 0.06308009343988755 sim_compute_performance-ego_min 0.05035271284715185 sim_compute_robot_state-ego_max 0.07331024275885688 sim_compute_robot_state-ego_mean 0.0630817376991218 sim_compute_robot_state-ego_median 0.06306172118467443 sim_compute_robot_state-ego_min 0.05286209988144209 sim_compute_sim_state_max 0.040295012791951496 sim_compute_sim_state_mean 0.034677350026697654 sim_compute_sim_state_median 0.03517515168470495 sim_compute_sim_state_min 0.029465747329424013 sim_physics_max 0.022486358218722875 sim_physics_mean 0.01995448767212063 sim_physics_median 0.021522437824922448 sim_physics_min 0.015884790780409327 sim_render-ego_max 0.06256270938449436 sim_render-ego_mean 0.055993697995713146 sim_render-ego_median 0.05733862694572 sim_render-ego_min 0.04630233206838932 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19647
2400
Liam Paull  🇨🇦random_agent aido2-LFVI-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:18:10+00:00 2019-04-24 16:26:32+00:00 0:08:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.1350987995824506 agent_compute-ego_mean 0.12583236376568527 agent_compute-ego_median 0.12405374202322451 agent_compute-ego_min 0.11885751669223492 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03576774445791093, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05292688475714789, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1192044114309644, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07960019414387053, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.032091980888730005, "sim_compute_performance-ego": 0.05934404948401072, "sim_compute_robot_state-ego": 0.059202254764617435, "sim_compute_robot_state-npc0": 0.05739707416958279, "sim_compute_robot_state-npc1": 0.056765121126931814, "sim_compute_robot_state-npc2": 0.05743613318791465, "sim_compute_robot_state-npc3": 0.058415276663643975}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.039388086281570735, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0569909133163153, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13194734909955194, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.09608156540814568, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03665710898006663, "sim_compute_performance-ego": 0.06519811293658088, "sim_compute_robot_state-ego": 0.06928610801696777, "sim_compute_robot_state-npc0": 0.0669237725874957, "sim_compute_robot_state-npc1": 0.06534705442540786, "sim_compute_robot_state-npc2": 0.06239506310107661, "sim_compute_robot_state-npc3": 0.062045770532944626}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04051281175305767, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.061348330590032765, "in-drivable-lane": 0, "agent_compute-ego": 0.1350987995824506, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09706875201194518, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03643358907391949, "sim_compute_performance-ego": 0.06564698680754631, "sim_compute_robot_state-ego": 0.06578744995978571, "sim_compute_robot_state-npc0": 0.07066230235561248, "sim_compute_robot_state-npc1": 0.06654747070804719, "sim_compute_robot_state-npc2": 0.06547381800989951, "sim_compute_robot_state-npc3": 0.06479941260430121}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04198285366626496, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.055086896774616645, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12405374202322451, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08499534840279437, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03522935065817326, "sim_compute_performance-ego": 0.0598601889103017, "sim_compute_robot_state-ego": 0.06364340985074957, "sim_compute_robot_state-npc0": 0.06130450329882033, "sim_compute_robot_state-npc1": 0.061367600522142775, "sim_compute_robot_state-npc2": 0.06004708878537442, "sim_compute_robot_state-npc3": 0.06141031802968776}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.035301075531886175, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05570769768494826, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11885751669223492, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08401188942102286, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03257767512248112, "sim_compute_performance-ego": 0.06003432090465839, "sim_compute_robot_state-ego": 0.060765779935396634, "sim_compute_robot_state-npc0": 0.06101514284427349, "sim_compute_robot_state-npc1": 0.0611994037261376, "sim_compute_robot_state-npc2": 0.05979001522064209, "sim_compute_robot_state-npc3": 0.05986969287578876}}set_robot_commands_max 0.09706875201194518 set_robot_commands_mean 0.08835154987755571 set_robot_commands_median 0.08499534840279437 set_robot_commands_min 0.07960019414387053 sim_compute_performance-ego_max 0.06564698680754631 sim_compute_performance-ego_mean 0.06201673180861959 sim_compute_performance-ego_median 0.06003432090465839 sim_compute_performance-ego_min 0.05934404948401072 sim_compute_robot_state-ego_max 0.06928610801696777 sim_compute_robot_state-ego_mean 0.06373700050550342 sim_compute_robot_state-ego_median 0.06364340985074957 sim_compute_robot_state-ego_min 0.059202254764617435 sim_compute_robot_state-npc0_max 0.07066230235561248 sim_compute_robot_state-npc0_mean 0.06346055905115697 sim_compute_robot_state-npc0_median 0.06130450329882033 sim_compute_robot_state-npc0_min 0.05739707416958279 sim_compute_robot_state-npc1_max 0.06654747070804719 sim_compute_robot_state-npc1_mean 0.06224533010173344 sim_compute_robot_state-npc1_median 0.061367600522142775 sim_compute_robot_state-npc1_min 0.056765121126931814 sim_compute_robot_state-npc2_max 0.06547381800989951 sim_compute_robot_state-npc2_mean 0.061028423660981455 sim_compute_robot_state-npc2_median 0.06004708878537442 sim_compute_robot_state-npc2_min 0.05743613318791465 sim_compute_robot_state-npc3_max 0.06479941260430121 sim_compute_robot_state-npc3_mean 0.061308094141273264 sim_compute_robot_state-npc3_median 0.06141031802968776 sim_compute_robot_state-npc3_min 0.058415276663643975 sim_compute_sim_state_max 0.03665710898006663 sim_compute_sim_state_mean 0.0345979409446741 sim_compute_sim_state_median 0.03522935065817326 sim_compute_sim_state_min 0.032091980888730005 sim_physics_max 0.04198285366626496 sim_physics_mean 0.03859051433813809 sim_physics_median 0.039388086281570735 sim_physics_min 0.035301075531886175 sim_render-ego_max 0.061348330590032765 sim_render-ego_mean 0.05641214462461217 sim_render-ego_median 0.05570769768494826 sim_render-ego_min 0.05292688475714789 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 19642
2403
Victor Guerra  🇫🇷Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:14:29+00:00 2019-04-24 16:18:03+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.09051650683722068 survival_time_median 1.3000000000000005 deviation-center-line_median 0.055990222688146615 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.19308953625815256 agent_compute-ego_mean 0.1558436265187774 agent_compute-ego_median 0.15664043793311486 agent_compute-ego_min 0.11901640892028809 deviation-center-line_max 0.06911146621945177 deviation-center-line_mean 0.05492955086862337 deviation-center-line_min 0.03640534054166274 deviation-heading_max 0.7634340516814753 deviation-heading_mean 0.7305722433886876 deviation-heading_median 0.7404544951972891 deviation-heading_min 0.6703214555753187 driven_any_max 0.19549377541120225 driven_any_mean 0.1627629166611407 driven_any_median 0.15431945767089358 driven_any_min 0.1458968448035718 driven_lanedir_consec_max 0.1458963023328943 driven_lanedir_consec_mean 0.10105936735547276 driven_lanedir_consec_min 0.07551693965470374 driven_lanedir_max 0.1458963023328943 driven_lanedir_mean 0.10105936735547276 driven_lanedir_median 0.09051650683722068 driven_lanedir_min 0.07551693965470374 in-drivable-lane_max 0.20000000000000015 in-drivable-lane_mean 0.04000000000000003 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1458968448035718, "sim_physics": 0.01665961742401123, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08204089560268191, "sim_render-ego": 0.042468518018722534, "in-drivable-lane": 0, "agent_compute-ego": 0.11901640892028809, "deviation-heading": 0.7470667460634683, "set_robot_commands": 0.06210479140281677, "deviation-center-line": 0.052156335952963706, "driven_lanedir_consec": 0.08204089560268191, "sim_compute_sim_state": 0.02677032351493835, "sim_compute_performance-ego": 0.044720083475112915, "sim_compute_robot_state-ego": 0.04602413376172384}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19549377541120225, "sim_physics": 0.026795898165021623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1458963023328943, "sim_render-ego": 0.05752663952963693, "in-drivable-lane": 0, "agent_compute-ego": 0.19308953625815256, "deviation-heading": 0.7315844684258864, "set_robot_commands": 0.10517443929399764, "deviation-center-line": 0.06911146621945177, "driven_lanedir_consec": 0.1458963023328943, "sim_compute_sim_state": 0.03668820858001709, "sim_compute_performance-ego": 0.07164158139910017, "sim_compute_robot_state-ego": 0.07883526597704206}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14968391991551006, "sim_physics": 0.021768264770507813, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09051650683722068, "sim_render-ego": 0.05775322914123535, "in-drivable-lane": 0, "agent_compute-ego": 0.15041498184204102, "deviation-heading": 0.7634340516814753, "set_robot_commands": 0.09504201889038086, "deviation-center-line": 0.055990222688146615, "driven_lanedir_consec": 0.09051650683722068, "sim_compute_sim_state": 0.0359719181060791, "sim_compute_performance-ego": 0.06324780464172364, "sim_compute_robot_state-ego": 0.06454475402832031}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15431945767089358, "sim_physics": 0.025629299658316153, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07551693965470374, "sim_render-ego": 0.06539728906419542, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.16005676764029045, "deviation-heading": 0.6703214555753187, "set_robot_commands": 0.09659829846134892, "deviation-center-line": 0.03640534054166274, "driven_lanedir_consec": 0.07551693965470374, "sim_compute_sim_state": 0.03754994604322645, "sim_compute_performance-ego": 0.07078969920123065, "sim_compute_robot_state-ego": 0.07204387806080005}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16842058550452585, "sim_physics": 0.02524413512303279, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11132619234986318, "sim_render-ego": 0.05599667475773738, "in-drivable-lane": 0, "agent_compute-ego": 0.15664043793311486, "deviation-heading": 0.7404544951972891, "set_robot_commands": 0.08994253782125619, "deviation-center-line": 0.06098438894089203, "driven_lanedir_consec": 0.11132619234986318, "sim_compute_sim_state": 0.034529878542973444, "sim_compute_performance-ego": 0.059094988382779635, "sim_compute_robot_state-ego": 0.06487997678609994}}set_robot_commands_max 0.10517443929399764 set_robot_commands_mean 0.08977241717396008 set_robot_commands_median 0.09504201889038086 set_robot_commands_min 0.06210479140281677 sim_compute_performance-ego_max 0.07164158139910017 sim_compute_performance-ego_mean 0.061898831419989406 sim_compute_performance-ego_median 0.06324780464172364 sim_compute_performance-ego_min 0.044720083475112915 sim_compute_robot_state-ego_max 0.07883526597704206 sim_compute_robot_state-ego_mean 0.06526560172279723 sim_compute_robot_state-ego_median 0.06487997678609994 sim_compute_robot_state-ego_min 0.04602413376172384 sim_compute_sim_state_max 0.03754994604322645 sim_compute_sim_state_mean 0.03430205495744689 sim_compute_sim_state_median 0.0359719181060791 sim_compute_sim_state_min 0.02677032351493835 sim_physics_max 0.026795898165021623 sim_physics_mean 0.02321944302817792 sim_physics_median 0.02524413512303279 sim_physics_min 0.01665961742401123 sim_render-ego_max 0.06539728906419542 sim_render-ego_mean 0.05582847010230553 sim_render-ego_median 0.05752663952963693 sim_render-ego_min 0.042468518018722534 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.3000000000000005 survival_time_min 1.2000000000000004
No reset possible 19641
2406
Victor Guerra  🇫🇷Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:09:26+00:00 2019-04-24 16:14:21+00:00 0:04:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.08438103385874385 survival_time_median 1.1500000000000004 deviation-center-line_median 0.046834026496191374 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.1616971492767334 agent_compute-ego_mean 0.15404952997746674 agent_compute-ego_median 0.1521343489487966 agent_compute-ego_min 0.14857937978661578 deviation-center-line_max 0.05111972015026863 deviation-center-line_mean 0.046161069416481085 deviation-center-line_min 0.0410378151693393 deviation-heading_max 0.6925679360829191 deviation-heading_mean 0.6663774644521805 deviation-heading_median 0.6628471501849217 deviation-heading_min 0.6407693806223403 driven_any_max 0.16899886814241896 driven_any_mean 0.15283471338170895 driven_any_median 0.15099887894750214 driven_any_min 0.14543182413261693 driven_lanedir_consec_max 0.1124476142158124 driven_lanedir_consec_mean 0.08971533687391994 driven_lanedir_consec_min 0.07922565990131347 driven_lanedir_max 0.1124476142158124 driven_lanedir_mean 0.08971533687391994 driven_lanedir_median 0.08438103385874385 driven_lanedir_min 0.07922565990131347 in-drivable-lane_max 0.05000000000000005 in-drivable-lane_mean 0.030000000000000027 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.15099887894750214, "sim_physics": 0.037966707478398865, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08987053448855531, "sim_render-ego": 0.06083877190299656, "in-drivable-lane": 0, "agent_compute-ego": 0.1616971492767334, "deviation-heading": 0.6925679360829191, "set_robot_commands": 0.08815511413242506, "deviation-center-line": 0.04960063126942189, "driven_lanedir_consec": 0.08987053448855531, "sim_compute_sim_state": 0.03769982379415761, "sim_compute_performance-ego": 0.06540269437043564, "sim_compute_robot_state-ego": 0.07360557887865149, "sim_compute_robot_state-npc0": 0.06630517088848611, "sim_compute_robot_state-npc1": 0.06219780963400136, "sim_compute_robot_state-npc2": 0.062010391898777176, "sim_compute_robot_state-npc3": 0.06522942625957986}, "udem1-1-0": {"driven_any": 0.15328957475821067, "sim_physics": 0.03734018405278524, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08438103385874385, "sim_render-ego": 0.056985308726628624, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1521343489487966, "deviation-heading": 0.6886158355890064, "set_robot_commands": 0.08736552794774373, "deviation-center-line": 0.046834026496191374, "driven_lanedir_consec": 0.08438103385874385, "sim_compute_sim_state": 0.032628665367762245, "sim_compute_performance-ego": 0.06381460030873616, "sim_compute_robot_state-ego": 0.06943004329999287, "sim_compute_robot_state-npc0": 0.061844309171040855, "sim_compute_robot_state-npc1": 0.06413103143374126, "sim_compute_robot_state-npc2": 0.06079180041948954, "sim_compute_robot_state-npc3": 0.06206547220547994}, "udem1-2-0": {"driven_any": 0.16899886814241896, "sim_physics": 0.04325980941454569, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1124476142158124, "sim_render-ego": 0.06071293354034424, "in-drivable-lane": 0, "agent_compute-ego": 0.15777562061945596, "deviation-heading": 0.6628471501849217, "set_robot_commands": 0.09361917773882548, "deviation-center-line": 0.05111972015026863, "driven_lanedir_consec": 0.1124476142158124, "sim_compute_sim_state": 0.03647403915723165, "sim_compute_performance-ego": 0.06453082958857219, "sim_compute_robot_state-ego": 0.06634294986724854, "sim_compute_robot_state-npc0": 0.06306268771489461, "sim_compute_robot_state-npc1": 0.06315140922864278, "sim_compute_robot_state-npc2": 0.06789288918177287, "sim_compute_robot_state-npc3": 0.06828706463177998}, "udem1-3-0": {"driven_any": 0.14545442092779612, "sim_physics": 0.03843485790750255, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07922565990131347, "sim_render-ego": 0.06113011940665867, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14857937978661578, "deviation-heading": 0.6470870197817149, "set_robot_commands": 0.07319108299587083, "deviation-center-line": 0.0410378151693393, "driven_lanedir_consec": 0.07922565990131347, "sim_compute_sim_state": 0.036027047945105514, "sim_compute_performance-ego": 0.062419497448465096, "sim_compute_robot_state-ego": 0.06536294066387674, "sim_compute_robot_state-npc0": 0.055097528125928795, "sim_compute_robot_state-npc1": 0.05604002786719281, "sim_compute_robot_state-npc2": 0.06008421856424083, "sim_compute_robot_state-npc3": 0.061203593793122665}, "udem1-4-0": {"driven_any": 0.14543182413261693, "sim_physics": 0.0346837043762207, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08265184190517472, "sim_render-ego": 0.05765725218731424, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.150061151255732, "deviation-heading": 0.6407693806223403, "set_robot_commands": 0.08201143015985904, "deviation-center-line": 0.042213153997184234, "driven_lanedir_consec": 0.08265184190517472, "sim_compute_sim_state": 0.03515333714692489, "sim_compute_performance-ego": 0.05960184594859248, "sim_compute_robot_state-ego": 0.06208450897880222, "sim_compute_robot_state-npc0": 0.05790570507878843, "sim_compute_robot_state-npc1": 0.06397119812343431, "sim_compute_robot_state-npc2": 0.06116464863652769, "sim_compute_robot_state-npc3": 0.05987583036008089}}set_robot_commands_max 0.09361917773882548 set_robot_commands_mean 0.08486846659494482 set_robot_commands_median 0.08736552794774373 set_robot_commands_min 0.07319108299587083 sim_compute_performance-ego_max 0.06540269437043564 sim_compute_performance-ego_mean 0.06315389353296032 sim_compute_performance-ego_median 0.06381460030873616 sim_compute_performance-ego_min 0.05960184594859248 sim_compute_robot_state-ego_max 0.07360557887865149 sim_compute_robot_state-ego_mean 0.06736520433771438 sim_compute_robot_state-ego_median 0.06634294986724854 sim_compute_robot_state-ego_min 0.06208450897880222 sim_compute_robot_state-npc0_max 0.06630517088848611 sim_compute_robot_state-npc0_mean 0.06084308019582776 sim_compute_robot_state-npc0_median 0.061844309171040855 sim_compute_robot_state-npc0_min 0.055097528125928795 sim_compute_robot_state-npc1_max 0.06413103143374126 sim_compute_robot_state-npc1_mean 0.0618982952574025 sim_compute_robot_state-npc1_median 0.06315140922864278 sim_compute_robot_state-npc1_min 0.05604002786719281 sim_compute_robot_state-npc2_max 0.06789288918177287 sim_compute_robot_state-npc2_mean 0.06238878974016163 sim_compute_robot_state-npc2_median 0.06116464863652769 sim_compute_robot_state-npc2_min 0.06008421856424083 sim_compute_robot_state-npc3_max 0.06828706463177998 sim_compute_robot_state-npc3_mean 0.06333227745000866 sim_compute_robot_state-npc3_median 0.06206547220547994 sim_compute_robot_state-npc3_min 0.05987583036008089 sim_compute_sim_state_max 0.03769982379415761 sim_compute_sim_state_mean 0.03559658268223638 sim_compute_sim_state_median 0.036027047945105514 sim_compute_sim_state_min 0.032628665367762245 sim_physics_max 0.04325980941454569 sim_physics_mean 0.038337052645890615 sim_physics_median 0.037966707478398865 sim_physics_min 0.0346837043762207 sim_render-ego_max 0.06113011940665867 sim_render-ego_mean 0.05946487715278846 sim_render-ego_median 0.06071293354034424 sim_render-ego_min 0.056985308726628624 simulation-passed 1 survival_time_max 1.2000000000000004 survival_time_mean 1.1700000000000004 survival_time_min 1.1500000000000004
No reset possible 19618
2424
Andrea Censi  🇨ðŸ‡random_agent aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 16:00:17+00:00 2019-04-24 16:09:12+00:00 0:08:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.12797746506143123 agent_compute-ego_mean 0.11934738110986154 agent_compute-ego_median 0.1263451845415177 agent_compute-ego_min 0.0949097963479849 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.041370232899983726, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05232120317126077, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12007546046423534, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.0842907882872082, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03361792413015214, "sim_compute_performance-ego": 0.058466483676244345, "sim_compute_robot_state-ego": 0.06006746443491134, "sim_compute_robot_state-npc0": 0.059854480955335826, "sim_compute_robot_state-npc1": 0.06171961436195979, "sim_compute_robot_state-npc2": 0.059339750380743114, "sim_compute_robot_state-npc3": 0.059873705818539576}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03668491980608772, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05845003034554276, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12742899913413852, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08824435402365292, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03421545963661343, "sim_compute_performance-ego": 0.06255682776955997, "sim_compute_robot_state-ego": 0.06698041336209166, "sim_compute_robot_state-npc0": 0.06285902098113415, "sim_compute_robot_state-npc1": 0.06721947239894493, "sim_compute_robot_state-npc2": 0.06128983871609557, "sim_compute_robot_state-npc3": 0.061840398638856174}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04333003490201889, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.058459654931099184, "in-drivable-lane": 0, "agent_compute-ego": 0.1263451845415177, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.0835013005041307, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.036393069451855074, "sim_compute_performance-ego": 0.06422207047862391, "sim_compute_robot_state-ego": 0.0658184289932251, "sim_compute_robot_state-npc0": 0.0630103349685669, "sim_compute_robot_state-npc1": 0.06416071230365385, "sim_compute_robot_state-npc2": 0.06369613062950873, "sim_compute_robot_state-npc3": 0.06379596648677703}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04414459999571455, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05893811773746572, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12797746506143123, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.09036411376709634, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03849765848606191, "sim_compute_performance-ego": 0.06491226845599235, "sim_compute_robot_state-ego": 0.06933191228420177, "sim_compute_robot_state-npc0": 0.06336079252527115, "sim_compute_robot_state-npc1": 0.06366053794292693, "sim_compute_robot_state-npc2": 0.06475240372596903, "sim_compute_robot_state-npc3": 0.06732628954217788}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027281770339378945, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04338882519648625, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0949097963479849, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.06560681874935444, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02737850409287673, "sim_compute_performance-ego": 0.045901092199178845, "sim_compute_robot_state-ego": 0.047955843118520886, "sim_compute_robot_state-npc0": 0.04927965769400963, "sim_compute_robot_state-npc1": 0.04759077842418964, "sim_compute_robot_state-npc2": 0.04939502477645874, "sim_compute_robot_state-npc3": 0.04833471316557664}}set_robot_commands_max 0.09036411376709634 set_robot_commands_mean 0.08240147506628852 set_robot_commands_median 0.0842907882872082 set_robot_commands_min 0.06560681874935444 sim_compute_performance-ego_max 0.06491226845599235 sim_compute_performance-ego_mean 0.059211748515919885 sim_compute_performance-ego_median 0.06255682776955997 sim_compute_performance-ego_min 0.045901092199178845 sim_compute_robot_state-ego_max 0.06933191228420177 sim_compute_robot_state-ego_mean 0.06203081243859014 sim_compute_robot_state-ego_median 0.0658184289932251 sim_compute_robot_state-ego_min 0.047955843118520886 sim_compute_robot_state-npc0_max 0.06336079252527115 sim_compute_robot_state-npc0_mean 0.05967285742486352 sim_compute_robot_state-npc0_median 0.06285902098113415 sim_compute_robot_state-npc0_min 0.04927965769400963 sim_compute_robot_state-npc1_max 0.06721947239894493 sim_compute_robot_state-npc1_mean 0.06087022308633502 sim_compute_robot_state-npc1_median 0.06366053794292693 sim_compute_robot_state-npc1_min 0.04759077842418964 sim_compute_robot_state-npc2_max 0.06475240372596903 sim_compute_robot_state-npc2_mean 0.05969462964575504 sim_compute_robot_state-npc2_median 0.06128983871609557 sim_compute_robot_state-npc2_min 0.04939502477645874 sim_compute_robot_state-npc3_max 0.06732628954217788 sim_compute_robot_state-npc3_mean 0.06023421473038546 sim_compute_robot_state-npc3_median 0.061840398638856174 sim_compute_robot_state-npc3_min 0.04833471316557664 sim_compute_sim_state_max 0.03849765848606191 sim_compute_sim_state_mean 0.03402052315951186 sim_compute_sim_state_median 0.03421545963661343 sim_compute_sim_state_min 0.02737850409287673 sim_physics_max 0.04414459999571455 sim_physics_mean 0.038562311588636766 sim_physics_median 0.041370232899983726 sim_physics_min 0.027281770339378945 sim_render-ego_max 0.05893811773746572 sim_render-ego_mean 0.05431156627637094 sim_render-ego_median 0.05845003034554276 sim_render-ego_min 0.04338882519648625 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 19598
2447
Nicky Eichmann Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation host-error no ip-172-31-38-104-8056
2019-04-24 15:53:05+00:00 2019-04-24 16:00:03+00:00 0:06:58 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']' returned non-zero exit status 255.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']' returned non-zero exit status 255.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19589
2452
Liam Paull  🇨🇦Baseline solution using ROS aido2-LF-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:49:28+00:00 2019-04-24 15:52:49+00:00 0:03:21 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19585
2456
Liam Paull  🇨🇦challenge-aido_LF-template-ros aido2-LF-sim-validation
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:48:51+00:00 2019-04-24 15:49:21+00:00 0:00:30 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19581
2463
Liam Paull  🇨🇦challenge-aido_LF-template-ros aido2-LFVI-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:48:07+00:00 2019-04-24 15:48:37+00:00 0:00:30 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19578
2484
Liam Paull  🇨🇦challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:46:51+00:00 2019-04-24 15:47:54+00:00 0:01:03 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19564
2501
jiang peng test for ppo aido2-LF-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:46:04+00:00 2019-04-24 15:46:34+00:00 0:00:30 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19537
2528
Liam Paull  🇨🇦baseline-IL-sim-tensorflow aido2-LF-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:42:56+00:00 2019-04-24 15:45:51+00:00 0:02:55 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19529
2542
Andrea Censi  🇨ðŸ‡challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 15:39:42+00:00 2019-04-24 15:42:49+00:00 0:03:07 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19495
2594
Julian Zilly baseline-IL-logs-tensorflow aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 15:25:24+00:00 2019-04-24 15:39:28+00:00 0:14:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24056463580365328 survival_time_median 5.14999999999999 deviation-center-line_median 0.2680092955032456 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2414101396949546 agent_compute-ego_mean 0.227939162309636 agent_compute-ego_median 0.2224889787343832 agent_compute-ego_min 0.21769199651830337 deviation-center-line_max 0.28220859840358753 deviation-center-line_mean 0.2616154306198516 deviation-center-line_min 0.23849895566489185 deviation-heading_max 2.128659291301694 deviation-heading_mean 2.028107595581917 deviation-heading_median 2.032334066672542 deviation-heading_min 1.9594553223265267 driven_any_max 0.2859818814903161 driven_any_mean 0.27865594359178997 driven_any_median 0.2784020274019724 driven_any_min 0.27043761596197047 driven_lanedir_consec_max 0.24975542890840807 driven_lanedir_consec_mean 0.24125415415598211 driven_lanedir_consec_min 0.2315090932046382 driven_lanedir_max 0.24975542890840807 driven_lanedir_mean 0.24125415415598211 driven_lanedir_median 0.24056463580365328 driven_lanedir_min 0.2315090932046382 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.2859818814903161, "sim_physics": 0.043634449394003856, "survival_time": 5.14999999999999, "driven_lanedir": 0.24975542890840807, "sim_render-ego": 0.062446249341501774, "in-drivable-lane": 0, "agent_compute-ego": 0.2414101396949546, "deviation-heading": 1.975067097252645, "set_robot_commands": 0.10022207602713872, "deviation-center-line": 0.2680092955032456, "driven_lanedir_consec": 0.24975542890840807, "sim_compute_sim_state": 0.03913455796473234, "sim_compute_performance-ego": 0.06774423886271357, "sim_compute_robot_state-ego": 0.0709228353592956, "sim_compute_robot_state-npc0": 0.06905778634895399, "sim_compute_robot_state-npc1": 0.06972641157872468, "sim_compute_robot_state-npc2": 0.07116100163135713, "sim_compute_robot_state-npc3": 0.06878017221839683}, "udem1-1-0": {"driven_any": 0.2784020274019724, "sim_physics": 0.04177699409998381, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24056463580365328, "sim_render-ego": 0.061671014015491195, "in-drivable-lane": 0, "agent_compute-ego": 0.2224889787343832, "deviation-heading": 1.9594553223265267, "set_robot_commands": 0.09321641463499802, "deviation-center-line": 0.23849895566489185, "driven_lanedir_consec": 0.24056463580365328, "sim_compute_sim_state": 0.037746500510435835, "sim_compute_performance-ego": 0.06864420038003188, "sim_compute_robot_state-ego": 0.06852163947545566, "sim_compute_robot_state-npc0": 0.06371879119139451, "sim_compute_robot_state-npc1": 0.06449979085188645, "sim_compute_robot_state-npc2": 0.06717930619533245, "sim_compute_robot_state-npc3": 0.06470065162732051}, "udem1-2-0": {"driven_any": 0.2754400469033636, "sim_physics": 0.049257248350717486, "survival_time": 5.14999999999999, "driven_lanedir": 0.23785073084129493, "sim_render-ego": 0.0589805390070943, "in-drivable-lane": 0, "agent_compute-ego": 0.21891846240145488, "deviation-heading": 2.128659291301694, "set_robot_commands": 0.09201603259855104, "deviation-center-line": 0.2802937238721823, "driven_lanedir_consec": 0.23785073084129493, "sim_compute_sim_state": 0.03833245073707359, "sim_compute_performance-ego": 0.0649826827558499, "sim_compute_robot_state-ego": 0.06940347245595987, "sim_compute_robot_state-npc0": 0.06614704039490339, "sim_compute_robot_state-npc1": 0.06915368154210952, "sim_compute_robot_state-npc2": 0.0686075733703317, "sim_compute_robot_state-npc3": 0.06697902633148489}, "udem1-3-0": {"driven_any": 0.27043761596197047, "sim_physics": 0.04814565410980812, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2315090932046382, "sim_render-ego": 0.06504629666988666, "in-drivable-lane": 0, "agent_compute-ego": 0.23918623419908375, "deviation-heading": 2.045022200356176, "set_robot_commands": 0.09883109193581802, "deviation-center-line": 0.2390665796553508, "driven_lanedir_consec": 0.2315090932046382, "sim_compute_sim_state": 0.03965836304884691, "sim_compute_performance-ego": 0.06964409351348877, "sim_compute_robot_state-ego": 0.07388484477996826, "sim_compute_robot_state-npc0": 0.06962114114027756, "sim_compute_robot_state-npc1": 0.06930158917720501, "sim_compute_robot_state-npc2": 0.06924107212286729, "sim_compute_robot_state-npc3": 0.0712563945696904}, "udem1-4-0": {"driven_any": 0.28301814620132737, "sim_physics": 0.0418244670419132, "survival_time": 5.09999999999999, "driven_lanedir": 0.24659088202191604, "sim_render-ego": 0.058136940002441406, "in-drivable-lane": 0, "agent_compute-ego": 0.21769199651830337, "deviation-heading": 2.032334066672542, "set_robot_commands": 0.09079114362305286, "deviation-center-line": 0.28220859840358753, "driven_lanedir_consec": 0.24659088202191604, "sim_compute_sim_state": 0.03872129028918697, "sim_compute_performance-ego": 0.0623165953393076, "sim_compute_robot_state-ego": 0.06446024717069139, "sim_compute_robot_state-npc0": 0.0658110216552136, "sim_compute_robot_state-npc1": 0.06346241399353626, "sim_compute_robot_state-npc2": 0.06368623995313458, "sim_compute_robot_state-npc3": 0.06534830261679257}}set_robot_commands_max 0.10022207602713872 set_robot_commands_mean 0.09501535176391172 set_robot_commands_median 0.09321641463499802 set_robot_commands_min 0.09079114362305286 sim_compute_performance-ego_max 0.06964409351348877 sim_compute_performance-ego_mean 0.06666636217027835 sim_compute_performance-ego_median 0.06774423886271357 sim_compute_performance-ego_min 0.0623165953393076 sim_compute_robot_state-ego_max 0.07388484477996826 sim_compute_robot_state-ego_mean 0.06943860784827414 sim_compute_robot_state-ego_median 0.06940347245595987 sim_compute_robot_state-ego_min 0.06446024717069139 sim_compute_robot_state-npc0_max 0.06962114114027756 sim_compute_robot_state-npc0_mean 0.06687115614614861 sim_compute_robot_state-npc0_median 0.06614704039490339 sim_compute_robot_state-npc0_min 0.06371879119139451 sim_compute_robot_state-npc1_max 0.06972641157872468 sim_compute_robot_state-npc1_mean 0.06722877742869238 sim_compute_robot_state-npc1_median 0.06915368154210952 sim_compute_robot_state-npc1_min 0.06346241399353626 sim_compute_robot_state-npc2_max 0.07116100163135713 sim_compute_robot_state-npc2_mean 0.06797503865460464 sim_compute_robot_state-npc2_median 0.0686075733703317 sim_compute_robot_state-npc2_min 0.06368623995313458 sim_compute_robot_state-npc3_max 0.0712563945696904 sim_compute_robot_state-npc3_mean 0.06741290947273705 sim_compute_robot_state-npc3_median 0.06697902633148489 sim_compute_robot_state-npc3_min 0.06470065162732051 sim_compute_sim_state_max 0.03965836304884691 sim_compute_sim_state_mean 0.038718632510055126 sim_compute_sim_state_median 0.03872129028918697 sim_compute_sim_state_min 0.037746500510435835 sim_physics_max 0.049257248350717486 sim_physics_mean 0.04492776259928529 sim_physics_median 0.043634449394003856 sim_physics_min 0.04177699409998381 sim_render-ego_max 0.06504629666988666 sim_render-ego_mean 0.06125620780728307 sim_render-ego_median 0.061671014015491195 sim_render-ego_min 0.058136940002441406 simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.15999999999999 survival_time_min 5.09999999999999
No reset possible 19484
2609
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 15:18:16+00:00 2019-04-24 15:25:10+00:00 0:06:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07729677150123998 agent_compute-ego_mean 0.06679519823485983 agent_compute-ego_median 0.06615566290341891 agent_compute-ego_min 0.05959350198179811 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.03240779841818461, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.056728738110239915, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06450173331470024, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0921483039855957, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.034520338221294126, "sim_compute_performance-ego": 0.06335928672697486, "sim_compute_robot_state-ego": 0.06464183039781524, "sim_compute_robot_state-npc0": 0.06469974285218774, "sim_compute_robot_state-npc1": 0.06288942767352593, "sim_compute_robot_state-npc2": 0.06220513436852432, "sim_compute_robot_state-npc3": 0.06277602474863936}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.032553828679598294, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.055922278991112344, "in-drivable-lane": 0, "agent_compute-ego": 0.06615566290341891, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08419219347146842, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.033625089205228366, "sim_compute_performance-ego": 0.06204776580517109, "sim_compute_robot_state-ego": 0.06188526520362267, "sim_compute_robot_state-npc0": 0.06357578130868766, "sim_compute_robot_state-npc1": 0.05929375611818754, "sim_compute_robot_state-npc2": 0.06040815206674429, "sim_compute_robot_state-npc3": 0.060999191724337064}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.03526918938819398, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05815779909174493, "in-drivable-lane": 0, "agent_compute-ego": 0.06642832147314194, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08829194434145664, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03451008492327751, "sim_compute_performance-ego": 0.06562044772695988, "sim_compute_robot_state-ego": 0.06591420478009163, "sim_compute_robot_state-npc0": 0.06443198183749585, "sim_compute_robot_state-npc1": 0.06522049295141343, "sim_compute_robot_state-npc2": 0.06538842586760825, "sim_compute_robot_state-npc3": 0.06540527242295285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.029495708235017543, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.04792773068606199, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05959350198179811, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07765797468332145, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02958272315643646, "sim_compute_performance-ego": 0.05367783399728628, "sim_compute_robot_state-ego": 0.05341574385925964, "sim_compute_robot_state-npc0": 0.05453464225098327, "sim_compute_robot_state-npc1": 0.053175813549167505, "sim_compute_robot_state-npc2": 0.05737850692245986, "sim_compute_robot_state-npc3": 0.05290727824955197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.03537893295288086, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.057291846526296514, "in-drivable-lane": 0, "agent_compute-ego": 0.07729677150123998, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.09550670573585912, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.034630775451660156, "sim_compute_performance-ego": 0.06176518139086271, "sim_compute_robot_state-ego": 0.06806817180231998, "sim_compute_robot_state-npc0": 0.06761316249245092, "sim_compute_robot_state-npc1": 0.0661475658416748, "sim_compute_robot_state-npc2": 0.06157228193785015, "sim_compute_robot_state-npc3": 0.06292654338635896}}set_robot_commands_max 0.09550670573585912 set_robot_commands_mean 0.08755942444354027 set_robot_commands_median 0.08829194434145664 set_robot_commands_min 0.07765797468332145 sim_compute_performance-ego_max 0.06562044772695988 sim_compute_performance-ego_mean 0.06129410312945097 sim_compute_performance-ego_median 0.06204776580517109 sim_compute_performance-ego_min 0.05367783399728628 sim_compute_robot_state-ego_max 0.06806817180231998 sim_compute_robot_state-ego_mean 0.06278504320862184 sim_compute_robot_state-ego_median 0.06464183039781524 sim_compute_robot_state-ego_min 0.05341574385925964 sim_compute_robot_state-npc0_max 0.06761316249245092 sim_compute_robot_state-npc0_mean 0.0629710621483611 sim_compute_robot_state-npc0_median 0.06443198183749585 sim_compute_robot_state-npc0_min 0.05453464225098327 sim_compute_robot_state-npc1_max 0.0661475658416748 sim_compute_robot_state-npc1_mean 0.06134541122679384 sim_compute_robot_state-npc1_median 0.06288942767352593 sim_compute_robot_state-npc1_min 0.053175813549167505 sim_compute_robot_state-npc2_max 0.06538842586760825 sim_compute_robot_state-npc2_mean 0.06139050023263738 sim_compute_robot_state-npc2_median 0.06157228193785015 sim_compute_robot_state-npc2_min 0.05737850692245986 sim_compute_robot_state-npc3_max 0.06540527242295285 sim_compute_robot_state-npc3_mean 0.06100286210636804 sim_compute_robot_state-npc3_median 0.06277602474863936 sim_compute_robot_state-npc3_min 0.05290727824955197 sim_compute_sim_state_max 0.034630775451660156 sim_compute_sim_state_mean 0.03337380219157932 sim_compute_sim_state_median 0.03451008492327751 sim_compute_sim_state_min 0.02958272315643646 sim_physics_max 0.03537893295288086 sim_physics_mean 0.03302109153477506 sim_physics_median 0.032553828679598294 sim_physics_min 0.029495708235017543 sim_render-ego_max 0.05815779909174493 sim_render-ego_mean 0.05520567868109114 sim_render-ego_median 0.056728738110239915 sim_render-ego_min 0.04792773068606199 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 19473
2625
Andrea Censi  🇨ðŸ‡challenge-aido_LF-template-random aido2-LFVI-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 15:09:20+00:00 2019-04-24 15:17:40+00:00 0:08:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.1502289405235877 agent_compute-ego_mean 0.13949062601045628 agent_compute-ego_median 0.1405730785862092 agent_compute-ego_min 0.12493495230979108 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.041708185559227354, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05620487152584015, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13996877745976524, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08402229490734282, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.033286548796154204, "sim_compute_performance-ego": 0.05989298744807168, "sim_compute_robot_state-ego": 0.06583498773120698, "sim_compute_robot_state-npc0": 0.0607498600369408, "sim_compute_robot_state-npc1": 0.06321423394339425, "sim_compute_robot_state-npc2": 0.06020659113687182, "sim_compute_robot_state-npc3": 0.05965197653997512}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03865675365223604, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05660815799937529, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14174738117292815, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0895082576602113, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03667312509873334, "sim_compute_performance-ego": 0.06743994881125058, "sim_compute_robot_state-ego": 0.06844011942545573, "sim_compute_robot_state-npc0": 0.073852398816277, "sim_compute_robot_state-npc1": 0.06408164547938927, "sim_compute_robot_state-npc2": 0.06364864461562213, "sim_compute_robot_state-npc3": 0.0649569922802495}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04401741873833441, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05518502189267066, "in-drivable-lane": 0, "agent_compute-ego": 0.1405730785862092, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09019490595786804, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03516066074371338, "sim_compute_performance-ego": 0.058544385817743114, "sim_compute_robot_state-ego": 0.06640303519464308, "sim_compute_robot_state-npc0": 0.06325950161103279, "sim_compute_robot_state-npc1": 0.06116471752043693, "sim_compute_robot_state-npc2": 0.06035156403818438, "sim_compute_robot_state-npc3": 0.06124336104239187}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0346830297023692, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.04870498434026191, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12493495230979108, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07602544541054583, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02999364568832073, "sim_compute_performance-ego": 0.05287630507286559, "sim_compute_robot_state-ego": 0.056886353391282105, "sim_compute_robot_state-npc0": 0.05405623862083922, "sim_compute_robot_state-npc1": 0.05431996507847563, "sim_compute_robot_state-npc2": 0.05290822018968298, "sim_compute_robot_state-npc3": 0.05178965406214937}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.03750823552791889, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05874870832149799, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1502289405235877, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.09015289636758658, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.033651301494011514, "sim_compute_performance-ego": 0.06415579410699698, "sim_compute_robot_state-ego": 0.06524846645501944, "sim_compute_robot_state-npc0": 0.0594175962301401, "sim_compute_robot_state-npc1": 0.06146038495577299, "sim_compute_robot_state-npc2": 0.06160310598520132, "sim_compute_robot_state-npc3": 0.061444640159606934}}set_robot_commands_max 0.09019490595786804 set_robot_commands_mean 0.08598076006071091 set_robot_commands_median 0.0895082576602113 set_robot_commands_min 0.07602544541054583 sim_compute_performance-ego_max 0.06743994881125058 sim_compute_performance-ego_mean 0.06058188425138559 sim_compute_performance-ego_median 0.05989298744807168 sim_compute_performance-ego_min 0.05287630507286559 sim_compute_robot_state-ego_max 0.06844011942545573 sim_compute_robot_state-ego_mean 0.06456259243952148 sim_compute_robot_state-ego_median 0.06583498773120698 sim_compute_robot_state-ego_min 0.056886353391282105 sim_compute_robot_state-npc0_max 0.073852398816277 sim_compute_robot_state-npc0_mean 0.06226711906304598 sim_compute_robot_state-npc0_median 0.0607498600369408 sim_compute_robot_state-npc0_min 0.05405623862083922 sim_compute_robot_state-npc1_max 0.06408164547938927 sim_compute_robot_state-npc1_mean 0.060848189395493815 sim_compute_robot_state-npc1_median 0.06146038495577299 sim_compute_robot_state-npc1_min 0.05431996507847563 sim_compute_robot_state-npc2_max 0.06364864461562213 sim_compute_robot_state-npc2_mean 0.05974362519311253 sim_compute_robot_state-npc2_median 0.06035156403818438 sim_compute_robot_state-npc2_min 0.05290822018968298 sim_compute_robot_state-npc3_max 0.0649569922802495 sim_compute_robot_state-npc3_mean 0.05981732481687456 sim_compute_robot_state-npc3_median 0.06124336104239187 sim_compute_robot_state-npc3_min 0.05178965406214937 sim_compute_sim_state_max 0.03667312509873334 sim_compute_sim_state_mean 0.033753056364186636 sim_compute_sim_state_median 0.033651301494011514 sim_compute_sim_state_min 0.02999364568832073 sim_physics_max 0.04401741873833441 sim_physics_mean 0.039314724636017186 sim_physics_median 0.03865675365223604 sim_physics_min 0.0346830297023692 sim_render-ego_max 0.05874870832149799 sim_render-ego_mean 0.0550903488159292 sim_render-ego_median 0.05620487152584015 sim_render-ego_min 0.04870498434026191 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 19451
2636
Andrea Censi  🇨ðŸ‡challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 15:00:22+00:00 2019-04-24 15:09:07+00:00 0:08:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.14878898666751 agent_compute-ego_mean 0.1341624166063577 agent_compute-ego_median 0.13515872047061012 agent_compute-ego_min 0.1177900479390071 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03873615416269454, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05482882923550076, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13515872047061012, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08347910169571165, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03474986742413233, "sim_compute_performance-ego": 0.05876867354862274, "sim_compute_robot_state-ego": 0.06408916200910296, "sim_compute_robot_state-npc0": 0.06004254780118427, "sim_compute_robot_state-npc1": 0.06158620970589774, "sim_compute_robot_state-npc2": 0.06158638000488281, "sim_compute_robot_state-npc3": 0.05990484782627651}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03732025389577828, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0554650297351912, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13667741943808162, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08862660445419013, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03455464980181526, "sim_compute_performance-ego": 0.06092655424978219, "sim_compute_robot_state-ego": 0.0653675630980847, "sim_compute_robot_state-npc0": 0.06137274293338552, "sim_compute_robot_state-npc1": 0.06480020167780857, "sim_compute_robot_state-npc2": 0.061157605227302105, "sim_compute_robot_state-npc3": 0.06346402448766372}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0412622497927758, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.060324565056831606, "in-drivable-lane": 0, "agent_compute-ego": 0.14878898666751, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.090661883354187, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.0359762599391322, "sim_compute_performance-ego": 0.06432243700950377, "sim_compute_robot_state-ego": 0.0658613097283148, "sim_compute_robot_state-npc0": 0.06456755438158589, "sim_compute_robot_state-npc1": 0.06323562514397406, "sim_compute_robot_state-npc2": 0.06297506440070368, "sim_compute_robot_state-npc3": 0.0637071632569836}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0396867001310308, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.053180669216399495, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13239690851657948, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08205023978618865, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.0325798658614463, "sim_compute_performance-ego": 0.057763657671339966, "sim_compute_robot_state-ego": 0.06166771624950653, "sim_compute_robot_state-npc0": 0.057427269347170566, "sim_compute_robot_state-npc1": 0.05843590421879545, "sim_compute_robot_state-npc2": 0.05674274424289135, "sim_compute_robot_state-npc3": 0.05624920763867967}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02806015656544612, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04809883924630972, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1177900479390071, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0691487193107605, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.026455269410060003, "sim_compute_performance-ego": 0.05276210949971126, "sim_compute_robot_state-ego": 0.04992194359119122, "sim_compute_robot_state-npc0": 0.04904763056681706, "sim_compute_robot_state-npc1": 0.049128518654749945, "sim_compute_robot_state-npc2": 0.04931641541994535, "sim_compute_robot_state-npc3": 0.04799523720374474}}set_robot_commands_max 0.090661883354187 set_robot_commands_mean 0.08279330972020758 set_robot_commands_median 0.08347910169571165 set_robot_commands_min 0.0691487193107605 sim_compute_performance-ego_max 0.06432243700950377 sim_compute_performance-ego_mean 0.058908686395791984 sim_compute_performance-ego_median 0.05876867354862274 sim_compute_performance-ego_min 0.05276210949971126 sim_compute_robot_state-ego_max 0.0658613097283148 sim_compute_robot_state-ego_mean 0.06138153893524005 sim_compute_robot_state-ego_median 0.06408916200910296 sim_compute_robot_state-ego_min 0.04992194359119122 sim_compute_robot_state-npc0_max 0.06456755438158589 sim_compute_robot_state-npc0_mean 0.05849154900602867 sim_compute_robot_state-npc0_median 0.06004254780118427 sim_compute_robot_state-npc0_min 0.04904763056681706 sim_compute_robot_state-npc1_max 0.06480020167780857 sim_compute_robot_state-npc1_mean 0.05943729188024516 sim_compute_robot_state-npc1_median 0.06158620970589774 sim_compute_robot_state-npc1_min 0.049128518654749945 sim_compute_robot_state-npc2_max 0.06297506440070368 sim_compute_robot_state-npc2_mean 0.05835564185914506 sim_compute_robot_state-npc2_median 0.061157605227302105 sim_compute_robot_state-npc2_min 0.04931641541994535 sim_compute_robot_state-npc3_max 0.0637071632569836 sim_compute_robot_state-npc3_mean 0.05826409608266965 sim_compute_robot_state-npc3_median 0.05990484782627651 sim_compute_robot_state-npc3_min 0.04799523720374474 sim_compute_sim_state_max 0.0359762599391322 sim_compute_sim_state_mean 0.03286318248731722 sim_compute_sim_state_median 0.03455464980181526 sim_compute_sim_state_min 0.026455269410060003 sim_physics_max 0.0412622497927758 sim_physics_mean 0.037013102909545105 sim_physics_median 0.03873615416269454 sim_physics_min 0.02806015656544612 sim_render-ego_max 0.060324565056831606 sim_render-ego_mean 0.05437958649804656 sim_render-ego_median 0.05482882923550076 sim_render-ego_min 0.04809883924630972 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 19443
2649
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation host-error no ip-172-31-38-104-8056
2019-04-24 14:54:48+00:00 2019-04-24 15:00:06+00:00 0:05:18 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19405
2708
Rami Al-Naim  🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 14:29:07+00:00 2019-04-24 14:54:42+00:00 0:25:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9940003362676816 survival_time_median 13.05000000000005 deviation-center-line_median 0.8156497959383973 in-drivable-lane_median 1.750000000000015
other stats agent_compute-ego_max 0.09378837647839128 agent_compute-ego_mean 0.08969972153649346 agent_compute-ego_median 0.08981918334960938 agent_compute-ego_min 0.08457835241295826 deviation-center-line_max 0.9723511364404808 deviation-center-line_mean 0.6807841971609401 deviation-center-line_min 0.32236663551128514 deviation-heading_max 6.7719638175575465 deviation-heading_mean 3.8456530594362506 deviation-heading_median 4.6205639543020744 deviation-heading_min 0.7626681611106574 driven_any_max 2.3553823552533815 driven_any_mean 1.668695122093321 driven_any_median 2.0500856106652763 driven_any_min 0.7806693780160238 driven_lanedir_consec_max 1.3679196990003089 driven_lanedir_consec_mean 1.0015318300615244 driven_lanedir_consec_min 0.7499990385650396 driven_lanedir_max 1.689176892272246 driven_lanedir_mean 1.164149485533915 driven_lanedir_median 1.2212807718066745 driven_lanedir_min 0.7499990385650396 in-drivable-lane_max 4.450000000000007 in-drivable-lane_mean 1.8400000000000076 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8020088466541154, "sim_physics": 0.0476960935325266, "survival_time": 5.349999999999989, "driven_lanedir": 0.7499990385650396, "sim_render-ego": 0.07152106160315398, "in-drivable-lane": 0, "agent_compute-ego": 0.09378837647839128, "deviation-heading": 1.4956603976025722, "set_robot_commands": 0.11733370629426476, "deviation-center-line": 0.32236663551128514, "driven_lanedir_consec": 0.7499990385650396, "sim_compute_sim_state": 0.04384741604885208, "sim_compute_performance-ego": 0.07774608825968805, "sim_compute_robot_state-ego": 0.08012530291191886, "sim_compute_robot_state-npc0": 0.07659173457421989, "sim_compute_robot_state-npc1": 0.07944065833760199, "sim_compute_robot_state-npc2": 0.07947686453846013, "sim_compute_robot_state-npc3": 0.07949332433326223}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355329419877808, "sim_physics": 0.04354924519856771, "survival_time": 14.950000000000076, "driven_lanedir": 1.689176892272246, "sim_render-ego": 0.06773686567942301, "in-drivable-lane": 1.750000000000015, "agent_compute-ego": 0.08981918334960938, "deviation-heading": 6.7719638175575465, "set_robot_commands": 0.11262656132380168, "deviation-center-line": 0.9723511364404808, "driven_lanedir_consec": 1.3679196990003089, "sim_compute_sim_state": 0.04249426364898681, "sim_compute_performance-ego": 0.07441637833913167, "sim_compute_robot_state-ego": 0.07862477858861287, "sim_compute_robot_state-npc0": 0.0751968789100647, "sim_compute_robot_state-npc1": 0.07576882521311443, "sim_compute_robot_state-npc2": 0.07588360786437988, "sim_compute_robot_state-npc3": 0.07502296447753906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7806693780160238, "sim_physics": 0.04540995486731668, "survival_time": 5.14999999999999, "driven_lanedir": 0.7666372600031672, "sim_render-ego": 0.06877258680399181, "in-drivable-lane": 0, "agent_compute-ego": 0.09065026912874388, "deviation-heading": 0.7626681611106574, "set_robot_commands": 0.11343043521769997, "deviation-center-line": 0.45189365578940954, "driven_lanedir_consec": 0.7666372600031672, "sim_compute_sim_state": 0.0421831515228864, "sim_compute_performance-ego": 0.07340508062862655, "sim_compute_robot_state-ego": 0.08144413846210369, "sim_compute_robot_state-npc0": 0.07483149037777799, "sim_compute_robot_state-npc1": 0.07443473408523116, "sim_compute_robot_state-npc2": 0.07564491438634187, "sim_compute_robot_state-npc3": 0.07423316159294648}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3553823552533815, "sim_physics": 0.041599178314208986, "survival_time": 14.950000000000076, "driven_lanedir": 1.3936534650224472, "sim_render-ego": 0.0665155816078186, "in-drivable-lane": 4.450000000000007, "agent_compute-ego": 0.08966242631276448, "deviation-heading": 4.6205639543020744, "set_robot_commands": 0.10971951405207316, "deviation-center-line": 0.8416597621251278, "driven_lanedir_consec": 1.1291028164714243, "sim_compute_sim_state": 0.04153342644373576, "sim_compute_performance-ego": 0.07392378091812134, "sim_compute_robot_state-ego": 0.07666513681411743, "sim_compute_robot_state-npc0": 0.07283376773198445, "sim_compute_robot_state-npc1": 0.0741311240196228, "sim_compute_robot_state-npc2": 0.07436803181966146, "sim_compute_robot_state-npc3": 0.07403980175654093}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0500856106652763, "sim_physics": 0.03853289012251229, "survival_time": 13.05000000000005, "driven_lanedir": 1.2212807718066745, "sim_render-ego": 0.062122918636862805, "in-drivable-lane": 3.000000000000017, "agent_compute-ego": 0.08457835241295826, "deviation-heading": 5.577408966608402, "set_robot_commands": 0.10224311105136212, "deviation-center-line": 0.8156497959383973, "driven_lanedir_consec": 0.9940003362676816, "sim_compute_sim_state": 0.03856723061923323, "sim_compute_performance-ego": 0.06764594713846843, "sim_compute_robot_state-ego": 0.07068545516880079, "sim_compute_robot_state-npc0": 0.07004584115127037, "sim_compute_robot_state-npc1": 0.07289505096230928, "sim_compute_robot_state-npc2": 0.06853601210875529, "sim_compute_robot_state-npc3": 0.07006461684274491}}set_robot_commands_max 0.11733370629426476 set_robot_commands_mean 0.11107066558784032 set_robot_commands_median 0.11262656132380168 set_robot_commands_min 0.10224311105136212 sim_compute_performance-ego_max 0.07774608825968805 sim_compute_performance-ego_mean 0.07342745505680721 sim_compute_performance-ego_median 0.07392378091812134 sim_compute_performance-ego_min 0.06764594713846843 sim_compute_robot_state-ego_max 0.08144413846210369 sim_compute_robot_state-ego_mean 0.07750896238911072 sim_compute_robot_state-ego_median 0.07862477858861287 sim_compute_robot_state-ego_min 0.07068545516880079 sim_compute_robot_state-npc0_max 0.07659173457421989 sim_compute_robot_state-npc0_mean 0.07389994254906349 sim_compute_robot_state-npc0_median 0.07483149037777799 sim_compute_robot_state-npc0_min 0.07004584115127037 sim_compute_robot_state-npc1_max 0.07944065833760199 sim_compute_robot_state-npc1_mean 0.07533407852357592 sim_compute_robot_state-npc1_median 0.07443473408523116 sim_compute_robot_state-npc1_min 0.07289505096230928 sim_compute_robot_state-npc2_max 0.07947686453846013 sim_compute_robot_state-npc2_mean 0.07478188614351973 sim_compute_robot_state-npc2_median 0.07564491438634187 sim_compute_robot_state-npc2_min 0.06853601210875529 sim_compute_robot_state-npc3_max 0.07949332433326223 sim_compute_robot_state-npc3_mean 0.07457077380060673 sim_compute_robot_state-npc3_median 0.07423316159294648 sim_compute_robot_state-npc3_min 0.07006461684274491 sim_compute_sim_state_max 0.04384741604885208 sim_compute_sim_state_mean 0.04172509765673886 sim_compute_sim_state_median 0.0421831515228864 sim_compute_sim_state_min 0.03856723061923323 sim_physics_max 0.0476960935325266 sim_physics_mean 0.043357472407026455 sim_physics_median 0.04354924519856771 sim_physics_min 0.03853289012251229 sim_render-ego_max 0.07152106160315398 sim_render-ego_mean 0.06733380286625004 sim_render-ego_median 0.06773686567942301 sim_render-ego_min 0.062122918636862805 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.690000000000037 survival_time_min 5.14999999999999
No reset possible 19365
2973
Julian Zilly Baseline-IL-logs-tensorflow aido2-LF-sim-testing
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 14:11:43+00:00 2019-04-24 14:29:00+00:00 0:17:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0288239201842655 survival_time_median 11.050000000000022 deviation-center-line_median 0.40135253135827864 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.20761467773338843 agent_compute-ego_mean 0.18776739353884192 agent_compute-ego_median 0.1899010354822332 agent_compute-ego_min 0.14404008830834297 deviation-center-line_max 0.5624371866279603 deviation-center-line_mean 0.42495976017930576 deviation-center-line_min 0.3019763805672595 deviation-heading_max 1.222631692653237 deviation-heading_mean 1.1317160939440254 deviation-heading_median 1.1503948660382377 deviation-heading_min 1.008864619324518 driven_any_max 1.3875634241859125 driven_any_mean 1.021966127776142 driven_any_median 1.074317883175983 driven_any_min 0.5071449377664291 driven_lanedir_consec_max 1.3820930410823813 driven_lanedir_consec_mean 0.9609240930921846 driven_lanedir_consec_min 0.4902491431589544 driven_lanedir_max 1.3820930410823813 driven_lanedir_mean 0.9609240930921846 driven_lanedir_median 1.0288239201842655 driven_lanedir_min 0.4902491431589544 in-drivable-lane_max 2.80000000000004 in-drivable-lane_mean 0.5600000000000079 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5071449377664291, "sim_physics": 0.018606799299066716, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4902491431589544, "sim_render-ego": 0.04509279727935791, "in-drivable-lane": 0, "agent_compute-ego": 0.1899010354822332, "deviation-heading": 1.1503948660382377, "set_robot_commands": 0.0771801926872947, "deviation-center-line": 0.3274067508014412, "driven_lanedir_consec": 0.4902491431589544, "sim_compute_sim_state": 0.03250836242328991, "sim_compute_performance-ego": 0.05153256979855624, "sim_compute_robot_state-ego": 0.059145814722234555}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.074317883175983, "sim_physics": 0.02287939088097934, "survival_time": 11.60000000000003, "driven_lanedir": 0.8207369655159571, "sim_render-ego": 0.05977393840921336, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.20761467773338843, "deviation-heading": 1.222631692653237, "set_robot_commands": 0.0949668390997525, "deviation-center-line": 0.40135253135827864, "driven_lanedir_consec": 0.8207369655159571, "sim_compute_sim_state": 0.037355055069101264, "sim_compute_performance-ego": 0.06745339364841066, "sim_compute_robot_state-ego": 0.07025040737513838}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3875634241859125, "sim_physics": 0.022148425579071044, "survival_time": 14.950000000000076, "driven_lanedir": 1.3820930410823813, "sim_render-ego": 0.06208174308141073, "in-drivable-lane": 0, "agent_compute-ego": 0.2075293517112732, "deviation-heading": 1.008864619324518, "set_robot_commands": 0.09577643235524495, "deviation-center-line": 0.3019763805672595, "driven_lanedir_consec": 1.3820930410823813, "sim_compute_sim_state": 0.03739493131637573, "sim_compute_performance-ego": 0.06868616898854574, "sim_compute_robot_state-ego": 0.07032042900721232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.04427316960406, "sim_physics": 0.023386368127626792, "survival_time": 10.700000000000015, "driven_lanedir": 1.0288239201842655, "sim_render-ego": 0.05285812092718677, "in-drivable-lane": 0, "agent_compute-ego": 0.18975181445897185, "deviation-heading": 1.1038202937194082, "set_robot_commands": 0.08374969981541143, "deviation-center-line": 0.5624371866279603, "driven_lanedir_consec": 1.0288239201842655, "sim_compute_sim_state": 0.03423026900425136, "sim_compute_performance-ego": 0.05861546837280844, "sim_compute_robot_state-ego": 0.06356603631349368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0965312241483252, "sim_physics": 0.015571404366471649, "survival_time": 11.050000000000022, "driven_lanedir": 1.0827173955193643, "sim_render-ego": 0.04165822887852181, "in-drivable-lane": 0, "agent_compute-ego": 0.14404008830834297, "deviation-heading": 1.1728689979847262, "set_robot_commands": 0.06887117122632885, "deviation-center-line": 0.5316259515415891, "driven_lanedir_consec": 1.0827173955193643, "sim_compute_sim_state": 0.026457689466519593, "sim_compute_performance-ego": 0.044132541207706225, "sim_compute_robot_state-ego": 0.047304220329043016}}set_robot_commands_max 0.09577643235524495 set_robot_commands_mean 0.08410886703680649 set_robot_commands_median 0.08374969981541143 set_robot_commands_min 0.06887117122632885 sim_compute_performance-ego_max 0.06868616898854574 sim_compute_performance-ego_mean 0.05808402840320546 sim_compute_performance-ego_median 0.05861546837280844 sim_compute_performance-ego_min 0.044132541207706225 sim_compute_robot_state-ego_max 0.07032042900721232 sim_compute_robot_state-ego_mean 0.06211738154942439 sim_compute_robot_state-ego_median 0.06356603631349368 sim_compute_robot_state-ego_min 0.047304220329043016 sim_compute_sim_state_max 0.03739493131637573 sim_compute_sim_state_mean 0.03358926145590757 sim_compute_sim_state_median 0.03423026900425136 sim_compute_sim_state_min 0.026457689466519593 sim_physics_max 0.023386368127626792 sim_physics_mean 0.02051847765064311 sim_physics_median 0.022148425579071044 sim_physics_min 0.015571404366471649 sim_render-ego_max 0.06208174308141073 sim_render-ego_mean 0.05229296571513812 sim_render-ego_median 0.05285812092718677 sim_render-ego_min 0.04165822887852181 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.760000000000028 survival_time_min 5.4999999999999885
No reset possible 19354
2805
Andrea Censi  🇨ðŸ‡challenge-aido_LF-template-random - random_agent aido2-LF-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 14:06:52+00:00 2019-04-24 14:11:29+00:00 0:04:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.17518998185793558 agent_compute-ego_mean 0.1365936377211164 agent_compute-ego_median 0.11981886625289916 agent_compute-ego_min 0.10876972410413954 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02863390490693866, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06914880140772406, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.16561294951528874, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10051444791397958, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.042010271324301664, "sim_compute_performance-ego": 0.0809633731842041, "sim_compute_robot_state-ego": 0.07986039035725144}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.017545792189511387, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.04574046351692893, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.11357666687531905, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07167724045840176, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.031233261932026257, "sim_compute_performance-ego": 0.052212287079204216, "sim_compute_robot_state-ego": 0.05415869301015681}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016470517052544487, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.044170506795247394, "in-drivable-lane": 0, "agent_compute-ego": 0.10876972410413954, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07016116778055827, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02713473637898763, "sim_compute_performance-ego": 0.04978825781080458, "sim_compute_robot_state-ego": 0.05038079155815972}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02875642478466034, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06346747279167175, "in-drivable-lane": 0, "agent_compute-ego": 0.17518998185793558, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10967579980691274, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.041506061951319374, "sim_compute_performance-ego": 0.07607783377170563, "sim_compute_robot_state-ego": 0.08268680671850841}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02058922893860761, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05009534429101383, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11981886625289916, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07349267426659079, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.031811672098496384, "sim_compute_performance-ego": 0.05312376513200648, "sim_compute_robot_state-ego": 0.05770640864091761}}set_robot_commands_max 0.10967579980691274 set_robot_commands_mean 0.08510426604528862 set_robot_commands_median 0.07349267426659079 set_robot_commands_min 0.07016116778055827 sim_compute_performance-ego_max 0.0809633731842041 sim_compute_performance-ego_mean 0.06243310339558501 sim_compute_performance-ego_median 0.05312376513200648 sim_compute_performance-ego_min 0.04978825781080458 sim_compute_robot_state-ego_max 0.08268680671850841 sim_compute_robot_state-ego_mean 0.0649586180569988 sim_compute_robot_state-ego_median 0.05770640864091761 sim_compute_robot_state-ego_min 0.05038079155815972 sim_compute_sim_state_max 0.042010271324301664 sim_compute_sim_state_mean 0.03473920073702626 sim_compute_sim_state_median 0.031811672098496384 sim_compute_sim_state_min 0.02713473637898763 sim_physics_max 0.02875642478466034 sim_physics_mean 0.022399173574452497 sim_physics_median 0.02058922893860761 sim_physics_min 0.016470517052544487 sim_render-ego_max 0.06914880140772406 sim_render-ego_mean 0.054524517760517185 sim_render-ego_median 0.05009534429101383 sim_render-ego_min 0.044170506795247394 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19340
2819
Liam Paull  🇨🇦challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation success no ip-172-31-38-104-8056
2019-04-24 14:00:49+00:00 2019-04-24 14:06:08+00:00 0:05:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.15099020302295685 agent_compute-ego_mean 0.14123791478233066 agent_compute-ego_median 0.14070814980400934 agent_compute-ego_min 0.1353485404320483 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021760405234570773, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05583969602045023, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1353485404320483, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0868748628868247, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03411060909055314, "sim_compute_performance-ego": 0.0588939774711177, "sim_compute_robot_state-ego": 0.06525808010461195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.0208232348615473, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06015391241420399, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14176593043587424, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08618019385771318, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03686186942187222, "sim_compute_performance-ego": 0.06376551498066295, "sim_compute_robot_state-ego": 0.06505718556317416}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.02273983425564236, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.055399322509765626, "in-drivable-lane": 0, "agent_compute-ego": 0.14070814980400934, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08712330924140083, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03670128716362847, "sim_compute_performance-ego": 0.06434120072258843, "sim_compute_robot_state-ego": 0.06761950916714138}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.023246119419733684, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06073311964670817, "in-drivable-lane": 0, "agent_compute-ego": 0.15099020302295685, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09218600392341614, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03825316826502482, "sim_compute_performance-ego": 0.06706056495507558, "sim_compute_robot_state-ego": 0.07212768495082855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02411586747449987, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06207544312757604, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13737675021676457, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08487629890441895, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03436579073176665, "sim_compute_performance-ego": 0.06594713996438419, "sim_compute_robot_state-ego": 0.0672899835249957}}set_robot_commands_max 0.09218600392341614 set_robot_commands_mean 0.08744813376275476 set_robot_commands_median 0.0868748628868247 set_robot_commands_min 0.08487629890441895 sim_compute_performance-ego_max 0.06706056495507558 sim_compute_performance-ego_mean 0.06400167961876577 sim_compute_performance-ego_median 0.06434120072258843 sim_compute_performance-ego_min 0.0588939774711177 sim_compute_robot_state-ego_max 0.07212768495082855 sim_compute_robot_state-ego_mean 0.06747048866215036 sim_compute_robot_state-ego_median 0.0672899835249957 sim_compute_robot_state-ego_min 0.06505718556317416 sim_compute_sim_state_max 0.03825316826502482 sim_compute_sim_state_mean 0.03605854493456906 sim_compute_sim_state_median 0.03670128716362847 sim_compute_sim_state_min 0.03411060909055314 sim_physics_max 0.02411586747449987 sim_physics_mean 0.0225370922491988 sim_physics_median 0.02273983425564236 sim_physics_min 0.0208232348615473 sim_render-ego_max 0.06207544312757604 sim_render-ego_mean 0.05884029874374082 sim_render-ego_median 0.06015391241420399 sim_render-ego_min 0.055399322509765626 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 19296
2877
Andrea Daniele  🇮🇹minimal_agent (Python 3) aido2-LF-sim-validation
step1-simulation host-error no ip-172-31-38-104-8056
2019-04-24 13:49:18+00:00 2019-04-24 14:00:13+00:00 0:10:55 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19293
2892
Diego Charrez  🇵🇪Python template aido2-AMOD-service_quality
step2-scoring success yes ip-172-31-38-104-8056
2019-04-24 13:47:16+00:00 2019-04-24 13:48:44+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.803471188314425
other stats efficiency -65.27552475325805 fleet_size -1000000000
No reset possible 19277
2800
Rami Al-Naim  🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error no ip-172-31-38-104-8056
2019-04-24 13:36:16+00:00 2019-04-24 13:46:43+00:00 0:10:27 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 88, in main
sim_ci.write_topic_and_expect_zero('seed', config.seed)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
wait_for_data(f, timeout, waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 88, in main
> sim_ci.write_topic_and_expect_zero('seed', config.seed)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
> wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
> wait_for_data(f, timeout, waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
> raise TimeoutError(msg)
> TimeoutError: Timeout after 30.0 s.
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19274
2865
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation host-error no ip-172-31-38-104-8056
2019-04-24 13:34:53+00:00 2019-04-24 13:35:56+00:00 0:01:03 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
six.raise_from(e, None)
File "<string>", line 2, in raise_from
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
response.begin()
File "/usr/lib/python3.6/http/client.py", line 297, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.6/http/client.py", line 258, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
_stacktrace=sys.exc_info()[2])
File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
raise value
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
chunked=chunked)
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
containers = client.containers.list(filters=dict(status='running'))
File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
containers.append(self.get(r['Id']))
File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
self._get(self._url("/containers/{0}/json", container)), True
File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 571, in run_single
timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 646, in run_one
client = check_docker_environment()
File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19246
2929
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFVI-sim-validation
step1-simulation host-error no ip-172-31-38-104-8056
2019-04-24 13:20:17+00:00 2019-04-24 13:34:46+00:00 0:14:29 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 993, in run_docker
subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19246-210452', 'down']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 485, in get_cr
run_docker(wd, project, cmd)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19246-210452', 'down']:
> Command '['docker-compose', '-p', 'job19246-210452', 'down']' returned non-zero exit status 1.
stdout |
stderr | Stopping job19246-210452_solution_1 ...
stderr | Stopping job19246-210452_evaluator_1 ...
stderr | Stopping job19246-210452_scenario_maker_1 ...
stderr | Stopping job19246-210452_simulator_1 ...
stderr |
stderr | ERROR: for job19246-210452_simulator_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr |
stderr | ERROR: for job19246-210452_evaluator_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr |
stderr | ERROR: for job19246-210452_scenario_maker_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr |
stderr | ERROR: for job19246-210452_solution_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible