Evaluator 789

step1-simulation

error

2019-04-24 20:18:26+00:00

2019-04-24 20:20:24+00:00

0:01:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19667

2373

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

aido2-LF-sim-validation

2019-04-24 16:33:33+00:00

2019-04-24 16:53:32+00:00

0:19:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6900582707828695
survival_time_median	14.700000000000074
deviation-center-line_median	0.3591683262706219
in-drivable-lane_median	1.200000000000017

other stats

agent_compute-ego_max	0.13797829345780976
agent_compute-ego_mean	0.11462671978071956
agent_compute-ego_median	0.11185665373074806
agent_compute-ego_min	0.08930041668188833
deviation-center-line_max	0.5528244200733968
deviation-center-line_mean	0.3250388716749043
deviation-center-line_min	0.12474392863155234
deviation-heading_max	1.7841667326335335
deviation-heading_mean	1.0687591038626745
deviation-heading_median	0.9805073681793997
deviation-heading_min	0.6869591234399757
driven_any_max	2.196039556148948
driven_any_mean	1.706254237612001
driven_any_median	2.1660738591449116
driven_any_min	0.9910472848979056
driven_lanedir_consec_max	1.8205635516580176
driven_lanedir_consec_mean	1.3480125540484669
driven_lanedir_consec_min	0.616683423521228
driven_lanedir_max	2.1929637182965305
driven_lanedir_mean	1.482287538796306
driven_lanedir_median	1.8205635516580176
driven_lanedir_min	0.616683423521228
in-drivable-lane_max	2.3999999999999915
in-drivable-lane_mean	1.250000000000006
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1660738591449116, "sim_physics": 0.03685335723721251, "survival_time": 14.700000000000074, "driven_lanedir": 1.961201560444252, "sim_render-ego": 0.0566103458404541, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.13797829345780976, "deviation-heading": 0.9805073681793997, "set_robot_commands": 0.08978969142550514, "deviation-center-line": 0.3591683262706219, "driven_lanedir_consec": 1.6900582707828695, "sim_compute_sim_state": 0.03572300826611162, "sim_compute_performance-ego": 0.06249245575496128, "sim_compute_robot_state-ego": 0.06683338012825064, "sim_compute_robot_state-npc0": 0.0625942645429754, "sim_compute_robot_state-npc1": 0.06302516882111427, "sim_compute_robot_state-npc2": 0.06233852006951157, "sim_compute_robot_state-npc3": 0.0633286951350517}, "udem1-1-0": {"driven_any": 1.0094322716915194, "sim_physics": 0.03411487794258225, "survival_time": 7.099999999999983, "driven_lanedir": 0.616683423521228, "sim_render-ego": 0.05049253181672432, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.12569720980147242, "deviation-heading": 0.7757170340260829, "set_robot_commands": 0.07845697772334999, "deviation-center-line": 0.12474392863155234, "driven_lanedir_consec": 0.616683423521228, "sim_compute_sim_state": 0.031617508807652434, "sim_compute_performance-ego": 0.05213653873389875, "sim_compute_robot_state-ego": 0.05442012699557022, "sim_compute_robot_state-npc0": 0.057625295410693535, "sim_compute_robot_state-npc1": 0.05695600241002902, "sim_compute_robot_state-npc2": 0.05539981412215972, "sim_compute_robot_state-npc3": 0.054643491624106824}, "udem1-2-0": {"driven_any": 2.168678216176718, "sim_physics": 0.02706876932564428, "survival_time": 14.750000000000076, "driven_lanedir": 1.8205635516580176, "sim_render-ego": 0.04239570730823582, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.11185665373074806, "deviation-heading": 1.7841667326335335, "set_robot_commands": 0.06881270893549515, "deviation-center-line": 0.38105433778148035, "driven_lanedir_consec": 1.8205635516580176, "sim_compute_sim_state": 0.027124623929039908, "sim_compute_performance-ego": 0.04632280074943931, "sim_compute_robot_state-ego": 0.047955614833508506, "sim_compute_robot_state-npc0": 0.048643289178104725, "sim_compute_robot_state-npc1": 0.04806864221217269, "sim_compute_robot_state-npc2": 0.0476314617415606, "sim_compute_robot_state-npc3": 0.047292047435954464}, "udem1-3-0": {"driven_any": 2.196039556148948, "sim_physics": 0.028067415555318196, "survival_time": 14.950000000000076, "driven_lanedir": 2.1929637182965305, "sim_render-ego": 0.044490453402201334, "in-drivable-lane": 0, "agent_compute-ego": 0.10830102523167928, "deviation-heading": 0.6869591234399757, "set_robot_commands": 0.06645713408788045, "deviation-center-line": 0.5528244200733968, "driven_lanedir_consec": 1.792732084218717, "sim_compute_sim_state": 0.026698163350423177, "sim_compute_performance-ego": 0.046546985308329264, "sim_compute_robot_state-ego": 0.04754974126815796, "sim_compute_robot_state-npc0": 0.04914613564809163, "sim_compute_robot_state-npc1": 0.04815057913462321, "sim_compute_robot_state-npc2": 0.04766159931818644, "sim_compute_robot_state-npc3": 0.04757961591084798}, "udem1-4-0": {"driven_any": 0.9910472848979056, "sim_physics": 0.023452704840332923, "survival_time": 6.849999999999984, "driven_lanedir": 0.8200254400615028, "sim_render-ego": 0.03729119788121133, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08930041668188833, "deviation-heading": 1.116445261034381, "set_robot_commands": 0.05518856709890992, "deviation-center-line": 0.20740334561747012, "driven_lanedir_consec": 0.8200254400615028, "sim_compute_sim_state": 0.022739455647712205, "sim_compute_performance-ego": 0.03885532817701354, "sim_compute_robot_state-ego": 0.039704234060579845, "sim_compute_robot_state-npc0": 0.04065097683537616, "sim_compute_robot_state-npc1": 0.03999722787063487, "sim_compute_robot_state-npc2": 0.039392368636862206, "sim_compute_robot_state-npc3": 0.04228274317553444}}
set_robot_commands_max	0.08978969142550514
set_robot_commands_mean	0.07174101585422812
set_robot_commands_median	0.06881270893549515
set_robot_commands_min	0.05518856709890992
sim_compute_performance-ego_max	0.06249245575496128
sim_compute_performance-ego_mean	0.049270821744728424
sim_compute_performance-ego_median	0.046546985308329264
sim_compute_performance-ego_min	0.03885532817701354
sim_compute_robot_state-ego_max	0.06683338012825064
sim_compute_robot_state-ego_mean	0.05129261945721343
sim_compute_robot_state-ego_median	0.047955614833508506
sim_compute_robot_state-ego_min	0.039704234060579845
sim_compute_robot_state-npc0_max	0.0625942645429754
sim_compute_robot_state-npc0_mean	0.051731992323048294
sim_compute_robot_state-npc0_median	0.04914613564809163
sim_compute_robot_state-npc0_min	0.04065097683537616
sim_compute_robot_state-npc1_max	0.06302516882111427
sim_compute_robot_state-npc1_mean	0.051239524089714814
sim_compute_robot_state-npc1_median	0.04815057913462321
sim_compute_robot_state-npc1_min	0.03999722787063487
sim_compute_robot_state-npc2_max	0.06233852006951157
sim_compute_robot_state-npc2_mean	0.05048475277765611
sim_compute_robot_state-npc2_median	0.04766159931818644
sim_compute_robot_state-npc2_min	0.039392368636862206
sim_compute_robot_state-npc3_max	0.0633286951350517
sim_compute_robot_state-npc3_mean	0.05102531865629908
sim_compute_robot_state-npc3_median	0.04757961591084798
sim_compute_robot_state-npc3_min	0.04228274317553444
sim_compute_sim_state_max	0.03572300826611162
sim_compute_sim_state_mean	0.028780552000187865
sim_compute_sim_state_median	0.027124623929039908
sim_compute_sim_state_min	0.022739455647712205
sim_physics_max	0.03685335723721251
sim_physics_mean	0.02991142498021803
sim_physics_median	0.028067415555318196
sim_physics_min	0.023452704840332923
sim_render-ego_max	0.0566103458404541
sim_render-ego_mean	0.046256047249765384
sim_render-ego_median	0.044490453402201334
sim_render-ego_min	0.03729119788121133
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.67000000000004
survival_time_min	6.849999999999984

No reset possible

19658

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:29:28+00:00

2019-04-24 16:33:13+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08904933221086164
survival_time_median	1.3500000000000003
deviation-center-line_median	0.04013566571024201
in-drivable-lane_median	0.15000000000000013

other stats

agent_compute-ego_max	0.19176740999575015
agent_compute-ego_mean	0.15916432173796963
agent_compute-ego_median	0.1489968044417245
agent_compute-ego_min	0.14446348696947098
deviation-center-line_max	0.05621684693435621
deviation-center-line_mean	0.04177310409712117
deviation-center-line_min	0.03256366167458567
deviation-heading_max	0.732755310104608
deviation-heading_mean	0.6773120628443443
deviation-heading_median	0.6700087299649555
deviation-heading_min	0.624996203475719
driven_any_max	0.17593516946550708
driven_any_mean	0.16198145443021916
driven_any_median	0.16523958685684323
driven_any_min	0.14605182895814797
driven_lanedir_consec_max	0.1082337598066907
driven_lanedir_consec_mean	0.08866252923843795
driven_lanedir_consec_min	0.07437473258424321
driven_lanedir_max	0.1082337598066907
driven_lanedir_mean	0.08866252923843795
driven_lanedir_median	0.08904933221086164
driven_lanedir_min	0.07437473258424321
in-drivable-lane_max	0.4500000000000004
in-drivable-lane_mean	0.18000000000000016
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16826806747566164, "sim_physics": 0.022366319383893697, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0919898580177474, "sim_render-ego": 0.05874077762876238, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1489968044417245, "deviation-heading": 0.6700087299649555, "set_robot_commands": 0.08594789675303868, "deviation-center-line": 0.04013566571024201, "driven_lanedir_consec": 0.0919898580177474, "sim_compute_sim_state": 0.03597476652690342, "sim_compute_performance-ego": 0.062199882098606656, "sim_compute_robot_state-ego": 0.06458385501589094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17593516946550708, "sim_physics": 0.01912625879049301, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07966496357264685, "sim_render-ego": 0.04925265908241272, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.14446348696947098, "deviation-heading": 0.624996203475719, "set_robot_commands": 0.07633549720048904, "deviation-center-line": 0.03256366167458567, "driven_lanedir_consec": 0.07966496357264685, "sim_compute_sim_state": 0.03164944052696228, "sim_compute_performance-ego": 0.057289302349090576, "sim_compute_robot_state-ego": 0.059224799275398254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16523958685684323, "sim_physics": 0.02319790698863842, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1082337598066907, "sim_render-ego": 0.060658269458346896, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19176740999575015, "deviation-heading": 0.732755310104608, "set_robot_commands": 0.09347917415477612, "deviation-center-line": 0.05621684693435621, "driven_lanedir_consec": 0.1082337598066907, "sim_compute_sim_state": 0.03728819776464392, "sim_compute_performance-ego": 0.0671521822611491, "sim_compute_robot_state-ego": 0.06652650126704464}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14605182895814797, "sim_physics": 0.023015141487121586, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07437473258424321, "sim_render-ego": 0.05421595390026386, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1467104691725511, "deviation-heading": 0.6596789354067415, "set_robot_commands": 0.08255056234506461, "deviation-center-line": 0.03468384399192496, "driven_lanedir_consec": 0.07437473258424321, "sim_compute_sim_state": 0.034123356525714583, "sim_compute_performance-ego": 0.060413012137779824, "sim_compute_robot_state-ego": 0.06062133495624249}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15441261939493592, "sim_physics": 0.023129100799560542, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08904933221086164, "sim_render-ego": 0.053166685104370115, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16388343811035155, "deviation-heading": 0.6991211352696978, "set_robot_commands": 0.08453210830688476, "deviation-center-line": 0.045265502174496965, "driven_lanedir_consec": 0.08904933221086164, "sim_compute_sim_state": 0.033094625473022464, "sim_compute_performance-ego": 0.06370179176330566, "sim_compute_robot_state-ego": 0.05932127952575684}}
set_robot_commands_max	0.09347917415477612
set_robot_commands_mean	0.08456904775205062
set_robot_commands_median	0.08453210830688476
set_robot_commands_min	0.07633549720048904
sim_compute_performance-ego_max	0.0671521822611491
sim_compute_performance-ego_mean	0.062151234121986365
sim_compute_performance-ego_median	0.062199882098606656
sim_compute_performance-ego_min	0.057289302349090576
sim_compute_robot_state-ego_max	0.06652650126704464
sim_compute_robot_state-ego_mean	0.06205555400806663
sim_compute_robot_state-ego_median	0.06062133495624249
sim_compute_robot_state-ego_min	0.059224799275398254
sim_compute_sim_state_max	0.03728819776464392
sim_compute_sim_state_mean	0.03442607736344934
sim_compute_sim_state_median	0.034123356525714583
sim_compute_sim_state_min	0.03164944052696228
sim_physics_max	0.02319790698863842
sim_physics_mean	0.02216694548994145
sim_physics_median	0.023015141487121586
sim_physics_min	0.01912625879049301
sim_render-ego_max	0.060658269458346896
sim_render-ego_mean	0.0552068690348312
sim_render-ego_median	0.05421595390026386
sim_render-ego_min	0.04925265908241272
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.3800000000000003
survival_time_min	1.2500000000000004

No reset possible

19626

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:00:46+00:00

2019-04-24 16:29:01+00:00

0:28:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3614573264245535
survival_time_median	14.950000000000076
deviation-center-line_median	1.0119696714086834
in-drivable-lane_median	4.050000000000022

other stats

agent_compute-ego_max	0.1584927654266357
agent_compute-ego_mean	0.1528042116165161
agent_compute-ego_median	0.15725028435389202
agent_compute-ego_min	0.14363507350285848
deviation-center-line_max	1.0119699909612991
deviation-center-line_mean	1.0119697191394268
deviation-center-line_min	1.0119693200897382
deviation-heading_max	6.81542792438532
deviation-heading_mean	6.815427924385318
deviation-heading_median	6.815427924385318
deviation-heading_min	6.815427924385317
driven_any_max	4.390824152784938
driven_any_mean	4.3908241527849325
driven_any_median	4.3908241527849325
driven_any_min	4.390824152784927
driven_lanedir_consec_max	-1.361452200425545
driven_lanedir_consec_mean	-1.3614579701548792
driven_lanedir_consec_min	-1.3614641213545289
driven_lanedir_max	-2.315814608416598
driven_lanedir_mean	-2.3158170164441083
driven_lanedir_median	-2.3158169926021728
driven_lanedir_min	-2.315819376788188
in-drivable-lane_max	4.050000000000022
in-drivable-lane_mean	4.050000000000022
in-drivable-lane_min	4.050000000000022
per-episodes	details {"udem1-0-0": {"driven_any": 4.390824152784927, "sim_physics": 0.03811277071634928, "survival_time": 14.950000000000076, "driven_lanedir": -2.315816992602138, "sim_render-ego": 0.056113093694051104, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15725028435389202, "deviation-heading": 6.815427924385318, "set_robot_commands": 0.0867177144686381, "deviation-center-line": 1.0119693200897382, "driven_lanedir_consec": -1.361457326424502, "sim_compute_sim_state": 0.03489411354064941, "sim_compute_performance-ego": 0.06109131415685018, "sim_compute_robot_state-ego": 0.06473783890406291, "sim_compute_robot_state-npc0": 0.06252609968185424, "sim_compute_robot_state-npc1": 0.06310569683710734, "sim_compute_robot_state-npc2": 0.06271047910054525, "sim_compute_robot_state-npc3": 0.06215681791305542}, "udem1-1-0": {"driven_any": 4.390824152784938, "sim_physics": 0.03550353447596232, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05220881859461467, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14363507350285848, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08064581871032715, "deviation-center-line": 1.0119699909612991, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.032064960797627766, "sim_compute_performance-ego": 0.05672631820042928, "sim_compute_robot_state-ego": 0.059629807472229006, "sim_compute_robot_state-npc0": 0.0566832423210144, "sim_compute_robot_state-npc1": 0.05642531633377075, "sim_compute_robot_state-npc2": 0.05558094024658203, "sim_compute_robot_state-npc3": 0.056166400909423826}, "udem1-2-0": {"driven_any": 4.390824152784927, "sim_physics": 0.037299080689748125, "survival_time": 14.950000000000076, "driven_lanedir": -2.315819376788188, "sim_render-ego": 0.055145950317382814, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14723472595214843, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08108796675999959, "deviation-center-line": 1.0119699909612945, "driven_lanedir_consec": -1.3614641213545289, "sim_compute_sim_state": 0.03448127110799153, "sim_compute_performance-ego": 0.05927889108657837, "sim_compute_robot_state-ego": 0.06456041892369588, "sim_compute_robot_state-npc0": 0.05887037038803101, "sim_compute_robot_state-npc1": 0.059229212601979574, "sim_compute_robot_state-npc2": 0.060046664873758954, "sim_compute_robot_state-npc3": 0.060244556268056235}, "udem1-3-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.03640127023061117, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158169926021728, "sim_render-ego": 0.054337058862050376, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1584927654266357, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08625680367151896, "deviation-center-line": 1.0119696714086834, "driven_lanedir_consec": -1.3614573264245535, "sim_compute_sim_state": 0.03520679473876953, "sim_compute_performance-ego": 0.05877618789672852, "sim_compute_robot_state-ego": 0.07282241821289062, "sim_compute_robot_state-npc0": 0.059411657651265465, "sim_compute_robot_state-npc1": 0.0588210391998291, "sim_compute_robot_state-npc2": 0.06320595264434814, "sim_compute_robot_state-npc3": 0.05993734121322632}, "udem1-4-0": {"driven_any": 4.390824152784936, "sim_physics": 0.03926663637161255, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158171118114455, "sim_render-ego": 0.05626099189122518, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1574082088470459, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08466642220815022, "deviation-center-line": 1.0119696222761183, "driven_lanedir_consec": -1.3614588761452664, "sim_compute_sim_state": 0.03578802188237508, "sim_compute_performance-ego": 0.06077367623647054, "sim_compute_robot_state-ego": 0.06455234289169312, "sim_compute_robot_state-npc0": 0.06082317352294922, "sim_compute_robot_state-npc1": 0.06262135108311971, "sim_compute_robot_state-npc2": 0.06185354709625244, "sim_compute_robot_state-npc3": 0.06286764462788899}}
set_robot_commands_max	0.0867177144686381
set_robot_commands_mean	0.0838749451637268
set_robot_commands_median	0.08466642220815022
set_robot_commands_min	0.08064581871032715
sim_compute_performance-ego_max	0.06109131415685018
sim_compute_performance-ego_mean	0.05932927751541138
sim_compute_performance-ego_median	0.05927889108657837
sim_compute_performance-ego_min	0.05672631820042928
sim_compute_robot_state-ego_max	0.07282241821289062
sim_compute_robot_state-ego_mean	0.06526056528091431
sim_compute_robot_state-ego_median	0.06456041892369588
sim_compute_robot_state-ego_min	0.059629807472229006
sim_compute_robot_state-npc0_max	0.06252609968185424
sim_compute_robot_state-npc0_mean	0.059662908713022864
sim_compute_robot_state-npc0_median	0.059411657651265465
sim_compute_robot_state-npc0_min	0.0566832423210144
sim_compute_robot_state-npc1_max	0.06310569683710734
sim_compute_robot_state-npc1_mean	0.0600405232111613
sim_compute_robot_state-npc1_median	0.059229212601979574
sim_compute_robot_state-npc1_min	0.05642531633377075
sim_compute_robot_state-npc2_max	0.06320595264434814
sim_compute_robot_state-npc2_mean	0.06067951679229736
sim_compute_robot_state-npc2_median	0.06185354709625244
sim_compute_robot_state-npc2_min	0.05558094024658203
sim_compute_robot_state-npc3_max	0.06286764462788899
sim_compute_robot_state-npc3_mean	0.060274552186330155
sim_compute_robot_state-npc3_median	0.060244556268056235
sim_compute_robot_state-npc3_min	0.056166400909423826
sim_compute_sim_state_max	0.03578802188237508
sim_compute_sim_state_mean	0.034487032413482666
sim_compute_sim_state_median	0.03489411354064941
sim_compute_sim_state_min	0.032064960797627766
sim_physics_max	0.03926663637161255
sim_physics_mean	0.03731665849685669
sim_physics_median	0.037299080689748125
sim_physics_min	0.03550353447596232
sim_render-ego_max	0.05626099189122518
sim_render-ego_mean	0.05481318267186482
sim_render-ego_median	0.055145950317382814
sim_render-ego_min	0.05220881859461467
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19590

2451

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-24 15:49:46+00:00

2019-04-24 16:00:07+00:00

0:10:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19586

2459

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

aido2-LFV-sim-testing

step1-simulation

error

aido2-LFV-sim-validation

2019-04-24 15:48:59+00:00

2019-04-24 15:49:29+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19580

2460

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

aido2-LF-sim-validation

2019-04-24 15:48:06+00:00

2019-04-24 15:48:36+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19574

2480

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:46:40+00:00

2019-04-24 15:47:28+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19512

2570

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 15:30:17+00:00

2019-04-24 15:46:32+00:00

0:16:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0
survival_time_median	14.950000000000076
deviation-center-line_median	4.685394139947218e-07
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06733129819234213
agent_compute-ego_mean	0.06454847160975138
agent_compute-ego_median	0.06590668439865112
agent_compute-ego_min	0.06136725505193075
deviation-center-line_max	4.373034425912704e-06
deviation-center-line_mean	1.170062906085128e-06
deviation-center-line_min	7.1661859209205e-08
deviation-heading_max	3.6616941510564305e-15
deviation-heading_mean	1.0060405349314265e-15
deviation-heading_median	3.4212715087255833e-16
deviation-heading_min	3.421270709830252e-16
driven_any_max	0
driven_any_mean	0
driven_any_median	0
driven_any_min	0
driven_lanedir_consec_max	0
driven_lanedir_consec_mean	0
driven_lanedir_consec_min	0
driven_lanedir_max	0
driven_lanedir_mean	0
driven_lanedir_median	0
driven_lanedir_min	0
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0, "sim_physics": 0.02175350586573283, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.057634910742441814, "in-drivable-lane": 0, "agent_compute-ego": 0.06620866219202677, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.0893378241856893, "deviation-center-line": 4.685394173142864e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.0363869047164917, "sim_compute_performance-ego": 0.06158399184544881, "sim_compute_robot_state-ego": 0.0647498099009196}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.01950884421666463, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.05220831553141276, "in-drivable-lane": 0, "agent_compute-ego": 0.06136725505193075, "deviation-heading": 3.6616941510564305e-15, "set_robot_commands": 0.08072105010350546, "deviation-center-line": 4.373034425912704e-06, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03289689540863037, "sim_compute_performance-ego": 0.05639612833658854, "sim_compute_robot_state-ego": 0.05897584517796834}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.019508825937906905, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.05442478815714518, "in-drivable-lane": 0, "agent_compute-ego": 0.06590668439865112, "deviation-heading": 3.421270709830252e-16, "set_robot_commands": 0.08145365556081136, "deviation-center-line": 7.1661859209205e-08, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03320893287658691, "sim_compute_performance-ego": 0.05719375530878703, "sim_compute_robot_state-ego": 0.059833695888519285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.01936524232228597, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.05109371662139892, "in-drivable-lane": 0, "agent_compute-ego": 0.06192845821380615, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.08200294494628907, "deviation-center-line": 4.685394139947218e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03302466869354248, "sim_compute_performance-ego": 0.05731031735738119, "sim_compute_robot_state-ego": 0.05941223462422689}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.016972281138102212, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.04553540547688802, "in-drivable-lane": 0, "agent_compute-ego": 0.06733129819234213, "deviation-heading": 3.4212715087255833e-16, "set_robot_commands": 0.06988510847091675, "deviation-center-line": 4.685394139947218e-07, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.028550446033477783, "sim_compute_performance-ego": 0.04971850474675497, "sim_compute_robot_state-ego": 0.055812439918518066}}
set_robot_commands_max	0.0893378241856893
set_robot_commands_mean	0.0806801166534424
set_robot_commands_median	0.08145365556081136
set_robot_commands_min	0.06988510847091675
sim_compute_performance-ego_max	0.06158399184544881
sim_compute_performance-ego_mean	0.056440539518992104
sim_compute_performance-ego_median	0.05719375530878703
sim_compute_performance-ego_min	0.04971850474675497
sim_compute_robot_state-ego_max	0.0647498099009196
sim_compute_robot_state-ego_mean	0.05975680510203044
sim_compute_robot_state-ego_median	0.05941223462422689
sim_compute_robot_state-ego_min	0.055812439918518066
sim_compute_sim_state_max	0.0363869047164917
sim_compute_sim_state_mean	0.032813569545745845
sim_compute_sim_state_median	0.03302466869354248
sim_compute_sim_state_min	0.028550446033477783
sim_physics_max	0.02175350586573283
sim_physics_mean	0.01942173989613851
sim_physics_median	0.019508825937906905
sim_physics_min	0.016972281138102212
sim_render-ego_max	0.057634910742441814
sim_render-ego_mean	0.05217942730585734
sim_render-ego_median	0.05220831553141276
sim_render-ego_min	0.04553540547688802
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19506

2581

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-24 15:27:24+00:00

2019-04-24 15:30:03+00:00

0:02:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19488

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-24 15:22:29+00:00

2019-04-24 15:27:01+00:00

0:04:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07534593957491875
survival_time_median	1.3000000000000005
deviation-center-line_median	0.03788023468206024
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.17144418679750884
agent_compute-ego_mean	0.14782860143368062
agent_compute-ego_median	0.16222280502319336
agent_compute-ego_min	0.098905120577131
deviation-center-line_max	0.03885845104103259
deviation-center-line_mean	0.03640636104426165
deviation-center-line_min	0.032955164361544866
deviation-heading_max	0.6658847581324782
deviation-heading_mean	0.6357516018728534
deviation-heading_median	0.647889867445494
deviation-heading_min	0.5758540173060595
driven_any_max	0.16029318761173475
driven_any_mean	0.1567326725557995
driven_any_median	0.15733487037534954
driven_any_min	0.15232244634967793
driven_lanedir_consec_max	0.08681075898607515
driven_lanedir_consec_mean	0.07650175068701381
driven_lanedir_consec_min	0.06918855730584994
driven_lanedir_max	0.08681075898607515
driven_lanedir_mean	0.07650175068701381
driven_lanedir_median	0.07534593957491875
driven_lanedir_min	0.06918855730584994
in-drivable-lane_max	0.30000000000000027
in-drivable-lane_mean	0.2300000000000002
in-drivable-lane_min	0.15000000000000013
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15733487037534954, "sim_physics": 0.024300758655254655, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07809293719830146, "sim_render-ego": 0.05876101897313045, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17144418679750884, "deviation-heading": 0.5758540173060595, "set_robot_commands": 0.09352022867936356, "deviation-center-line": 0.032955164361544866, "driven_lanedir_consec": 0.07809293719830146, "sim_compute_sim_state": 0.03774705299964318, "sim_compute_performance-ego": 0.06269478797912598, "sim_compute_robot_state-ego": 0.06965705981621376}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1535660087912748, "sim_physics": 0.018178812095097138, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06918855730584994, "sim_render-ego": 0.05248303924288068, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.13804867437907628, "deviation-heading": 0.647889867445494, "set_robot_commands": 0.08251563140324183, "deviation-center-line": 0.03788023468206024, "driven_lanedir_consec": 0.06918855730584994, "sim_compute_sim_state": 0.03374601261956351, "sim_compute_performance-ego": 0.0633169412612915, "sim_compute_robot_state-ego": 0.06245340619768415}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16029318761173475, "sim_physics": 0.015369900635310582, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07307056036992376, "sim_render-ego": 0.03504866361618042, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.098905120577131, "deviation-heading": 0.6658847581324782, "set_robot_commands": 0.05372296060834613, "deviation-center-line": 0.03826355643186507, "driven_lanedir_consec": 0.07307056036992376, "sim_compute_sim_state": 0.02239248582295009, "sim_compute_performance-ego": 0.03926937920706613, "sim_compute_robot_state-ego": 0.04074963501521519}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16014684965096057, "sim_physics": 0.02225355001596304, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08681075898607515, "sim_render-ego": 0.05647356693561261, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1685222203914936, "deviation-heading": 0.6551083636417908, "set_robot_commands": 0.09008046296926644, "deviation-center-line": 0.03885845104103259, "driven_lanedir_consec": 0.08681075898607515, "sim_compute_sim_state": 0.03229535543001615, "sim_compute_performance-ego": 0.06252990319178654, "sim_compute_robot_state-ego": 0.07455879908341628}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15232244634967793, "sim_physics": 0.02236652374267578, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07534593957491875, "sim_render-ego": 0.06434700965881347, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16222280502319336, "deviation-heading": 0.6340210028384443, "set_robot_commands": 0.08986959457397461, "deviation-center-line": 0.034074398704805456, "driven_lanedir_consec": 0.07534593957491875, "sim_compute_sim_state": 0.036579980850219726, "sim_compute_performance-ego": 0.06780048370361329, "sim_compute_robot_state-ego": 0.06894542694091797}}
set_robot_commands_max	0.09352022867936356
set_robot_commands_mean	0.08194177564683851
set_robot_commands_median	0.08986959457397461
set_robot_commands_min	0.05372296060834613
sim_compute_performance-ego_max	0.06780048370361329
sim_compute_performance-ego_mean	0.05912229906857669
sim_compute_performance-ego_median	0.06269478797912598
sim_compute_performance-ego_min	0.03926937920706613
sim_compute_robot_state-ego_max	0.07455879908341628
sim_compute_robot_state-ego_mean	0.06327286541068947
sim_compute_robot_state-ego_median	0.06894542694091797
sim_compute_robot_state-ego_min	0.04074963501521519
sim_compute_sim_state_max	0.03774705299964318
sim_compute_sim_state_mean	0.03255217754447853
sim_compute_sim_state_median	0.03374601261956351
sim_compute_sim_state_min	0.02239248582295009
sim_physics_max	0.024300758655254655
sim_physics_mean	0.02049390902886024
sim_physics_median	0.02225355001596304
sim_physics_min	0.015369900635310582
sim_render-ego_max	0.06434700965881347
sim_render-ego_mean	0.05342265968532352
sim_render-ego_median	0.05647356693561261
sim_render-ego_min	0.03504866361618042
simulation-passed	1
survival_time_max	1.4000000000000006
survival_time_mean	1.3300000000000003
survival_time_min	1.2500000000000004

No reset possible

19479

2616

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 15:16:48+00:00

2019-04-24 15:21:56+00:00

0:05:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.16042440587824042
agent_compute-ego_mean	0.13206081157213162
agent_compute-ego_median	0.11947523145114676
agent_compute-ego_min	0.11561277227581672
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.019547786352769384, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04610107079991754, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11561277227581672, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07052062142570063, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03165249104769725, "sim_compute_performance-ego": 0.050399771276509985, "sim_compute_robot_state-ego": 0.051421669294249336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.023772808638485996, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06091028451919556, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.16042440587824042, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.10098761320114136, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03898531198501587, "sim_compute_performance-ego": 0.06774808060039174, "sim_compute_robot_state-ego": 0.06988448446447199}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.021621969011094835, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05910512076483832, "in-drivable-lane": 0, "agent_compute-ego": 0.1477805879380968, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09241064389546712, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03632567723592122, "sim_compute_performance-ego": 0.063467009862264, "sim_compute_robot_state-ego": 0.06486140886942546}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02054223914941152, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0450005034605662, "in-drivable-lane": 0, "agent_compute-ego": 0.11701106031735738, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07390636205673218, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.030091668168703716, "sim_compute_performance-ego": 0.049341787894566856, "sim_compute_robot_state-ego": 0.05116528272628784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.020008052096647376, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.04793499497806325, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11947523145114676, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07260427755468032, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.02970279665554271, "sim_compute_performance-ego": 0.05086950694813448, "sim_compute_robot_state-ego": 0.05279748930650599}}
set_robot_commands_max	0.10098761320114136
set_robot_commands_mean	0.08208590362674432
set_robot_commands_median	0.07390636205673218
set_robot_commands_min	0.07052062142570063
sim_compute_performance-ego_max	0.06774808060039174
sim_compute_performance-ego_mean	0.05636523131637341
sim_compute_performance-ego_median	0.05086950694813448
sim_compute_performance-ego_min	0.049341787894566856
sim_compute_robot_state-ego_max	0.06988448446447199
sim_compute_robot_state-ego_mean	0.058026066932188126
sim_compute_robot_state-ego_median	0.05279748930650599
sim_compute_robot_state-ego_min	0.05116528272628784
sim_compute_sim_state_max	0.03898531198501587
sim_compute_sim_state_mean	0.03335158901857615
sim_compute_sim_state_median	0.03165249104769725
sim_compute_sim_state_min	0.02970279665554271
sim_physics_max	0.023772808638485996
sim_physics_mean	0.021098571049681818
sim_physics_median	0.02054223914941152
sim_physics_min	0.019547786352769384
sim_render-ego_max	0.06091028451919556
sim_render-ego_mean	0.05181039490451618
sim_render-ego_median	0.04793499497806325
sim_render-ego_min	0.0450005034605662
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19456

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

aido2-LFV-sim-validation

2019-04-24 15:00:30+00:00

2019-04-24 15:16:22+00:00

0:15:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.306499954262757
survival_time_median	8.79999999999999
deviation-center-line_median	0.4695387597934955
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.08642592545478575
agent_compute-ego_mean	0.08291291243333156
agent_compute-ego_median	0.08232618868350983
agent_compute-ego_min	0.07880716959635417
deviation-center-line_max	1.0921433452039202
deviation-center-line_mean	0.5905211981978564
deviation-center-line_min	0.1575933380807941
deviation-heading_max	3.4742583929333795
deviation-heading_mean	2.2018573582926244
deviation-heading_median	2.1304474093237507
deviation-heading_min	0.7872295715156691
driven_any_max	2.355655241246426
driven_any_mean	1.5225710264571592
driven_any_median	1.3672342667232948
driven_any_min	0.5850660151561602
driven_lanedir_consec_max	2.022402434350766
driven_lanedir_consec_mean	1.1894141311014716
driven_lanedir_consec_min	0.382792147963225
driven_lanedir_max	2.022402434350766
driven_lanedir_mean	1.1894141311014716
driven_lanedir_median	1.306499954262757
driven_lanedir_min	0.382792147963225
in-drivable-lane_max	3.600000000000051
in-drivable-lane_mean	1.5900000000000072
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5850660151561602, "sim_physics": 0.03192986845970154, "survival_time": 3.999999999999994, "driven_lanedir": 0.5629753531237327, "sim_render-ego": 0.06698814928531646, "in-drivable-lane": 0, "agent_compute-ego": 0.08232618868350983, "deviation-heading": 0.7872295715156691, "set_robot_commands": 0.10964299440383912, "deviation-center-line": 0.2580269514464388, "driven_lanedir_consec": 0.5629753531237327, "sim_compute_sim_state": 0.042404976487159726, "sim_compute_performance-ego": 0.0763699769973755, "sim_compute_robot_state-ego": 0.07637387812137604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355655241246426, "sim_physics": 0.023525479634602865, "survival_time": 14.950000000000076, "driven_lanedir": 2.022402434350766, "sim_render-ego": 0.06313960711161296, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07880716959635417, "deviation-heading": 3.4742583929333795, "set_robot_commands": 0.09928041060765584, "deviation-center-line": 1.0921433452039202, "driven_lanedir_consec": 2.022402434350766, "sim_compute_sim_state": 0.04002691666285197, "sim_compute_performance-ego": 0.06981996536254882, "sim_compute_robot_state-ego": 0.07215283711751302}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3556165863526526, "sim_physics": 0.02636268615722656, "survival_time": 14.950000000000076, "driven_lanedir": 1.6724007658068778, "sim_render-ego": 0.06694169123967489, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.08511716763178508, "deviation-heading": 3.1809790523306005, "set_robot_commands": 0.10771280606587728, "deviation-center-line": 0.9753035964646336, "driven_lanedir_consec": 1.6724007658068778, "sim_compute_sim_state": 0.04239170471827189, "sim_compute_performance-ego": 0.07499547004699707, "sim_compute_robot_state-ego": 0.07872865835825603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9492830228072624, "sim_physics": 0.03007003184287779, "survival_time": 6.199999999999986, "driven_lanedir": 0.382792147963225, "sim_render-ego": 0.06692757529597129, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.08642592545478575, "deviation-heading": 1.4363723653597242, "set_robot_commands": 0.10900751813765495, "deviation-center-line": 0.1575933380807941, "driven_lanedir_consec": 0.382792147963225, "sim_compute_sim_state": 0.04492567239269134, "sim_compute_performance-ego": 0.07250773329888621, "sim_compute_robot_state-ego": 0.0770425142780427}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3672342667232948, "sim_physics": 0.028660309585657982, "survival_time": 8.79999999999999, "driven_lanedir": 1.306499954262757, "sim_render-ego": 0.06616425107825886, "in-drivable-lane": 0, "agent_compute-ego": 0.08188811080022292, "deviation-heading": 2.1304474093237507, "set_robot_commands": 0.10594545711170544, "deviation-center-line": 0.4695387597934955, "driven_lanedir_consec": 1.306499954262757, "sim_compute_sim_state": 0.04113243791190061, "sim_compute_performance-ego": 0.0735148313370618, "sim_compute_robot_state-ego": 0.07871856608174065}}
set_robot_commands_max	0.10964299440383912
set_robot_commands_mean	0.10631783726534652
set_robot_commands_median	0.10771280606587728
set_robot_commands_min	0.09928041060765584
sim_compute_performance-ego_max	0.0763699769973755
sim_compute_performance-ego_mean	0.0734415954085739
sim_compute_performance-ego_median	0.0735148313370618
sim_compute_performance-ego_min	0.06981996536254882
sim_compute_robot_state-ego_max	0.07872865835825603
sim_compute_robot_state-ego_mean	0.0766032907913857
sim_compute_robot_state-ego_median	0.0770425142780427
sim_compute_robot_state-ego_min	0.07215283711751302
sim_compute_sim_state_max	0.04492567239269134
sim_compute_sim_state_mean	0.04217634163457511
sim_compute_sim_state_median	0.04239170471827189
sim_compute_sim_state_min	0.04002691666285197
sim_physics_max	0.03192986845970154
sim_physics_mean	0.02810967513601335
sim_physics_median	0.028660309585657982
sim_physics_min	0.023525479634602865
sim_render-ego_max	0.06698814928531646
sim_render-ego_mean	0.06603225480216689
sim_render-ego_median	0.06692757529597129
sim_render-ego_min	0.06313960711161296
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.780000000000026
survival_time_min	3.999999999999994

No reset possible

19440

2657

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-24 14:52:24+00:00

2019-04-24 15:00:08+00:00

0:07:44

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19440-151417', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19440-151417', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19440-151417', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19438

2664

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-24 14:51:25+00:00

2019-04-24 14:51:59+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19436

2668

Rami Al-Naim 🇷🇺

Modidfied config

aido2-LFV-sim-testing

step1-simulation

error

aido2-LFV-sim-validation

2019-04-24 14:50:44+00:00

2019-04-24 14:51:19+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19434

2669

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-24 14:50:03+00:00

2019-04-24 14:50:37+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19427

2673

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

aido2-LF-sim-validation

2019-04-24 14:49:08+00:00

2019-04-24 14:49:50+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19421

2691

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:34:29+00:00

2019-04-24 14:48:26+00:00

0:13:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.737068752223593
survival_time_median	5.399999999999989
deviation-center-line_median	0.4242251825368753
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0896015453338623
agent_compute-ego_mean	0.08000341813238875
agent_compute-ego_median	0.08499036996792524
agent_compute-ego_min	0.058316387311376706
deviation-center-line_max	1.0280170713230894
deviation-center-line_mean	0.6256189464360098
deviation-center-line_min	0.2601628063636697
deviation-heading_max	6.871591212825562
deviation-heading_mean	2.818852295160102
deviation-heading_median	0.9093156621505248
deviation-heading_min	0.6363399751210043
driven_any_max	2.355539375588959
driven_any_mean	1.369795113405441
driven_any_median	0.8208359230835469
driven_any_min	0.5689941070418084
driven_lanedir_consec_max	1.4908129636431302
driven_lanedir_consec_mean	0.8633006517086415
driven_lanedir_consec_min	0.5487521967371047
driven_lanedir_max	1.860415338700975
driven_lanedir_mean	1.050111424545052
driven_lanedir_median	0.8029162075880771
driven_lanedir_min	0.5487521967371047
in-drivable-lane_max	3.750000000000034
in-drivable-lane_mean	1.08000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5689941070418084, "sim_physics": 0.030336725406157665, "survival_time": 3.899999999999994, "driven_lanedir": 0.5487521967371047, "sim_render-ego": 0.06986076709551689, "in-drivable-lane": 0, "agent_compute-ego": 0.08499036996792524, "deviation-heading": 0.7125764298738073, "set_robot_commands": 0.11363849884424454, "deviation-center-line": 0.2601628063636697, "driven_lanedir_consec": 0.5487521967371047, "sim_compute_sim_state": 0.04124349508530054, "sim_compute_performance-ego": 0.07656518312600943, "sim_compute_robot_state-ego": 0.08429312705993652}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355539375588959, "sim_physics": 0.029160101413726807, "survival_time": 14.950000000000076, "driven_lanedir": 1.860415338700975, "sim_render-ego": 0.06932754198710124, "in-drivable-lane": 1.6500000000000157, "agent_compute-ego": 0.0896015453338623, "deviation-heading": 4.964438195829612, "set_robot_commands": 0.1103793168067932, "deviation-center-line": 1.0280170713230894, "driven_lanedir_consec": 1.4908129636431302, "sim_compute_sim_state": 0.04313207467397054, "sim_compute_performance-ego": 0.07758594592412313, "sim_compute_robot_state-ego": 0.07988129854202271}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355080144609072, "sim_physics": 0.02870542049407959, "survival_time": 14.950000000000076, "driven_lanedir": 1.30140462747551, "sim_render-ego": 0.06987317005793253, "in-drivable-lane": 3.750000000000034, "agent_compute-ego": 0.0868214750289917, "deviation-heading": 6.871591212825562, "set_robot_commands": 0.11113568782806396, "deviation-center-line": 1.007561613082167, "driven_lanedir_consec": 0.7369531383513022, "sim_compute_sim_state": 0.04203749259312948, "sim_compute_performance-ego": 0.07747917652130126, "sim_compute_robot_state-ego": 0.08099328358968098}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8208359230835469, "sim_physics": 0.0288218237735607, "survival_time": 5.399999999999989, "driven_lanedir": 0.8029162075880771, "sim_render-ego": 0.06385152869754368, "in-drivable-lane": 0, "agent_compute-ego": 0.08028731301978782, "deviation-heading": 0.9093156621505248, "set_robot_commands": 0.09976541996002196, "deviation-center-line": 0.4081280588742475, "driven_lanedir_consec": 0.8029162075880771, "sim_compute_sim_state": 0.03887384909170645, "sim_compute_performance-ego": 0.07369045637272022, "sim_compute_robot_state-ego": 0.0746027562353346}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7485260167038192, "sim_physics": 0.020455360412597656, "survival_time": 4.94999999999999, "driven_lanedir": 0.737068752223593, "sim_render-ego": 0.04510398826213798, "in-drivable-lane": 0, "agent_compute-ego": 0.058316387311376706, "deviation-heading": 0.6363399751210043, "set_robot_commands": 0.0712434161793102, "deviation-center-line": 0.4242251825368753, "driven_lanedir_consec": 0.737068752223593, "sim_compute_sim_state": 0.02935592574302596, "sim_compute_performance-ego": 0.049864732857906456, "sim_compute_robot_state-ego": 0.05102234175710967}}
set_robot_commands_max	0.11363849884424454
set_robot_commands_mean	0.10123246792368676
set_robot_commands_median	0.1103793168067932
set_robot_commands_min	0.0712434161793102
sim_compute_performance-ego_max	0.07758594592412313
sim_compute_performance-ego_mean	0.07103709896041209
sim_compute_performance-ego_median	0.07656518312600943
sim_compute_performance-ego_min	0.049864732857906456
sim_compute_robot_state-ego_max	0.08429312705993652
sim_compute_robot_state-ego_mean	0.0741585614368169
sim_compute_robot_state-ego_median	0.07988129854202271
sim_compute_robot_state-ego_min	0.05102234175710967
sim_compute_sim_state_max	0.04313207467397054
sim_compute_sim_state_mean	0.03892856743742659
sim_compute_sim_state_median	0.04124349508530054
sim_compute_sim_state_min	0.02935592574302596
sim_physics_max	0.030336725406157665
sim_physics_mean	0.027495886300024485
sim_physics_median	0.0288218237735607
sim_physics_min	0.020455360412597656
sim_render-ego_max	0.06987317005793253
sim_render-ego_mean	0.06360339922004646
sim_render-ego_median	0.06932754198710124
sim_render-ego_min	0.04510398826213798
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.830000000000027
survival_time_min	3.899999999999994

No reset possible

19346

2981

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 14:05:12+00:00

2019-04-24 14:34:16+00:00

0:29:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8683601579423474
survival_time_median	12.900000000000048
deviation-center-line_median	0.5095800429556276
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.21524929761886596
agent_compute-ego_mean	0.1991531185048115
agent_compute-ego_median	0.207856763229679
agent_compute-ego_min	0.1704380746473346
deviation-center-line_max	1.4819817541351823
deviation-center-line_mean	0.6374825573677837
deviation-center-line_min	0.2843983329373953
deviation-heading_max	1.6780520687693454
deviation-heading_mean	1.159367454246307
deviation-heading_median	1.2094894480077245
deviation-heading_min	0.35227852837961154
driven_any_max	1.4351127501650205
driven_any_mean	1.0805417696782564
driven_any_median	1.161923942236755
driven_any_min	0.5178800799197198
driven_lanedir_consec_max	1.2632508875573516
driven_lanedir_consec_mean	0.8664595093823537
driven_lanedir_consec_min	0.5027676099706446
driven_lanedir_max	1.426177732775685
driven_lanedir_mean	0.957402963471303
driven_lanedir_median	0.8683601579423474
driven_lanedir_min	0.5027676099706446
in-drivable-lane_max	3.450000000000049
in-drivable-lane_mean	1.3200000000000187
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2639562306855057, "sim_physics": 0.03972894350687663, "survival_time": 14.950000000000076, "driven_lanedir": 1.2632512997730136, "sim_render-ego": 0.06140995740890503, "in-drivable-lane": 0, "agent_compute-ego": 0.21524929761886596, "deviation-heading": 0.35227852837961154, "set_robot_commands": 0.09262216329574584, "deviation-center-line": 0.2843983329373953, "driven_lanedir_consec": 1.2632508875573516, "sim_compute_sim_state": 0.03810637553532918, "sim_compute_performance-ego": 0.06768966436386109, "sim_compute_robot_state-ego": 0.07294413169225057, "sim_compute_robot_state-npc0": 0.06706297953923543, "sim_compute_robot_state-npc1": 0.06637088060379029, "sim_compute_robot_state-npc2": 0.06665716648101806, "sim_compute_robot_state-npc3": 0.06878373781840007}, "udem1-1-0": {"driven_any": 0.5178800799197198, "sim_physics": 0.03994068929127285, "survival_time": 5.599999999999988, "driven_lanedir": 0.5027676099706446, "sim_render-ego": 0.057946002909115384, "in-drivable-lane": 0, "agent_compute-ego": 0.2096725425549916, "deviation-heading": 1.104027031932554, "set_robot_commands": 0.08685739551271711, "deviation-center-line": 0.33751886926949487, "driven_lanedir_consec": 0.5027676099706446, "sim_compute_sim_state": 0.03504682651587895, "sim_compute_performance-ego": 0.061789550951548984, "sim_compute_robot_state-ego": 0.06723001599311829, "sim_compute_robot_state-npc0": 0.061836068119321554, "sim_compute_robot_state-npc1": 0.06506215887410301, "sim_compute_robot_state-npc2": 0.0646755120583943, "sim_compute_robot_state-npc3": 0.06235152270112719}, "udem1-2-0": {"driven_any": 1.023835845384281, "sim_physics": 0.040001746613969685, "survival_time": 12.35000000000004, "driven_lanedir": 0.7264580168948245, "sim_render-ego": 0.06092160047307188, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.207856763229679, "deviation-heading": 1.6780520687693454, "set_robot_commands": 0.08920646582537817, "deviation-center-line": 0.5739337875412183, "driven_lanedir_consec": 0.6826492910983035, "sim_compute_sim_state": 0.03643993713595124, "sim_compute_performance-ego": 0.06452236291367998, "sim_compute_robot_state-ego": 0.0663672883500937, "sim_compute_robot_state-npc0": 0.06621279021506367, "sim_compute_robot_state-npc1": 0.06642050878239064, "sim_compute_robot_state-npc2": 0.06496608884711015, "sim_compute_robot_state-npc3": 0.06400693476441419}, "udem1-3-0": {"driven_any": 1.4351127501650205, "sim_physics": 0.034349372094137624, "survival_time": 14.250000000000068, "driven_lanedir": 1.426177732775685, "sim_render-ego": 0.051254773558231825, "in-drivable-lane": 0, "agent_compute-ego": 0.1704380746473346, "deviation-heading": 1.4529901941423, "set_robot_commands": 0.07676352701689068, "deviation-center-line": 1.4819817541351823, "driven_lanedir_consec": 1.015269600343122, "sim_compute_sim_state": 0.03111834526062012, "sim_compute_performance-ego": 0.05350708459552966, "sim_compute_robot_state-ego": 0.05598564733538711, "sim_compute_robot_state-npc0": 0.05554814756962291, "sim_compute_robot_state-npc1": 0.054623752727843165, "sim_compute_robot_state-npc2": 0.054717795890674256, "sim_compute_robot_state-npc3": 0.054921383606760125}, "udem1-4-0": {"driven_any": 1.161923942236755, "sim_physics": 0.035143840220547465, "survival_time": 12.900000000000048, "driven_lanedir": 0.8683601579423474, "sim_render-ego": 0.05350677541984144, "in-drivable-lane": 3.450000000000049, "agent_compute-ego": 0.19254891447318617, "deviation-heading": 1.2094894480077245, "set_robot_commands": 0.08615908142208129, "deviation-center-line": 0.5095800429556276, "driven_lanedir_consec": 0.8683601579423474, "sim_compute_sim_state": 0.03571540625520455, "sim_compute_performance-ego": 0.058985192646351894, "sim_compute_robot_state-ego": 0.06267358073892519, "sim_compute_robot_state-npc0": 0.060065828552541806, "sim_compute_robot_state-npc1": 0.05972538530364517, "sim_compute_robot_state-npc2": 0.0594905790432479, "sim_compute_robot_state-npc3": 0.059835409009179406}}
set_robot_commands_max	0.09262216329574584
set_robot_commands_mean	0.08632172661456261
set_robot_commands_median	0.08685739551271711
set_robot_commands_min	0.07676352701689068
sim_compute_performance-ego_max	0.06768966436386109
sim_compute_performance-ego_mean	0.061298771094194314
sim_compute_performance-ego_median	0.061789550951548984
sim_compute_performance-ego_min	0.05350708459552966
sim_compute_robot_state-ego_max	0.07294413169225057
sim_compute_robot_state-ego_mean	0.06504013282195498
sim_compute_robot_state-ego_median	0.0663672883500937
sim_compute_robot_state-ego_min	0.05598564733538711
sim_compute_robot_state-npc0_max	0.06706297953923543
sim_compute_robot_state-npc0_mean	0.06214516279915707
sim_compute_robot_state-npc0_median	0.061836068119321554
sim_compute_robot_state-npc0_min	0.05554814756962291
sim_compute_robot_state-npc1_max	0.06642050878239064
sim_compute_robot_state-npc1_mean	0.06244053725835445
sim_compute_robot_state-npc1_median	0.06506215887410301
sim_compute_robot_state-npc1_min	0.054623752727843165
sim_compute_robot_state-npc2_max	0.06665716648101806
sim_compute_robot_state-npc2_mean	0.062101428464088934
sim_compute_robot_state-npc2_median	0.0646755120583943
sim_compute_robot_state-npc2_min	0.054717795890674256
sim_compute_robot_state-npc3_max	0.06878373781840007
sim_compute_robot_state-npc3_mean	0.061979797579976195
sim_compute_robot_state-npc3_median	0.06235152270112719
sim_compute_robot_state-npc3_min	0.054921383606760125
sim_compute_sim_state_max	0.03810637553532918
sim_compute_sim_state_mean	0.035285378140596804
sim_compute_sim_state_median	0.03571540625520455
sim_compute_sim_state_min	0.03111834526062012
sim_physics_max	0.040001746613969685
sim_physics_mean	0.03783291834536086
sim_physics_median	0.03972894350687663
sim_physics_min	0.034349372094137624
sim_render-ego_max	0.06140995740890503
sim_render-ego_mean	0.05700782195383312
sim_render-ego_median	0.057946002909115384
sim_render-ego_min	0.051254773558231825
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.010000000000044
survival_time_min	5.599999999999988

No reset possible

19338

2813

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

host-error

2019-04-24 14:00:42+00:00

2019-04-24 14:04:45+00:00

0:04:03

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 258, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 691, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19290

2885

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-24 13:45:28+00:00

2019-04-24 14:00:13+00:00

0:14:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19290-260509', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19290-260509', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19290-260509', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19278

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-24 13:40:08+00:00

2019-04-24 13:45:10+00:00

0:05:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19241

2940

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error