Evaluator 807

2019-04-26 13:41:40+00:00

2019-04-26 13:42:19+00:00

0:00:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-74.6809614848012

other stats

fleet_size	-1000000000
service_quality	-35.08491037120022

No reset possible

20675

3084

Claudio Ruch

Java template

aido2-AMOD-efficiency

step2-scoring

success

yes

2019-04-26 12:39:15+00:00

2019-04-26 12:39:56+00:00

0:00:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-63.52735013403736

other stats

fleet_size	-1000000000
service_quality	-32.41278753350997

No reset possible

20663

3080

Andrea Censi 🇨🇭

Java template

aido2-AMOD-efficiency

step1-simulation

success

yes

2019-04-26 10:25:28+00:00

2019-04-26 10:29:05+00:00

0:03:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20661

3074

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:03:01+00:00

2019-04-26 10:21:21+00:00

0:18:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6282321272354099
survival_time_median	10.90000000000002
deviation-center-line_median	0.5403153727644442
in-drivable-lane_median	3.6500000000000377

other stats

agent_compute-ego_max	0.1547117590904236
agent_compute-ego_mean	0.15053917287021337
agent_compute-ego_median	0.15185930013656615
agent_compute-ego_min	0.14239349597837866
deviation-center-line_max	0.6105787967404427
deviation-center-line_mean	0.5384827545165862
deviation-center-line_min	0.4548514945128936
deviation-heading_max	1.6621628477961958
deviation-heading_mean	1.383384238369865
deviation-heading_median	1.5570045941153134
deviation-heading_min	1.0283750089973105
driven_any_max	1.376542059212302
driven_any_mean	0.9592128797142294
driven_any_median	0.9927746886797696
driven_any_min	0.5124994683118874
driven_lanedir_consec_max	0.8157672168037178
driven_lanedir_consec_mean	0.6541870786684613
driven_lanedir_consec_min	0.5036860688845833
driven_lanedir_max	0.8157672168037178
driven_lanedir_mean	0.6541870786684613
driven_lanedir_median	0.6282321272354099
driven_lanedir_min	0.5036860688845833
in-drivable-lane_max	5.9500000000000846
in-drivable-lane_mean	3.080000000000041
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9927746886797696, "sim_physics": 0.10915652655680246, "survival_time": 10.90000000000002, "driven_lanedir": 0.6282321272354099, "sim_render-ego": 0.04541537302349685, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.15076261266655877, "deviation-heading": 1.0283750089973105, "set_robot_commands": 0.06901953745325771, "deviation-center-line": 0.5403153727644442, "driven_lanedir_consec": 0.6282321272354099, "sim_compute_sim_state": 0.02821848042514346, "sim_compute_performance-ego": 0.049983511277295035, "sim_compute_robot_state-ego": 0.05046296557155224, "sim_compute_robot_state-npc0": 0.051780968631079435, "sim_compute_robot_state-npc1": 0.05106677921540147, "sim_compute_robot_state-npc2": 0.05034259809266536, "sim_compute_robot_state-npc3": 0.05070418283480023}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5392619924422878, "sim_physics": 0.11063583498078632, "survival_time": 6.149999999999986, "driven_lanedir": 0.5197856906625655, "sim_render-ego": 0.043355951464273096, "in-drivable-lane": 0, "agent_compute-ego": 0.14239349597837866, "deviation-heading": 1.6621628477961958, "set_robot_commands": 0.06475287918152849, "deviation-center-line": 0.4548514945128936, "driven_lanedir_consec": 0.5197856906625655, "sim_compute_sim_state": 0.02692621704039535, "sim_compute_performance-ego": 0.04700404647889176, "sim_compute_robot_state-ego": 0.04853136558842853, "sim_compute_robot_state-npc0": 0.04922170755339832, "sim_compute_robot_state-npc1": 0.04781114182821134, "sim_compute_robot_state-npc2": 0.04791174477678004, "sim_compute_robot_state-npc3": 0.04794671283504827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3749861899249, "sim_physics": 0.11340508143107096, "survival_time": 14.950000000000076, "driven_lanedir": 0.8157672168037178, "sim_render-ego": 0.04615701834360759, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.1547117590904236, "deviation-heading": 1.5872718172175444, "set_robot_commands": 0.0705399489402771, "deviation-center-line": 0.6105787967404427, "driven_lanedir_consec": 0.8157672168037178, "sim_compute_sim_state": 0.028369417985280355, "sim_compute_performance-ego": 0.05027927954991659, "sim_compute_robot_state-ego": 0.050656624635060626, "sim_compute_robot_state-npc0": 0.051403610706329345, "sim_compute_robot_state-npc1": 0.04982913573582967, "sim_compute_robot_state-npc2": 0.05027932167053223, "sim_compute_robot_state-npc3": 0.050495954354604085}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.376542059212302, "sim_physics": 0.11546786546707154, "survival_time": 14.950000000000076, "driven_lanedir": 0.8034642897560298, "sim_render-ego": 0.048964192072550455, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.15185930013656615, "deviation-heading": 1.5570045941153134, "set_robot_commands": 0.07046917041142782, "deviation-center-line": 0.5992765974333993, "driven_lanedir_consec": 0.8034642897560298, "sim_compute_sim_state": 0.029780821005503336, "sim_compute_performance-ego": 0.05032448530197144, "sim_compute_robot_state-ego": 0.051364893913269045, "sim_compute_robot_state-npc0": 0.05298401037851969, "sim_compute_robot_state-npc1": 0.051656442483266195, "sim_compute_robot_state-npc2": 0.05092855294545492, "sim_compute_robot_state-npc3": 0.05189839204152425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5124994683118874, "sim_physics": 0.11282369186138284, "survival_time": 5.799999999999987, "driven_lanedir": 0.5036860688845833, "sim_render-ego": 0.04718510652410573, "in-drivable-lane": 0, "agent_compute-ego": 0.15296869647913966, "deviation-heading": 1.08210692372296, "set_robot_commands": 0.07443946188893812, "deviation-center-line": 0.4873915111317512, "driven_lanedir_consec": 0.5036860688845833, "sim_compute_sim_state": 0.02834265396512788, "sim_compute_performance-ego": 0.051210689133611216, "sim_compute_robot_state-ego": 0.05349702054056628, "sim_compute_robot_state-npc0": 0.05238999580514842, "sim_compute_robot_state-npc1": 0.05111140423807605, "sim_compute_robot_state-npc2": 0.05043402211419467, "sim_compute_robot_state-npc3": 0.049755287581476675}}
set_robot_commands_max	0.07443946188893812
set_robot_commands_mean	0.06984419957508585
set_robot_commands_median	0.07046917041142782
set_robot_commands_min	0.06475287918152849
sim_compute_performance-ego_max	0.051210689133611216
sim_compute_performance-ego_mean	0.04976040234833721
sim_compute_performance-ego_median	0.05027927954991659
sim_compute_performance-ego_min	0.04700404647889176
sim_compute_robot_state-ego_max	0.05349702054056628
sim_compute_robot_state-ego_mean	0.05090257404977534
sim_compute_robot_state-ego_median	0.050656624635060626
sim_compute_robot_state-ego_min	0.04853136558842853
sim_compute_robot_state-npc0_max	0.05298401037851969
sim_compute_robot_state-npc0_mean	0.05155605861489504
sim_compute_robot_state-npc0_median	0.051780968631079435
sim_compute_robot_state-npc0_min	0.04922170755339832
sim_compute_robot_state-npc1_max	0.051656442483266195
sim_compute_robot_state-npc1_mean	0.05029498070015694
sim_compute_robot_state-npc1_median	0.05106677921540147
sim_compute_robot_state-npc1_min	0.04781114182821134
sim_compute_robot_state-npc2_max	0.05092855294545492
sim_compute_robot_state-npc2_mean	0.049979247919925446
sim_compute_robot_state-npc2_median	0.05034259809266536
sim_compute_robot_state-npc2_min	0.04791174477678004
sim_compute_robot_state-npc3_max	0.05189839204152425
sim_compute_robot_state-npc3_mean	0.050160105929490696
sim_compute_robot_state-npc3_median	0.050495954354604085
sim_compute_robot_state-npc3_min	0.04794671283504827
sim_compute_sim_state_max	0.029780821005503336
sim_compute_sim_state_mean	0.02832751808429008
sim_compute_sim_state_median	0.02834265396512788
sim_compute_sim_state_min	0.02692621704039535
sim_physics_max	0.11546786546707154
sim_physics_mean	0.11229780005942284
sim_physics_median	0.11282369186138284
sim_physics_min	0.10915652655680246
sim_render-ego_max	0.048964192072550455
sim_render-ego_mean	0.046215528285606745
sim_render-ego_median	0.04615701834360759
sim_render-ego_min	0.043355951464273096
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.55000000000003
survival_time_min	5.799999999999987

No reset possible

20632

2403

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:06:36+00:00

2019-04-25 15:14:32+00:00

0:07:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08815722978948815
survival_time_median	1.800000000000001
deviation-center-line_median	0.06759128482153459
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.17485741111967298
agent_compute-ego_mean	0.1636699282328288
agent_compute-ego_median	0.16085152493582833
agent_compute-ego_min	0.15666745730808804
deviation-center-line_max	0.5947150110563205
deviation-center-line_mean	0.1675445150536224
deviation-center-line_min	0.03912403727176084
deviation-heading_max	5.235813465809776
deviation-heading_mean	1.6159005933450217
deviation-heading_median	0.6996226549460283
deviation-heading_min	0.6798633322706823
driven_any_max	2.242642705482657
driven_any_mean	0.5916615860222353
driven_any_median	0.19911654739020512
driven_any_min	0.10248218522851008
driven_lanedir_consec_max	0.5081124182265015
driven_lanedir_consec_mean	0.1644510172476035
driven_lanedir_consec_min	0.06526533721991656
driven_lanedir_max	0.5081124182265015
driven_lanedir_mean	0.1644510172476035
driven_lanedir_median	0.08815722978948815
driven_lanedir_min	0.06526533721991656
in-drivable-lane_max	8.950000000000067
in-drivable-lane_mean	2.1100000000000136
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22677824346116215, "sim_physics": 0.10790665282143488, "survival_time": 1.800000000000001, "driven_lanedir": 0.08815722978948815, "sim_render-ego": 0.06705776188108656, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.17485741111967298, "deviation-heading": 0.7775570588512737, "set_robot_commands": 0.09886724419063991, "deviation-center-line": 0.06759128482153459, "driven_lanedir_consec": 0.08815722978948815, "sim_compute_sim_state": 0.04192372825410631, "sim_compute_performance-ego": 0.07140382793214586, "sim_compute_robot_state-ego": 0.07824756039513482}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19911654739020512, "sim_physics": 0.10265554984410603, "survival_time": 1.800000000000001, "driven_lanedir": 0.0937347669274905, "sim_render-ego": 0.05737366278966268, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16085152493582833, "deviation-heading": 0.6996226549460283, "set_robot_commands": 0.0895894898308648, "deviation-center-line": 0.03963327966851285, "driven_lanedir_consec": 0.0937347669274905, "sim_compute_sim_state": 0.034775873025258384, "sim_compute_performance-ego": 0.06658173931969537, "sim_compute_robot_state-ego": 0.07701187663608128}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10248218522851008, "sim_physics": 0.0734486352829706, "survival_time": 1.0500000000000005, "driven_lanedir": 0.06526533721991656, "sim_render-ego": 0.05753600029718308, "in-drivable-lane": 0, "agent_compute-ego": 0.16736488115219844, "deviation-heading": 0.6866464548473458, "set_robot_commands": 0.08061483928135463, "deviation-center-line": 0.09665896244998325, "driven_lanedir_consec": 0.06526533721991656, "sim_compute_sim_state": 0.03609116872151693, "sim_compute_performance-ego": 0.06399190993536086, "sim_compute_robot_state-ego": 0.06689918608892531}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.242642705482657, "sim_physics": 0.11721322298049928, "survival_time": 14.950000000000076, "driven_lanedir": 0.5081124182265015, "sim_render-ego": 0.05780451615651449, "in-drivable-lane": 8.950000000000067, "agent_compute-ego": 0.15860836664835612, "deviation-heading": 5.235813465809776, "set_robot_commands": 0.08684628407160441, "deviation-center-line": 0.5947150110563205, "driven_lanedir_consec": 0.5081124182265015, "sim_compute_sim_state": 0.0363958740234375, "sim_compute_performance-ego": 0.06451934655507406, "sim_compute_robot_state-ego": 0.06719267686208089}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18728824854864237, "sim_physics": 0.0974090576171875, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0669853340746207, "sim_render-ego": 0.060436889103480745, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15666745730808804, "deviation-heading": 0.6798633322706823, "set_robot_commands": 0.08873304639543805, "deviation-center-line": 0.03912403727176084, "driven_lanedir_consec": 0.0669853340746207, "sim_compute_sim_state": 0.035951757431030275, "sim_compute_performance-ego": 0.06761046818324498, "sim_compute_robot_state-ego": 0.0672299861907959}}
set_robot_commands_max	0.09886724419063991
set_robot_commands_mean	0.08893018075398038
set_robot_commands_median	0.08873304639543805
set_robot_commands_min	0.08061483928135463
sim_compute_performance-ego_max	0.07140382793214586
sim_compute_performance-ego_mean	0.06682145838510423
sim_compute_performance-ego_median	0.06658173931969537
sim_compute_performance-ego_min	0.06399190993536086
sim_compute_robot_state-ego_max	0.07824756039513482
sim_compute_robot_state-ego_mean	0.07131625723460364
sim_compute_robot_state-ego_median	0.0672299861907959
sim_compute_robot_state-ego_min	0.06689918608892531
sim_compute_sim_state_max	0.04192372825410631
sim_compute_sim_state_mean	0.03702768029106989
sim_compute_sim_state_median	0.03609116872151693
sim_compute_sim_state_min	0.034775873025258384
sim_physics_max	0.11721322298049928
sim_physics_mean	0.09972662370923964
sim_physics_median	0.10265554984410603
sim_physics_min	0.0734486352829706
sim_render-ego_max	0.06705776188108656
sim_render-ego_mean	0.06004176604558551
sim_render-ego_median	0.05780451615651449
sim_render-ego_min	0.05737366278966268
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.270000000000016
survival_time_min	1.0500000000000005

No reset possible

20618

2362

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:10+00:00

2019-04-25 15:05:54+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16350172600656185
agent_compute-ego_mean	0.13922414268076255
agent_compute-ego_median	0.13274737810477233
agent_compute-ego_min	0.12285497453477648
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.12433961652359872, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.07439141453437086, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16350172600656185, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1231205868271162, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04662673428373517, "sim_compute_performance-ego": 0.08040378228673395, "sim_compute_robot_state-ego": 0.08479504315358288}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.11051710293843196, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06575323985173152, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15055609207886916, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.10613842193896954, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.04108802171853872, "sim_compute_performance-ego": 0.07307499188643235, "sim_compute_robot_state-ego": 0.08000433444976807}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.07664158609178331, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05836166275872125, "in-drivable-lane": 0, "agent_compute-ego": 0.12285497453477648, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.08863393465677898, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.03694423039754232, "sim_compute_performance-ego": 0.07068133354187012, "sim_compute_robot_state-ego": 0.07095661428239611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.08876690864562989, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.05566856384277344, "in-drivable-lane": 0, "agent_compute-ego": 0.126460542678833, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.08636988639831543, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03278533935546875, "sim_compute_performance-ego": 0.06066613197326661, "sim_compute_robot_state-ego": 0.06742000579833984}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09015853588397686, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06023748104388897, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13274737810477233, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.095022656978705, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03873794201092842, "sim_compute_performance-ego": 0.06641530684935741, "sim_compute_robot_state-ego": 0.07290331522623698}}
set_robot_commands_max	0.1231205868271162
set_robot_commands_mean	0.09985709735997704
set_robot_commands_median	0.095022656978705
set_robot_commands_min	0.08636988639831543
sim_compute_performance-ego_max	0.08040378228673395
sim_compute_performance-ego_mean	0.07024830930753209
sim_compute_performance-ego_median	0.07068133354187012
sim_compute_performance-ego_min	0.06066613197326661
sim_compute_robot_state-ego_max	0.08479504315358288
sim_compute_robot_state-ego_mean	0.07521586258206478
sim_compute_robot_state-ego_median	0.07290331522623698
sim_compute_robot_state-ego_min	0.06742000579833984
sim_compute_sim_state_max	0.04662673428373517
sim_compute_sim_state_mean	0.03923645355324267
sim_compute_sim_state_median	0.03873794201092842
sim_compute_sim_state_min	0.03278533935546875
sim_physics_max	0.12433961652359872
sim_physics_mean	0.09808475001668414
sim_physics_median	0.09015853588397686
sim_physics_min	0.07664158609178331
sim_render-ego_max	0.07439141453437086
sim_render-ego_mean	0.06288247240629721
sim_render-ego_median	0.06023748104388897
sim_render-ego_min	0.05566856384277344
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20603

2388

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:51:15+00:00

2019-04-25 15:00:03+00:00

0:08:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20590

2404

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:45:13+00:00

2019-04-25 14:50:33+00:00

0:05:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08608637141076136
survival_time_median	1.1500000000000004
deviation-center-line_median	0.06462114159355194
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1819150447845459
agent_compute-ego_mean	0.16853446500391142
agent_compute-ego_median	0.16627250546994415
agent_compute-ego_min	0.15786896032445571
deviation-center-line_max	0.09657332316428484
deviation-center-line_mean	0.07546722419693404
deviation-center-line_min	0.05925304510034487
deviation-heading_max	0.8833154358597554
deviation-heading_mean	0.690690990978047
deviation-heading_median	0.7226491021144509
deviation-heading_min	0.5117278481717907
driven_any_max	0.2063552121752718
driven_any_mean	0.16215647597903612
driven_any_median	0.14600915371263687
driven_any_min	0.12143843683801338
driven_lanedir_consec_max	0.10008224496005712
driven_lanedir_consec_mean	0.08158301581984477
driven_lanedir_consec_min	0.048097810517388595
driven_lanedir_max	0.10008224496005712
driven_lanedir_mean	0.08158301581984477
driven_lanedir_median	0.08608637141076136
driven_lanedir_min	0.048097810517388595
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.17000000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2063552121752718, "sim_physics": 0.1431970806682811, "survival_time": 1.7000000000000008, "driven_lanedir": 0.048097810517388595, "sim_render-ego": 0.059599630972918344, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15786896032445571, "deviation-heading": 0.7226491021144509, "set_robot_commands": 0.08612547201268814, "deviation-center-line": 0.060533321082424894, "driven_lanedir_consec": 0.048097810517388595, "sim_compute_sim_state": 0.03608421718373018, "sim_compute_performance-ego": 0.06371158010819379, "sim_compute_robot_state-ego": 0.06721749025232651, "sim_compute_robot_state-npc0": 0.06413578987121582, "sim_compute_robot_state-npc1": 0.06467981899485868, "sim_compute_robot_state-npc2": 0.06441653476041906, "sim_compute_robot_state-npc3": 0.06375759489396039}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19996387693293816, "sim_physics": 0.13530552798304066, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0891732000470129, "sim_render-ego": 0.054971875815555966, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.16010366637131265, "deviation-heading": 0.8833154358597554, "set_robot_commands": 0.09042597639149633, "deviation-center-line": 0.06462114159355194, "driven_lanedir_consec": 0.0891732000470129, "sim_compute_sim_state": 0.035666194455376984, "sim_compute_performance-ego": 0.06617554302873283, "sim_compute_robot_state-ego": 0.07387630692843733, "sim_compute_robot_state-npc0": 0.06807429215003705, "sim_compute_robot_state-npc1": 0.06295451624640103, "sim_compute_robot_state-npc2": 0.06008425252190951, "sim_compute_robot_state-npc3": 0.06214701718297498}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12143843683801338, "sim_physics": 0.14281357418407092, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08447545216400387, "sim_render-ego": 0.06332098353992809, "in-drivable-lane": 0, "agent_compute-ego": 0.1819150447845459, "deviation-heading": 0.5273487611089064, "set_robot_commands": 0.10490853136236016, "deviation-center-line": 0.09657332316428484, "driven_lanedir_consec": 0.08447545216400387, "sim_compute_sim_state": 0.03887631676413796, "sim_compute_performance-ego": 0.0676980885592374, "sim_compute_robot_state-ego": 0.07229564406655052, "sim_compute_robot_state-npc0": 0.07462741028178822, "sim_compute_robot_state-npc1": 0.07138252258300781, "sim_compute_robot_state-npc2": 0.07146584987640381, "sim_compute_robot_state-npc3": 0.0683584213256836}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1370157002363204, "sim_physics": 0.13679905559705652, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10008224496005712, "sim_render-ego": 0.058817967124607254, "in-drivable-lane": 0, "agent_compute-ego": 0.16627250546994415, "deviation-heading": 0.5117278481717907, "set_robot_commands": 0.09416382209114406, "deviation-center-line": 0.0963552900440636, "driven_lanedir_consec": 0.10008224496005712, "sim_compute_sim_state": 0.03703830553137738, "sim_compute_performance-ego": 0.06223340656446374, "sim_compute_robot_state-ego": 0.06932580989340077, "sim_compute_robot_state-npc0": 0.06895870747773544, "sim_compute_robot_state-npc1": 0.06537127494812012, "sim_compute_robot_state-npc2": 0.061203386472619095, "sim_compute_robot_state-npc3": 0.06477655535158904}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14600915371263687, "sim_physics": 0.14111814291580865, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08608637141076136, "sim_render-ego": 0.06714579333429752, "in-drivable-lane": 0, "agent_compute-ego": 0.1765121480692988, "deviation-heading": 0.8084138076353312, "set_robot_commands": 0.09657003568566364, "deviation-center-line": 0.05925304510034487, "driven_lanedir_consec": 0.08608637141076136, "sim_compute_sim_state": 0.04322249993034031, "sim_compute_performance-ego": 0.07007731562075407, "sim_compute_robot_state-ego": 0.07602518537770146, "sim_compute_robot_state-npc0": 0.07154242888740871, "sim_compute_robot_state-npc1": 0.07479684249214504, "sim_compute_robot_state-npc2": 0.07536585434623387, "sim_compute_robot_state-npc3": 0.07534471802089525}}
set_robot_commands_max	0.10490853136236016
set_robot_commands_mean	0.09443876750867046
set_robot_commands_median	0.09416382209114406
set_robot_commands_min	0.08612547201268814
sim_compute_performance-ego_max	0.07007731562075407
sim_compute_performance-ego_mean	0.06597918677627637
sim_compute_performance-ego_median	0.06617554302873283
sim_compute_performance-ego_min	0.06223340656446374
sim_compute_robot_state-ego_max	0.07602518537770146
sim_compute_robot_state-ego_mean	0.07174808730368332
sim_compute_robot_state-ego_median	0.07229564406655052
sim_compute_robot_state-ego_min	0.06721749025232651
sim_compute_robot_state-npc0_max	0.07462741028178822
sim_compute_robot_state-npc0_mean	0.06946772573363705
sim_compute_robot_state-npc0_median	0.06895870747773544
sim_compute_robot_state-npc0_min	0.06413578987121582
sim_compute_robot_state-npc1_max	0.07479684249214504
sim_compute_robot_state-npc1_mean	0.06783699505290654
sim_compute_robot_state-npc1_median	0.06537127494812012
sim_compute_robot_state-npc1_min	0.06295451624640103
sim_compute_robot_state-npc2_max	0.07536585434623387
sim_compute_robot_state-npc2_mean	0.06650717559551708
sim_compute_robot_state-npc2_median	0.06441653476041906
sim_compute_robot_state-npc2_min	0.06008425252190951
sim_compute_robot_state-npc3_max	0.07534471802089525
sim_compute_robot_state-npc3_mean	0.06687686135502066
sim_compute_robot_state-npc3_median	0.06477655535158904
sim_compute_robot_state-npc3_min	0.06214701718297498
sim_compute_sim_state_max	0.04322249993034031
sim_compute_sim_state_mean	0.038177506772992566
sim_compute_sim_state_median	0.03703830553137738
sim_compute_sim_state_min	0.035666194455376984
sim_physics_max	0.1431970806682811
sim_physics_mean	0.13984667626965158
sim_physics_median	0.14111814291580865
sim_physics_min	0.13530552798304066
sim_render-ego_max	0.06714579333429752
sim_render-ego_mean	0.06077125015746143
sim_render-ego_median	0.059599630972918344
sim_render-ego_min	0.054971875815555966
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.3100000000000005
survival_time_min	1.1000000000000003

No reset possible

20584

2407

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:37:12+00:00

2019-04-25 14:44:49+00:00

0:07:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1061041434176222
survival_time_median	1.3500000000000003
deviation-center-line_median	0.06930232162918272
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2017465463051429
agent_compute-ego_mean	0.17310659427075953
agent_compute-ego_median	0.1662852668762207
agent_compute-ego_min	0.14684929992213394
deviation-center-line_max	0.11767564172694953
deviation-center-line_mean	0.083259459980928
deviation-center-line_min	0.05269733773263336
deviation-heading_max	0.9265300455380044
deviation-heading_mean	0.7141511232513374
deviation-heading_median	0.7680567502641477
deviation-heading_min	0.46543968436588146
driven_any_max	0.2481778772764457
driven_any_mean	0.18486876827987136
driven_any_median	0.1840451209683768
driven_any_min	0.14427978563022456
driven_lanedir_consec_max	0.15573292360028956
driven_lanedir_consec_mean	0.10339122262623386
driven_lanedir_consec_min	0.06126924626986163
driven_lanedir_max	0.15573292360028956
driven_lanedir_mean	0.10339122262623386
driven_lanedir_median	0.1061041434176222
driven_lanedir_min	0.06126924626986163
in-drivable-lane_max	0.6500000000000004
in-drivable-lane_mean	0.25000000000000017
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2481778772764457, "sim_physics": 0.1989002585411072, "survival_time": 2.000000000000001, "driven_lanedir": 0.1061041434176222, "sim_render-ego": 0.06584365367889404, "in-drivable-lane": 0.6500000000000004, "agent_compute-ego": 0.1938116133213043, "deviation-heading": 0.7680567502641477, "set_robot_commands": 0.09929092526435852, "deviation-center-line": 0.06930232162918272, "driven_lanedir_consec": 0.1061041434176222, "sim_compute_sim_state": 0.04315050840377808, "sim_compute_performance-ego": 0.07054314017295837, "sim_compute_robot_state-ego": 0.07680444717407227, "sim_compute_robot_state-npc0": 0.07286195755004883, "sim_compute_robot_state-npc1": 0.07671245336532592, "sim_compute_robot_state-npc2": 0.07415735721588135, "sim_compute_robot_state-npc3": 0.0755180537700653}, "udem1-1-0": {"driven_any": 0.20158961364655592, "sim_physics": 0.1652576273137873, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06126924626986163, "sim_render-ego": 0.0632397984013413, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.14684929992213394, "deviation-heading": 0.7767641333955604, "set_robot_commands": 0.09033843965241405, "deviation-center-line": 0.05269733773263336, "driven_lanedir_consec": 0.06126924626986163, "sim_compute_sim_state": 0.038523710135257606, "sim_compute_performance-ego": 0.06264362190708969, "sim_compute_robot_state-ego": 0.06014321067116477, "sim_compute_robot_state-npc0": 0.06964852593161842, "sim_compute_robot_state-npc1": 0.0662772510990952, "sim_compute_robot_state-npc2": 0.0633152470444188, "sim_compute_robot_state-npc3": 0.06534118363351533}, "udem1-2-0": {"driven_any": 0.14625144387775366, "sim_physics": 0.17705817575807925, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11318786352006605, "sim_render-ego": 0.054763237635294594, "in-drivable-lane": 0, "agent_compute-ego": 0.15684024492899576, "deviation-heading": 0.6339650026930927, "set_robot_commands": 0.08990264821935583, "deviation-center-line": 0.11767564172694953, "driven_lanedir_consec": 0.11318786352006605, "sim_compute_sim_state": 0.03820167647467719, "sim_compute_performance-ego": 0.0631814267900255, "sim_compute_robot_state-ego": 0.06249383643821434, "sim_compute_robot_state-npc0": 0.06829757160610622, "sim_compute_robot_state-npc1": 0.07076557477315266, "sim_compute_robot_state-npc2": 0.06487326268796567, "sim_compute_robot_state-npc3": 0.06759007771809895}, "udem1-3-0": {"driven_any": 0.1840451209683768, "sim_physics": 0.21292604849888727, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15573292360028956, "sim_render-ego": 0.06701433658599854, "in-drivable-lane": 0, "agent_compute-ego": 0.2017465463051429, "deviation-heading": 0.46543968436588146, "set_robot_commands": 0.10961776513319749, "deviation-center-line": 0.11047284309847268, "driven_lanedir_consec": 0.15573292360028956, "sim_compute_sim_state": 0.04317041543813852, "sim_compute_performance-ego": 0.07568661066202018, "sim_compute_robot_state-ego": 0.07792399479792668, "sim_compute_robot_state-npc0": 0.07628089648026687, "sim_compute_robot_state-npc1": 0.0769262038744413, "sim_compute_robot_state-npc2": 0.07556439363039456, "sim_compute_robot_state-npc3": 0.07558724513420692}, "udem1-4-0": {"driven_any": 0.14427978563022456, "sim_physics": 0.15411264419555665, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08066193632332985, "sim_render-ego": 0.05874455451965332, "in-drivable-lane": 0, "agent_compute-ego": 0.1662852668762207, "deviation-heading": 0.9265300455380044, "set_robot_commands": 0.08785685539245605, "deviation-center-line": 0.0661491557174017, "driven_lanedir_consec": 0.08066193632332985, "sim_compute_sim_state": 0.037284040451049806, "sim_compute_performance-ego": 0.069024076461792, "sim_compute_robot_state-ego": 0.07206304550170899, "sim_compute_robot_state-npc0": 0.06323307991027832, "sim_compute_robot_state-npc1": 0.061248559951782224, "sim_compute_robot_state-npc2": 0.0635935401916504, "sim_compute_robot_state-npc3": 0.06384636878967286}}
set_robot_commands_max	0.10961776513319749
set_robot_commands_mean	0.0954013267323564
set_robot_commands_median	0.09033843965241405
set_robot_commands_min	0.08785685539245605
sim_compute_performance-ego_max	0.07568661066202018
sim_compute_performance-ego_mean	0.06821577519877715
sim_compute_performance-ego_median	0.069024076461792
sim_compute_performance-ego_min	0.06264362190708969
sim_compute_robot_state-ego_max	0.07792399479792668
sim_compute_robot_state-ego_mean	0.06988570691661741
sim_compute_robot_state-ego_median	0.07206304550170899
sim_compute_robot_state-ego_min	0.06014321067116477
sim_compute_robot_state-npc0_max	0.07628089648026687
sim_compute_robot_state-npc0_mean	0.07006440629566374
sim_compute_robot_state-npc0_median	0.06964852593161842
sim_compute_robot_state-npc0_min	0.06323307991027832
sim_compute_robot_state-npc1_max	0.0769262038744413
sim_compute_robot_state-npc1_mean	0.07038600861275945
sim_compute_robot_state-npc1_median	0.07076557477315266
sim_compute_robot_state-npc1_min	0.061248559951782224
sim_compute_robot_state-npc2_max	0.07556439363039456
sim_compute_robot_state-npc2_mean	0.06830076015406214
sim_compute_robot_state-npc2_median	0.06487326268796567
sim_compute_robot_state-npc2_min	0.0633152470444188
sim_compute_robot_state-npc3_max	0.07558724513420692
sim_compute_robot_state-npc3_mean	0.06957658580911188
sim_compute_robot_state-npc3_median	0.06759007771809895
sim_compute_robot_state-npc3_min	0.06384636878967286
sim_compute_sim_state_max	0.04317041543813852
sim_compute_sim_state_mean	0.04006607018058024
sim_compute_sim_state_median	0.038523710135257606
sim_compute_sim_state_min	0.037284040451049806
sim_physics_max	0.21292604849888727
sim_physics_mean	0.18165095086148356
sim_physics_median	0.17705817575807925
sim_physics_min	0.15411264419555665
sim_render-ego_max	0.06701433658599854
sim_render-ego_mean	0.06192111616423636
sim_render-ego_median	0.0632397984013413
sim_render-ego_min	0.054763237635294594
simulation-passed	1
survival_time_max	2.000000000000001
survival_time_mean	1.5100000000000005
survival_time_min	1.2500000000000004

No reset possible

20559

2446

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:12:58+00:00

2019-04-25 14:36:30+00:00

0:23:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3397390356601346
survival_time_median	14.950000000000076
deviation-center-line_median	1.401141803909748
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.16138179381688436
agent_compute-ego_mean	0.1544363842010498
agent_compute-ego_median	0.15614225546518962
agent_compute-ego_min	0.14178179423014323
deviation-center-line_max	1.5194332589791988
deviation-center-line_mean	1.1743762518416452
deviation-center-line_min	0.26891847472491964
deviation-heading_max	8.492476633385415
deviation-heading_mean	7.583649780851511
deviation-heading_median	8.165190079878816
deviation-heading_min	5.589657549909816
driven_any_max	4.378320939674851
driven_any_mean	4.378320939674839
driven_any_median	4.3783209396748415
driven_any_min	4.378320939674831
driven_lanedir_consec_max	-1.3111163275808764
driven_lanedir_consec_mean	-1.342604284062788
driven_lanedir_consec_min	-1.3761077892801137
driven_lanedir_max	-1.3397390356601346
driven_lanedir_mean	-2.354812195437246
driven_lanedir_median	-2.597977359892488
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.570000000000019
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.11867382605870563, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.061295249462127686, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15907333294550577, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09471826314926148, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.039498422940572105, "sim_compute_performance-ego": 0.06658160924911499, "sim_compute_robot_state-ego": 0.07134103298187255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.09986755688985188, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.05394635279973348, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.14178179423014323, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.0860521109898885, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.03407214959462484, "sim_compute_performance-ego": 0.061092854340871174, "sim_compute_robot_state-ego": 0.06848312218983968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.11246212402979532, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.059262658754984536, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.16138179381688436, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.08992591301600138, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.03743815183639526, "sim_compute_performance-ego": 0.06525811115900676, "sim_compute_robot_state-ego": 0.07070332606633505}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11153515418370565, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.05833609660466512, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.15614225546518962, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.08980220397313436, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03662278811136881, "sim_compute_performance-ego": 0.06377999464670817, "sim_compute_robot_state-ego": 0.06868614276250204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.1111218245824178, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.05714348872502645, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.15380274454752604, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.08649130423863728, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.035748157501220706, "sim_compute_performance-ego": 0.0633875584602356, "sim_compute_robot_state-ego": 0.06745607852935791}}
set_robot_commands_max	0.09471826314926148
set_robot_commands_mean	0.0893979590733846
set_robot_commands_median	0.08980220397313436
set_robot_commands_min	0.0860521109898885
sim_compute_performance-ego_max	0.06658160924911499
sim_compute_performance-ego_mean	0.06402002557118733
sim_compute_performance-ego_median	0.06377999464670817
sim_compute_performance-ego_min	0.061092854340871174
sim_compute_robot_state-ego_max	0.07134103298187255
sim_compute_robot_state-ego_mean	0.06933394050598143
sim_compute_robot_state-ego_median	0.06868614276250204
sim_compute_robot_state-ego_min	0.06745607852935791
sim_compute_sim_state_max	0.039498422940572105
sim_compute_sim_state_mean	0.036675933996836343
sim_compute_sim_state_median	0.03662278811136881
sim_compute_sim_state_min	0.03407214959462484
sim_physics_max	0.11867382605870563
sim_physics_mean	0.11073209714889524
sim_physics_median	0.11153515418370565
sim_physics_min	0.09986755688985188
sim_render-ego_max	0.061295249462127686
sim_render-ego_mean	0.057996769269307455
sim_render-ego_median	0.05833609660466512
sim_render-ego_min	0.05394635279973348
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20539

2476

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:04:18+00:00

2019-04-25 14:12:33+00:00

0:08:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15229589939117433
agent_compute-ego_mean	0.14431240450000343
agent_compute-ego_median	0.14749660581912635
agent_compute-ego_min	0.13055876890818277
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1673862596727767, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.058809212918551464, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14749660581912635, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0910801977481482, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03758765166660525, "sim_compute_performance-ego": 0.06624426256935552, "sim_compute_robot_state-ego": 0.06982349899579894, "sim_compute_robot_state-npc0": 0.06737172828530366, "sim_compute_robot_state-npc1": 0.06807965827438067, "sim_compute_robot_state-npc2": 0.06646648442970132, "sim_compute_robot_state-npc3": 0.06733904694611172}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1325227121512095, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0555245578289032, "in-drivable-lane": 0, "agent_compute-ego": 0.13055876890818277, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08149820566177368, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03551695744196574, "sim_compute_performance-ego": 0.056304991245269775, "sim_compute_robot_state-ego": 0.0636179546515147, "sim_compute_robot_state-npc0": 0.05872394641240438, "sim_compute_robot_state-npc1": 0.05962708592414856, "sim_compute_robot_state-npc2": 0.0607814093430837, "sim_compute_robot_state-npc3": 0.05981533726056417}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16751879756733523, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06240136744612354, "in-drivable-lane": 0, "agent_compute-ego": 0.15060061519428836, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09082206224991105, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03775790586309918, "sim_compute_performance-ego": 0.06940381405717236, "sim_compute_robot_state-ego": 0.07079132532669326, "sim_compute_robot_state-npc0": 0.0672377166101488, "sim_compute_robot_state-npc1": 0.06532197079416048, "sim_compute_robot_state-npc2": 0.06442651910296941, "sim_compute_robot_state-npc3": 0.06395639403391692}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.17007670968265856, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05830424518908484, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14061013318724552, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09006859488406424, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03925511796595687, "sim_compute_performance-ego": 0.06301033294807046, "sim_compute_robot_state-ego": 0.0687178312721899, "sim_compute_robot_state-npc0": 0.06594339063612081, "sim_compute_robot_state-npc1": 0.06826176885831153, "sim_compute_robot_state-npc2": 0.06628026800640559, "sim_compute_robot_state-npc3": 0.0695900149264578}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1364813804626465, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.0635748028755188, "in-drivable-lane": 0, "agent_compute-ego": 0.15229589939117433, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0926251769065857, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0491624116897583, "sim_compute_performance-ego": 0.07009050846099854, "sim_compute_robot_state-ego": 0.07372802495956421, "sim_compute_robot_state-npc0": 0.0677424430847168, "sim_compute_robot_state-npc1": 0.0676951289176941, "sim_compute_robot_state-npc2": 0.06438014507293702, "sim_compute_robot_state-npc3": 0.0652887463569641}}
set_robot_commands_max	0.0926251769065857
set_robot_commands_mean	0.08921884749009656
set_robot_commands_median	0.09082206224991105
set_robot_commands_min	0.08149820566177368
sim_compute_performance-ego_max	0.07009050846099854
sim_compute_performance-ego_mean	0.06501078185617333
sim_compute_performance-ego_median	0.06624426256935552
sim_compute_performance-ego_min	0.056304991245269775
sim_compute_robot_state-ego_max	0.07372802495956421
sim_compute_robot_state-ego_mean	0.06933572704115219
sim_compute_robot_state-ego_median	0.06982349899579894
sim_compute_robot_state-ego_min	0.0636179546515147
sim_compute_robot_state-npc0_max	0.0677424430847168
sim_compute_robot_state-npc0_mean	0.06540384500573888
sim_compute_robot_state-npc0_median	0.0672377166101488
sim_compute_robot_state-npc0_min	0.05872394641240438
sim_compute_robot_state-npc1_max	0.06826176885831153
sim_compute_robot_state-npc1_mean	0.06579712255373907
sim_compute_robot_state-npc1_median	0.0676951289176941
sim_compute_robot_state-npc1_min	0.05962708592414856
sim_compute_robot_state-npc2_max	0.06646648442970132
sim_compute_robot_state-npc2_mean	0.0644669651910194
sim_compute_robot_state-npc2_median	0.06442651910296941
sim_compute_robot_state-npc2_min	0.0607814093430837
sim_compute_robot_state-npc3_max	0.0695900149264578
sim_compute_robot_state-npc3_mean	0.06519790790480295
sim_compute_robot_state-npc3_median	0.0652887463569641
sim_compute_robot_state-npc3_min	0.05981533726056417
sim_compute_sim_state_max	0.0491624116897583
sim_compute_sim_state_mean	0.03985600892547707
sim_compute_sim_state_median	0.03775790586309918
sim_compute_sim_state_min	0.03551695744196574
sim_physics_max	0.17007670968265856
sim_physics_mean	0.15479717190732528
sim_physics_median	0.1673862596727767
sim_physics_min	0.1325227121512095
sim_render-ego_max	0.0635748028755188
sim_render-ego_mean	0.059722837251636365
sim_render-ego_median	0.058809212918551464
sim_render-ego_min	0.0555245578289032
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20517

2503

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:00:14+00:00

2019-04-25 14:03:45+00:00

0:03:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20508

2511

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 13:59:16+00:00

2019-04-25 13:59:47+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20494

2536

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:54:58+00:00

2019-04-25 13:59:02+00:00

0:04:04

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20488

2540

jiang peng

test for ppo

step1-simulation

error

2019-04-25 13:52:01+00:00

2019-04-25 13:54:45+00:00

0:02:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20473

2569

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:38:44+00:00

2019-04-25 13:51:21+00:00

0:12:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.06985245212431877
agent_compute-ego_mean	0.06606155820294043
agent_compute-ego_median	0.0661080001939273
agent_compute-ego_min	0.06130549773364
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.15488361770456488, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.05752167647535151, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.06901965628970753, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09041005914861504, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03797838904640891, "sim_compute_performance-ego": 0.06484072045846419, "sim_compute_robot_state-ego": 0.06600644100796092, "sim_compute_robot_state-npc0": 0.06832053173672069, "sim_compute_robot_state-npc1": 0.06902096217328851, "sim_compute_robot_state-npc2": 0.06792019172148271, "sim_compute_robot_state-npc3": 0.06666739962317726}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.18206663285532304, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06073248001836961, "in-drivable-lane": 0, "agent_compute-ego": 0.06985245212431877, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09962374164212134, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03958725160168063, "sim_compute_performance-ego": 0.06532813656714655, "sim_compute_robot_state-ego": 0.06847654619524556, "sim_compute_robot_state-npc0": 0.07399349827920237, "sim_compute_robot_state-npc1": 0.06860121603934996, "sim_compute_robot_state-npc2": 0.07388054170916157, "sim_compute_robot_state-npc3": 0.07428034659354918}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.1660807284903019, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.058730477136923066, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0661080001939273, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.08883213827796016, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.0368504524230957, "sim_compute_performance-ego": 0.06518496012856774, "sim_compute_robot_state-ego": 0.06887937437558005, "sim_compute_robot_state-npc0": 0.06540519295009316, "sim_compute_robot_state-npc1": 0.06417890812488312, "sim_compute_robot_state-npc2": 0.06277901906493707, "sim_compute_robot_state-npc3": 0.06478089643708358}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.16889375385485195, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.05798525057340923, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.06402218467310855, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.08848637530678197, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.03701082279807643, "sim_compute_performance-ego": 0.06617409304568642, "sim_compute_robot_state-ego": 0.06708127824883713, "sim_compute_robot_state-npc0": 0.06630960012737074, "sim_compute_robot_state-npc1": 0.0647829156172903, "sim_compute_robot_state-npc2": 0.06282997633281508, "sim_compute_robot_state-npc3": 0.06327394184313323}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.158968255553447, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.052807853255473394, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.06130549773364, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.08469315817658331, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.033325824939029317, "sim_compute_performance-ego": 0.058971982606699766, "sim_compute_robot_state-ego": 0.05998391500661071, "sim_compute_robot_state-npc0": 0.05965442556730458, "sim_compute_robot_state-npc1": 0.0599777211605663, "sim_compute_robot_state-npc2": 0.058206447413269906, "sim_compute_robot_state-npc3": 0.058056708792565574}}
set_robot_commands_max	0.09962374164212134
set_robot_commands_mean	0.09040909451041236
set_robot_commands_median	0.08883213827796016
set_robot_commands_min	0.08469315817658331
sim_compute_performance-ego_max	0.06617409304568642
sim_compute_performance-ego_mean	0.06409997856131293
sim_compute_performance-ego_median	0.06518496012856774
sim_compute_performance-ego_min	0.058971982606699766
sim_compute_robot_state-ego_max	0.06887937437558005
sim_compute_robot_state-ego_mean	0.06608551096684687
sim_compute_robot_state-ego_median	0.06708127824883713
sim_compute_robot_state-ego_min	0.05998391500661071
sim_compute_robot_state-npc0_max	0.07399349827920237
sim_compute_robot_state-npc0_mean	0.06673664973213832
sim_compute_robot_state-npc0_median	0.06630960012737074
sim_compute_robot_state-npc0_min	0.05965442556730458
sim_compute_robot_state-npc1_max	0.06902096217328851
sim_compute_robot_state-npc1_mean	0.06531234462307564
sim_compute_robot_state-npc1_median	0.0647829156172903
sim_compute_robot_state-npc1_min	0.0599777211605663
sim_compute_robot_state-npc2_max	0.07388054170916157
sim_compute_robot_state-npc2_mean	0.06512323524833327
sim_compute_robot_state-npc2_median	0.06282997633281508
sim_compute_robot_state-npc2_min	0.058206447413269906
sim_compute_robot_state-npc3_max	0.07428034659354918
sim_compute_robot_state-npc3_mean	0.06541185865790176
sim_compute_robot_state-npc3_median	0.06478089643708358
sim_compute_robot_state-npc3_min	0.058056708792565574
sim_compute_sim_state_max	0.03958725160168063
sim_compute_sim_state_mean	0.0369505481616582
sim_compute_sim_state_median	0.03701082279807643
sim_compute_sim_state_min	0.033325824939029317
sim_physics_max	0.18206663285532304
sim_physics_mean	0.16617859769169777
sim_physics_median	0.1660807284903019
sim_physics_min	0.15488361770456488
sim_render-ego_max	0.06073248001836961
sim_render-ego_mean	0.057555547491905355
sim_render-ego_median	0.05798525057340923
sim_render-ego_min	0.052807853255473394
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20470

2577

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:37:17+00:00

2019-04-25 13:37:48+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20468

2578

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:36:08+00:00

2019-04-25 13:36:40+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20466

2582

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:32:39+00:00

2019-04-25 13:35:53+00:00

0:03:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20448

2612

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:19:39+00:00

2019-04-25 13:32:19+00:00

0:12:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.07103275981816379
agent_compute-ego_mean	0.0650434087456119
agent_compute-ego_median	0.06635873537537054
agent_compute-ego_min	0.05357226572538677
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1614128134467385, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06169727444648743, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07103275981816379, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09118498184464197, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03754965554584156, "sim_compute_performance-ego": 0.06680286743424156, "sim_compute_robot_state-ego": 0.07305401292714206, "sim_compute_robot_state-npc0": 0.06403444571928545, "sim_compute_robot_state-npc1": 0.0659427588636225, "sim_compute_robot_state-npc2": 0.06697573445060036, "sim_compute_robot_state-npc3": 0.06625508991154758}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.15104493787211756, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.058651854915003625, "in-drivable-lane": 0, "agent_compute-ego": 0.06449074898996661, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09042016921504852, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03372353123080346, "sim_compute_performance-ego": 0.060463843807097406, "sim_compute_robot_state-ego": 0.06309854599737352, "sim_compute_robot_state-npc0": 0.06231720985904816, "sim_compute_robot_state-npc1": 0.05987057378215174, "sim_compute_robot_state-npc2": 0.0632039116274926, "sim_compute_robot_state-npc3": 0.06200739645188855}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.19014201603882705, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.0595362626068981, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06635873537537054, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.09381489381722524, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.03816811750966606, "sim_compute_performance-ego": 0.06898925828595534, "sim_compute_robot_state-ego": 0.07200637945892117, "sim_compute_robot_state-npc0": 0.06647444616818259, "sim_compute_robot_state-npc1": 0.06792442342068286, "sim_compute_robot_state-npc2": 0.06705505797203551, "sim_compute_robot_state-npc3": 0.06812755605007739}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.1325592417466013, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.04718783027247379, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.05357226572538677, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.07052206742136102, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.02968752258702328, "sim_compute_performance-ego": 0.04999924207988538, "sim_compute_robot_state-ego": 0.053487283305117955, "sim_compute_robot_state-npc0": 0.05231952918203254, "sim_compute_robot_state-npc1": 0.053849463713796515, "sim_compute_robot_state-npc2": 0.05326677874514931, "sim_compute_robot_state-npc3": 0.05355518491644608}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.1820112769032868, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06050204223310444, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.06976253381917175, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.09285041479997232, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.03716243992389088, "sim_compute_performance-ego": 0.06625573567941155, "sim_compute_robot_state-ego": 0.06910562347358382, "sim_compute_robot_state-npc0": 0.06592472674141467, "sim_compute_robot_state-npc1": 0.06648095560745454, "sim_compute_robot_state-npc2": 0.07085030515429, "sim_compute_robot_state-npc3": 0.06741191131967894}}
set_robot_commands_max	0.09381489381722524
set_robot_commands_mean	0.08775850541964982
set_robot_commands_median	0.09118498184464197
set_robot_commands_min	0.07052206742136102
sim_compute_performance-ego_max	0.06898925828595534
sim_compute_performance-ego_mean	0.06250218945731825
sim_compute_performance-ego_median	0.06625573567941155
sim_compute_performance-ego_min	0.04999924207988538
sim_compute_robot_state-ego_max	0.07305401292714206
sim_compute_robot_state-ego_mean	0.0661503690324277
sim_compute_robot_state-ego_median	0.06910562347358382
sim_compute_robot_state-ego_min	0.053487283305117955
sim_compute_robot_state-npc0_max	0.06647444616818259
sim_compute_robot_state-npc0_mean	0.06221407153399268
sim_compute_robot_state-npc0_median	0.06403444571928545
sim_compute_robot_state-npc0_min	0.05231952918203254
sim_compute_robot_state-npc1_max	0.06792442342068286
sim_compute_robot_state-npc1_mean	0.06281363507754163
sim_compute_robot_state-npc1_median	0.0659427588636225
sim_compute_robot_state-npc1_min	0.053849463713796515
sim_compute_robot_state-npc2_max	0.07085030515429
sim_compute_robot_state-npc2_mean	0.06427035758991355
sim_compute_robot_state-npc2_median	0.06697573445060036
sim_compute_robot_state-npc2_min	0.05326677874514931
sim_compute_robot_state-npc3_max	0.06812755605007739
sim_compute_robot_state-npc3_mean	0.06347142772992771
sim_compute_robot_state-npc3_median	0.06625508991154758
sim_compute_robot_state-npc3_min	0.05355518491644608
sim_compute_sim_state_max	0.03816811750966606
sim_compute_sim_state_mean	0.035258253359445046
sim_compute_sim_state_median	0.03716243992389088
sim_compute_sim_state_min	0.02968752258702328
sim_physics_max	0.19014201603882705
sim_physics_mean	0.16343405720151422
sim_physics_median	0.1614128134467385
sim_physics_min	0.1325592417466013
sim_render-ego_max	0.06169727444648743
sim_render-ego_mean	0.05751505289479347
sim_render-ego_median	0.0595362626068981
sim_render-ego_min	0.04718783027247379
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20436

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:00:26+00:00

2019-04-25 13:19:32+00:00

0:19:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5801776286491975
survival_time_median	4.699999999999991
deviation-center-line_median	0.26936761040239493
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.10425066947937012
agent_compute-ego_mean	0.07877306172864658
agent_compute-ego_median	0.07297825495402019
agent_compute-ego_min	0.069343972773779
deviation-center-line_max	1.355913677449695
deviation-center-line_mean	0.5100146192268586
deviation-center-line_min	0.25386983582980877
deviation-heading_max	5.054650638931494
deviation-heading_mean	2.6593116483367205
deviation-heading_median	2.2537593720877656
deviation-heading_min	1.0416601628945743
driven_any_max	2.348604877411217
driven_any_mean	1.103445143727089
driven_any_median	0.7015372390145492
driven_any_min	0.6211615163230134
driven_lanedir_consec_max	1.3906545927931624
driven_lanedir_consec_mean	0.6987098609920824
driven_lanedir_consec_min	0.42145634901816664
driven_lanedir_max	1.6070487472205957
driven_lanedir_mean	0.765129724025013
driven_lanedir_median	0.5801776286491975
driven_lanedir_min	0.46678183916440785
in-drivable-lane_max	2.8000000000000327
in-drivable-lane_mean	1.1500000000000044
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6624683501359925, "sim_physics": 0.23774931981013372, "survival_time": 4.549999999999992, "driven_lanedir": 0.6344788953354776, "sim_render-ego": 0.0781041580242115, "in-drivable-lane": 0, "agent_compute-ego": 0.10425066947937012, "deviation-heading": 1.0416601628945743, "set_robot_commands": 0.14326243348174042, "deviation-center-line": 0.26936761040239493, "driven_lanedir_consec": 0.6344788953354776, "sim_compute_sim_state": 0.0494250360426012, "sim_compute_performance-ego": 0.0915365743113088, "sim_compute_robot_state-ego": 0.10334096374092522, "sim_compute_robot_state-npc0": 0.09145923761221078, "sim_compute_robot_state-npc1": 0.08759878231928898, "sim_compute_robot_state-npc2": 0.08629641166100135, "sim_compute_robot_state-npc3": 0.08846108730022724}, "udem1-1-0": {"driven_any": 0.7015372390145492, "sim_physics": 0.1735348549294979, "survival_time": 4.699999999999991, "driven_lanedir": 0.5801776286491975, "sim_render-ego": 0.062085920191825704, "in-drivable-lane": 0, "agent_compute-ego": 0.07457624344115561, "deviation-heading": 2.2537593720877656, "set_robot_commands": 0.09703561600218429, "deviation-center-line": 0.2543433113586656, "driven_lanedir_consec": 0.5801776286491975, "sim_compute_sim_state": 0.039021367722369256, "sim_compute_performance-ego": 0.0658872330442388, "sim_compute_robot_state-ego": 0.07483504680877036, "sim_compute_robot_state-npc0": 0.06723661372002135, "sim_compute_robot_state-npc1": 0.06632758962347153, "sim_compute_robot_state-npc2": 0.06798178084353183, "sim_compute_robot_state-npc3": 0.0668721021489894}, "udem1-2-0": {"driven_any": 0.6211615163230134, "sim_physics": 0.14794334911164783, "survival_time": 4.199999999999993, "driven_lanedir": 0.46678183916440785, "sim_render-ego": 0.0532480137688773, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.069343972773779, "deviation-heading": 1.5404118207268411, "set_robot_commands": 0.07871835572378975, "deviation-center-line": 0.25386983582980877, "driven_lanedir_consec": 0.46678183916440785, "sim_compute_sim_state": 0.033267716566721596, "sim_compute_performance-ego": 0.05922813358761016, "sim_compute_robot_state-ego": 0.06260295992805845, "sim_compute_robot_state-npc0": 0.058890964303697856, "sim_compute_robot_state-npc1": 0.05676056089855376, "sim_compute_robot_state-npc2": 0.05902534723281861, "sim_compute_robot_state-npc3": 0.05743403945650373}, "udem1-3-0": {"driven_any": 1.183453735750672, "sim_physics": 0.18154857839856828, "survival_time": 7.699999999999981, "driven_lanedir": 0.5371615097553868, "sim_render-ego": 0.0582614363013924, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.07271616799490792, "deviation-heading": 3.4060762470429276, "set_robot_commands": 0.092274724663078, "deviation-center-line": 0.416578661093729, "driven_lanedir_consec": 0.42145634901816664, "sim_compute_sim_state": 0.03667543460796406, "sim_compute_performance-ego": 0.06380183975417893, "sim_compute_robot_state-ego": 0.06721591794645632, "sim_compute_robot_state-npc0": 0.06569496687356528, "sim_compute_robot_state-npc1": 0.06443776093520127, "sim_compute_robot_state-npc2": 0.06494198062203148, "sim_compute_robot_state-npc3": 0.06599500581815645}, "udem1-4-0": {"driven_any": 2.348604877411217, "sim_physics": 0.2078692881266276, "survival_time": 14.950000000000076, "driven_lanedir": 1.6070487472205957, "sim_render-ego": 0.06183717807133993, "in-drivable-lane": 2.8000000000000327, "agent_compute-ego": 0.07297825495402019, "deviation-heading": 5.054650638931494, "set_robot_commands": 0.0912077768643697, "deviation-center-line": 1.355913677449695, "driven_lanedir_consec": 1.3906545927931624, "sim_compute_sim_state": 0.03735380252202352, "sim_compute_performance-ego": 0.06734412511189779, "sim_compute_robot_state-ego": 0.07036105314890544, "sim_compute_robot_state-npc0": 0.06751850684483846, "sim_compute_robot_state-npc1": 0.06564093271891276, "sim_compute_robot_state-npc2": 0.06659367402394613, "sim_compute_robot_state-npc3": 0.06508284091949462}}
set_robot_commands_max	0.14326243348174042
set_robot_commands_mean	0.10049978134703244
set_robot_commands_median	0.092274724663078
set_robot_commands_min	0.07871835572378975
sim_compute_performance-ego_max	0.0915365743113088
sim_compute_performance-ego_mean	0.06955958116184689
sim_compute_performance-ego_median	0.0658872330442388
sim_compute_performance-ego_min	0.05922813358761016
sim_compute_robot_state-ego_max	0.10334096374092522
sim_compute_robot_state-ego_mean	0.07567118831462315
sim_compute_robot_state-ego_median	0.07036105314890544
sim_compute_robot_state-ego_min	0.06260295992805845
sim_compute_robot_state-npc0_max	0.09145923761221078
sim_compute_robot_state-npc0_mean	0.07016005787086674
sim_compute_robot_state-npc0_median	0.06723661372002135
sim_compute_robot_state-npc0_min	0.058890964303697856
sim_compute_robot_state-npc1_max	0.08759878231928898
sim_compute_robot_state-npc1_mean	0.06815312529908565
sim_compute_robot_state-npc1_median	0.06564093271891276
sim_compute_robot_state-npc1_min	0.05676056089855376
sim_compute_robot_state-npc2_max	0.08629641166100135
sim_compute_robot_state-npc2_mean	0.06896783887666588
sim_compute_robot_state-npc2_median	0.06659367402394613
sim_compute_robot_state-npc2_min	0.05902534723281861
sim_compute_robot_state-npc3_max	0.08846108730022724
sim_compute_robot_state-npc3_mean	0.0687690151286743
sim_compute_robot_state-npc3_median	0.06599500581815645
sim_compute_robot_state-npc3_min	0.05743403945650373
sim_compute_sim_state_max	0.0494250360426012
sim_compute_sim_state_mean	0.03914867149233593
sim_compute_sim_state_median	0.03735380252202352
sim_compute_sim_state_min	0.033267716566721596
sim_physics_max	0.23774931981013372
sim_physics_mean	0.1897290780752951
sim_physics_median	0.18154857839856828
sim_physics_min	0.14794334911164783
sim_render-ego_max	0.0781041580242115
sim_render-ego_mean	0.06270734127152937
sim_render-ego_median	0.06183717807133993
sim_render-ego_min	0.0532480137688773
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.220000000000008
survival_time_min	4.199999999999993

No reset possible

20413

2633

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-25 12:50:57+00:00

2019-04-25 13:00:04+00:00

0:09:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20407

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:34:18+00:00

2019-04-25 12:50:49+00:00

0:16:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4587094566633867
survival_time_median	6.349999999999985
deviation-center-line_median	0.3408872833205343
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.09028587088120722
agent_compute-ego_mean	0.08906622417601687
agent_compute-ego_median	0.08871284444281395
agent_compute-ego_min	0.08824935672790046
deviation-center-line_max	0.39935208923922294
deviation-center-line_mean	0.3243459608240416
deviation-center-line_min	0.19985626859444777
deviation-heading_max	4.446349796476346
deviation-heading_mean	2.3831537464685475
deviation-heading_median	2.4413788363422397
deviation-heading_min	0.44613898832102566
driven_any_max	2.332162583870461
driven_any_mean	1.1178579173230168
driven_any_median	0.9667679884547196
driven_any_min	0.3239274593926854
driven_lanedir_consec_max	0.9044641808529988
driven_lanedir_consec_mean	0.5491496887658731
driven_lanedir_consec_min	0.3148470293482286
driven_lanedir_max	0.9044641808529988
driven_lanedir_mean	0.5661728293206962
driven_lanedir_median	0.5438251594375023
driven_lanedir_min	0.3148470293482286
in-drivable-lane_max	8.950000000000056
in-drivable-lane_mean	2.5100000000000087
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8390730009290593, "sim_physics": 0.12364065541630298, "survival_time": 5.649999999999988, "driven_lanedir": 0.6107688206770328, "sim_render-ego": 0.07136464540937305, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09028587088120722, "deviation-heading": 2.4413788363422397, "set_robot_commands": 0.11370072955578828, "deviation-center-line": 0.3408872833205343, "driven_lanedir_consec": 0.6107688206770328, "sim_compute_sim_state": 0.04268224471438248, "sim_compute_performance-ego": 0.07966521777937897, "sim_compute_robot_state-ego": 0.0848373459503714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.332162583870461, "sim_physics": 0.16286329307941474, "survival_time": 14.850000000000076, "driven_lanedir": 0.5438251594375023, "sim_render-ego": 0.0717143177584767, "in-drivable-lane": 8.950000000000056, "agent_compute-ego": 0.0886637731031938, "deviation-heading": 4.446349796476346, "set_robot_commands": 0.11405438927287606, "deviation-center-line": 0.36166139778690215, "driven_lanedir_consec": 0.4587094566633867, "sim_compute_sim_state": 0.043923441408459184, "sim_compute_performance-ego": 0.08138076945988819, "sim_compute_robot_state-ego": 0.09188815720554956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3239274593926854, "sim_physics": 0.12882715083183127, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3148470293482286, "sim_render-ego": 0.07350120138614735, "in-drivable-lane": 0, "agent_compute-ego": 0.08871284444281395, "deviation-heading": 0.44613898832102566, "set_robot_commands": 0.11962821635794132, "deviation-center-line": 0.19985626859444777, "driven_lanedir_consec": 0.3148470293482286, "sim_compute_sim_state": 0.04426471223222449, "sim_compute_performance-ego": 0.08769662329491149, "sim_compute_robot_state-ego": 0.09698073914710512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9667679884547196, "sim_physics": 0.13435636730644646, "survival_time": 6.349999999999985, "driven_lanedir": 0.9044641808529988, "sim_render-ego": 0.0741482006283257, "in-drivable-lane": 0, "agent_compute-ego": 0.08824935672790046, "deviation-heading": 2.015918995340098, "set_robot_commands": 0.11297616996164396, "deviation-center-line": 0.39935208923922294, "driven_lanedir_consec": 0.9044641808529988, "sim_compute_sim_state": 0.044612681771826555, "sim_compute_performance-ego": 0.08089491701501561, "sim_compute_robot_state-ego": 0.08688166761022853}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.127358553968158, "sim_physics": 0.1385949014806423, "survival_time": 7.349999999999982, "driven_lanedir": 0.456958956287719, "sim_render-ego": 0.07017510440073857, "in-drivable-lane": 3.099999999999989, "agent_compute-ego": 0.08941927572496894, "deviation-heading": 2.565982115863027, "set_robot_commands": 0.11352499001691133, "deviation-center-line": 0.3199727651791009, "driven_lanedir_consec": 0.456958956287719, "sim_compute_sim_state": 0.043316928707823464, "sim_compute_performance-ego": 0.07904197893986085, "sim_compute_robot_state-ego": 0.08705312702931514}}
set_robot_commands_max	0.11962821635794132
set_robot_commands_mean	0.1147768990330322
set_robot_commands_median	0.11370072955578828
set_robot_commands_min	0.11297616996164396
sim_compute_performance-ego_max	0.08769662329491149
sim_compute_performance-ego_mean	0.08173590129781103
sim_compute_performance-ego_median	0.08089491701501561
sim_compute_performance-ego_min	0.07904197893986085
sim_compute_robot_state-ego_max	0.09698073914710512
sim_compute_robot_state-ego_mean	0.08952820738851394
sim_compute_robot_state-ego_median	0.08705312702931514
sim_compute_robot_state-ego_min	0.0848373459503714
sim_compute_sim_state_max	0.044612681771826555
sim_compute_sim_state_mean	0.04376000176694324
sim_compute_sim_state_median	0.043923441408459184
sim_compute_sim_state_min	0.04268224471438248
sim_physics_max	0.16286329307941474
sim_physics_mean	0.13765647362292754
sim_physics_median	0.13435636730644646
sim_physics_min	0.12364065541630298
sim_render-ego_max	0.0741482006283257
sim_render-ego_mean	0.07218069391661228
sim_render-ego_median	0.0717143177584767
sim_render-ego_min	0.07017510440073857
simulation-passed	1
survival_time_max	14.850000000000076
survival_time_mean	7.310000000000007
survival_time_min	2.3499999999999996

No reset possible

20393

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:02:44+00:00

2019-04-25 12:33:42+00:00

0:30:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7410358729566031
survival_time_median	12.200000000000038
deviation-center-line_median	0.6056038630824019
in-drivable-lane_median	2.9999999999999893

other stats

agent_compute-ego_max	0.09482275459864369
agent_compute-ego_mean	0.09068826844485592
agent_compute-ego_median	0.09047730004086214
agent_compute-ego_min	0.08682222127914428
deviation-center-line_max	1.3880114032695448
deviation-center-line_mean	0.6968188671653625
deviation-center-line_min	0.2587507428435846
deviation-heading_max	6.864386611015579
deviation-heading_mean	4.491067630643374
deviation-heading_median	5.117464412776776
deviation-heading_min	2.0286661519943876
driven_any_max	2.3483159991790097
driven_any_mean	1.7491921610604957
driven_any_median	1.9063621158472064
driven_any_min	1.0389688326706847
driven_lanedir_consec_max	1.0270509243291088
driven_lanedir_consec_mean	0.7638496238208232
driven_lanedir_consec_min	0.4535572669862935
driven_lanedir_max	1.503122851333198
driven_lanedir_mean	1.0076820206345802
driven_lanedir_median	0.9913643500755764
driven_lanedir_min	0.4535572669862935
in-drivable-lane_max	5.550000000000036
in-drivable-lane_mean	2.830000000000013
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1043257543280258, "sim_physics": 0.20997489478490125, "survival_time": 7.299999999999982, "driven_lanedir": 0.9913643500755764, "sim_render-ego": 0.07233911344449814, "in-drivable-lane": 0, "agent_compute-ego": 0.09482275459864369, "deviation-heading": 2.4432648040974025, "set_robot_commands": 0.11578956695452128, "deviation-center-line": 0.6056038630824019, "driven_lanedir_consec": 0.9913643500755764, "sim_compute_sim_state": 0.046309363352109306, "sim_compute_performance-ego": 0.07870306054206744, "sim_compute_robot_state-ego": 0.08631131093795985, "sim_compute_robot_state-npc0": 0.07785222138444038, "sim_compute_robot_state-npc1": 0.07857984386078298, "sim_compute_robot_state-npc2": 0.07963199484838199, "sim_compute_robot_state-npc3": 0.08061903796783865}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0389688326706847, "sim_physics": 0.22706272146281073, "survival_time": 6.799999999999984, "driven_lanedir": 0.4535572669862935, "sim_render-ego": 0.07219003579195808, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.09047730004086214, "deviation-heading": 2.0286661519943876, "set_robot_commands": 0.11802427207722384, "deviation-center-line": 0.2587507428435846, "driven_lanedir_consec": 0.4535572669862935, "sim_compute_sim_state": 0.045209271066329056, "sim_compute_performance-ego": 0.07903260343215045, "sim_compute_robot_state-ego": 0.0932152551763198, "sim_compute_robot_state-npc0": 0.08015200671027689, "sim_compute_robot_state-npc1": 0.0801593748962178, "sim_compute_robot_state-npc2": 0.08055790732888614, "sim_compute_robot_state-npc3": 0.08295961162623237}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34798810327755, "sim_physics": 0.21810126781463623, "survival_time": 14.950000000000076, "driven_lanedir": 1.1032846068805884, "sim_render-ego": 0.07090428829193116, "in-drivable-lane": 5.550000000000036, "agent_compute-ego": 0.08682222127914428, "deviation-heading": 5.117464412776776, "set_robot_commands": 0.11234514395395914, "deviation-center-line": 0.6325392801800446, "driven_lanedir_consec": 1.0270509243291088, "sim_compute_sim_state": 0.04437473853429159, "sim_compute_performance-ego": 0.07977993249893188, "sim_compute_robot_state-ego": 0.08557620684305826, "sim_compute_robot_state-npc0": 0.0787421202659607, "sim_compute_robot_state-npc1": 0.08046971956888835, "sim_compute_robot_state-npc2": 0.07930029074350993, "sim_compute_robot_state-npc3": 0.07993050416310628}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3483159991790097, "sim_physics": 0.2197733537356059, "survival_time": 14.950000000000076, "driven_lanedir": 1.503122851333198, "sim_render-ego": 0.0697348165512085, "in-drivable-lane": 2.3500000000000174, "agent_compute-ego": 0.09019285202026368, "deviation-heading": 6.864386611015579, "set_robot_commands": 0.11502321322758992, "deviation-center-line": 1.3880114032695448, "driven_lanedir_consec": 0.7410358729566031, "sim_compute_sim_state": 0.0434428326288859, "sim_compute_performance-ego": 0.07962900320688883, "sim_compute_robot_state-ego": 0.08411659081776937, "sim_compute_robot_state-npc0": 0.07770491520563762, "sim_compute_robot_state-npc1": 0.07847851514816284, "sim_compute_robot_state-npc2": 0.07767907460530599, "sim_compute_robot_state-npc3": 0.07799942970275879}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9063621158472064, "sim_physics": 0.24165187702804317, "survival_time": 12.200000000000038, "driven_lanedir": 0.987081027897244, "sim_render-ego": 0.0710828001381921, "in-drivable-lane": 3.2500000000000213, "agent_compute-ego": 0.09112621428536588, "deviation-heading": 6.001556173332725, "set_robot_commands": 0.11623599197043748, "deviation-center-line": 0.5991890464512365, "driven_lanedir_consec": 0.6062397047565342, "sim_compute_sim_state": 0.04394480146345545, "sim_compute_performance-ego": 0.0783893964329704, "sim_compute_robot_state-ego": 0.08903097226971486, "sim_compute_robot_state-npc0": 0.07932909785724077, "sim_compute_robot_state-npc1": 0.07906122969799355, "sim_compute_robot_state-npc2": 0.07792016717254138, "sim_compute_robot_state-npc3": 0.08000779933616763}}
set_robot_commands_max	0.11802427207722384
set_robot_commands_mean	0.11548363763674632
set_robot_commands_median	0.11578956695452128
set_robot_commands_min	0.11234514395395914
sim_compute_performance-ego_max	0.07977993249893188
sim_compute_performance-ego_mean	0.0791067992226018
sim_compute_performance-ego_median	0.07903260343215045
sim_compute_performance-ego_min	0.0783893964329704
sim_compute_robot_state-ego_max	0.0932152551763198
sim_compute_robot_state-ego_mean	0.08765006720896443
sim_compute_robot_state-ego_median	0.08631131093795985
sim_compute_robot_state-ego_min	0.08411659081776937
sim_compute_robot_state-npc0_max	0.08015200671027689
sim_compute_robot_state-npc0_mean	0.07875607228471126
sim_compute_robot_state-npc0_median	0.0787421202659607
sim_compute_robot_state-npc0_min	0.07770491520563762
sim_compute_robot_state-npc1_max	0.08046971956888835
sim_compute_robot_state-npc1_mean	0.07934973663440911
sim_compute_robot_state-npc1_median	0.07906122969799355
sim_compute_robot_state-npc1_min	0.07847851514816284
sim_compute_robot_state-npc2_max	0.08055790732888614
sim_compute_robot_state-npc2_mean	0.07901788693972508
sim_compute_robot_state-npc2_median	0.07930029074350993
sim_compute_robot_state-npc2_min	0.07767907460530599
sim_compute_robot_state-npc3_max	0.08295961162623237
sim_compute_robot_state-npc3_mean	0.08030327655922075
sim_compute_robot_state-npc3_median	0.08000779933616763
sim_compute_robot_state-npc3_min	0.07799942970275879
sim_compute_sim_state_max	0.046309363352109306
sim_compute_sim_state_mean	0.04465620140901426
sim_compute_sim_state_median	0.04437473853429159
sim_compute_sim_state_min	0.0434428326288859
sim_physics_max	0.24165187702804317
sim_physics_mean	0.22331282296519944
sim_physics_median	0.2197733537356059
sim_physics_min	0.20997489478490125
sim_render-ego_max	0.07233911344449814
sim_render-ego_mean	0.07125021084355761
sim_render-ego_median	0.0710828001381921
sim_render-ego_min	0.0697348165512085
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.240000000000032
survival_time_min	6.799999999999984

No reset possible

20381

2681

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 12:00:16+00:00

2019-04-25 12:01:56+00:00

0:01:40

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20375

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:57+00:00

2019-04-25 12:00:08+00:00

0:04:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20366

2719

jiang peng

test for ppo

step1-simulation

error

2019-04-25 11:54:47+00:00

2019-04-25 11:55:50+00:00

0:01:03

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20358

2727

jiang peng

test for ppo

step1-simulation

error

2019-04-25 11:53:06+00:00

2019-04-25 11:54:40+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20354

2738

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:51:24+00:00

2019-04-25 11:52:59+00:00

0:01:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20349

2746

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:49:16+00:00

2019-04-25 11:51:03+00:00

0:01:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20344

2754

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:41:28+00:00

2019-04-25 11:48:42+00:00

0:07:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.0729943730614402
agent_compute-ego_mean	0.07063664771807782
agent_compute-ego_median	0.07056268579081486
agent_compute-ego_min	0.06781417739634611
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.09825458965803448, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06356999748631527, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07056268579081486, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09431205297771252, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.039281170619161504, "sim_compute_performance-ego": 0.07117449609856856, "sim_compute_robot_state-ego": 0.07481140212008827}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.10480068731999052, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06273996311685313, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.06986585561779962, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09410195419753808, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.04015776385431704, "sim_compute_performance-ego": 0.07061885059743687, "sim_compute_robot_state-ego": 0.07598134054653886}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.11945321343161842, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06565457040613348, "in-drivable-lane": 0, "agent_compute-ego": 0.0729943730614402, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.10858733003789728, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.04310119152069092, "sim_compute_performance-ego": 0.07195647196336226, "sim_compute_robot_state-ego": 0.08162676204334605}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.10607445109021532, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06298034269731123, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07194614672398829, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09920267220381852, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03906635661701579, "sim_compute_performance-ego": 0.07133703965407151, "sim_compute_robot_state-ego": 0.07472830814319653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.0966978389389661, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.06083676766376106, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06781417739634611, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.09452539074177645, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03674073608554139, "sim_compute_performance-ego": 0.06924068197912099, "sim_compute_robot_state-ego": 0.07097276619502477}}
set_robot_commands_max	0.10858733003789728
set_robot_commands_mean	0.09814588003174857
set_robot_commands_median	0.09452539074177645
set_robot_commands_min	0.09410195419753808
sim_compute_performance-ego_max	0.07195647196336226
sim_compute_performance-ego_mean	0.07086550805851204
sim_compute_performance-ego_median	0.07117449609856856
sim_compute_performance-ego_min	0.06924068197912099
sim_compute_robot_state-ego_max	0.08162676204334605
sim_compute_robot_state-ego_mean	0.0756241158096389
sim_compute_robot_state-ego_median	0.07481140212008827
sim_compute_robot_state-ego_min	0.07097276619502477
sim_compute_sim_state_max	0.04310119152069092
sim_compute_sim_state_mean	0.039669443739345334
sim_compute_sim_state_median	0.039281170619161504
sim_compute_sim_state_min	0.03674073608554139
sim_physics_max	0.11945321343161842
sim_physics_mean	0.10505615608776496
sim_physics_median	0.10480068731999052
sim_physics_min	0.0966978389389661
sim_render-ego_max	0.06565457040613348
sim_render-ego_mean	0.06315632827407483
sim_render-ego_median	0.06298034269731123
sim_render-ego_min	0.06083676766376106
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20317

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:32:57+00:00

2019-04-25 11:41:14+00:00

0:08:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15677049604512877
agent_compute-ego_mean	0.14189820258668995
agent_compute-ego_median	0.14625507290080442
agent_compute-ego_min	0.11561219890912372
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.15715734463817668, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05529630409096772, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.13901285630352092, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0891975794198378, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.032861639868538337, "sim_compute_performance-ego": 0.059322789030255015, "sim_compute_robot_state-ego": 0.06265832793037847, "sim_compute_robot_state-npc0": 0.05983354685441503, "sim_compute_robot_state-npc1": 0.06569905775897908, "sim_compute_robot_state-npc2": 0.05609425733674248, "sim_compute_robot_state-npc3": 0.05817384090063707}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.10020214319229126, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.044131308794021606, "in-drivable-lane": 0, "agent_compute-ego": 0.11561219890912372, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07538301746050517, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.029965182145436604, "sim_compute_performance-ego": 0.048062642415364586, "sim_compute_robot_state-ego": 0.04949691891670227, "sim_compute_robot_state-npc0": 0.05571940541267395, "sim_compute_robot_state-npc1": 0.05636218190193176, "sim_compute_robot_state-npc2": 0.05803137024243673, "sim_compute_robot_state-npc3": 0.05497406919797262}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16105112382921122, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.060273679636292536, "in-drivable-lane": 0, "agent_compute-ego": 0.14625507290080442, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09476944955728822, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03655576705932617, "sim_compute_performance-ego": 0.06582230228488728, "sim_compute_robot_state-ego": 0.07697221788309389, "sim_compute_robot_state-npc0": 0.06547800969269316, "sim_compute_robot_state-npc1": 0.062146837428464725, "sim_compute_robot_state-npc2": 0.06474835589780646, "sim_compute_robot_state-npc3": 0.06255834789599403}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.18339176097158655, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.061727608664561125, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15677049604512877, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.1000603498038599, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.0390612594151901, "sim_compute_performance-ego": 0.06683581562365516, "sim_compute_robot_state-ego": 0.07346398547544318, "sim_compute_robot_state-npc0": 0.07073149438631737, "sim_compute_robot_state-npc1": 0.06875995862281929, "sim_compute_robot_state-npc2": 0.07111161038026971, "sim_compute_robot_state-npc3": 0.06945049964775474}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1550727128982544, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06955864429473876, "in-drivable-lane": 0, "agent_compute-ego": 0.15184038877487183, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08835825920104981, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04837143421173096, "sim_compute_performance-ego": 0.07281306982040406, "sim_compute_robot_state-ego": 0.08043560981750489, "sim_compute_robot_state-npc0": 0.06878918409347534, "sim_compute_robot_state-npc1": 0.07090170383453369, "sim_compute_robot_state-npc2": 0.06610616445541381, "sim_compute_robot_state-npc3": 0.07004119157791137}}
set_robot_commands_max	0.1000603498038599
set_robot_commands_mean	0.0895537310885082
set_robot_commands_median	0.0891975794198378
set_robot_commands_min	0.07538301746050517
sim_compute_performance-ego_max	0.07281306982040406
sim_compute_performance-ego_mean	0.06257132383491322
sim_compute_performance-ego_median	0.06582230228488728
sim_compute_performance-ego_min	0.048062642415364586
sim_compute_robot_state-ego_max	0.08043560981750489
sim_compute_robot_state-ego_mean	0.06860541200462453
sim_compute_robot_state-ego_median	0.07346398547544318
sim_compute_robot_state-ego_min	0.04949691891670227
sim_compute_robot_state-npc0_max	0.07073149438631737
sim_compute_robot_state-npc0_mean	0.06411032808791498
sim_compute_robot_state-npc0_median	0.06547800969269316
sim_compute_robot_state-npc0_min	0.05571940541267395
sim_compute_robot_state-npc1_max	0.07090170383453369
sim_compute_robot_state-npc1_mean	0.06477394790934571
sim_compute_robot_state-npc1_median	0.06569905775897908
sim_compute_robot_state-npc1_min	0.05636218190193176
sim_compute_robot_state-npc2_max	0.07111161038026971
sim_compute_robot_state-npc2_mean	0.06321835166253384
sim_compute_robot_state-npc2_median	0.06474835589780646
sim_compute_robot_state-npc2_min	0.05609425733674248
sim_compute_robot_state-npc3_max	0.07004119157791137
sim_compute_robot_state-npc3_mean	0.06303958984405397
sim_compute_robot_state-npc3_median	0.06255834789599403
sim_compute_robot_state-npc3_min	0.05497406919797262
sim_compute_sim_state_max	0.04837143421173096
sim_compute_sim_state_mean	0.03736305654004443
sim_compute_sim_state_median	0.03655576705932617
sim_compute_sim_state_min	0.029965182145436604
sim_physics_max	0.18339176097158655
sim_physics_mean	0.151375017105904
sim_physics_median	0.15715734463817668
sim_physics_min	0.10020214319229126
sim_render-ego_max	0.06955864429473876
sim_render-ego_mean	0.05819750909611635
sim_render-ego_median	0.060273679636292536
sim_render-ego_min	0.044131308794021606
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20306

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:24:27+00:00

2019-04-25 11:32:41+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.15931634633046277
agent_compute-ego_mean	0.14636109831699476
agent_compute-ego_median	0.1476164196110979
agent_compute-ego_min	0.12489930265828182
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.14265525116110747, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06174266563271576, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15931634633046277, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10112181699500894, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03924468328367989, "sim_compute_performance-ego": 0.06777319368326438, "sim_compute_robot_state-ego": 0.07550719549071114, "sim_compute_robot_state-npc0": 0.06966268341496305, "sim_compute_robot_state-npc1": 0.06922862214862176, "sim_compute_robot_state-npc2": 0.0665983074116257, "sim_compute_robot_state-npc3": 0.06689897573219156}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.14430915392362154, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05988472241621751, "in-drivable-lane": 0, "agent_compute-ego": 0.14082065912393424, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09019047480363113, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03814731194422795, "sim_compute_performance-ego": 0.06376249973590557, "sim_compute_robot_state-ego": 0.06818543947660007, "sim_compute_robot_state-npc0": 0.06968217629652756, "sim_compute_robot_state-npc1": 0.07368279420412503, "sim_compute_robot_state-npc2": 0.06719095890338604, "sim_compute_robot_state-npc3": 0.06675256215609036}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.12447345884222734, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.051173235240735505, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.12489930265828182, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.07997808958354749, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03393776165811639, "sim_compute_performance-ego": 0.05549566996724982, "sim_compute_robot_state-ego": 0.05757167778517071, "sim_compute_robot_state-npc0": 0.059752928583245525, "sim_compute_robot_state-npc1": 0.05789482593536377, "sim_compute_robot_state-npc2": 0.05692828956403231, "sim_compute_robot_state-npc3": 0.05878774429622449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1500472358510464, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05957907966420621, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1476164196110979, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09136294111420835, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03763535354710833, "sim_compute_performance-ego": 0.06850580022304872, "sim_compute_robot_state-ego": 0.0715191575545299, "sim_compute_robot_state-npc0": 0.06602495833288265, "sim_compute_robot_state-npc1": 0.07153858715974831, "sim_compute_robot_state-npc2": 0.07315275940714003, "sim_compute_robot_state-npc3": 0.0680193659625476}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.15629318025377062, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06414432878847476, "in-drivable-lane": 0, "agent_compute-ego": 0.159152763861197, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.10668863190544976, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.038934283786349826, "sim_compute_performance-ego": 0.07102637820773655, "sim_compute_robot_state-ego": 0.07958604671336987, "sim_compute_robot_state-npc0": 0.07464416821797688, "sim_compute_robot_state-npc1": 0.07074029357345016, "sim_compute_robot_state-npc2": 0.0699498211895978, "sim_compute_robot_state-npc3": 0.0697843763563368}}
set_robot_commands_max	0.10668863190544976
set_robot_commands_mean	0.09386839088036912
set_robot_commands_median	0.09136294111420835
set_robot_commands_min	0.07997808958354749
sim_compute_performance-ego_max	0.07102637820773655
sim_compute_performance-ego_mean	0.06531270836344102
sim_compute_performance-ego_median	0.06777319368326438
sim_compute_performance-ego_min	0.05549566996724982
sim_compute_robot_state-ego_max	0.07958604671336987
sim_compute_robot_state-ego_mean	0.07047390340407633
sim_compute_robot_state-ego_median	0.0715191575545299
sim_compute_robot_state-ego_min	0.05757167778517071
sim_compute_robot_state-npc0_max	0.07464416821797688
sim_compute_robot_state-npc0_mean	0.06795338296911914
sim_compute_robot_state-npc0_median	0.06966268341496305
sim_compute_robot_state-npc0_min	0.059752928583245525
sim_compute_robot_state-npc1_max	0.07368279420412503
sim_compute_robot_state-npc1_mean	0.0686170246042618
sim_compute_robot_state-npc1_median	0.07074029357345016
sim_compute_robot_state-npc1_min	0.05789482593536377
sim_compute_robot_state-npc2_max	0.07315275940714003
sim_compute_robot_state-npc2_mean	0.06676402729515638
sim_compute_robot_state-npc2_median	0.06719095890338604
sim_compute_robot_state-npc2_min	0.05692828956403231
sim_compute_robot_state-npc3_max	0.0697843763563368
sim_compute_robot_state-npc3_mean	0.06604860490067817
sim_compute_robot_state-npc3_median	0.06689897573219156
sim_compute_robot_state-npc3_min	0.05878774429622449
sim_compute_sim_state_max	0.03924468328367989
sim_compute_sim_state_mean	0.03757987884389648
sim_compute_sim_state_median	0.03814731194422795
sim_compute_sim_state_min	0.03393776165811639
sim_physics_max	0.15629318025377062
sim_physics_mean	0.14355565600635467
sim_physics_median	0.14430915392362154
sim_physics_min	0.12447345884222734
sim_render-ego_max	0.06414432878847476
sim_render-ego_mean	0.05930480634846995
sim_render-ego_median	0.05988472241621751
sim_render-ego_min	0.051173235240735505
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20299

2835

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:32+00:00

2019-04-25 11:24:11+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20284

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 11:10:31+00:00

2019-04-25 11:23:24+00:00

0:12:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3805179887067449
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.17243033388386603
agent_compute-ego_mean	0.1687139706699985
agent_compute-ego_median	0.1684068374230828
agent_compute-ego_min	0.16338521214674143
deviation-center-line_max	0.8219069617270801
deviation-center-line_mean	0.4622890220224802
deviation-center-line_min	0.240946508088056
deviation-heading_max	1.819384597985526
deviation-heading_mean	0.9470500519861752
deviation-heading_median	0.8064348941516836
deviation-heading_min	0.5022393903257442
driven_any_max	1.5790906665051212
driven_any_mean	0.90897363561738
driven_any_median	0.9970530395825568
driven_any_min	0.2870933095253068
driven_lanedir_consec_max	1.1522212258289768
driven_lanedir_consec_mean	0.7286312661816596
driven_lanedir_consec_min	0.2804952221609298
driven_lanedir_max	1.1522212258289768
driven_lanedir_mean	0.7286312661816596
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.2804952221609298
in-drivable-lane_max	2.80000000000004
in-drivable-lane_mean	1.0400000000000065
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.11204352038247244, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06587284633091518, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1672304323741368, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.10490657091140748, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.04104852846690587, "sim_compute_performance-ego": 0.07503373963492257, "sim_compute_robot_state-ego": 0.08072641747338431}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.12809753250068345, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.06801993242451843, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.1684068374230828, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.10782137890936624, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.04331202406278798, "sim_compute_performance-ego": 0.07754944076000804, "sim_compute_robot_state-ego": 0.08547520973313023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.11464060389477274, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.06769274110379427, "in-drivable-lane": 0, "agent_compute-ego": 0.17243033388386603, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.10517137465269669, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.0435880474422289, "sim_compute_performance-ego": 0.07558473815088687, "sim_compute_robot_state-ego": 0.08308624702951183}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.1093242745650442, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06499189075670744, "in-drivable-lane": 0, "agent_compute-ego": 0.1721170375221654, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.10862487742775365, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.04273630945306075, "sim_compute_performance-ego": 0.0737854606226871, "sim_compute_robot_state-ego": 0.08021437745345267}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.14100554681593372, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.06685615245098342, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.16338521214674143, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.10453470621240853, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.04181198260751188, "sim_compute_performance-ego": 0.07613751635573426, "sim_compute_robot_state-ego": 0.08591391304121589}}
set_robot_commands_max	0.10862487742775365
set_robot_commands_mean	0.10621178162272651
set_robot_commands_median	0.10517137465269669
set_robot_commands_min	0.10453470621240853
sim_compute_performance-ego_max	0.07754944076000804
sim_compute_performance-ego_mean	0.07561817910484778
sim_compute_performance-ego_median	0.07558473815088687
sim_compute_performance-ego_min	0.0737854606226871
sim_compute_robot_state-ego_max	0.08591391304121589
sim_compute_robot_state-ego_mean	0.08308323294613898
sim_compute_robot_state-ego_median	0.08308624702951183
sim_compute_robot_state-ego_min	0.08021437745345267
sim_compute_sim_state_max	0.0435880474422289
sim_compute_sim_state_mean	0.042499378406499075
sim_compute_sim_state_median	0.04273630945306075
sim_compute_sim_state_min	0.04104852846690587
sim_physics_max	0.14100554681593372
sim_physics_mean	0.12102229563178132
sim_physics_median	0.11464060389477274
sim_physics_min	0.1093242745650442
sim_render-ego_max	0.06801993242451843
sim_render-ego_mean	0.06668671261338374
sim_render-ego_median	0.06685615245098342
sim_render-ego_min	0.06499189075670744
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.399999999999995
survival_time_min	2.3

No reset possible

20278

2948

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 11:00:27+00:00

2019-04-25 11:09:55+00:00

0:09:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.062022045298948725
survival_time_median	1.2500000000000004
deviation-center-line_median	0.06367263209683718
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.26552375880154694
agent_compute-ego_mean	0.19188546731521053
agent_compute-ego_median	0.17399880409240723
agent_compute-ego_min	0.17003538157488848
deviation-center-line_max	0.09235503759619666
deviation-center-line_mean	0.06677903886860923
deviation-center-line_min	0.03636486940047102
deviation-heading_max	0.7997265771535362
deviation-heading_mean	0.669299074807683
deviation-heading_median	0.6876974904005794
deviation-heading_min	0.5425159606207464
driven_any_max	0.2333169249222232
driven_any_mean	0.15682149971094142
driven_any_median	0.13817713243418897
driven_any_min	0.09786744043340422
driven_lanedir_consec_max	0.09434724319464571
driven_lanedir_consec_mean	0.0677402015112041
driven_lanedir_consec_min	0.05370683158025358
driven_lanedir_max	0.09434724319464571
driven_lanedir_mean	0.0677402015112041
driven_lanedir_median	0.062022045298948725
driven_lanedir_min	0.05370683158025358
in-drivable-lane_max	0.6500000000000006
in-drivable-lane_mean	0.30000000000000027
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2333169249222232, "sim_physics": 0.171918688593684, "survival_time": 1.850000000000001, "driven_lanedir": 0.09434724319464571, "sim_render-ego": 0.06183778273092734, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.17003538157488848, "deviation-heading": 0.6876974904005794, "set_robot_commands": 0.09544511743493982, "deviation-center-line": 0.06367263209683718, "driven_lanedir_consec": 0.09434724319464571, "sim_compute_sim_state": 0.03853230218629579, "sim_compute_performance-ego": 0.07011429039207664, "sim_compute_robot_state-ego": 0.07719074068842707, "sim_compute_robot_state-npc0": 0.07047954121151485, "sim_compute_robot_state-npc1": 0.06891423302727777, "sim_compute_robot_state-npc2": 0.07052418347951528, "sim_compute_robot_state-npc3": 0.06798199705175452}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20325863373162156, "sim_physics": 0.15626079194685993, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05370683158025358, "sim_render-ego": 0.05867436352898093, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17122549169203816, "deviation-heading": 0.7997265771535362, "set_robot_commands": 0.1034177120994119, "deviation-center-line": 0.053364118877278766, "driven_lanedir_consec": 0.05370683158025358, "sim_compute_sim_state": 0.0397406395743875, "sim_compute_performance-ego": 0.06744058693156522, "sim_compute_robot_state-ego": 0.0752182076959049, "sim_compute_robot_state-npc0": 0.0692053893033196, "sim_compute_robot_state-npc1": 0.06582143727470846, "sim_compute_robot_state-npc2": 0.07219572628245634, "sim_compute_robot_state-npc3": 0.07150168278638054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09786744043340422, "sim_physics": 0.15463064027869183, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05496427285117811, "sim_render-ego": 0.06329139419223952, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17864390041517175, "deviation-heading": 0.5962568805053253, "set_robot_commands": 0.09685848070227582, "deviation-center-line": 0.09235503759619666, "driven_lanedir_consec": 0.05496427285117811, "sim_compute_sim_state": 0.040069497149923576, "sim_compute_performance-ego": 0.06497030672819717, "sim_compute_robot_state-ego": 0.06978291013966435, "sim_compute_robot_state-npc0": 0.06870944603629735, "sim_compute_robot_state-npc1": 0.07754169339719026, "sim_compute_robot_state-npc2": 0.06788867452870244, "sim_compute_robot_state-npc3": 0.07178190480107846}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11148736703326911, "sim_physics": 0.1778471903367476, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07366061463099438, "sim_render-ego": 0.06499561396512119, "in-drivable-lane": 0, "agent_compute-ego": 0.26552375880154694, "deviation-heading": 0.5425159606207464, "set_robot_commands": 0.11745527657595548, "deviation-center-line": 0.08813853637226249, "driven_lanedir_consec": 0.07366061463099438, "sim_compute_sim_state": 0.040841102600097656, "sim_compute_performance-ego": 0.0704135461287065, "sim_compute_robot_state-ego": 0.08560953357002953, "sim_compute_robot_state-npc0": 0.07576862248507413, "sim_compute_robot_state-npc1": 0.07950913906097412, "sim_compute_robot_state-npc2": 0.077734036879106, "sim_compute_robot_state-npc3": 0.0709182999350808}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13817713243418897, "sim_physics": 0.1341552257537842, "survival_time": 1.2500000000000004, "driven_lanedir": 0.062022045298948725, "sim_render-ego": 0.06138493537902832, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17399880409240723, "deviation-heading": 0.7202984653582282, "set_robot_commands": 0.09775976181030271, "deviation-center-line": 0.03636486940047102, "driven_lanedir_consec": 0.062022045298948725, "sim_compute_sim_state": 0.0394734001159668, "sim_compute_performance-ego": 0.06831073760986328, "sim_compute_robot_state-ego": 0.07931803703308106, "sim_compute_robot_state-npc0": 0.0686339282989502, "sim_compute_robot_state-npc1": 0.07543515205383301, "sim_compute_robot_state-npc2": 0.0686737823486328, "sim_compute_robot_state-npc3": 0.06864395141601562}}
set_robot_commands_max	0.11745527657595548
set_robot_commands_mean	0.10218726972457716
set_robot_commands_median	0.09775976181030271
set_robot_commands_min	0.09544511743493982
sim_compute_performance-ego_max	0.0704135461287065
sim_compute_performance-ego_mean	0.06824989355808177
sim_compute_performance-ego_median	0.06831073760986328
sim_compute_performance-ego_min	0.06497030672819717
sim_compute_robot_state-ego_max	0.08560953357002953
sim_compute_robot_state-ego_mean	0.07742388582542138
sim_compute_robot_state-ego_median	0.07719074068842707
sim_compute_robot_state-ego_min	0.06978291013966435
sim_compute_robot_state-npc0_max	0.07576862248507413
sim_compute_robot_state-npc0_mean	0.07055938546703122
sim_compute_robot_state-npc0_median	0.0692053893033196
sim_compute_robot_state-npc0_min	0.0686339282989502
sim_compute_robot_state-npc1_max	0.07950913906097412
sim_compute_robot_state-npc1_mean	0.07344433096279672
sim_compute_robot_state-npc1_median	0.07543515205383301
sim_compute_robot_state-npc1_min	0.06582143727470846
sim_compute_robot_state-npc2_max	0.077734036879106
sim_compute_robot_state-npc2_mean	0.07140328070368258
sim_compute_robot_state-npc2_median	0.07052418347951528
sim_compute_robot_state-npc2_min	0.06788867452870244
sim_compute_robot_state-npc3_max	0.07178190480107846
sim_compute_robot_state-npc3_mean	0.070165567198062
sim_compute_robot_state-npc3_median	0.0709182999350808
sim_compute_robot_state-npc3_min	0.06798199705175452
sim_compute_sim_state_max	0.040841102600097656
sim_compute_sim_state_mean	0.03973138832533426
sim_compute_sim_state_median	0.0397406395743875
sim_compute_sim_state_min	0.03853230218629579
sim_physics_max	0.1778471903367476
sim_physics_mean	0.15896250738195353
sim_physics_median	0.15626079194685993
sim_physics_min	0.1341552257537842
sim_render-ego_max	0.06499561396512119
sim_render-ego_mean	0.06203681795925946
sim_render-ego_median	0.06183778273092734
sim_render-ego_min	0.05867436352898093
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.4100000000000006
survival_time_min	1.1000000000000003

No reset possible

20254

2910

FANG MEIYI 🇸🇬

test

step1-simulation

host-error

2019-04-25 10:43:06+00:00

2019-04-25 11:00:03+00:00

0:16:57

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20231

2960

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:22:42+00:00

2019-04-25 10:42:53+00:00

0:20:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.34593961179203836
survival_time_median	6.349999999999985
deviation-center-line_median	0.24087102948169464
in-drivable-lane_median	2.499999999999991

other stats

agent_compute-ego_max	0.20873291015625
agent_compute-ego_mean	0.19037944692862507
agent_compute-ego_median	0.19698805570602415
agent_compute-ego_min	0.15135787771298334
deviation-center-line_max	0.4184568661818192
deviation-center-line_mean	0.2860696021898548
deviation-center-line_min	0.19383355720964093
deviation-heading_max	2.9309867454486027
deviation-heading_mean	1.7878848861530887
deviation-heading_median	1.586991268253102
deviation-heading_min	0.7125851723468939
driven_any_max	1.866868198311411
driven_any_mean	1.019594414525446
driven_any_median	0.7870319413072165
driven_any_min	0.6101869510445624
driven_lanedir_consec_max	0.6339497587176974
driven_lanedir_consec_mean	0.3696653712059442
driven_lanedir_consec_min	0.2383880900329518
driven_lanedir_max	0.6627895711347058
driven_lanedir_mean	0.3788363257891192
driven_lanedir_median	0.34593961179203836
driven_lanedir_min	0.2383880900329518
in-drivable-lane_max	12.500000000000078
in-drivable-lane_mean	4.280000000000017
in-drivable-lane_min	1.499999999999995
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.160259962778786, "sim_physics": 0.15013384701583185, "survival_time": 10.15000000000001, "driven_lanedir": 0.6627895711347058, "sim_render-ego": 0.0606418466333098, "in-drivable-lane": 3.3500000000000254, "agent_compute-ego": 0.1993710137353155, "deviation-heading": 2.338798993819092, "set_robot_commands": 0.09046443107680148, "deviation-center-line": 0.4184568661818192, "driven_lanedir_consec": 0.6339497587176974, "sim_compute_sim_state": 0.03812551850755814, "sim_compute_performance-ego": 0.0662440431529078, "sim_compute_robot_state-ego": 0.06995928816020196, "sim_compute_robot_state-npc0": 0.06738507806373935, "sim_compute_robot_state-npc1": 0.06672760066140461, "sim_compute_robot_state-npc2": 0.06867966510979413, "sim_compute_robot_state-npc3": 0.06763415501035493}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.866868198311411, "sim_physics": 0.17845311721165974, "survival_time": 14.950000000000076, "driven_lanedir": 0.2383880900329518, "sim_render-ego": 0.0601069696744283, "in-drivable-lane": 12.500000000000078, "agent_compute-ego": 0.19698805570602415, "deviation-heading": 0.7125851723468939, "set_robot_commands": 0.09109277645746867, "deviation-center-line": 0.24087102948169464, "driven_lanedir_consec": 0.2383880900329518, "sim_compute_sim_state": 0.03800556500752767, "sim_compute_performance-ego": 0.06509129126866658, "sim_compute_robot_state-ego": 0.06963764429092408, "sim_compute_robot_state-npc0": 0.06878456751505534, "sim_compute_robot_state-npc1": 0.06668624560038248, "sim_compute_robot_state-npc2": 0.0654680061340332, "sim_compute_robot_state-npc3": 0.06706066290537516}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6736250191852543, "sim_physics": 0.1280587470437598, "survival_time": 6.349999999999985, "driven_lanedir": 0.36082400893476674, "sim_render-ego": 0.056145720594511256, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.1954473773325522, "deviation-heading": 2.9309867454486027, "set_robot_commands": 0.09008516289117768, "deviation-center-line": 0.3482991638396876, "driven_lanedir_consec": 0.34693143700977336, "sim_compute_sim_state": 0.03584050944470984, "sim_compute_performance-ego": 0.07225676033440537, "sim_compute_robot_state-ego": 0.0661276607062873, "sim_compute_robot_state-npc0": 0.07777761286637914, "sim_compute_robot_state-npc1": 0.06461588416512556, "sim_compute_robot_state-npc2": 0.06210137915423536, "sim_compute_robot_state-npc3": 0.06200020519767221}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7870319413072165, "sim_physics": 0.14288883972167968, "survival_time": 6.249999999999986, "driven_lanedir": 0.34593961179203836, "sim_render-ego": 0.0586039981842041, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.20873291015625, "deviation-heading": 1.3700622508977518, "set_robot_commands": 0.08787023162841796, "deviation-center-line": 0.2288873942364315, "driven_lanedir_consec": 0.34593961179203836, "sim_compute_sim_state": 0.03742860221862793, "sim_compute_performance-ego": 0.06483577346801758, "sim_compute_robot_state-ego": 0.06727952575683593, "sim_compute_robot_state-npc0": 0.0650634765625, "sim_compute_robot_state-npc1": 0.06425827980041504, "sim_compute_robot_state-npc2": 0.06440291786193848, "sim_compute_robot_state-npc3": 0.06450833129882813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6101869510445624, "sim_physics": 0.10808719121492824, "survival_time": 5.1999999999999895, "driven_lanedir": 0.28624034705113355, "sim_render-ego": 0.0460399160018334, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.15135787771298334, "deviation-heading": 1.586991268253102, "set_robot_commands": 0.0683868550337278, "deviation-center-line": 0.19383355720964093, "driven_lanedir_consec": 0.28311795847725996, "sim_compute_sim_state": 0.028909609867976263, "sim_compute_performance-ego": 0.051152123854710504, "sim_compute_robot_state-ego": 0.052261950877996594, "sim_compute_robot_state-npc0": 0.05235410195130568, "sim_compute_robot_state-npc1": 0.05074831614127526, "sim_compute_robot_state-npc2": 0.05074128737816444, "sim_compute_robot_state-npc3": 0.050817439189324014}}
set_robot_commands_max	0.09109277645746867
set_robot_commands_mean	0.08557989141751872
set_robot_commands_median	0.09008516289117768
set_robot_commands_min	0.0683868550337278
sim_compute_performance-ego_max	0.07225676033440537
sim_compute_performance-ego_mean	0.06391599841574157
sim_compute_performance-ego_median	0.06509129126866658
sim_compute_performance-ego_min	0.051152123854710504
sim_compute_robot_state-ego_max	0.06995928816020196
sim_compute_robot_state-ego_mean	0.06505321395844917
sim_compute_robot_state-ego_median	0.06727952575683593
sim_compute_robot_state-ego_min	0.052261950877996594
sim_compute_robot_state-npc0_max	0.07777761286637914
sim_compute_robot_state-npc0_mean	0.0662729673917959
sim_compute_robot_state-npc0_median	0.06738507806373935
sim_compute_robot_state-npc0_min	0.05235410195130568
sim_compute_robot_state-npc1_max	0.06672760066140461
sim_compute_robot_state-npc1_mean	0.0626072652737206
sim_compute_robot_state-npc1_median	0.06461588416512556
sim_compute_robot_state-npc1_min	0.05074831614127526
sim_compute_robot_state-npc2_max	0.06867966510979413
sim_compute_robot_state-npc2_mean	0.06227865112763311
sim_compute_robot_state-npc2_median	0.06440291786193848
sim_compute_robot_state-npc2_min	0.05074128737816444
sim_compute_robot_state-npc3_max	0.06763415501035493
sim_compute_robot_state-npc3_mean	0.06240415872031089
sim_compute_robot_state-npc3_median	0.06450833129882813
sim_compute_robot_state-npc3_min	0.050817439189324014
sim_compute_sim_state_max	0.03812551850755814
sim_compute_sim_state_mean	0.035661961009279965
sim_compute_sim_state_median	0.03742860221862793
sim_compute_sim_state_min	0.028909609867976263
sim_physics_max	0.17845311721165974
sim_physics_mean	0.14152434844157186
sim_physics_median	0.14288883972167968
sim_physics_min	0.10808719121492824
sim_render-ego_max	0.0606418466333098
sim_render-ego_mean	0.05630769021765737
sim_render-ego_median	0.0586039981842041
sim_render-ego_min	0.0460399160018334
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.580000000000009
survival_time_min	5.1999999999999895

No reset possible

20214

2987

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-04-25 10:13:01+00:00

2019-04-25 10:22:12+00:00

0:09:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6484136414234332
survival_time_median	3.399999999999996
deviation-center-line_median	0.1909822160345785
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15445299542278323
agent_compute-ego_mean	0.14710888565230945
agent_compute-ego_median	0.14361471448625837
agent_compute-ego_min	0.14061563462018967
deviation-center-line_max	0.22170094668066745
deviation-center-line_mean	0.16868831051476302
deviation-center-line_min	0.10506487786396092
deviation-heading_max	1.6006068941187166
deviation-heading_mean	1.0594481132844054
deviation-heading_median	1.2405855277219906
deviation-heading_min	0.41078212378775375
driven_any_max	1.7860179099022448
driven_any_mean	0.9729200161058988
driven_any_median	0.9862929044127214
driven_any_min	0.4864214977522009
driven_lanedir_consec_max	0.6730160510584665
driven_lanedir_consec_mean	0.5976346980955531
driven_lanedir_consec_min	0.44061819790611745
driven_lanedir_max	0.6730160510584665
driven_lanedir_mean	0.5981547593997137
driven_lanedir_median	0.6504595364882388
driven_lanedir_min	0.44061819790611745
in-drivable-lane_max	2.9499999999999895
in-drivable-lane_mean	0.7299999999999974
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4864214977522009, "sim_physics": 0.1025351583957672, "survival_time": 1.6000000000000008, "driven_lanedir": 0.44061819790611745, "sim_render-ego": 0.06609877943992615, "in-drivable-lane": 0, "agent_compute-ego": 0.14061563462018967, "deviation-heading": 0.4908647695496521, "set_robot_commands": 0.0864119678735733, "deviation-center-line": 0.10506487786396092, "driven_lanedir_consec": 0.44061819790611745, "sim_compute_sim_state": 0.037740111351013184, "sim_compute_performance-ego": 0.07004030048847198, "sim_compute_robot_state-ego": 0.07266425341367722}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9862929044127214, "sim_physics": 0.09214012916773966, "survival_time": 3.649999999999995, "driven_lanedir": 0.6730160510584665, "sim_render-ego": 0.06129436950161032, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14302545051052146, "deviation-heading": 1.554401251243914, "set_robot_commands": 0.09213625241632332, "deviation-center-line": 0.22170094668066745, "driven_lanedir_consec": 0.6730160510584665, "sim_compute_sim_state": 0.0402023628966449, "sim_compute_performance-ego": 0.06515240342649695, "sim_compute_robot_state-ego": 0.07209008687163053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7860179099022448, "sim_physics": 0.10185372282605652, "survival_time": 5.449999999999989, "driven_lanedir": 0.6504595364882388, "sim_render-ego": 0.06046299978133735, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.15445299542278323, "deviation-heading": 1.2405855277219906, "set_robot_commands": 0.09544551700627038, "deviation-center-line": 0.1909822160345785, "driven_lanedir_consec": 0.6504595364882388, "sim_compute_sim_state": 0.03852842925885402, "sim_compute_performance-ego": 0.06799250348992304, "sim_compute_robot_state-ego": 0.07284270295309364}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.001019273229271, "sim_physics": 0.09396729749791764, "survival_time": 3.399999999999996, "driven_lanedir": 0.6510139479442363, "sim_render-ego": 0.06443445822771858, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15383563322179458, "deviation-heading": 1.6006068941187166, "set_robot_commands": 0.0958485813701854, "deviation-center-line": 0.2142380647295583, "driven_lanedir_consec": 0.6484136414234332, "sim_compute_sim_state": 0.03801520431742949, "sim_compute_performance-ego": 0.06659012331682093, "sim_compute_robot_state-ego": 0.07146489269593183}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6048484952330552, "sim_physics": 0.0971313408442906, "survival_time": 1.7500000000000009, "driven_lanedir": 0.5756660636015098, "sim_render-ego": 0.05922983033316476, "in-drivable-lane": 0, "agent_compute-ego": 0.14361471448625837, "deviation-heading": 0.41078212378775375, "set_robot_commands": 0.09217500686645508, "deviation-center-line": 0.11145544726505012, "driven_lanedir_consec": 0.5756660636015098, "sim_compute_sim_state": 0.03628269604274205, "sim_compute_performance-ego": 0.06818105152675084, "sim_compute_robot_state-ego": 0.06717523166111537}}
set_robot_commands_max	0.0958485813701854
set_robot_commands_mean	0.0924034651065615
set_robot_commands_median	0.09217500686645508
set_robot_commands_min	0.0864119678735733
sim_compute_performance-ego_max	0.07004030048847198
sim_compute_performance-ego_mean	0.06759127644969275
sim_compute_performance-ego_median	0.06799250348992304
sim_compute_performance-ego_min	0.06515240342649695
sim_compute_robot_state-ego_max	0.07284270295309364
sim_compute_robot_state-ego_mean	0.07124743351908971
sim_compute_robot_state-ego_median	0.07209008687163053
sim_compute_robot_state-ego_min	0.06717523166111537
sim_compute_sim_state_max	0.0402023628966449
sim_compute_sim_state_mean	0.03815376077333673
sim_compute_sim_state_median	0.03801520431742949
sim_compute_sim_state_min	0.03628269604274205
sim_physics_max	0.1025351583957672
sim_physics_mean	0.09752552974635433
sim_physics_median	0.0971313408442906
sim_physics_min	0.09214012916773966
sim_render-ego_max	0.06609877943992615
sim_render-ego_mean	0.06230408745675144
sim_render-ego_median	0.06129436950161032
sim_render-ego_min	0.05922983033316476
simulation-passed	1
survival_time_max	5.449999999999989
survival_time_mean	3.169999999999996
survival_time_min	1.6000000000000008

No reset possible

20211

2998

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:12:14+00:00

2019-04-25 10:12:46+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20208

2999

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:11:34+00:00

2019-04-25 10:12:07+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20206

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:10:53+00:00

2019-04-25 10:11:27+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20203

3011

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:10:14+00:00

2019-04-25 10:10:46+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20199

3014

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:09:33+00:00

2019-04-25 10:10:06+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20197

3026

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:08:53+00:00

2019-04-25 10:09:25+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20192

3038

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:06:49+00:00

2019-04-25 10:08:45+00:00

0:01:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20189

3042

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:05:56+00:00

2019-04-25 10:06:29+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20185

3047

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:04:53+00:00

2019-04-25 10:05:33+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20169

3050

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:00:12+00:00

2019-04-25 10:04:29+00:00

0:04:17

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20158

2903

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:50:34+00:00

2019-04-25 10:00:05+00:00

0:09:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20139

2990

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-04-25 09:41:24+00:00

2019-04-25 09:50:27+00:00

0:09:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6938003480617501
survival_time_median	2.6999999999999984
deviation-center-line_median	0.1516523249231353
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.1626388669013977
agent_compute-ego_mean	0.14779628717119195
agent_compute-ego_median	0.14909951714263564
agent_compute-ego_min	0.13091718719666262
deviation-center-line_max	0.1973158696573789
deviation-center-line_mean	0.1629072778180587
deviation-center-line_min	0.12760599685152874
deviation-heading_max	1.635929476455538
deviation-heading_mean	1.0023018457230384
deviation-heading_median	0.8160244785183065
deviation-heading_min	0.5220457886378561
driven_any_max	1.1196931395510552
driven_any_mean	0.9398847149299168
driven_any_median	1.074517527847484
driven_any_min	0.550496450238808
driven_lanedir_consec_max	0.7870020807084321
driven_lanedir_consec_mean	0.6571316765701173
driven_lanedir_consec_min	0.4919505802026425
driven_lanedir_max	0.7870020807084321
driven_lanedir_mean	0.6571316765701173
driven_lanedir_median	0.6938003480617501
driven_lanedir_min	0.4919505802026425
in-drivable-lane_max	1.4499999999999948
in-drivable-lane_mean	0.6299999999999979
in-drivable-lane_min	0.04999999999999982
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.074517527847484, "sim_physics": 0.05145123269822863, "survival_time": 2.6999999999999984, "driven_lanedir": 0.6938003480617501, "sim_render-ego": 0.06495200704645228, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15738723896167897, "deviation-heading": 0.8160244785183065, "set_robot_commands": 0.09534743538609255, "deviation-center-line": 0.14437780907348313, "driven_lanedir_consec": 0.6938003480617501, "sim_compute_sim_state": 0.040158496962653265, "sim_compute_performance-ego": 0.069221090387415, "sim_compute_robot_state-ego": 0.0774365884286386}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1196931395510552, "sim_physics": 0.044195309452626896, "survival_time": 4.3499999999999925, "driven_lanedir": 0.5845674586820551, "sim_render-ego": 0.05879632357893319, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.14909951714263564, "deviation-heading": 1.635929476455538, "set_robot_commands": 0.09420123867604924, "deviation-center-line": 0.19358438858476745, "driven_lanedir_consec": 0.5845674586820551, "sim_compute_sim_state": 0.03739983185954478, "sim_compute_performance-ego": 0.06670707669751398, "sim_compute_robot_state-ego": 0.07332626430467627}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.104355623939405, "sim_physics": 0.04003961114998324, "survival_time": 4.149999999999993, "driven_lanedir": 0.7283379151957066, "sim_render-ego": 0.0550241326711264, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.13091718719666262, "deviation-heading": 1.24512117441081, "set_robot_commands": 0.08522570276834879, "deviation-center-line": 0.1973158696573789, "driven_lanedir_consec": 0.7283379151957066, "sim_compute_sim_state": 0.03544157097138554, "sim_compute_performance-ego": 0.06217752020043063, "sim_compute_robot_state-ego": 0.06372757417609892}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8503608330728324, "sim_physics": 0.04333650182794641, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7870020807084321, "sim_render-ego": 0.05524974840658682, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1389386256535848, "deviation-heading": 0.7923883105926819, "set_robot_commands": 0.08499088552263048, "deviation-center-line": 0.1516523249231353, "driven_lanedir_consec": 0.7870020807084321, "sim_compute_sim_state": 0.03628272921950729, "sim_compute_performance-ego": 0.061572653275948984, "sim_compute_robot_state-ego": 0.06719525655110677}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.550496450238808, "sim_physics": 0.056916171312332155, "survival_time": 2.000000000000001, "driven_lanedir": 0.4919505802026425, "sim_render-ego": 0.06729492545127869, "in-drivable-lane": 0.1499999999999999, "agent_compute-ego": 0.1626388669013977, "deviation-heading": 0.5220457886378561, "set_robot_commands": 0.10017446279525756, "deviation-center-line": 0.12760599685152874, "driven_lanedir_consec": 0.4919505802026425, "sim_compute_sim_state": 0.04045846462249756, "sim_compute_performance-ego": 0.0740838885307312, "sim_compute_robot_state-ego": 0.08161905407905579}}
set_robot_commands_max	0.10017446279525756
set_robot_commands_mean	0.09198794502967574
set_robot_commands_median	0.09420123867604924
set_robot_commands_min	0.08499088552263048
sim_compute_performance-ego_max	0.0740838885307312
sim_compute_performance-ego_mean	0.06675244581840796
sim_compute_performance-ego_median	0.06670707669751398
sim_compute_performance-ego_min	0.061572653275948984
sim_compute_robot_state-ego_max	0.08161905407905579
sim_compute_robot_state-ego_mean	0.07266094750791527
sim_compute_robot_state-ego_median	0.07332626430467627
sim_compute_robot_state-ego_min	0.06372757417609892
sim_compute_sim_state_max	0.04045846462249756
sim_compute_sim_state_mean	0.03794821872711768
sim_compute_sim_state_median	0.03739983185954478
sim_compute_sim_state_min	0.03544157097138554
sim_physics_max	0.056916171312332155
sim_physics_mean	0.047187765288223465
sim_physics_median	0.044195309452626896
sim_physics_min	0.04003961114998324
sim_render-ego_max	0.06729492545127869
sim_render-ego_mean	0.06026342743087547
sim_render-ego_median	0.05879632357893319
sim_render-ego_min	0.0550241326711264
simulation-passed	1
survival_time_max	4.3499999999999925
survival_time_mean	3.179999999999997
survival_time_min	2.000000000000001

No reset possible

20126

3011

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:39:27+00:00

2019-04-25 09:41:16+00:00

0:01:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20097

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:26:01+00:00

2019-04-25 09:39:12+00:00

0:13:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2964165331703259
survival_time_median	3.1999999999999966
deviation-center-line_median	0.2338897728424024
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.09550918851579938
agent_compute-ego_mean	0.09238366577295858
agent_compute-ego_median	0.09098811820149422
agent_compute-ego_min	0.08973031092171717
deviation-center-line_max	0.682467951300583
deviation-center-line_mean	0.2943822653698276
deviation-center-line_min	0.09432510139180456
deviation-heading_max	3.665132485726784
deviation-heading_mean	1.6215157366801365
deviation-heading_median	1.0781779272443104
deviation-heading_min	0.5044061025423345
driven_any_max	1.5417162801264834
driven_any_mean	0.6284259785535156
driven_any_median	0.46506767228558993
driven_any_min	0.17576453339198922
driven_lanedir_consec_max	0.618339218983615
driven_lanedir_consec_mean	0.33227307377916404
driven_lanedir_consec_min	0.1445656684060399
driven_lanedir_max	0.7736285236119969
driven_lanedir_mean	0.4104054999090705
driven_lanedir_median	0.4520002341786171
driven_lanedir_min	0.1445656684060399
in-drivable-lane_max	3.300000000000016
in-drivable-lane_mean	0.7500000000000032
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.7275929077398147, "sim_physics": 0.0967987970430024, "survival_time": 4.899999999999991, "driven_lanedir": 0.5317893591914763, "sim_render-ego": 0.07018238427687665, "in-drivable-lane": 0.3500000000000001, "agent_compute-ego": 0.09550918851579938, "deviation-heading": 2.176259545684896, "set_robot_commands": 0.13007041142911327, "deviation-center-line": 0.3506183913110702, "driven_lanedir_consec": 0.2964165331703259, "sim_compute_sim_state": 0.043923721021535446, "sim_compute_performance-ego": 0.07711956452350227, "sim_compute_robot_state-ego": 0.08836050666108423, "sim_compute_robot_state-npc0": 0.08030000511480838, "sim_compute_robot_state-npc1": 0.08177820760376599, "sim_compute_robot_state-npc2": 0.07663846502498704, "sim_compute_robot_state-npc3": 0.0776656622789344}, "udem1-1-0": {"driven_any": 0.2319884992237008, "sim_physics": 0.10097523416791644, "survival_time": 1.7500000000000009, "driven_lanedir": 0.1500437141572224, "sim_render-ego": 0.07334507533482143, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09500278064182828, "deviation-heading": 1.0781779272443104, "set_robot_commands": 0.13066411018371582, "deviation-center-line": 0.09432510139180456, "driven_lanedir_consec": 0.1500437141572224, "sim_compute_sim_state": 0.0442514283316476, "sim_compute_performance-ego": 0.08118383543831961, "sim_compute_robot_state-ego": 0.09472007751464843, "sim_compute_robot_state-npc0": 0.07986164093017578, "sim_compute_robot_state-npc1": 0.07901438304356166, "sim_compute_robot_state-npc2": 0.08010352679661342, "sim_compute_robot_state-npc3": 0.0782543591090611}, "udem1-2-0": {"driven_any": 1.5417162801264834, "sim_physics": 0.08497506560701312, "survival_time": 9.900000000000006, "driven_lanedir": 0.7736285236119969, "sim_render-ego": 0.06996364665753914, "in-drivable-lane": 3.300000000000016, "agent_compute-ego": 0.08973031092171717, "deviation-heading": 3.665132485726784, "set_robot_commands": 0.11321290334065756, "deviation-center-line": 0.682467951300583, "driven_lanedir_consec": 0.618339218983615, "sim_compute_sim_state": 0.04363157171191591, "sim_compute_performance-ego": 0.07662846343685882, "sim_compute_robot_state-ego": 0.08429446726134329, "sim_compute_robot_state-npc0": 0.07690942769098763, "sim_compute_robot_state-npc1": 0.07802956513684205, "sim_compute_robot_state-npc2": 0.07763752311167091, "sim_compute_robot_state-npc3": 0.07764632774121834}, "udem1-3-0": {"driven_any": 0.17576453339198922, "sim_physics": 0.08978650399616786, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1445656684060399, "sim_render-ego": 0.076431257384164, "in-drivable-lane": 0, "agent_compute-ego": 0.09068793058395386, "deviation-heading": 0.5044061025423345, "set_robot_commands": 0.12276463849203928, "deviation-center-line": 0.11061011000327788, "driven_lanedir_consec": 0.1445656684060399, "sim_compute_sim_state": 0.044947411332811625, "sim_compute_performance-ego": 0.07602662699563163, "sim_compute_robot_state-ego": 0.0807223916053772, "sim_compute_robot_state-npc0": 0.08529383795601982, "sim_compute_robot_state-npc1": 0.0802516256059919, "sim_compute_robot_state-npc2": 0.08142810208456856, "sim_compute_robot_state-npc3": 0.0817208204950605}, "udem1-4-0": {"driven_any": 0.46506767228558993, "sim_physics": 0.0939488559961319, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4520002341786171, "sim_render-ego": 0.07088271528482437, "in-drivable-lane": 0, "agent_compute-ego": 0.09098811820149422, "deviation-heading": 0.6836026222023585, "set_robot_commands": 0.1152818650007248, "deviation-center-line": 0.2338897728424024, "driven_lanedir_consec": 0.4520002341786171, "sim_compute_sim_state": 0.04543296992778778, "sim_compute_performance-ego": 0.079033974558115, "sim_compute_robot_state-ego": 0.08999491110444069, "sim_compute_robot_state-npc0": 0.07904291898012161, "sim_compute_robot_state-npc1": 0.07905133813619614, "sim_compute_robot_state-npc2": 0.08027615770697594, "sim_compute_robot_state-npc3": 0.0811455175280571}}
set_robot_commands_max	0.13066411018371582
set_robot_commands_mean	0.12239878568925014
set_robot_commands_median	0.12276463849203928
set_robot_commands_min	0.11321290334065756
sim_compute_performance-ego_max	0.08118383543831961
sim_compute_performance-ego_mean	0.07799849299048547
sim_compute_performance-ego_median	0.07711956452350227
sim_compute_performance-ego_min	0.07602662699563163
sim_compute_robot_state-ego_max	0.09472007751464843
sim_compute_robot_state-ego_mean	0.08761847082937876
sim_compute_robot_state-ego_median	0.08836050666108423
sim_compute_robot_state-ego_min	0.0807223916053772
sim_compute_robot_state-npc0_max	0.08529383795601982
sim_compute_robot_state-npc0_mean	0.08028156613442264
sim_compute_robot_state-npc0_median	0.07986164093017578
sim_compute_robot_state-npc0_min	0.07690942769098763
sim_compute_robot_state-npc1_max	0.08177820760376599
sim_compute_robot_state-npc1_mean	0.07962502390527156
sim_compute_robot_state-npc1_median	0.07905133813619614
sim_compute_robot_state-npc1_min	0.07802956513684205
sim_compute_robot_state-npc2_max	0.08142810208456856
sim_compute_robot_state-npc2_mean	0.07921675494496318
sim_compute_robot_state-npc2_median	0.08010352679661342
sim_compute_robot_state-npc2_min	0.07663846502498704
sim_compute_robot_state-npc3_max	0.0817208204950605
sim_compute_robot_state-npc3_mean	0.07928653743046629
sim_compute_robot_state-npc3_median	0.0782543591090611
sim_compute_robot_state-npc3_min	0.07764632774121834
sim_compute_sim_state_max	0.04543296992778778
sim_compute_sim_state_mean	0.04443742046513967
sim_compute_sim_state_median	0.0442514283316476
sim_compute_sim_state_min	0.04363157171191591
sim_physics_max	0.10097523416791644
sim_physics_mean	0.09329689136204632
sim_physics_median	0.0939488559961319
sim_physics_min	0.08497506560701312
sim_render-ego_max	0.076431257384164
sim_render-ego_mean	0.07216101578764512
sim_render-ego_median	0.07088271528482437
sim_render-ego_min	0.06996364665753914
simulation-passed	1
survival_time_max	9.900000000000006
survival_time_mean	4.229999999999999
survival_time_min	1.4000000000000006

No reset possible

20093

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 09:23:21+00:00

2019-04-25 09:25:47+00:00

0:02:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20065

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:01:57+00:00

2019-04-25 09:22:45+00:00

0:20:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4610916151723656
survival_time_median	4.849999999999991
deviation-center-line_median	0.45276698352946704
in-drivable-lane_median	0.30000000000000027

other stats

agent_compute-ego_max	0.10740617794149064
agent_compute-ego_mean	0.0974848856270518
agent_compute-ego_median	0.096357758512202
agent_compute-ego_min	0.0888194751739502
deviation-center-line_max	0.8920565985855058
deviation-center-line_mean	0.48665771018907816
deviation-center-line_min	0.14878517045151526
deviation-heading_max	5.590394782413816
deviation-heading_mean	2.409177872207663
deviation-heading_median	1.88827014016829
deviation-heading_min	0.5387737474023465
driven_any_max	2.3481774496539756
driven_any_mean	1.0344466349959816
driven_any_median	0.7192216566210685
driven_any_min	0.21946392917965632
driven_lanedir_consec_max	1.069865675058762
driven_lanedir_consec_mean	0.6191910085715143
driven_lanedir_consec_min	0.19553454300342188
driven_lanedir_max	1.5416723159581756
driven_lanedir_mean	0.767947028079514
driven_lanedir_median	0.5715709912048453
driven_lanedir_min	0.19553454300342188
in-drivable-lane_max	2.9500000000000375
in-drivable-lane_mean	0.8700000000000084
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.7192216566210685, "sim_physics": 0.1689629751382415, "survival_time": 4.849999999999991, "driven_lanedir": 0.5715709912048453, "sim_render-ego": 0.05945467211536525, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.096357758512202, "deviation-heading": 1.88827014016829, "set_robot_commands": 0.09270533089785232, "deviation-center-line": 0.45276698352946704, "driven_lanedir_consec": 0.37282484425229906, "sim_compute_sim_state": 0.038741283810015806, "sim_compute_performance-ego": 0.06619467931924407, "sim_compute_robot_state-ego": 0.0716333168069112, "sim_compute_robot_state-npc0": 0.06770825386047363, "sim_compute_robot_state-npc1": 0.06736286153498384, "sim_compute_robot_state-npc2": 0.07119387449677457, "sim_compute_robot_state-npc3": 0.06805651949853012}, "udem1-1-0": {"driven_any": 0.49269325732533115, "sim_physics": 0.19289657298256369, "survival_time": 3.399999999999996, "driven_lanedir": 0.4610916151723656, "sim_render-ego": 0.07153643580044017, "in-drivable-lane": 0, "agent_compute-ego": 0.10740617794149064, "deviation-heading": 1.1009792762837594, "set_robot_commands": 0.10758546170066384, "deviation-center-line": 0.22231101114908083, "driven_lanedir_consec": 0.4610916151723656, "sim_compute_sim_state": 0.04134117154514089, "sim_compute_performance-ego": 0.0755239164128023, "sim_compute_robot_state-ego": 0.08622941900702084, "sim_compute_robot_state-npc0": 0.07506196288501515, "sim_compute_robot_state-npc1": 0.07389005142099717, "sim_compute_robot_state-npc2": 0.07289907160927267, "sim_compute_robot_state-npc3": 0.07438559041303747}, "udem1-2-0": {"driven_any": 2.3481774496539756, "sim_physics": 0.19945947885513304, "survival_time": 14.950000000000076, "driven_lanedir": 1.5416723159581756, "sim_render-ego": 0.058152720133463544, "in-drivable-lane": 2.9500000000000375, "agent_compute-ego": 0.0888194751739502, "deviation-heading": 5.590394782413816, "set_robot_commands": 0.0914736827214559, "deviation-center-line": 0.8920565985855058, "driven_lanedir_consec": 0.9966383653707234, "sim_compute_sim_state": 0.0374313481648763, "sim_compute_performance-ego": 0.06605641762415568, "sim_compute_robot_state-ego": 0.06949221928914388, "sim_compute_robot_state-npc0": 0.06721139748891194, "sim_compute_robot_state-npc1": 0.0660956358909607, "sim_compute_robot_state-npc2": 0.06559297482172648, "sim_compute_robot_state-npc3": 0.06510388771692911}, "udem1-3-0": {"driven_any": 0.21946392917965632, "sim_physics": 0.17837156267727122, "survival_time": 1.7000000000000008, "driven_lanedir": 0.19553454300342188, "sim_render-ego": 0.05897978474112118, "in-drivable-lane": 0, "agent_compute-ego": 0.09934999662287096, "deviation-heading": 0.5387737474023465, "set_robot_commands": 0.09515185215893912, "deviation-center-line": 0.14878517045151526, "driven_lanedir_consec": 0.19553454300342188, "sim_compute_sim_state": 0.04157113327699549, "sim_compute_performance-ego": 0.06533599601072423, "sim_compute_robot_state-ego": 0.06749247803407557, "sim_compute_robot_state-npc0": 0.06542510144850787, "sim_compute_robot_state-npc1": 0.06549784015206729, "sim_compute_robot_state-npc2": 0.07089714442982394, "sim_compute_robot_state-npc3": 0.06852858908036176}, "udem1-4-0": {"driven_any": 1.3926768821998767, "sim_physics": 0.21406842205259535, "survival_time": 8.999999999999993, "driven_lanedir": 1.069865675058762, "sim_render-ego": 0.06567460828357273, "in-drivable-lane": 1.100000000000004, "agent_compute-ego": 0.09549101988474527, "deviation-heading": 2.927471414770104, "set_robot_commands": 0.09785147110621134, "deviation-center-line": 0.717368787229822, "driven_lanedir_consec": 1.069865675058762, "sim_compute_sim_state": 0.03894011576970418, "sim_compute_performance-ego": 0.07078109449810452, "sim_compute_robot_state-ego": 0.07896152072482639, "sim_compute_robot_state-npc0": 0.07110564046435885, "sim_compute_robot_state-npc1": 0.07201767630047268, "sim_compute_robot_state-npc2": 0.07041087812847562, "sim_compute_robot_state-npc3": 0.06952949629889595}}
set_robot_commands_max	0.10758546170066384
set_robot_commands_mean	0.0969535597170245
set_robot_commands_median	0.09515185215893912
set_robot_commands_min	0.0914736827214559
sim_compute_performance-ego_max	0.0755239164128023
sim_compute_performance-ego_mean	0.06877842077300615
sim_compute_performance-ego_median	0.06619467931924407
sim_compute_performance-ego_min	0.06533599601072423
sim_compute_robot_state-ego_max	0.08622941900702084
sim_compute_robot_state-ego_mean	0.07476179077239556
sim_compute_robot_state-ego_median	0.0716333168069112
sim_compute_robot_state-ego_min	0.06749247803407557
sim_compute_robot_state-npc0_max	0.07506196288501515
sim_compute_robot_state-npc0_mean	0.06930247122945349
sim_compute_robot_state-npc0_median	0.06770825386047363
sim_compute_robot_state-npc0_min	0.06542510144850787
sim_compute_robot_state-npc1_max	0.07389005142099717
sim_compute_robot_state-npc1_mean	0.06897281305989633
sim_compute_robot_state-npc1_median	0.06736286153498384
sim_compute_robot_state-npc1_min	0.06549784015206729
sim_compute_robot_state-npc2_max	0.07289907160927267
sim_compute_robot_state-npc2_mean	0.07019878869721466
sim_compute_robot_state-npc2_median	0.07089714442982394
sim_compute_robot_state-npc2_min	0.06559297482172648
sim_compute_robot_state-npc3_max	0.07438559041303747
sim_compute_robot_state-npc3_mean	0.06912081660155087
sim_compute_robot_state-npc3_median	0.06852858908036176
sim_compute_robot_state-npc3_min	0.06510388771692911
sim_compute_sim_state_max	0.04157113327699549
sim_compute_sim_state_mean	0.039605010513346535
sim_compute_sim_state_median	0.03894011576970418
sim_compute_sim_state_min	0.0374313481648763
sim_physics_max	0.21406842205259535
sim_physics_mean	0.190751802341161
sim_physics_median	0.19289657298256369
sim_physics_min	0.1689629751382415
sim_render-ego_max	0.07153643580044017
sim_render-ego_mean	0.06275964421479258
sim_render-ego_median	0.05945467211536525
sim_render-ego_min	0.058152720133463544
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.780000000000011
survival_time_min	1.7000000000000008

No reset possible

20040

3002

challenge-aido_LF-template-tensorflow

step1-simulation

host-error

2019-04-25 08:59:25+00:00

2019-04-25 09:01:51+00:00

0:02:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20004

2424

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 08:45:04+00:00

2019-04-25 08:51:25+00:00

0:06:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.13045658005608451
agent_compute-ego_mean	0.09698571854625712
agent_compute-ego_median	0.08343864181666698
agent_compute-ego_min	0.07597101362128007
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.04072495301564535, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.05850170718299018, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.118720057937834, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.0805099109808604, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.030799855788548783, "sim_compute_performance-ego": 0.05336981349521213, "sim_compute_robot_state-ego": 0.05818211038907369, "sim_compute_robot_state-npc0": 0.0550132691860199, "sim_compute_robot_state-npc1": 0.05443762077225579, "sim_compute_robot_state-npc2": 0.054849853118260704, "sim_compute_robot_state-npc3": 0.05299637383884854}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.03362323619701244, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.0556843810611301, "in-drivable-lane": 0, "agent_compute-ego": 0.13045658005608451, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.08223069155657733, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03130326447663484, "sim_compute_performance-ego": 0.0560518812250208, "sim_compute_robot_state-ego": 0.0581561459435357, "sim_compute_robot_state-npc0": 0.06354708141750759, "sim_compute_robot_state-npc1": 0.05521211800751863, "sim_compute_robot_state-npc2": 0.055425811696935584, "sim_compute_robot_state-npc3": 0.058741339930781615}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.03192920823699062, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.03988044933207984, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08343864181666698, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.06110258704250299, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.024314845649941453, "sim_compute_performance-ego": 0.04161832633527737, "sim_compute_robot_state-ego": 0.042404114621356855, "sim_compute_robot_state-npc0": 0.04397331163721177, "sim_compute_robot_state-npc1": 0.042393911232068704, "sim_compute_robot_state-npc2": 0.04336014766137577, "sim_compute_robot_state-npc3": 0.04306308042655871}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.024745806208196677, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.035915289285048, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.07634229929942005, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.05552375541543061, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.022777089532816184, "sim_compute_performance-ego": 0.04073105218275538, "sim_compute_robot_state-ego": 0.039519561911528965, "sim_compute_robot_state-npc0": 0.03977642419203272, "sim_compute_robot_state-npc1": 0.03964980143421101, "sim_compute_robot_state-npc2": 0.03974571317996619, "sim_compute_robot_state-npc3": 0.039744372637766714}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.02239679035387541, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.03522785086380808, "in-drivable-lane": 0, "agent_compute-ego": 0.07597101362128007, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.05506658554077149, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.022198840191489773, "sim_compute_performance-ego": 0.03795906117087916, "sim_compute_robot_state-ego": 0.039517615970812346, "sim_compute_robot_state-npc0": 0.03932024303235506, "sim_compute_robot_state-npc1": 0.03874579228852924, "sim_compute_robot_state-npc2": 0.03876790247465435, "sim_compute_robot_state-npc3": 0.03872107204638029}}
set_robot_commands_max	0.08223069155657733
set_robot_commands_mean	0.06688670610722855
set_robot_commands_median	0.06110258704250299
set_robot_commands_min	0.05506658554077149
sim_compute_performance-ego_max	0.0560518812250208
sim_compute_performance-ego_mean	0.045946026881828965
sim_compute_performance-ego_median	0.04161832633527737
sim_compute_performance-ego_min	0.03795906117087916
sim_compute_robot_state-ego_max	0.05818211038907369
sim_compute_robot_state-ego_mean	0.04755590976726151
sim_compute_robot_state-ego_median	0.042404114621356855
sim_compute_robot_state-ego_min	0.039517615970812346
sim_compute_robot_state-npc0_max	0.06354708141750759
sim_compute_robot_state-npc0_mean	0.04832606589302541
sim_compute_robot_state-npc0_median	0.04397331163721177
sim_compute_robot_state-npc0_min	0.03932024303235506
sim_compute_robot_state-npc1_max	0.05521211800751863
sim_compute_robot_state-npc1_mean	0.04608784874691667
sim_compute_robot_state-npc1_median	0.042393911232068704
sim_compute_robot_state-npc1_min	0.03874579228852924
sim_compute_robot_state-npc2_max	0.055425811696935584
sim_compute_robot_state-npc2_mean	0.04642988562623852
sim_compute_robot_state-npc2_median	0.04336014766137577
sim_compute_robot_state-npc2_min	0.03876790247465435
sim_compute_robot_state-npc3_max	0.058741339930781615
sim_compute_robot_state-npc3_mean	0.04665324777606717
sim_compute_robot_state-npc3_median	0.04306308042655871
sim_compute_robot_state-npc3_min	0.03872107204638029
sim_compute_sim_state_max	0.03130326447663484
sim_compute_sim_state_mean	0.026278779127886204
sim_compute_sim_state_median	0.024314845649941453
sim_compute_sim_state_min	0.022198840191489773
sim_physics_max	0.04072495301564535
sim_physics_mean	0.030683998802344094
sim_physics_median	0.03192920823699062
sim_physics_min	0.02239679035387541
sim_render-ego_max	0.05850170718299018
sim_render-ego_mean	0.04504193554501124
sim_render-ego_median	0.03988044933207984
sim_render-ego_min	0.03522785086380808
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

19976

2487

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:42:42+00:00

2019-04-25 08:44:50+00:00

0:02:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19955

2617

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:40:33+00:00

2019-04-25 08:42:07+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19943

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:39:28+00:00

2019-04-25 08:40:19+00:00

0:00:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19925

2974

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:38:09+00:00

2019-04-25 08:39:05+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19910

2665

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 08:37:10+00:00

2019-04-25 08:37:43+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19809

2964

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:11:27+00:00

2019-04-25 08:36:52+00:00

0:25:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3632709853899321
survival_time_median	14.950000000000076
deviation-center-line_median	0.2651556500958301
in-drivable-lane_median	2.199999999999992

other stats

agent_compute-ego_max	0.2403205143777948
agent_compute-ego_mean	0.21406297965157303
agent_compute-ego_median	0.21068809111913045
agent_compute-ego_min	0.2007650647844587
deviation-center-line_max	1.338768390486617
deviation-center-line_mean	0.5833651019248329
deviation-center-line_min	0.17956925054779688
deviation-heading_max	1.911104817429614
deviation-heading_mean	1.371509752151971
deviation-heading_median	1.3652537939052305
deviation-heading_min	0.7451138797018895
driven_any_max	1.650928186830955
driven_any_mean	1.21784380082501
driven_any_median	1.502155110133958
driven_any_min	0.6850636179225965
driven_lanedir_consec_max	1.5499306361971164
driven_lanedir_consec_mean	0.7329507511157798
driven_lanedir_consec_min	0.2693312838668618
driven_lanedir_max	1.5499306361971164
driven_lanedir_mean	0.7329507511157798
driven_lanedir_median	0.3632709853899321
driven_lanedir_min	0.2693312838668618
in-drivable-lane_max	11.200000000000085
in-drivable-lane_mean	3.750000000000012
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.502155110133958, "sim_physics": 0.03986517667770386, "survival_time": 14.950000000000076, "driven_lanedir": 1.1673208440022462, "sim_render-ego": 0.05969158490498861, "in-drivable-lane": 3.5999999999999908, "agent_compute-ego": 0.20334578275680543, "deviation-heading": 1.911104817429614, "set_robot_commands": 0.09187567313512168, "deviation-center-line": 1.338768390486617, "driven_lanedir_consec": 1.1673208440022462, "sim_compute_sim_state": 0.03713069200515747, "sim_compute_performance-ego": 0.06541584253311157, "sim_compute_robot_state-ego": 0.06865583340326945, "sim_compute_robot_state-npc0": 0.06664136330286662, "sim_compute_robot_state-npc1": 0.06700712521870932, "sim_compute_robot_state-npc2": 0.06525582393010457, "sim_compute_robot_state-npc3": 0.06533918937047323}, "udem1-1-0": {"driven_any": 0.6850636179225965, "sim_physics": 0.04260722471743214, "survival_time": 4.899999999999991, "driven_lanedir": 0.2693312838668618, "sim_render-ego": 0.06057168269643978, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.2007650647844587, "deviation-heading": 0.7451138797018895, "set_robot_commands": 0.09172646366820043, "deviation-center-line": 0.2651556500958301, "driven_lanedir_consec": 0.2693312838668618, "sim_compute_sim_state": 0.03669844841470524, "sim_compute_performance-ego": 0.06429301962560537, "sim_compute_robot_state-ego": 0.06543077498066183, "sim_compute_robot_state-npc0": 0.06485108210116017, "sim_compute_robot_state-npc1": 0.06572820702377631, "sim_compute_robot_state-npc2": 0.06514873066726996, "sim_compute_robot_state-npc3": 0.06526582824940584}, "udem1-2-0": {"driven_any": 0.6876186580608464, "sim_physics": 0.047087576514796205, "survival_time": 4.749999999999991, "driven_lanedir": 0.3149000061227425, "sim_render-ego": 0.062468601527966953, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2403205143777948, "deviation-heading": 1.2083798606632024, "set_robot_commands": 0.09858937012521844, "deviation-center-line": 0.17956925054779688, "driven_lanedir_consec": 0.3149000061227425, "sim_compute_sim_state": 0.04046435356140136, "sim_compute_performance-ego": 0.06927243784854287, "sim_compute_robot_state-ego": 0.07659800178126284, "sim_compute_robot_state-npc0": 0.07000113286470112, "sim_compute_robot_state-npc1": 0.07065830481679816, "sim_compute_robot_state-npc2": 0.07195301055908203, "sim_compute_robot_state-npc3": 0.07260706048262747}, "udem1-3-0": {"driven_any": 1.650928186830955, "sim_physics": 0.0430057692527771, "survival_time": 14.950000000000076, "driven_lanedir": 0.3632709853899321, "sim_render-ego": 0.06107528289159139, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.2151954452196757, "deviation-heading": 1.3652537939052305, "set_robot_commands": 0.09324332555135093, "deviation-center-line": 0.24303355671047608, "driven_lanedir_consec": 0.3632709853899321, "sim_compute_sim_state": 0.03771128575007121, "sim_compute_performance-ego": 0.06677445729573568, "sim_compute_robot_state-ego": 0.07108130455017089, "sim_compute_robot_state-npc0": 0.06696974515914916, "sim_compute_robot_state-npc1": 0.06736607154210408, "sim_compute_robot_state-npc2": 0.06762938896814982, "sim_compute_robot_state-npc3": 0.06736282269159953}, "udem1-4-0": {"driven_any": 1.5634534311766934, "sim_physics": 0.03827539920806885, "survival_time": 14.950000000000076, "driven_lanedir": 1.5499306361971164, "sim_render-ego": 0.05965169350306193, "in-drivable-lane": 0, "agent_compute-ego": 0.21068809111913045, "deviation-heading": 1.6276964090599195, "set_robot_commands": 0.0942766531308492, "deviation-center-line": 0.8902986617834451, "driven_lanedir_consec": 1.5499306361971164, "sim_compute_sim_state": 0.0383815614382426, "sim_compute_performance-ego": 0.06598840395609538, "sim_compute_robot_state-ego": 0.07010128577550252, "sim_compute_robot_state-npc0": 0.0666686987876892, "sim_compute_robot_state-npc1": 0.06540005127588908, "sim_compute_robot_state-npc2": 0.0647949473063151, "sim_compute_robot_state-npc3": 0.06525809526443481}}
set_robot_commands_max	0.09858937012521844
set_robot_commands_mean	0.09394229712214812
set_robot_commands_median	0.09324332555135093
set_robot_commands_min	0.09172646366820043
sim_compute_performance-ego_max	0.06927243784854287
sim_compute_performance-ego_mean	0.06634883225181817
sim_compute_performance-ego_median	0.06598840395609538
sim_compute_performance-ego_min	0.06429301962560537
sim_compute_robot_state-ego_max	0.07659800178126284
sim_compute_robot_state-ego_mean	0.0703734400981735
sim_compute_robot_state-ego_median	0.07010128577550252
sim_compute_robot_state-ego_min	0.06543077498066183
sim_compute_robot_state-npc0_max	0.07000113286470112
sim_compute_robot_state-npc0_mean	0.06702640444311325
sim_compute_robot_state-npc0_median	0.0666686987876892
sim_compute_robot_state-npc0_min	0.06485108210116017
sim_compute_robot_state-npc1_max	0.07065830481679816
sim_compute_robot_state-npc1_mean	0.0672319519754554
sim_compute_robot_state-npc1_median	0.06700712521870932
sim_compute_robot_state-npc1_min	0.06540005127588908
sim_compute_robot_state-npc2_max	0.07195301055908203
sim_compute_robot_state-npc2_mean	0.0669563802861843
sim_compute_robot_state-npc2_median	0.06525582393010457
sim_compute_robot_state-npc2_min	0.0647949473063151
sim_compute_robot_state-npc3_max	0.07260706048262747
sim_compute_robot_state-npc3_mean	0.06716659921170817
sim_compute_robot_state-npc3_median	0.06533918937047323
sim_compute_robot_state-npc3_min	0.06525809526443481
sim_compute_sim_state_max	0.04046435356140136
sim_compute_sim_state_mean	0.03807726823391558
sim_compute_sim_state_median	0.03771128575007121
sim_compute_sim_state_min	0.03669844841470524
sim_physics_max	0.047087576514796205
sim_physics_mean	0.04216822927415563
sim_physics_median	0.04260722471743214
sim_physics_min	0.03827539920806885
sim_render-ego_max	0.062468601527966953
sim_render-ego_mean	0.06069176910480974
sim_render-ego_median	0.06057168269643978
sim_render-ego_min	0.05965169350306193
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.900000000000045
survival_time_min	4.749999999999991

No reset possible

19787

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:01:18+00:00

2019-04-25 08:11:05+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.07544160516638505
agent_compute-ego_mean	0.06812801526475358
agent_compute-ego_median	0.06712697170398853
agent_compute-ego_min	0.06398144521211323
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.04282885903765442, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06177498124966955, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06966054971051064, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.09017984882281845, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03630462118015168, "sim_compute_performance-ego": 0.06711908662395114, "sim_compute_robot_state-ego": 0.06954807688476174, "sim_compute_robot_state-npc0": 0.06569163055176948, "sim_compute_robot_state-npc1": 0.06543698432339225, "sim_compute_robot_state-npc2": 0.06476116484137857, "sim_compute_robot_state-npc3": 0.06474994246367437}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.04200396412297299, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.06470039016322086, "in-drivable-lane": 0, "agent_compute-ego": 0.07544160516638505, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.10326998484762091, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03918901242707905, "sim_compute_performance-ego": 0.06936484888980263, "sim_compute_robot_state-ego": 0.07331530043953344, "sim_compute_robot_state-npc0": 0.07017082289645546, "sim_compute_robot_state-npc1": 0.0668426375640066, "sim_compute_robot_state-npc2": 0.06704604625701904, "sim_compute_robot_state-npc3": 0.06656617867319208}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.04180845043115448, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.05957789588392826, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06398144521211323, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.08161811661301997, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03417824444017912, "sim_compute_performance-ego": 0.06549668730350963, "sim_compute_robot_state-ego": 0.07006826317101195, "sim_compute_robot_state-npc0": 0.06324334311903569, "sim_compute_robot_state-npc1": 0.06375572555943539, "sim_compute_robot_state-npc2": 0.06206117596542626, "sim_compute_robot_state-npc3": 0.06176816371449253}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.043116207476015446, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06108865914521394, "in-drivable-lane": 0, "agent_compute-ego": 0.06712697170398853, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.09635046676353172, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03770404391818576, "sim_compute_performance-ego": 0.06558160428647641, "sim_compute_robot_state-ego": 0.06301864871272335, "sim_compute_robot_state-npc0": 0.06650079621209039, "sim_compute_robot_state-npc1": 0.0629394495928729, "sim_compute_robot_state-npc2": 0.06449591671978985, "sim_compute_robot_state-npc3": 0.06230823198954264}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.04097558770860944, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.05659602937244233, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06442950453077044, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.08817848137446813, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03593378407614572, "sim_compute_performance-ego": 0.06166742529187884, "sim_compute_robot_state-ego": 0.06437347805689252, "sim_compute_robot_state-npc0": 0.06231158877175952, "sim_compute_robot_state-npc1": 0.06245580173674084, "sim_compute_robot_state-npc2": 0.06348648714640784, "sim_compute_robot_state-npc3": 0.060644588773212736}}
set_robot_commands_max	0.10326998484762091
set_robot_commands_mean	0.09191937968429184
set_robot_commands_median	0.09017984882281845
set_robot_commands_min	0.08161811661301997
sim_compute_performance-ego_max	0.06936484888980263
sim_compute_performance-ego_mean	0.06584593047912372
sim_compute_performance-ego_median	0.06558160428647641
sim_compute_performance-ego_min	0.06166742529187884
sim_compute_robot_state-ego_max	0.07331530043953344
sim_compute_robot_state-ego_mean	0.0680647534529846
sim_compute_robot_state-ego_median	0.06954807688476174
sim_compute_robot_state-ego_min	0.06301864871272335
sim_compute_robot_state-npc0_max	0.07017082289645546
sim_compute_robot_state-npc0_mean	0.0655836363102221
sim_compute_robot_state-npc0_median	0.06569163055176948
sim_compute_robot_state-npc0_min	0.06231158877175952
sim_compute_robot_state-npc1_max	0.0668426375640066
sim_compute_robot_state-npc1_mean	0.0642861197552896
sim_compute_robot_state-npc1_median	0.06375572555943539
sim_compute_robot_state-npc1_min	0.06245580173674084
sim_compute_robot_state-npc2_max	0.06704604625701904
sim_compute_robot_state-npc2_mean	0.0643701581860043
sim_compute_robot_state-npc2_median	0.06449591671978985
sim_compute_robot_state-npc2_min	0.06206117596542626
sim_compute_robot_state-npc3_max	0.06656617867319208
sim_compute_robot_state-npc3_mean	0.06320742112282288
sim_compute_robot_state-npc3_median	0.06230823198954264
sim_compute_robot_state-npc3_min	0.060644588773212736
sim_compute_sim_state_max	0.03918901242707905
sim_compute_sim_state_mean	0.03666194120834827
sim_compute_sim_state_median	0.03630462118015168
sim_compute_sim_state_min	0.03417824444017912
sim_physics_max	0.043116207476015446
sim_physics_mean	0.04214661375528136
sim_physics_median	0.04200396412297299
sim_physics_min	0.04097558770860944
sim_render-ego_max	0.06470039016322086
sim_render-ego_mean	0.060747591162894986
sim_render-ego_median	0.06108865914521394
sim_render-ego_min	0.05659602937244233
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19744

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 07:45:29+00:00

2019-04-25 08:00:03+00:00

0:14:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19718

3038

challenge-aido_LF-template-pytorch

step1-simulation

error