AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 807

evaluator807
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2470
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success28
# timeout
# failed2
# error29
# aborted
# host-error7
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)
Disk (MB)96.9 GB
Disk available (MB)
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable0
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
206893089Claudio RuchJava template from Webinaraido2-AMOD-efficiencystep2-scoringsuccessyes8070:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-74.6809614848012


other stats
fleet_size-1000000000
service_quality-35.08491037120022
206753084Claudio RuchJava templateaido2-AMOD-efficiencystep2-scoringsuccessyes8070:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-63.52735013403736


other stats
fleet_size-1000000000
service_quality-32.41278753350997
206633080Andrea CensiJava templateaido2-AMOD-efficiencystep1-simulationsuccessyes8070:03:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
206613074Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationsuccessno8070:18:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6282321272354099
survival_time_median10.90000000000002
deviation-center-line_median0.5403153727644442
in-drivable-lane_median3.6500000000000377


other stats
agent_compute-ego_max0.1547117590904236
agent_compute-ego_mean0.15053917287021337
agent_compute-ego_median0.15185930013656615
agent_compute-ego_min0.14239349597837866
deviation-center-line_max0.6105787967404427
deviation-center-line_mean0.5384827545165862
deviation-center-line_min0.4548514945128936
deviation-heading_max1.6621628477961958
deviation-heading_mean1.383384238369865
deviation-heading_median1.5570045941153134
deviation-heading_min1.0283750089973105
driven_any_max1.376542059212302
driven_any_mean0.9592128797142294
driven_any_median0.9927746886797696
driven_any_min0.5124994683118874
driven_lanedir_consec_max0.8157672168037178
driven_lanedir_consec_mean0.6541870786684613
driven_lanedir_consec_min0.5036860688845833
driven_lanedir_max0.8157672168037178
driven_lanedir_mean0.6541870786684613
driven_lanedir_median0.6282321272354099
driven_lanedir_min0.5036860688845833
in-drivable-lane_max5.9500000000000846
in-drivable-lane_mean3.080000000000041
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9927746886797696, "sim_physics": 0.10915652655680246, "survival_time": 10.90000000000002, "driven_lanedir": 0.6282321272354099, "sim_render-ego": 0.04541537302349685, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.15076261266655877, "deviation-heading": 1.0283750089973105, "set_robot_commands": 0.06901953745325771, "deviation-center-line": 0.5403153727644442, "driven_lanedir_consec": 0.6282321272354099, "sim_compute_sim_state": 0.02821848042514346, "sim_compute_performance-ego": 0.049983511277295035, "sim_compute_robot_state-ego": 0.05046296557155224, "sim_compute_robot_state-npc0": 0.051780968631079435, "sim_compute_robot_state-npc1": 0.05106677921540147, "sim_compute_robot_state-npc2": 0.05034259809266536, "sim_compute_robot_state-npc3": 0.05070418283480023}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5392619924422878, "sim_physics": 0.11063583498078632, "survival_time": 6.149999999999986, "driven_lanedir": 0.5197856906625655, "sim_render-ego": 0.043355951464273096, "in-drivable-lane": 0, "agent_compute-ego": 0.14239349597837866, "deviation-heading": 1.6621628477961958, "set_robot_commands": 0.06475287918152849, "deviation-center-line": 0.4548514945128936, "driven_lanedir_consec": 0.5197856906625655, "sim_compute_sim_state": 0.02692621704039535, "sim_compute_performance-ego": 0.04700404647889176, "sim_compute_robot_state-ego": 0.04853136558842853, "sim_compute_robot_state-npc0": 0.04922170755339832, "sim_compute_robot_state-npc1": 0.04781114182821134, "sim_compute_robot_state-npc2": 0.04791174477678004, "sim_compute_robot_state-npc3": 0.04794671283504827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3749861899249, "sim_physics": 0.11340508143107096, "survival_time": 14.950000000000076, "driven_lanedir": 0.8157672168037178, "sim_render-ego": 0.04615701834360759, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.1547117590904236, "deviation-heading": 1.5872718172175444, "set_robot_commands": 0.0705399489402771, "deviation-center-line": 0.6105787967404427, "driven_lanedir_consec": 0.8157672168037178, "sim_compute_sim_state": 0.028369417985280355, "sim_compute_performance-ego": 0.05027927954991659, "sim_compute_robot_state-ego": 0.050656624635060626, "sim_compute_robot_state-npc0": 0.051403610706329345, "sim_compute_robot_state-npc1": 0.04982913573582967, "sim_compute_robot_state-npc2": 0.05027932167053223, "sim_compute_robot_state-npc3": 0.050495954354604085}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.376542059212302, "sim_physics": 0.11546786546707154, "survival_time": 14.950000000000076, "driven_lanedir": 0.8034642897560298, "sim_render-ego": 0.048964192072550455, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.15185930013656615, "deviation-heading": 1.5570045941153134, "set_robot_commands": 0.07046917041142782, "deviation-center-line": 0.5992765974333993, "driven_lanedir_consec": 0.8034642897560298, "sim_compute_sim_state": 0.029780821005503336, "sim_compute_performance-ego": 0.05032448530197144, "sim_compute_robot_state-ego": 0.051364893913269045, "sim_compute_robot_state-npc0": 0.05298401037851969, "sim_compute_robot_state-npc1": 0.051656442483266195, "sim_compute_robot_state-npc2": 0.05092855294545492, "sim_compute_robot_state-npc3": 0.05189839204152425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5124994683118874, "sim_physics": 0.11282369186138284, "survival_time": 5.799999999999987, "driven_lanedir": 0.5036860688845833, "sim_render-ego": 0.04718510652410573, "in-drivable-lane": 0, "agent_compute-ego": 0.15296869647913966, "deviation-heading": 1.08210692372296, "set_robot_commands": 0.07443946188893812, "deviation-center-line": 0.4873915111317512, "driven_lanedir_consec": 0.5036860688845833, "sim_compute_sim_state": 0.02834265396512788, "sim_compute_performance-ego": 0.051210689133611216, "sim_compute_robot_state-ego": 0.05349702054056628, "sim_compute_robot_state-npc0": 0.05238999580514842, "sim_compute_robot_state-npc1": 0.05111140423807605, "sim_compute_robot_state-npc2": 0.05043402211419467, "sim_compute_robot_state-npc3": 0.049755287581476675}}
set_robot_commands_max0.07443946188893812
set_robot_commands_mean0.06984419957508585
set_robot_commands_median0.07046917041142782
set_robot_commands_min0.06475287918152849
sim_compute_performance-ego_max0.051210689133611216
sim_compute_performance-ego_mean0.04976040234833721
sim_compute_performance-ego_median0.05027927954991659
sim_compute_performance-ego_min0.04700404647889176
sim_compute_robot_state-ego_max0.05349702054056628
sim_compute_robot_state-ego_mean0.05090257404977534
sim_compute_robot_state-ego_median0.050656624635060626
sim_compute_robot_state-ego_min0.04853136558842853
sim_compute_robot_state-npc0_max0.05298401037851969
sim_compute_robot_state-npc0_mean0.05155605861489504
sim_compute_robot_state-npc0_median0.051780968631079435
sim_compute_robot_state-npc0_min0.04922170755339832
sim_compute_robot_state-npc1_max0.051656442483266195
sim_compute_robot_state-npc1_mean0.05029498070015694
sim_compute_robot_state-npc1_median0.05106677921540147
sim_compute_robot_state-npc1_min0.04781114182821134
sim_compute_robot_state-npc2_max0.05092855294545492
sim_compute_robot_state-npc2_mean0.049979247919925446
sim_compute_robot_state-npc2_median0.05034259809266536
sim_compute_robot_state-npc2_min0.04791174477678004
sim_compute_robot_state-npc3_max0.05189839204152425
sim_compute_robot_state-npc3_mean0.050160105929490696
sim_compute_robot_state-npc3_median0.050495954354604085
sim_compute_robot_state-npc3_min0.04794671283504827
sim_compute_sim_state_max0.029780821005503336
sim_compute_sim_state_mean0.02832751808429008
sim_compute_sim_state_median0.02834265396512788
sim_compute_sim_state_min0.02692621704039535
sim_physics_max0.11546786546707154
sim_physics_mean0.11229780005942284
sim_physics_median0.11282369186138284
sim_physics_min0.10915652655680246
sim_render-ego_max0.048964192072550455
sim_render-ego_mean0.046215528285606745
sim_render-ego_median0.04615701834360759
sim_render-ego_min0.043355951464273096
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.55000000000003
survival_time_min5.799999999999987
206322403vguerraBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno8070:07:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08815722978948815
survival_time_median1.800000000000001
deviation-center-line_median0.06759128482153459
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.17485741111967298
agent_compute-ego_mean0.1636699282328288
agent_compute-ego_median0.16085152493582833
agent_compute-ego_min0.15666745730808804
deviation-center-line_max0.5947150110563205
deviation-center-line_mean0.1675445150536224
deviation-center-line_min0.03912403727176084
deviation-heading_max5.235813465809776
deviation-heading_mean1.6159005933450217
deviation-heading_median0.6996226549460283
deviation-heading_min0.6798633322706823
driven_any_max2.242642705482657
driven_any_mean0.5916615860222353
driven_any_median0.19911654739020512
driven_any_min0.10248218522851008
driven_lanedir_consec_max0.5081124182265015
driven_lanedir_consec_mean0.1644510172476035
driven_lanedir_consec_min0.06526533721991656
driven_lanedir_max0.5081124182265015
driven_lanedir_mean0.1644510172476035
driven_lanedir_median0.08815722978948815
driven_lanedir_min0.06526533721991656
in-drivable-lane_max8.950000000000067
in-drivable-lane_mean2.1100000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22677824346116215, "sim_physics": 0.10790665282143488, "survival_time": 1.800000000000001, "driven_lanedir": 0.08815722978948815, "sim_render-ego": 0.06705776188108656, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.17485741111967298, "deviation-heading": 0.7775570588512737, "set_robot_commands": 0.09886724419063991, "deviation-center-line": 0.06759128482153459, "driven_lanedir_consec": 0.08815722978948815, "sim_compute_sim_state": 0.04192372825410631, "sim_compute_performance-ego": 0.07140382793214586, "sim_compute_robot_state-ego": 0.07824756039513482}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19911654739020512, "sim_physics": 0.10265554984410603, "survival_time": 1.800000000000001, "driven_lanedir": 0.0937347669274905, "sim_render-ego": 0.05737366278966268, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16085152493582833, "deviation-heading": 0.6996226549460283, "set_robot_commands": 0.0895894898308648, "deviation-center-line": 0.03963327966851285, "driven_lanedir_consec": 0.0937347669274905, "sim_compute_sim_state": 0.034775873025258384, "sim_compute_performance-ego": 0.06658173931969537, "sim_compute_robot_state-ego": 0.07701187663608128}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10248218522851008, "sim_physics": 0.0734486352829706, "survival_time": 1.0500000000000005, "driven_lanedir": 0.06526533721991656, "sim_render-ego": 0.05753600029718308, "in-drivable-lane": 0, "agent_compute-ego": 0.16736488115219844, "deviation-heading": 0.6866464548473458, "set_robot_commands": 0.08061483928135463, "deviation-center-line": 0.09665896244998325, "driven_lanedir_consec": 0.06526533721991656, "sim_compute_sim_state": 0.03609116872151693, "sim_compute_performance-ego": 0.06399190993536086, "sim_compute_robot_state-ego": 0.06689918608892531}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.242642705482657, "sim_physics": 0.11721322298049928, "survival_time": 14.950000000000076, "driven_lanedir": 0.5081124182265015, "sim_render-ego": 0.05780451615651449, "in-drivable-lane": 8.950000000000067, "agent_compute-ego": 0.15860836664835612, "deviation-heading": 5.235813465809776, "set_robot_commands": 0.08684628407160441, "deviation-center-line": 0.5947150110563205, "driven_lanedir_consec": 0.5081124182265015, "sim_compute_sim_state": 0.0363958740234375, "sim_compute_performance-ego": 0.06451934655507406, "sim_compute_robot_state-ego": 0.06719267686208089}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18728824854864237, "sim_physics": 0.0974090576171875, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0669853340746207, "sim_render-ego": 0.060436889103480745, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15666745730808804, "deviation-heading": 0.6798633322706823, "set_robot_commands": 0.08873304639543805, "deviation-center-line": 0.03912403727176084, "driven_lanedir_consec": 0.0669853340746207, "sim_compute_sim_state": 0.035951757431030275, "sim_compute_performance-ego": 0.06761046818324498, "sim_compute_robot_state-ego": 0.0672299861907959}}
set_robot_commands_max0.09886724419063991
set_robot_commands_mean0.08893018075398038
set_robot_commands_median0.08873304639543805
set_robot_commands_min0.08061483928135463
sim_compute_performance-ego_max0.07140382793214586
sim_compute_performance-ego_mean0.06682145838510423
sim_compute_performance-ego_median0.06658173931969537
sim_compute_performance-ego_min0.06399190993536086
sim_compute_robot_state-ego_max0.07824756039513482
sim_compute_robot_state-ego_mean0.07131625723460364
sim_compute_robot_state-ego_median0.0672299861907959
sim_compute_robot_state-ego_min0.06689918608892531
sim_compute_sim_state_max0.04192372825410631
sim_compute_sim_state_mean0.03702768029106989
sim_compute_sim_state_median0.03609116872151693
sim_compute_sim_state_min0.034775873025258384
sim_physics_max0.11721322298049928
sim_physics_mean0.09972662370923964
sim_physics_median0.10265554984410603
sim_physics_min0.0734486352829706
sim_render-ego_max0.06705776188108656
sim_render-ego_mean0.06004176604558551
sim_render-ego_median0.05780451615651449
sim_render-ego_min0.05737366278966268
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.270000000000016
survival_time_min1.0500000000000005
206182362Andrea Censirandom_agentaido2-LF-sim-testingstep1-simulationsuccessno8070:05:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.576224177547854
survival_time_median2.5999999999999988
deviation-center-line_median0.14883191153694192
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.16350172600656185
agent_compute-ego_mean0.13922414268076255
agent_compute-ego_median0.13274737810477233
agent_compute-ego_min0.12285497453477648
deviation-center-line_max0.2616907164891491
deviation-center-line_mean0.14783547886832604
deviation-center-line_min0.082953742710957
deviation-heading_max0.5845520464047074
deviation-heading_mean0.33155245513961573
deviation-heading_median0.2409964306091145
deviation-heading_min0.19231746951364015
driven_any_max1.6077077287168993
driven_any_mean0.8622724108020788
driven_any_median1.006879208370262
driven_any_min0.25817502165929507
driven_lanedir_consec_max1.104102494174326
driven_lanedir_consec_mean0.6287232488539246
driven_lanedir_consec_min0.2479316890295844
driven_lanedir_max1.104102494174326
driven_lanedir_mean0.6287232488539246
driven_lanedir_median0.576224177547854
driven_lanedir_min0.2479316890295844
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.4699999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.12433961652359872, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.07439141453437086, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16350172600656185, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1231205868271162, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04662673428373517, "sim_compute_performance-ego": 0.08040378228673395, "sim_compute_robot_state-ego": 0.08479504315358288}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.11051710293843196, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06575323985173152, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15055609207886916, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.10613842193896954, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.04108802171853872, "sim_compute_performance-ego": 0.07307499188643235, "sim_compute_robot_state-ego": 0.08000433444976807}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.07664158609178331, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05836166275872125, "in-drivable-lane": 0, "agent_compute-ego": 0.12285497453477648, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.08863393465677898, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.03694423039754232, "sim_compute_performance-ego": 0.07068133354187012, "sim_compute_robot_state-ego": 0.07095661428239611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.08876690864562989, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.05566856384277344, "in-drivable-lane": 0, "agent_compute-ego": 0.126460542678833, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.08636988639831543, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03278533935546875, "sim_compute_performance-ego": 0.06066613197326661, "sim_compute_robot_state-ego": 0.06742000579833984}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09015853588397686, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06023748104388897, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13274737810477233, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.095022656978705, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03873794201092842, "sim_compute_performance-ego": 0.06641530684935741, "sim_compute_robot_state-ego": 0.07290331522623698}}
set_robot_commands_max0.1231205868271162
set_robot_commands_mean0.09985709735997704
set_robot_commands_median0.095022656978705
set_robot_commands_min0.08636988639831543
sim_compute_performance-ego_max0.08040378228673395
sim_compute_performance-ego_mean0.07024830930753209
sim_compute_performance-ego_median0.07068133354187012
sim_compute_performance-ego_min0.06066613197326661
sim_compute_robot_state-ego_max0.08479504315358288
sim_compute_robot_state-ego_mean0.07521586258206478
sim_compute_robot_state-ego_median0.07290331522623698
sim_compute_robot_state-ego_min0.06742000579833984
sim_compute_sim_state_max0.04662673428373517
sim_compute_sim_state_mean0.03923645355324267
sim_compute_sim_state_median0.03873794201092842
sim_compute_sim_state_min0.03278533935546875
sim_physics_max0.12433961652359872
sim_physics_mean0.09808475001668414
sim_physics_median0.09015853588397686
sim_physics_min0.07664158609178331
sim_render-ego_max0.07439141453437086
sim_render-ego_mean0.06288247240629721
sim_render-ego_median0.06023748104388897
sim_render-ego_min0.05566856384277344
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean2.259999999999999
survival_time_min0.9000000000000002
206032388Andrea CensiBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationhost-errorno8070:08:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20603-709667', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
205902404vguerraBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno8070:05:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08608637141076136
survival_time_median1.1500000000000004
deviation-center-line_median0.06462114159355194
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1819150447845459
agent_compute-ego_mean0.16853446500391142
agent_compute-ego_median0.16627250546994415
agent_compute-ego_min0.15786896032445571
deviation-center-line_max0.09657332316428484
deviation-center-line_mean0.07546722419693404
deviation-center-line_min0.05925304510034487
deviation-heading_max0.8833154358597554
deviation-heading_mean0.690690990978047
deviation-heading_median0.7226491021144509
deviation-heading_min0.5117278481717907
driven_any_max0.2063552121752718
driven_any_mean0.16215647597903612
driven_any_median0.14600915371263687
driven_any_min0.12143843683801338
driven_lanedir_consec_max0.10008224496005712
driven_lanedir_consec_mean0.08158301581984477
driven_lanedir_consec_min0.048097810517388595
driven_lanedir_max0.10008224496005712
driven_lanedir_mean0.08158301581984477
driven_lanedir_median0.08608637141076136
driven_lanedir_min0.048097810517388595
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.17000000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2063552121752718, "sim_physics": 0.1431970806682811, "survival_time": 1.7000000000000008, "driven_lanedir": 0.048097810517388595, "sim_render-ego": 0.059599630972918344, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15786896032445571, "deviation-heading": 0.7226491021144509, "set_robot_commands": 0.08612547201268814, "deviation-center-line": 0.060533321082424894, "driven_lanedir_consec": 0.048097810517388595, "sim_compute_sim_state": 0.03608421718373018, "sim_compute_performance-ego": 0.06371158010819379, "sim_compute_robot_state-ego": 0.06721749025232651, "sim_compute_robot_state-npc0": 0.06413578987121582, "sim_compute_robot_state-npc1": 0.06467981899485868, "sim_compute_robot_state-npc2": 0.06441653476041906, "sim_compute_robot_state-npc3": 0.06375759489396039}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19996387693293816, "sim_physics": 0.13530552798304066, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0891732000470129, "sim_render-ego": 0.054971875815555966, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.16010366637131265, "deviation-heading": 0.8833154358597554, "set_robot_commands": 0.09042597639149633, "deviation-center-line": 0.06462114159355194, "driven_lanedir_consec": 0.0891732000470129, "sim_compute_sim_state": 0.035666194455376984, "sim_compute_performance-ego": 0.06617554302873283, "sim_compute_robot_state-ego": 0.07387630692843733, "sim_compute_robot_state-npc0": 0.06807429215003705, "sim_compute_robot_state-npc1": 0.06295451624640103, "sim_compute_robot_state-npc2": 0.06008425252190951, "sim_compute_robot_state-npc3": 0.06214701718297498}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12143843683801338, "sim_physics": 0.14281357418407092, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08447545216400387, "sim_render-ego": 0.06332098353992809, "in-drivable-lane": 0, "agent_compute-ego": 0.1819150447845459, "deviation-heading": 0.5273487611089064, "set_robot_commands": 0.10490853136236016, "deviation-center-line": 0.09657332316428484, "driven_lanedir_consec": 0.08447545216400387, "sim_compute_sim_state": 0.03887631676413796, "sim_compute_performance-ego": 0.0676980885592374, "sim_compute_robot_state-ego": 0.07229564406655052, "sim_compute_robot_state-npc0": 0.07462741028178822, "sim_compute_robot_state-npc1": 0.07138252258300781, "sim_compute_robot_state-npc2": 0.07146584987640381, "sim_compute_robot_state-npc3": 0.0683584213256836}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1370157002363204, "sim_physics": 0.13679905559705652, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10008224496005712, "sim_render-ego": 0.058817967124607254, "in-drivable-lane": 0, "agent_compute-ego": 0.16627250546994415, "deviation-heading": 0.5117278481717907, "set_robot_commands": 0.09416382209114406, "deviation-center-line": 0.0963552900440636, "driven_lanedir_consec": 0.10008224496005712, "sim_compute_sim_state": 0.03703830553137738, "sim_compute_performance-ego": 0.06223340656446374, "sim_compute_robot_state-ego": 0.06932580989340077, "sim_compute_robot_state-npc0": 0.06895870747773544, "sim_compute_robot_state-npc1": 0.06537127494812012, "sim_compute_robot_state-npc2": 0.061203386472619095, "sim_compute_robot_state-npc3": 0.06477655535158904}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14600915371263687, "sim_physics": 0.14111814291580865, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08608637141076136, "sim_render-ego": 0.06714579333429752, "in-drivable-lane": 0, "agent_compute-ego": 0.1765121480692988, "deviation-heading": 0.8084138076353312, "set_robot_commands": 0.09657003568566364, "deviation-center-line": 0.05925304510034487, "driven_lanedir_consec": 0.08608637141076136, "sim_compute_sim_state": 0.04322249993034031, "sim_compute_performance-ego": 0.07007731562075407, "sim_compute_robot_state-ego": 0.07602518537770146, "sim_compute_robot_state-npc0": 0.07154242888740871, "sim_compute_robot_state-npc1": 0.07479684249214504, "sim_compute_robot_state-npc2": 0.07536585434623387, "sim_compute_robot_state-npc3": 0.07534471802089525}}
set_robot_commands_max0.10490853136236016
set_robot_commands_mean0.09443876750867046
set_robot_commands_median0.09416382209114406
set_robot_commands_min0.08612547201268814
sim_compute_performance-ego_max0.07007731562075407
sim_compute_performance-ego_mean0.06597918677627637
sim_compute_performance-ego_median0.06617554302873283
sim_compute_performance-ego_min0.06223340656446374
sim_compute_robot_state-ego_max0.07602518537770146
sim_compute_robot_state-ego_mean0.07174808730368332
sim_compute_robot_state-ego_median0.07229564406655052
sim_compute_robot_state-ego_min0.06721749025232651
sim_compute_robot_state-npc0_max0.07462741028178822
sim_compute_robot_state-npc0_mean0.06946772573363705
sim_compute_robot_state-npc0_median0.06895870747773544
sim_compute_robot_state-npc0_min0.06413578987121582
sim_compute_robot_state-npc1_max0.07479684249214504
sim_compute_robot_state-npc1_mean0.06783699505290654
sim_compute_robot_state-npc1_median0.06537127494812012
sim_compute_robot_state-npc1_min0.06295451624640103
sim_compute_robot_state-npc2_max0.07536585434623387
sim_compute_robot_state-npc2_mean0.06650717559551708
sim_compute_robot_state-npc2_median0.06441653476041906
sim_compute_robot_state-npc2_min0.06008425252190951
sim_compute_robot_state-npc3_max0.07534471802089525
sim_compute_robot_state-npc3_mean0.06687686135502066
sim_compute_robot_state-npc3_median0.06477655535158904
sim_compute_robot_state-npc3_min0.06214701718297498
sim_compute_sim_state_max0.04322249993034031
sim_compute_sim_state_mean0.038177506772992566
sim_compute_sim_state_median0.03703830553137738
sim_compute_sim_state_min0.035666194455376984
sim_physics_max0.1431970806682811
sim_physics_mean0.13984667626965158
sim_physics_median0.14111814291580865
sim_physics_min0.13530552798304066
sim_render-ego_max0.06714579333429752
sim_render-ego_mean0.06077125015746143
sim_render-ego_median0.059599630972918344
sim_render-ego_min0.054971875815555966
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.3100000000000005
survival_time_min1.1000000000000003
205842407vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno8070:07:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1061041434176222
survival_time_median1.3500000000000003
deviation-center-line_median0.06930232162918272
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2017465463051429
agent_compute-ego_mean0.17310659427075953
agent_compute-ego_median0.1662852668762207
agent_compute-ego_min0.14684929992213394
deviation-center-line_max0.11767564172694953
deviation-center-line_mean0.083259459980928
deviation-center-line_min0.05269733773263336
deviation-heading_max0.9265300455380044
deviation-heading_mean0.7141511232513374
deviation-heading_median0.7680567502641477
deviation-heading_min0.46543968436588146
driven_any_max0.2481778772764457
driven_any_mean0.18486876827987136
driven_any_median0.1840451209683768
driven_any_min0.14427978563022456
driven_lanedir_consec_max0.15573292360028956
driven_lanedir_consec_mean0.10339122262623386
driven_lanedir_consec_min0.06126924626986163
driven_lanedir_max0.15573292360028956
driven_lanedir_mean0.10339122262623386
driven_lanedir_median0.1061041434176222
driven_lanedir_min0.06126924626986163
in-drivable-lane_max0.6500000000000004
in-drivable-lane_mean0.25000000000000017
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2481778772764457, "sim_physics": 0.1989002585411072, "survival_time": 2.000000000000001, "driven_lanedir": 0.1061041434176222, "sim_render-ego": 0.06584365367889404, "in-drivable-lane": 0.6500000000000004, "agent_compute-ego": 0.1938116133213043, "deviation-heading": 0.7680567502641477, "set_robot_commands": 0.09929092526435852, "deviation-center-line": 0.06930232162918272, "driven_lanedir_consec": 0.1061041434176222, "sim_compute_sim_state": 0.04315050840377808, "sim_compute_performance-ego": 0.07054314017295837, "sim_compute_robot_state-ego": 0.07680444717407227, "sim_compute_robot_state-npc0": 0.07286195755004883, "sim_compute_robot_state-npc1": 0.07671245336532592, "sim_compute_robot_state-npc2": 0.07415735721588135, "sim_compute_robot_state-npc3": 0.0755180537700653}, "udem1-1-0": {"driven_any": 0.20158961364655592, "sim_physics": 0.1652576273137873, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06126924626986163, "sim_render-ego": 0.0632397984013413, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.14684929992213394, "deviation-heading": 0.7767641333955604, "set_robot_commands": 0.09033843965241405, "deviation-center-line": 0.05269733773263336, "driven_lanedir_consec": 0.06126924626986163, "sim_compute_sim_state": 0.038523710135257606, "sim_compute_performance-ego": 0.06264362190708969, "sim_compute_robot_state-ego": 0.06014321067116477, "sim_compute_robot_state-npc0": 0.06964852593161842, "sim_compute_robot_state-npc1": 0.0662772510990952, "sim_compute_robot_state-npc2": 0.0633152470444188, "sim_compute_robot_state-npc3": 0.06534118363351533}, "udem1-2-0": {"driven_any": 0.14625144387775366, "sim_physics": 0.17705817575807925, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11318786352006605, "sim_render-ego": 0.054763237635294594, "in-drivable-lane": 0, "agent_compute-ego": 0.15684024492899576, "deviation-heading": 0.6339650026930927, "set_robot_commands": 0.08990264821935583, "deviation-center-line": 0.11767564172694953, "driven_lanedir_consec": 0.11318786352006605, "sim_compute_sim_state": 0.03820167647467719, "sim_compute_performance-ego": 0.0631814267900255, "sim_compute_robot_state-ego": 0.06249383643821434, "sim_compute_robot_state-npc0": 0.06829757160610622, "sim_compute_robot_state-npc1": 0.07076557477315266, "sim_compute_robot_state-npc2": 0.06487326268796567, "sim_compute_robot_state-npc3": 0.06759007771809895}, "udem1-3-0": {"driven_any": 0.1840451209683768, "sim_physics": 0.21292604849888727, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15573292360028956, "sim_render-ego": 0.06701433658599854, "in-drivable-lane": 0, "agent_compute-ego": 0.2017465463051429, "deviation-heading": 0.46543968436588146, "set_robot_commands": 0.10961776513319749, "deviation-center-line": 0.11047284309847268, "driven_lanedir_consec": 0.15573292360028956, "sim_compute_sim_state": 0.04317041543813852, "sim_compute_performance-ego": 0.07568661066202018, "sim_compute_robot_state-ego": 0.07792399479792668, "sim_compute_robot_state-npc0": 0.07628089648026687, "sim_compute_robot_state-npc1": 0.0769262038744413, "sim_compute_robot_state-npc2": 0.07556439363039456, "sim_compute_robot_state-npc3": 0.07558724513420692}, "udem1-4-0": {"driven_any": 0.14427978563022456, "sim_physics": 0.15411264419555665, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08066193632332985, "sim_render-ego": 0.05874455451965332, "in-drivable-lane": 0, "agent_compute-ego": 0.1662852668762207, "deviation-heading": 0.9265300455380044, "set_robot_commands": 0.08785685539245605, "deviation-center-line": 0.0661491557174017, "driven_lanedir_consec": 0.08066193632332985, "sim_compute_sim_state": 0.037284040451049806, "sim_compute_performance-ego": 0.069024076461792, "sim_compute_robot_state-ego": 0.07206304550170899, "sim_compute_robot_state-npc0": 0.06323307991027832, "sim_compute_robot_state-npc1": 0.061248559951782224, "sim_compute_robot_state-npc2": 0.0635935401916504, "sim_compute_robot_state-npc3": 0.06384636878967286}}
set_robot_commands_max0.10961776513319749
set_robot_commands_mean0.0954013267323564
set_robot_commands_median0.09033843965241405
set_robot_commands_min0.08785685539245605
sim_compute_performance-ego_max0.07568661066202018
sim_compute_performance-ego_mean0.06821577519877715
sim_compute_performance-ego_median0.069024076461792
sim_compute_performance-ego_min0.06264362190708969
sim_compute_robot_state-ego_max0.07792399479792668
sim_compute_robot_state-ego_mean0.06988570691661741
sim_compute_robot_state-ego_median0.07206304550170899
sim_compute_robot_state-ego_min0.06014321067116477
sim_compute_robot_state-npc0_max0.07628089648026687
sim_compute_robot_state-npc0_mean0.07006440629566374
sim_compute_robot_state-npc0_median0.06964852593161842
sim_compute_robot_state-npc0_min0.06323307991027832
sim_compute_robot_state-npc1_max0.0769262038744413
sim_compute_robot_state-npc1_mean0.07038600861275945
sim_compute_robot_state-npc1_median0.07076557477315266
sim_compute_robot_state-npc1_min0.061248559951782224
sim_compute_robot_state-npc2_max0.07556439363039456
sim_compute_robot_state-npc2_mean0.06830076015406214
sim_compute_robot_state-npc2_median0.06487326268796567
sim_compute_robot_state-npc2_min0.0633152470444188
sim_compute_robot_state-npc3_max0.07558724513420692
sim_compute_robot_state-npc3_mean0.06957658580911188
sim_compute_robot_state-npc3_median0.06759007771809895
sim_compute_robot_state-npc3_min0.06384636878967286
sim_compute_sim_state_max0.04317041543813852
sim_compute_sim_state_mean0.04006607018058024
sim_compute_sim_state_median0.038523710135257606
sim_compute_sim_state_min0.037284040451049806
sim_physics_max0.21292604849888727
sim_physics_mean0.18165095086148356
sim_physics_median0.17705817575807925
sim_physics_min0.15411264419555665
sim_render-ego_max0.06701433658599854
sim_render-ego_mean0.06192111616423636
sim_render-ego_median0.0632397984013413
sim_render-ego_min0.054763237635294594
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.5100000000000005
survival_time_min1.2500000000000004
205592446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno8070:23:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3397390356601346
survival_time_median14.950000000000076
deviation-center-line_median1.401141803909748
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.16138179381688436
agent_compute-ego_mean0.1544363842010498
agent_compute-ego_median0.15614225546518962
agent_compute-ego_min0.14178179423014323
deviation-center-line_max1.5194332589791988
deviation-center-line_mean1.1743762518416452
deviation-center-line_min0.26891847472491964
deviation-heading_max8.492476633385415
deviation-heading_mean7.583649780851511
deviation-heading_median8.165190079878816
deviation-heading_min5.589657549909816
driven_any_max4.378320939674851
driven_any_mean4.378320939674839
driven_any_median4.3783209396748415
driven_any_min4.378320939674831
driven_lanedir_consec_max-1.3111163275808764
driven_lanedir_consec_mean-1.342604284062788
driven_lanedir_consec_min-1.3761077892801137
driven_lanedir_max-1.3397390356601346
driven_lanedir_mean-2.354812195437246
driven_lanedir_median-2.597977359892488
driven_lanedir_min-2.711272268924253
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.570000000000019
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.11867382605870563, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.061295249462127686, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15907333294550577, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09471826314926148, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.039498422940572105, "sim_compute_performance-ego": 0.06658160924911499, "sim_compute_robot_state-ego": 0.07134103298187255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.09986755688985188, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.05394635279973348, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.14178179423014323, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.0860521109898885, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.03407214959462484, "sim_compute_performance-ego": 0.061092854340871174, "sim_compute_robot_state-ego": 0.06848312218983968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.11246212402979532, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.059262658754984536, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.16138179381688436, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.08992591301600138, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.03743815183639526, "sim_compute_performance-ego": 0.06525811115900676, "sim_compute_robot_state-ego": 0.07070332606633505}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11153515418370565, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.05833609660466512, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.15614225546518962, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.08980220397313436, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03662278811136881, "sim_compute_performance-ego": 0.06377999464670817, "sim_compute_robot_state-ego": 0.06868614276250204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.1111218245824178, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.05714348872502645, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.15380274454752604, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.08649130423863728, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.035748157501220706, "sim_compute_performance-ego": 0.0633875584602356, "sim_compute_robot_state-ego": 0.06745607852935791}}
set_robot_commands_max0.09471826314926148
set_robot_commands_mean0.0893979590733846
set_robot_commands_median0.08980220397313436
set_robot_commands_min0.0860521109898885
sim_compute_performance-ego_max0.06658160924911499
sim_compute_performance-ego_mean0.06402002557118733
sim_compute_performance-ego_median0.06377999464670817
sim_compute_performance-ego_min0.061092854340871174
sim_compute_robot_state-ego_max0.07134103298187255
sim_compute_robot_state-ego_mean0.06933394050598143
sim_compute_robot_state-ego_median0.06868614276250204
sim_compute_robot_state-ego_min0.06745607852935791
sim_compute_sim_state_max0.039498422940572105
sim_compute_sim_state_mean0.036675933996836343
sim_compute_sim_state_median0.03662278811136881
sim_compute_sim_state_min0.03407214959462484
sim_physics_max0.11867382605870563
sim_physics_mean0.11073209714889524
sim_physics_median0.11153515418370565
sim_physics_min0.09986755688985188
sim_render-ego_max0.061295249462127686
sim_render-ego_mean0.057996769269307455
sim_render-ego_median0.05833609660466512
sim_render-ego_min0.05394635279973348
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
205392476Liam Paullchallenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessno8070:08:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7060476436119825
survival_time_median2.9499999999999975
deviation-center-line_median0.11000911211661404
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15229589939117433
agent_compute-ego_mean0.14431240450000343
agent_compute-ego_median0.14749660581912635
agent_compute-ego_min0.13055876890818277
deviation-center-line_max0.2756124593780862
deviation-center-line_mean0.14761657707365936
deviation-center-line_min0.05521015531316102
deviation-heading_max1.16360603086641
deviation-heading_mean0.4999185982159845
deviation-heading_median0.3379975413110555
deviation-heading_min0.23494529737543027
driven_any_max2.1872512115945857
driven_any_mean1.055944540531118
driven_any_median1.167808122478256
driven_any_min0.3209290725136122
driven_lanedir_consec_max0.9419039350715476
driven_lanedir_consec_mean0.6173219551829218
driven_lanedir_consec_min0.30305117192114617
driven_lanedir_max1.1635498459086595
driven_lanedir_mean0.6971981394313693
driven_lanedir_median0.7060476436119825
driven_lanedir_min0.30305117192114617
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1673862596727767, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.058809212918551464, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14749660581912635, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0910801977481482, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03758765166660525, "sim_compute_performance-ego": 0.06624426256935552, "sim_compute_robot_state-ego": 0.06982349899579894, "sim_compute_robot_state-npc0": 0.06737172828530366, "sim_compute_robot_state-npc1": 0.06807965827438067, "sim_compute_robot_state-npc2": 0.06646648442970132, "sim_compute_robot_state-npc3": 0.06733904694611172}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1325227121512095, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0555245578289032, "in-drivable-lane": 0, "agent_compute-ego": 0.13055876890818277, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08149820566177368, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03551695744196574, "sim_compute_performance-ego": 0.056304991245269775, "sim_compute_robot_state-ego": 0.0636179546515147, "sim_compute_robot_state-npc0": 0.05872394641240438, "sim_compute_robot_state-npc1": 0.05962708592414856, "sim_compute_robot_state-npc2": 0.0607814093430837, "sim_compute_robot_state-npc3": 0.05981533726056417}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16751879756733523, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06240136744612354, "in-drivable-lane": 0, "agent_compute-ego": 0.15060061519428836, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09082206224991105, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03775790586309918, "sim_compute_performance-ego": 0.06940381405717236, "sim_compute_robot_state-ego": 0.07079132532669326, "sim_compute_robot_state-npc0": 0.0672377166101488, "sim_compute_robot_state-npc1": 0.06532197079416048, "sim_compute_robot_state-npc2": 0.06442651910296941, "sim_compute_robot_state-npc3": 0.06395639403391692}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.17007670968265856, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05830424518908484, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14061013318724552, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09006859488406424, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03925511796595687, "sim_compute_performance-ego": 0.06301033294807046, "sim_compute_robot_state-ego": 0.0687178312721899, "sim_compute_robot_state-npc0": 0.06594339063612081, "sim_compute_robot_state-npc1": 0.06826176885831153, "sim_compute_robot_state-npc2": 0.06628026800640559, "sim_compute_robot_state-npc3": 0.0695900149264578}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1364813804626465, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.0635748028755188, "in-drivable-lane": 0, "agent_compute-ego": 0.15229589939117433, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0926251769065857, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0491624116897583, "sim_compute_performance-ego": 0.07009050846099854, "sim_compute_robot_state-ego": 0.07372802495956421, "sim_compute_robot_state-npc0": 0.0677424430847168, "sim_compute_robot_state-npc1": 0.0676951289176941, "sim_compute_robot_state-npc2": 0.06438014507293702, "sim_compute_robot_state-npc3": 0.0652887463569641}}
set_robot_commands_max0.0926251769065857
set_robot_commands_mean0.08921884749009656
set_robot_commands_median0.09082206224991105
set_robot_commands_min0.08149820566177368
sim_compute_performance-ego_max0.07009050846099854
sim_compute_performance-ego_mean0.06501078185617333
sim_compute_performance-ego_median0.06624426256935552
sim_compute_performance-ego_min0.056304991245269775
sim_compute_robot_state-ego_max0.07372802495956421
sim_compute_robot_state-ego_mean0.06933572704115219
sim_compute_robot_state-ego_median0.06982349899579894
sim_compute_robot_state-ego_min0.0636179546515147
sim_compute_robot_state-npc0_max0.0677424430847168
sim_compute_robot_state-npc0_mean0.06540384500573888
sim_compute_robot_state-npc0_median0.0672377166101488
sim_compute_robot_state-npc0_min0.05872394641240438
sim_compute_robot_state-npc1_max0.06826176885831153
sim_compute_robot_state-npc1_mean0.06579712255373907
sim_compute_robot_state-npc1_median0.0676951289176941
sim_compute_robot_state-npc1_min0.05962708592414856
sim_compute_robot_state-npc2_max0.06646648442970132
sim_compute_robot_state-npc2_mean0.0644669651910194
sim_compute_robot_state-npc2_median0.06442651910296941
sim_compute_robot_state-npc2_min0.0607814093430837
sim_compute_robot_state-npc3_max0.0695900149264578
sim_compute_robot_state-npc3_mean0.06519790790480295
sim_compute_robot_state-npc3_median0.0652887463569641
sim_compute_robot_state-npc3_min0.05981533726056417
sim_compute_sim_state_max0.0491624116897583
sim_compute_sim_state_mean0.03985600892547707
sim_compute_sim_state_median0.03775790586309918
sim_compute_sim_state_min0.03551695744196574
sim_physics_max0.17007670968265856
sim_physics_mean0.15479717190732528
sim_physics_median0.1673862596727767
sim_physics_min0.1325227121512095
sim_render-ego_max0.0635748028755188
sim_render-ego_mean0.059722837251636365
sim_render-ego_median0.058809212918551464
sim_render-ego_min0.0555245578289032
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.679999999999997
survival_time_min1.0000000000000002
205172503RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrorno8070:03:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
205082511RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrorno8070:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204942536Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationerrorno8070:04:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204882540jp18813100494test for ppoaido2-LF-sim-testingstep1-simulationerrorno8070:02:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204732569AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessno8070:12:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48833540127088915
survival_time_median4.749999999999991
deviation-center-line_median0.206292958644122
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego_max0.06985245212431877
agent_compute-ego_mean0.06606155820294043
agent_compute-ego_median0.0661080001939273
agent_compute-ego_min0.06130549773364
deviation-center-line_max0.3912682651728664
deviation-center-line_mean0.23227387059090404
deviation-center-line_min0.11846104838828224
deviation-heading_max2.4601311411745157
deviation-heading_mean1.2781805872611902
deviation-heading_median1.3327642896506582
deviation-heading_min0.566903075639298
driven_any_max2.083583756004467
driven_any_mean1.3572645029063808
driven_any_median1.21492227445162
driven_any_min0.37688790065546496
driven_lanedir_consec_max1.307826359971858
driven_lanedir_consec_mean0.6703257890941815
driven_lanedir_consec_min0.3420979566210387
driven_lanedir_max1.699034370134248
driven_lanedir_mean0.78554370039537
driven_lanedir_median0.5549295175109604
driven_lanedir_min0.3420979566210387
in-drivable-lane_max3.749999999999987
in-drivable-lane_mean1.529999999999995
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.15488361770456488, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.05752167647535151, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.06901965628970753, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09041005914861504, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03797838904640891, "sim_compute_performance-ego": 0.06484072045846419, "sim_compute_robot_state-ego": 0.06600644100796092, "sim_compute_robot_state-npc0": 0.06832053173672069, "sim_compute_robot_state-npc1": 0.06902096217328851, "sim_compute_robot_state-npc2": 0.06792019172148271, "sim_compute_robot_state-npc3": 0.06666739962317726}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.18206663285532304, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06073248001836961, "in-drivable-lane": 0, "agent_compute-ego": 0.06985245212431877, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09962374164212134, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03958725160168063, "sim_compute_performance-ego": 0.06532813656714655, "sim_compute_robot_state-ego": 0.06847654619524556, "sim_compute_robot_state-npc0": 0.07399349827920237, "sim_compute_robot_state-npc1": 0.06860121603934996, "sim_compute_robot_state-npc2": 0.07388054170916157, "sim_compute_robot_state-npc3": 0.07428034659354918}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.1660807284903019, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.058730477136923066, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0661080001939273, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.08883213827796016, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.0368504524230957, "sim_compute_performance-ego": 0.06518496012856774, "sim_compute_robot_state-ego": 0.06887937437558005, "sim_compute_robot_state-npc0": 0.06540519295009316, "sim_compute_robot_state-npc1": 0.06417890812488312, "sim_compute_robot_state-npc2": 0.06277901906493707, "sim_compute_robot_state-npc3": 0.06478089643708358}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.16889375385485195, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.05798525057340923, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.06402218467310855, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.08848637530678197, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.03701082279807643, "sim_compute_performance-ego": 0.06617409304568642, "sim_compute_robot_state-ego": 0.06708127824883713, "sim_compute_robot_state-npc0": 0.06630960012737074, "sim_compute_robot_state-npc1": 0.0647829156172903, "sim_compute_robot_state-npc2": 0.06282997633281508, "sim_compute_robot_state-npc3": 0.06327394184313323}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.158968255553447, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.052807853255473394, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.06130549773364, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.08469315817658331, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.033325824939029317, "sim_compute_performance-ego": 0.058971982606699766, "sim_compute_robot_state-ego": 0.05998391500661071, "sim_compute_robot_state-npc0": 0.05965442556730458, "sim_compute_robot_state-npc1": 0.0599777211605663, "sim_compute_robot_state-npc2": 0.058206447413269906, "sim_compute_robot_state-npc3": 0.058056708792565574}}
set_robot_commands_max0.09962374164212134
set_robot_commands_mean0.09040909451041236
set_robot_commands_median0.08883213827796016
set_robot_commands_min0.08469315817658331
sim_compute_performance-ego_max0.06617409304568642
sim_compute_performance-ego_mean0.06409997856131293
sim_compute_performance-ego_median0.06518496012856774
sim_compute_performance-ego_min0.058971982606699766
sim_compute_robot_state-ego_max0.06887937437558005
sim_compute_robot_state-ego_mean0.06608551096684687
sim_compute_robot_state-ego_median0.06708127824883713
sim_compute_robot_state-ego_min0.05998391500661071
sim_compute_robot_state-npc0_max0.07399349827920237
sim_compute_robot_state-npc0_mean0.06673664973213832
sim_compute_robot_state-npc0_median0.06630960012737074
sim_compute_robot_state-npc0_min0.05965442556730458
sim_compute_robot_state-npc1_max0.06902096217328851
sim_compute_robot_state-npc1_mean0.06531234462307564
sim_compute_robot_state-npc1_median0.0647829156172903
sim_compute_robot_state-npc1_min0.0599777211605663
sim_compute_robot_state-npc2_max0.07388054170916157
sim_compute_robot_state-npc2_mean0.06512323524833327
sim_compute_robot_state-npc2_median0.06282997633281508
sim_compute_robot_state-npc2_min0.058206447413269906
sim_compute_robot_state-npc3_max0.07428034659354918
sim_compute_robot_state-npc3_mean0.06541185865790176
sim_compute_robot_state-npc3_median0.06478089643708358
sim_compute_robot_state-npc3_min0.058056708792565574
sim_compute_sim_state_max0.03958725160168063
sim_compute_sim_state_mean0.0369505481616582
sim_compute_sim_state_median0.03701082279807643
sim_compute_sim_state_min0.033325824939029317
sim_physics_max0.18206663285532304
sim_physics_mean0.16617859769169777
sim_physics_median0.1660807284903019
sim_physics_min0.15488361770456488
sim_render-ego_max0.06073248001836961
sim_render-ego_mean0.057555547491905355
sim_render-ego_median0.05798525057340923
sim_render-ego_min0.052807853255473394
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean4.96999999999999
survival_time_min1.5500000000000007
204702577AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerrorno8070:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204682578AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerrorno8070:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204662582AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrorno8070:03:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204482612Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessno8070:12:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48833540127088915
survival_time_median4.749999999999991
deviation-center-line_median0.206292958644122
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego_max0.07103275981816379
agent_compute-ego_mean0.0650434087456119
agent_compute-ego_median0.06635873537537054
agent_compute-ego_min0.05357226572538677
deviation-center-line_max0.3912682651728664
deviation-center-line_mean0.23227387059090404
deviation-center-line_min0.11846104838828224
deviation-heading_max2.4601311411745157
deviation-heading_mean1.2781805872611902
deviation-heading_median1.3327642896506582
deviation-heading_min0.566903075639298
driven_any_max2.083583756004467
driven_any_mean1.3572645029063808
driven_any_median1.21492227445162
driven_any_min0.37688790065546496
driven_lanedir_consec_max1.307826359971858
driven_lanedir_consec_mean0.6703257890941815
driven_lanedir_consec_min0.3420979566210387
driven_lanedir_max1.699034370134248
driven_lanedir_mean0.78554370039537
driven_lanedir_median0.5549295175109604
driven_lanedir_min0.3420979566210387
in-drivable-lane_max3.749999999999987
in-drivable-lane_mean1.529999999999995
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1614128134467385, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06169727444648743, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07103275981816379, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09118498184464197, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03754965554584156, "sim_compute_performance-ego": 0.06680286743424156, "sim_compute_robot_state-ego": 0.07305401292714206, "sim_compute_robot_state-npc0": 0.06403444571928545, "sim_compute_robot_state-npc1": 0.0659427588636225, "sim_compute_robot_state-npc2": 0.06697573445060036, "sim_compute_robot_state-npc3": 0.06625508991154758}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.15104493787211756, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.058651854915003625, "in-drivable-lane": 0, "agent_compute-ego": 0.06449074898996661, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09042016921504852, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03372353123080346, "sim_compute_performance-ego": 0.060463843807097406, "sim_compute_robot_state-ego": 0.06309854599737352, "sim_compute_robot_state-npc0": 0.06231720985904816, "sim_compute_robot_state-npc1": 0.05987057378215174, "sim_compute_robot_state-npc2": 0.0632039116274926, "sim_compute_robot_state-npc3": 0.06200739645188855}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.19014201603882705, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.0595362626068981, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06635873537537054, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.09381489381722524, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.03816811750966606, "sim_compute_performance-ego": 0.06898925828595534, "sim_compute_robot_state-ego": 0.07200637945892117, "sim_compute_robot_state-npc0": 0.06647444616818259, "sim_compute_robot_state-npc1": 0.06792442342068286, "sim_compute_robot_state-npc2": 0.06705505797203551, "sim_compute_robot_state-npc3": 0.06812755605007739}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.1325592417466013, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.04718783027247379, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.05357226572538677, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.07052206742136102, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.02968752258702328, "sim_compute_performance-ego": 0.04999924207988538, "sim_compute_robot_state-ego": 0.053487283305117955, "sim_compute_robot_state-npc0": 0.05231952918203254, "sim_compute_robot_state-npc1": 0.053849463713796515, "sim_compute_robot_state-npc2": 0.05326677874514931, "sim_compute_robot_state-npc3": 0.05355518491644608}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.1820112769032868, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06050204223310444, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.06976253381917175, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.09285041479997232, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.03716243992389088, "sim_compute_performance-ego": 0.06625573567941155, "sim_compute_robot_state-ego": 0.06910562347358382, "sim_compute_robot_state-npc0": 0.06592472674141467, "sim_compute_robot_state-npc1": 0.06648095560745454, "sim_compute_robot_state-npc2": 0.07085030515429, "sim_compute_robot_state-npc3": 0.06741191131967894}}
set_robot_commands_max0.09381489381722524
set_robot_commands_mean0.08775850541964982
set_robot_commands_median0.09118498184464197
set_robot_commands_min0.07052206742136102
sim_compute_performance-ego_max0.06898925828595534
sim_compute_performance-ego_mean0.06250218945731825
sim_compute_performance-ego_median0.06625573567941155
sim_compute_performance-ego_min0.04999924207988538
sim_compute_robot_state-ego_max0.07305401292714206
sim_compute_robot_state-ego_mean0.0661503690324277
sim_compute_robot_state-ego_median0.06910562347358382
sim_compute_robot_state-ego_min0.053487283305117955
sim_compute_robot_state-npc0_max0.06647444616818259
sim_compute_robot_state-npc0_mean0.06221407153399268
sim_compute_robot_state-npc0_median0.06403444571928545
sim_compute_robot_state-npc0_min0.05231952918203254
sim_compute_robot_state-npc1_max0.06792442342068286
sim_compute_robot_state-npc1_mean0.06281363507754163
sim_compute_robot_state-npc1_median0.0659427588636225
sim_compute_robot_state-npc1_min0.053849463713796515
sim_compute_robot_state-npc2_max0.07085030515429
sim_compute_robot_state-npc2_mean0.06427035758991355
sim_compute_robot_state-npc2_median0.06697573445060036
sim_compute_robot_state-npc2_min0.05326677874514931
sim_compute_robot_state-npc3_max0.06812755605007739
sim_compute_robot_state-npc3_mean0.06347142772992771
sim_compute_robot_state-npc3_median0.06625508991154758
sim_compute_robot_state-npc3_min0.05355518491644608
sim_compute_sim_state_max0.03816811750966606
sim_compute_sim_state_mean0.035258253359445046
sim_compute_sim_state_median0.03716243992389088
sim_compute_sim_state_min0.02968752258702328
sim_physics_max0.19014201603882705
sim_physics_mean0.16343405720151422
sim_physics_median0.1614128134467385
sim_physics_min0.1325592417466013
sim_render-ego_max0.06169727444648743
sim_render-ego_mean0.05751505289479347
sim_render-ego_median0.0595362626068981
sim_render-ego_min0.04718783027247379
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean4.96999999999999
survival_time_min1.5500000000000007
204362699Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessno8070:19:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5801776286491975
survival_time_median4.699999999999991
deviation-center-line_median0.26936761040239493
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.10425066947937012
agent_compute-ego_mean0.07877306172864658
agent_compute-ego_median0.07297825495402019
agent_compute-ego_min0.069343972773779
deviation-center-line_max1.355913677449695
deviation-center-line_mean0.5100146192268586
deviation-center-line_min0.25386983582980877
deviation-heading_max5.054650638931494
deviation-heading_mean2.6593116483367205
deviation-heading_median2.2537593720877656
deviation-heading_min1.0416601628945743
driven_any_max2.348604877411217
driven_any_mean1.103445143727089
driven_any_median0.7015372390145492
driven_any_min0.6211615163230134
driven_lanedir_consec_max1.3906545927931624
driven_lanedir_consec_mean0.6987098609920824
driven_lanedir_consec_min0.42145634901816664
driven_lanedir_max1.6070487472205957
driven_lanedir_mean0.765129724025013
driven_lanedir_median0.5801776286491975
driven_lanedir_min0.46678183916440785
in-drivable-lane_max2.8000000000000327
in-drivable-lane_mean1.1500000000000044
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6624683501359925, "sim_physics": 0.23774931981013372, "survival_time": 4.549999999999992, "driven_lanedir": 0.6344788953354776, "sim_render-ego": 0.0781041580242115, "in-drivable-lane": 0, "agent_compute-ego": 0.10425066947937012, "deviation-heading": 1.0416601628945743, "set_robot_commands": 0.14326243348174042, "deviation-center-line": 0.26936761040239493, "driven_lanedir_consec": 0.6344788953354776, "sim_compute_sim_state": 0.0494250360426012, "sim_compute_performance-ego": 0.0915365743113088, "sim_compute_robot_state-ego": 0.10334096374092522, "sim_compute_robot_state-npc0": 0.09145923761221078, "sim_compute_robot_state-npc1": 0.08759878231928898, "sim_compute_robot_state-npc2": 0.08629641166100135, "sim_compute_robot_state-npc3": 0.08846108730022724}, "udem1-1-0": {"driven_any": 0.7015372390145492, "sim_physics": 0.1735348549294979, "survival_time": 4.699999999999991, "driven_lanedir": 0.5801776286491975, "sim_render-ego": 0.062085920191825704, "in-drivable-lane": 0, "agent_compute-ego": 0.07457624344115561, "deviation-heading": 2.2537593720877656, "set_robot_commands": 0.09703561600218429, "deviation-center-line": 0.2543433113586656, "driven_lanedir_consec": 0.5801776286491975, "sim_compute_sim_state": 0.039021367722369256, "sim_compute_performance-ego": 0.0658872330442388, "sim_compute_robot_state-ego": 0.07483504680877036, "sim_compute_robot_state-npc0": 0.06723661372002135, "sim_compute_robot_state-npc1": 0.06632758962347153, "sim_compute_robot_state-npc2": 0.06798178084353183, "sim_compute_robot_state-npc3": 0.0668721021489894}, "udem1-2-0": {"driven_any": 0.6211615163230134, "sim_physics": 0.14794334911164783, "survival_time": 4.199999999999993, "driven_lanedir": 0.46678183916440785, "sim_render-ego": 0.0532480137688773, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.069343972773779, "deviation-heading": 1.5404118207268411, "set_robot_commands": 0.07871835572378975, "deviation-center-line": 0.25386983582980877, "driven_lanedir_consec": 0.46678183916440785, "sim_compute_sim_state": 0.033267716566721596, "sim_compute_performance-ego": 0.05922813358761016, "sim_compute_robot_state-ego": 0.06260295992805845, "sim_compute_robot_state-npc0": 0.058890964303697856, "sim_compute_robot_state-npc1": 0.05676056089855376, "sim_compute_robot_state-npc2": 0.05902534723281861, "sim_compute_robot_state-npc3": 0.05743403945650373}, "udem1-3-0": {"driven_any": 1.183453735750672, "sim_physics": 0.18154857839856828, "survival_time": 7.699999999999981, "driven_lanedir": 0.5371615097553868, "sim_render-ego": 0.0582614363013924, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.07271616799490792, "deviation-heading": 3.4060762470429276, "set_robot_commands": 0.092274724663078, "deviation-center-line": 0.416578661093729, "driven_lanedir_consec": 0.42145634901816664, "sim_compute_sim_state": 0.03667543460796406, "sim_compute_performance-ego": 0.06380183975417893, "sim_compute_robot_state-ego": 0.06721591794645632, "sim_compute_robot_state-npc0": 0.06569496687356528, "sim_compute_robot_state-npc1": 0.06443776093520127, "sim_compute_robot_state-npc2": 0.06494198062203148, "sim_compute_robot_state-npc3": 0.06599500581815645}, "udem1-4-0": {"driven_any": 2.348604877411217, "sim_physics": 0.2078692881266276, "survival_time": 14.950000000000076, "driven_lanedir": 1.6070487472205957, "sim_render-ego": 0.06183717807133993, "in-drivable-lane": 2.8000000000000327, "agent_compute-ego": 0.07297825495402019, "deviation-heading": 5.054650638931494, "set_robot_commands": 0.0912077768643697, "deviation-center-line": 1.355913677449695, "driven_lanedir_consec": 1.3906545927931624, "sim_compute_sim_state": 0.03735380252202352, "sim_compute_performance-ego": 0.06734412511189779, "sim_compute_robot_state-ego": 0.07036105314890544, "sim_compute_robot_state-npc0": 0.06751850684483846, "sim_compute_robot_state-npc1": 0.06564093271891276, "sim_compute_robot_state-npc2": 0.06659367402394613, "sim_compute_robot_state-npc3": 0.06508284091949462}}
set_robot_commands_max0.14326243348174042
set_robot_commands_mean0.10049978134703244
set_robot_commands_median0.092274724663078
set_robot_commands_min0.07871835572378975
sim_compute_performance-ego_max0.0915365743113088
sim_compute_performance-ego_mean0.06955958116184689
sim_compute_performance-ego_median0.0658872330442388
sim_compute_performance-ego_min0.05922813358761016
sim_compute_robot_state-ego_max0.10334096374092522
sim_compute_robot_state-ego_mean0.07567118831462315
sim_compute_robot_state-ego_median0.07036105314890544
sim_compute_robot_state-ego_min0.06260295992805845
sim_compute_robot_state-npc0_max0.09145923761221078
sim_compute_robot_state-npc0_mean0.07016005787086674
sim_compute_robot_state-npc0_median0.06723661372002135
sim_compute_robot_state-npc0_min0.058890964303697856
sim_compute_robot_state-npc1_max0.08759878231928898
sim_compute_robot_state-npc1_mean0.06815312529908565
sim_compute_robot_state-npc1_median0.06564093271891276
sim_compute_robot_state-npc1_min0.05676056089855376
sim_compute_robot_state-npc2_max0.08629641166100135
sim_compute_robot_state-npc2_mean0.06896783887666588
sim_compute_robot_state-npc2_median0.06659367402394613
sim_compute_robot_state-npc2_min0.05902534723281861
sim_compute_robot_state-npc3_max0.08846108730022724
sim_compute_robot_state-npc3_mean0.0687690151286743
sim_compute_robot_state-npc3_median0.06599500581815645
sim_compute_robot_state-npc3_min0.05743403945650373
sim_compute_sim_state_max0.0494250360426012
sim_compute_sim_state_mean0.03914867149233593
sim_compute_sim_state_median0.03735380252202352
sim_compute_sim_state_min0.033267716566721596
sim_physics_max0.23774931981013372
sim_physics_mean0.1897290780752951
sim_physics_median0.18154857839856828
sim_physics_min0.14794334911164783
sim_render-ego_max0.0781041580242115
sim_render-ego_mean0.06270734127152937
sim_render-ego_median0.06183717807133993
sim_render-ego_min0.0532480137688773
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.220000000000008
survival_time_min4.199999999999993
204132633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationhost-errorno8070:09:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20413-972550', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204072652zamatorychallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno8070:16:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4587094566633867
survival_time_median6.349999999999985
deviation-center-line_median0.3408872833205343
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.09028587088120722
agent_compute-ego_mean0.08906622417601687
agent_compute-ego_median0.08871284444281395
agent_compute-ego_min0.08824935672790046
deviation-center-line_max0.39935208923922294
deviation-center-line_mean0.3243459608240416
deviation-center-line_min0.19985626859444777
deviation-heading_max4.446349796476346
deviation-heading_mean2.3831537464685475
deviation-heading_median2.4413788363422397
deviation-heading_min0.44613898832102566
driven_any_max2.332162583870461
driven_any_mean1.1178579173230168
driven_any_median0.9667679884547196
driven_any_min0.3239274593926854
driven_lanedir_consec_max0.9044641808529988
driven_lanedir_consec_mean0.5491496887658731
driven_lanedir_consec_min0.3148470293482286
driven_lanedir_max0.9044641808529988
driven_lanedir_mean0.5661728293206962
driven_lanedir_median0.5438251594375023
driven_lanedir_min0.3148470293482286
in-drivable-lane_max8.950000000000056
in-drivable-lane_mean2.5100000000000087
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8390730009290593, "sim_physics": 0.12364065541630298, "survival_time": 5.649999999999988, "driven_lanedir": 0.6107688206770328, "sim_render-ego": 0.07136464540937305, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09028587088120722, "deviation-heading": 2.4413788363422397, "set_robot_commands": 0.11370072955578828, "deviation-center-line": 0.3408872833205343, "driven_lanedir_consec": 0.6107688206770328, "sim_compute_sim_state": 0.04268224471438248, "sim_compute_performance-ego": 0.07966521777937897, "sim_compute_robot_state-ego": 0.0848373459503714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.332162583870461, "sim_physics": 0.16286329307941474, "survival_time": 14.850000000000076, "driven_lanedir": 0.5438251594375023, "sim_render-ego": 0.0717143177584767, "in-drivable-lane": 8.950000000000056, "agent_compute-ego": 0.0886637731031938, "deviation-heading": 4.446349796476346, "set_robot_commands": 0.11405438927287606, "deviation-center-line": 0.36166139778690215, "driven_lanedir_consec": 0.4587094566633867, "sim_compute_sim_state": 0.043923441408459184, "sim_compute_performance-ego": 0.08138076945988819, "sim_compute_robot_state-ego": 0.09188815720554956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3239274593926854, "sim_physics": 0.12882715083183127, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3148470293482286, "sim_render-ego": 0.07350120138614735, "in-drivable-lane": 0, "agent_compute-ego": 0.08871284444281395, "deviation-heading": 0.44613898832102566, "set_robot_commands": 0.11962821635794132, "deviation-center-line": 0.19985626859444777, "driven_lanedir_consec": 0.3148470293482286, "sim_compute_sim_state": 0.04426471223222449, "sim_compute_performance-ego": 0.08769662329491149, "sim_compute_robot_state-ego": 0.09698073914710512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9667679884547196, "sim_physics": 0.13435636730644646, "survival_time": 6.349999999999985, "driven_lanedir": 0.9044641808529988, "sim_render-ego": 0.0741482006283257, "in-drivable-lane": 0, "agent_compute-ego": 0.08824935672790046, "deviation-heading": 2.015918995340098, "set_robot_commands": 0.11297616996164396, "deviation-center-line": 0.39935208923922294, "driven_lanedir_consec": 0.9044641808529988, "sim_compute_sim_state": 0.044612681771826555, "sim_compute_performance-ego": 0.08089491701501561, "sim_compute_robot_state-ego": 0.08688166761022853}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.127358553968158, "sim_physics": 0.1385949014806423, "survival_time": 7.349999999999982, "driven_lanedir": 0.456958956287719, "sim_render-ego": 0.07017510440073857, "in-drivable-lane": 3.099999999999989, "agent_compute-ego": 0.08941927572496894, "deviation-heading": 2.565982115863027, "set_robot_commands": 0.11352499001691133, "deviation-center-line": 0.3199727651791009, "driven_lanedir_consec": 0.456958956287719, "sim_compute_sim_state": 0.043316928707823464, "sim_compute_performance-ego": 0.07904197893986085, "sim_compute_robot_state-ego": 0.08705312702931514}}
set_robot_commands_max0.11962821635794132
set_robot_commands_mean0.1147768990330322
set_robot_commands_median0.11370072955578828
set_robot_commands_min0.11297616996164396
sim_compute_performance-ego_max0.08769662329491149
sim_compute_performance-ego_mean0.08173590129781103
sim_compute_performance-ego_median0.08089491701501561
sim_compute_performance-ego_min0.07904197893986085
sim_compute_robot_state-ego_max0.09698073914710512
sim_compute_robot_state-ego_mean0.08952820738851394
sim_compute_robot_state-ego_median0.08705312702931514
sim_compute_robot_state-ego_min0.0848373459503714
sim_compute_sim_state_max0.044612681771826555
sim_compute_sim_state_mean0.04376000176694324
sim_compute_sim_state_median0.043923441408459184
sim_compute_sim_state_min0.04268224471438248
sim_physics_max0.16286329307941474
sim_physics_mean0.13765647362292754
sim_physics_median0.13435636730644646
sim_physics_min0.12364065541630298
sim_render-ego_max0.0741482006283257
sim_render-ego_mean0.07218069391661228
sim_render-ego_median0.0717143177584767
sim_render-ego_min0.07017510440073857
simulation-passed1
survival_time_max14.850000000000076
survival_time_mean7.310000000000007
survival_time_min2.3499999999999996
203932708RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessno8070:30:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7410358729566031
survival_time_median12.200000000000038
deviation-center-line_median0.6056038630824019
in-drivable-lane_median2.9999999999999893


other stats
agent_compute-ego_max0.09482275459864369
agent_compute-ego_mean0.09068826844485592
agent_compute-ego_median0.09047730004086214
agent_compute-ego_min0.08682222127914428
deviation-center-line_max1.3880114032695448
deviation-center-line_mean0.6968188671653625
deviation-center-line_min0.2587507428435846
deviation-heading_max6.864386611015579
deviation-heading_mean4.491067630643374
deviation-heading_median5.117464412776776
deviation-heading_min2.0286661519943876
driven_any_max2.3483159991790097
driven_any_mean1.7491921610604957
driven_any_median1.9063621158472064
driven_any_min1.0389688326706847
driven_lanedir_consec_max1.0270509243291088
driven_lanedir_consec_mean0.7638496238208232
driven_lanedir_consec_min0.4535572669862935
driven_lanedir_max1.503122851333198
driven_lanedir_mean1.0076820206345802
driven_lanedir_median0.9913643500755764
driven_lanedir_min0.4535572669862935
in-drivable-lane_max5.550000000000036
in-drivable-lane_mean2.830000000000013
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1043257543280258, "sim_physics": 0.20997489478490125, "survival_time": 7.299999999999982, "driven_lanedir": 0.9913643500755764, "sim_render-ego": 0.07233911344449814, "in-drivable-lane": 0, "agent_compute-ego": 0.09482275459864369, "deviation-heading": 2.4432648040974025, "set_robot_commands": 0.11578956695452128, "deviation-center-line": 0.6056038630824019, "driven_lanedir_consec": 0.9913643500755764, "sim_compute_sim_state": 0.046309363352109306, "sim_compute_performance-ego": 0.07870306054206744, "sim_compute_robot_state-ego": 0.08631131093795985, "sim_compute_robot_state-npc0": 0.07785222138444038, "sim_compute_robot_state-npc1": 0.07857984386078298, "sim_compute_robot_state-npc2": 0.07963199484838199, "sim_compute_robot_state-npc3": 0.08061903796783865}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0389688326706847, "sim_physics": 0.22706272146281073, "survival_time": 6.799999999999984, "driven_lanedir": 0.4535572669862935, "sim_render-ego": 0.07219003579195808, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.09047730004086214, "deviation-heading": 2.0286661519943876, "set_robot_commands": 0.11802427207722384, "deviation-center-line": 0.2587507428435846, "driven_lanedir_consec": 0.4535572669862935, "sim_compute_sim_state": 0.045209271066329056, "sim_compute_performance-ego": 0.07903260343215045, "sim_compute_robot_state-ego": 0.0932152551763198, "sim_compute_robot_state-npc0": 0.08015200671027689, "sim_compute_robot_state-npc1": 0.0801593748962178, "sim_compute_robot_state-npc2": 0.08055790732888614, "sim_compute_robot_state-npc3": 0.08295961162623237}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34798810327755, "sim_physics": 0.21810126781463623, "survival_time": 14.950000000000076, "driven_lanedir": 1.1032846068805884, "sim_render-ego": 0.07090428829193116, "in-drivable-lane": 5.550000000000036, "agent_compute-ego": 0.08682222127914428, "deviation-heading": 5.117464412776776, "set_robot_commands": 0.11234514395395914, "deviation-center-line": 0.6325392801800446, "driven_lanedir_consec": 1.0270509243291088, "sim_compute_sim_state": 0.04437473853429159, "sim_compute_performance-ego": 0.07977993249893188, "sim_compute_robot_state-ego": 0.08557620684305826, "sim_compute_robot_state-npc0": 0.0787421202659607, "sim_compute_robot_state-npc1": 0.08046971956888835, "sim_compute_robot_state-npc2": 0.07930029074350993, "sim_compute_robot_state-npc3": 0.07993050416310628}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3483159991790097, "sim_physics": 0.2197733537356059, "survival_time": 14.950000000000076, "driven_lanedir": 1.503122851333198, "sim_render-ego": 0.0697348165512085, "in-drivable-lane": 2.3500000000000174, "agent_compute-ego": 0.09019285202026368, "deviation-heading": 6.864386611015579, "set_robot_commands": 0.11502321322758992, "deviation-center-line": 1.3880114032695448, "driven_lanedir_consec": 0.7410358729566031, "sim_compute_sim_state": 0.0434428326288859, "sim_compute_performance-ego": 0.07962900320688883, "sim_compute_robot_state-ego": 0.08411659081776937, "sim_compute_robot_state-npc0": 0.07770491520563762, "sim_compute_robot_state-npc1": 0.07847851514816284, "sim_compute_robot_state-npc2": 0.07767907460530599, "sim_compute_robot_state-npc3": 0.07799942970275879}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9063621158472064, "sim_physics": 0.24165187702804317, "survival_time": 12.200000000000038, "driven_lanedir": 0.987081027897244, "sim_render-ego": 0.0710828001381921, "in-drivable-lane": 3.2500000000000213, "agent_compute-ego": 0.09112621428536588, "deviation-heading": 6.001556173332725, "set_robot_commands": 0.11623599197043748, "deviation-center-line": 0.5991890464512365, "driven_lanedir_consec": 0.6062397047565342, "sim_compute_sim_state": 0.04394480146345545, "sim_compute_performance-ego": 0.0783893964329704, "sim_compute_robot_state-ego": 0.08903097226971486, "sim_compute_robot_state-npc0": 0.07932909785724077, "sim_compute_robot_state-npc1": 0.07906122969799355, "sim_compute_robot_state-npc2": 0.07792016717254138, "sim_compute_robot_state-npc3": 0.08000779933616763}}
set_robot_commands_max0.11802427207722384
set_robot_commands_mean0.11548363763674632
set_robot_commands_median0.11578956695452128
set_robot_commands_min0.11234514395395914
sim_compute_performance-ego_max0.07977993249893188
sim_compute_performance-ego_mean0.0791067992226018
sim_compute_performance-ego_median0.07903260343215045
sim_compute_performance-ego_min0.0783893964329704
sim_compute_robot_state-ego_max0.0932152551763198
sim_compute_robot_state-ego_mean0.08765006720896443
sim_compute_robot_state-ego_median0.08631131093795985
sim_compute_robot_state-ego_min0.08411659081776937
sim_compute_robot_state-npc0_max0.08015200671027689
sim_compute_robot_state-npc0_mean0.07875607228471126
sim_compute_robot_state-npc0_median0.0787421202659607
sim_compute_robot_state-npc0_min0.07770491520563762
sim_compute_robot_state-npc1_max0.08046971956888835
sim_compute_robot_state-npc1_mean0.07934973663440911
sim_compute_robot_state-npc1_median0.07906122969799355
sim_compute_robot_state-npc1_min0.07847851514816284
sim_compute_robot_state-npc2_max0.08055790732888614
sim_compute_robot_state-npc2_mean0.07901788693972508
sim_compute_robot_state-npc2_median0.07930029074350993
sim_compute_robot_state-npc2_min0.07767907460530599
sim_compute_robot_state-npc3_max0.08295961162623237
sim_compute_robot_state-npc3_mean0.08030327655922075
sim_compute_robot_state-npc3_median0.08000779933616763
sim_compute_robot_state-npc3_min0.07799942970275879
sim_compute_sim_state_max0.046309363352109306
sim_compute_sim_state_mean0.04465620140901426
sim_compute_sim_state_median0.04437473853429159
sim_compute_sim_state_min0.0434428326288859
sim_physics_max0.24165187702804317
sim_physics_mean0.22331282296519944
sim_physics_median0.2197733537356059
sim_physics_min0.20997489478490125
sim_render-ego_max0.07233911344449814
sim_render-ego_mean0.07125021084355761
sim_render-ego_median0.0710828001381921
sim_render-ego_min0.0697348165512085
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.240000000000032
survival_time_min6.799999999999984
203812681RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrorno8070:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203752698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno8070:04:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203662719jp18813100494test for ppoaido2-LFV-sim-testingstep1-simulationerrorno8070:01:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203582727jp18813100494test for ppoaido2-LFV-sim-testingstep1-simulationerrorno8070:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203542738Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationfailedno8070:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203492746RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationfailedno8070:01:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203442754Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessno8070:07:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7512916548554684
survival_time_median3.7999999999999945
deviation-center-line_median0.18412495978986793
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego_max0.0729943730614402
agent_compute-ego_mean0.07063664771807782
agent_compute-ego_median0.07056268579081486
agent_compute-ego_min0.06781417739634611
deviation-center-line_max0.2407793328387492
deviation-center-line_mean0.18524304998761165
deviation-center-line_min0.10543526712795737
deviation-heading_max1.078034640218307
deviation-heading_mean0.5372342619527618
deviation-heading_median0.3838282375787499
deviation-heading_min0.27824896253672804
driven_any_max1.320019378772244
driven_any_mean0.9597161700643624
driven_any_median1.0035384623320458
driven_any_min0.22182656237034495
driven_lanedir_consec_max0.9856760680639272
driven_lanedir_consec_mean0.639512700274553
driven_lanedir_consec_min0.21092633501229985
driven_lanedir_max0.9856760680639272
driven_lanedir_mean0.639512700274553
driven_lanedir_median0.7512916548554684
driven_lanedir_min0.21092633501229985
in-drivable-lane_max2.0499999999999936
in-drivable-lane_mean0.9599999999999967
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.09825458965803448, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06356999748631527, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07056268579081486, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09431205297771252, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.039281170619161504, "sim_compute_performance-ego": 0.07117449609856856, "sim_compute_robot_state-ego": 0.07481140212008827}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.10480068731999052, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06273996311685313, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.06986585561779962, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09410195419753808, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.04015776385431704, "sim_compute_performance-ego": 0.07061885059743687, "sim_compute_robot_state-ego": 0.07598134054653886}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.11945321343161842, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06565457040613348, "in-drivable-lane": 0, "agent_compute-ego": 0.0729943730614402, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.10858733003789728, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.04310119152069092, "sim_compute_performance-ego": 0.07195647196336226, "sim_compute_robot_state-ego": 0.08162676204334605}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.10607445109021532, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06298034269731123, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07194614672398829, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09920267220381852, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03906635661701579, "sim_compute_performance-ego": 0.07133703965407151, "sim_compute_robot_state-ego": 0.07472830814319653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.0966978389389661, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.06083676766376106, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06781417739634611, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.09452539074177645, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03674073608554139, "sim_compute_performance-ego": 0.06924068197912099, "sim_compute_robot_state-ego": 0.07097276619502477}}
set_robot_commands_max0.10858733003789728
set_robot_commands_mean0.09814588003174857
set_robot_commands_median0.09452539074177645
set_robot_commands_min0.09410195419753808
sim_compute_performance-ego_max0.07195647196336226
sim_compute_performance-ego_mean0.07086550805851204
sim_compute_performance-ego_median0.07117449609856856
sim_compute_performance-ego_min0.06924068197912099
sim_compute_robot_state-ego_max0.08162676204334605
sim_compute_robot_state-ego_mean0.0756241158096389
sim_compute_robot_state-ego_median0.07481140212008827
sim_compute_robot_state-ego_min0.07097276619502477
sim_compute_sim_state_max0.04310119152069092
sim_compute_sim_state_mean0.039669443739345334
sim_compute_sim_state_median0.039281170619161504
sim_compute_sim_state_min0.03674073608554139
sim_physics_max0.11945321343161842
sim_physics_mean0.10505615608776496
sim_physics_median0.10480068731999052
sim_physics_min0.0966978389389661
sim_render-ego_max0.06565457040613348
sim_render-ego_mean0.06315632827407483
sim_render-ego_median0.06298034269731123
sim_render-ego_min0.06083676766376106
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean3.5599999999999943
survival_time_min1.1000000000000003
203172812Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFVI-sim-testingstep1-simulationsuccessno8070:08:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7060476436119825
survival_time_median2.9499999999999975
deviation-center-line_median0.11000911211661404
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15677049604512877
agent_compute-ego_mean0.14189820258668995
agent_compute-ego_median0.14625507290080442
agent_compute-ego_min0.11561219890912372
deviation-center-line_max0.2756124593780862
deviation-center-line_mean0.14761657707365936
deviation-center-line_min0.05521015531316102
deviation-heading_max1.16360603086641
deviation-heading_mean0.4999185982159845
deviation-heading_median0.3379975413110555
deviation-heading_min0.23494529737543027
driven_any_max2.1872512115945857
driven_any_mean1.055944540531118
driven_any_median1.167808122478256
driven_any_min0.3209290725136122
driven_lanedir_consec_max0.9419039350715476
driven_lanedir_consec_mean0.6173219551829218
driven_lanedir_consec_min0.30305117192114617
driven_lanedir_max1.1635498459086595
driven_lanedir_mean0.6971981394313693
driven_lanedir_median0.7060476436119825
driven_lanedir_min0.30305117192114617
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.15715734463817668, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05529630409096772, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.13901285630352092, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0891975794198378, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.032861639868538337, "sim_compute_performance-ego": 0.059322789030255015, "sim_compute_robot_state-ego": 0.06265832793037847, "sim_compute_robot_state-npc0": 0.05983354685441503, "sim_compute_robot_state-npc1": 0.06569905775897908, "sim_compute_robot_state-npc2": 0.05609425733674248, "sim_compute_robot_state-npc3": 0.05817384090063707}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.10020214319229126, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.044131308794021606, "in-drivable-lane": 0, "agent_compute-ego": 0.11561219890912372, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07538301746050517, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.029965182145436604, "sim_compute_performance-ego": 0.048062642415364586, "sim_compute_robot_state-ego": 0.04949691891670227, "sim_compute_robot_state-npc0": 0.05571940541267395, "sim_compute_robot_state-npc1": 0.05636218190193176, "sim_compute_robot_state-npc2": 0.05803137024243673, "sim_compute_robot_state-npc3": 0.05497406919797262}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16105112382921122, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.060273679636292536, "in-drivable-lane": 0, "agent_compute-ego": 0.14625507290080442, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09476944955728822, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03655576705932617, "sim_compute_performance-ego": 0.06582230228488728, "sim_compute_robot_state-ego": 0.07697221788309389, "sim_compute_robot_state-npc0": 0.06547800969269316, "sim_compute_robot_state-npc1": 0.062146837428464725, "sim_compute_robot_state-npc2": 0.06474835589780646, "sim_compute_robot_state-npc3": 0.06255834789599403}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.18339176097158655, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.061727608664561125, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15677049604512877, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.1000603498038599, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.0390612594151901, "sim_compute_performance-ego": 0.06683581562365516, "sim_compute_robot_state-ego": 0.07346398547544318, "sim_compute_robot_state-npc0": 0.07073149438631737, "sim_compute_robot_state-npc1": 0.06875995862281929, "sim_compute_robot_state-npc2": 0.07111161038026971, "sim_compute_robot_state-npc3": 0.06945049964775474}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1550727128982544, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06955864429473876, "in-drivable-lane": 0, "agent_compute-ego": 0.15184038877487183, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08835825920104981, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04837143421173096, "sim_compute_performance-ego": 0.07281306982040406, "sim_compute_robot_state-ego": 0.08043560981750489, "sim_compute_robot_state-npc0": 0.06878918409347534, "sim_compute_robot_state-npc1": 0.07090170383453369, "sim_compute_robot_state-npc2": 0.06610616445541381, "sim_compute_robot_state-npc3": 0.07004119157791137}}
set_robot_commands_max0.1000603498038599
set_robot_commands_mean0.0895537310885082
set_robot_commands_median0.0891975794198378
set_robot_commands_min0.07538301746050517
sim_compute_performance-ego_max0.07281306982040406
sim_compute_performance-ego_mean0.06257132383491322
sim_compute_performance-ego_median0.06582230228488728
sim_compute_performance-ego_min0.048062642415364586
sim_compute_robot_state-ego_max0.08043560981750489
sim_compute_robot_state-ego_mean0.06860541200462453
sim_compute_robot_state-ego_median0.07346398547544318
sim_compute_robot_state-ego_min0.04949691891670227
sim_compute_robot_state-npc0_max0.07073149438631737
sim_compute_robot_state-npc0_mean0.06411032808791498
sim_compute_robot_state-npc0_median0.06547800969269316
sim_compute_robot_state-npc0_min0.05571940541267395
sim_compute_robot_state-npc1_max0.07090170383453369
sim_compute_robot_state-npc1_mean0.06477394790934571
sim_compute_robot_state-npc1_median0.06569905775897908
sim_compute_robot_state-npc1_min0.05636218190193176
sim_compute_robot_state-npc2_max0.07111161038026971
sim_compute_robot_state-npc2_mean0.06321835166253384
sim_compute_robot_state-npc2_median0.06474835589780646
sim_compute_robot_state-npc2_min0.05609425733674248
sim_compute_robot_state-npc3_max0.07004119157791137
sim_compute_robot_state-npc3_mean0.06303958984405397
sim_compute_robot_state-npc3_median0.06255834789599403
sim_compute_robot_state-npc3_min0.05497406919797262
sim_compute_sim_state_max0.04837143421173096
sim_compute_sim_state_mean0.03736305654004443
sim_compute_sim_state_median0.03655576705932617
sim_compute_sim_state_min0.029965182145436604
sim_physics_max0.18339176097158655
sim_physics_mean0.151375017105904
sim_physics_median0.15715734463817668
sim_physics_min0.10020214319229126
sim_render-ego_max0.06955864429473876
sim_render-ego_mean0.05819750909611635
sim_render-ego_median0.060273679636292536
sim_render-ego_min0.044131308794021606
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.679999999999997
survival_time_min1.0000000000000002
203062823Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessno8070:08:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.576224177547854
survival_time_median2.6499999999999986
deviation-center-line_median0.11441348272325454
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.15931634633046277
agent_compute-ego_mean0.14636109831699476
agent_compute-ego_median0.1476164196110979
agent_compute-ego_min0.12489930265828182
deviation-center-line_max0.1591461472514269
deviation-center-line_mean0.11596609894630484
deviation-center-line_min0.08510371473961074
deviation-heading_max0.476664618733542
deviation-heading_mean0.334022300897731
deviation-heading_median0.33193430349064146
deviation-heading_min0.19231746951364015
driven_any_max1.6164397331284492
driven_any_mean1.0223266277113094
driven_any_median1.006879208370262
driven_any_min0.431219000505003
driven_lanedir_consec_max1.2450085389977108
driven_lanedir_consec_mean0.7771319802171096
driven_lanedir_consec_min0.40042409985820093
driven_lanedir_max1.2450085389977108
driven_lanedir_mean0.7771319802171096
driven_lanedir_median0.576224177547854
driven_lanedir_min0.40042409985820093
in-drivable-lane_max0.9499999999999976
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.14265525116110747, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06174266563271576, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15931634633046277, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10112181699500894, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03924468328367989, "sim_compute_performance-ego": 0.06777319368326438, "sim_compute_robot_state-ego": 0.07550719549071114, "sim_compute_robot_state-npc0": 0.06966268341496305, "sim_compute_robot_state-npc1": 0.06922862214862176, "sim_compute_robot_state-npc2": 0.0665983074116257, "sim_compute_robot_state-npc3": 0.06689897573219156}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.14430915392362154, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05988472241621751, "in-drivable-lane": 0, "agent_compute-ego": 0.14082065912393424, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09019047480363113, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03814731194422795, "sim_compute_performance-ego": 0.06376249973590557, "sim_compute_robot_state-ego": 0.06818543947660007, "sim_compute_robot_state-npc0": 0.06968217629652756, "sim_compute_robot_state-npc1": 0.07368279420412503, "sim_compute_robot_state-npc2": 0.06719095890338604, "sim_compute_robot_state-npc3": 0.06675256215609036}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.12447345884222734, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.051173235240735505, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.12489930265828182, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.07997808958354749, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03393776165811639, "sim_compute_performance-ego": 0.05549566996724982, "sim_compute_robot_state-ego": 0.05757167778517071, "sim_compute_robot_state-npc0": 0.059752928583245525, "sim_compute_robot_state-npc1": 0.05789482593536377, "sim_compute_robot_state-npc2": 0.05692828956403231, "sim_compute_robot_state-npc3": 0.05878774429622449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1500472358510464, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05957907966420621, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1476164196110979, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09136294111420835, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03763535354710833, "sim_compute_performance-ego": 0.06850580022304872, "sim_compute_robot_state-ego": 0.0715191575545299, "sim_compute_robot_state-npc0": 0.06602495833288265, "sim_compute_robot_state-npc1": 0.07153858715974831, "sim_compute_robot_state-npc2": 0.07315275940714003, "sim_compute_robot_state-npc3": 0.0680193659625476}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.15629318025377062, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06414432878847476, "in-drivable-lane": 0, "agent_compute-ego": 0.159152763861197, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.10668863190544976, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.038934283786349826, "sim_compute_performance-ego": 0.07102637820773655, "sim_compute_robot_state-ego": 0.07958604671336987, "sim_compute_robot_state-npc0": 0.07464416821797688, "sim_compute_robot_state-npc1": 0.07074029357345016, "sim_compute_robot_state-npc2": 0.0699498211895978, "sim_compute_robot_state-npc3": 0.0697843763563368}}
set_robot_commands_max0.10668863190544976
set_robot_commands_mean0.09386839088036912
set_robot_commands_median0.09136294111420835
set_robot_commands_min0.07997808958354749
sim_compute_performance-ego_max0.07102637820773655
sim_compute_performance-ego_mean0.06531270836344102
sim_compute_performance-ego_median0.06777319368326438
sim_compute_performance-ego_min0.05549566996724982
sim_compute_robot_state-ego_max0.07958604671336987
sim_compute_robot_state-ego_mean0.07047390340407633
sim_compute_robot_state-ego_median0.0715191575545299
sim_compute_robot_state-ego_min0.05757167778517071
sim_compute_robot_state-npc0_max0.07464416821797688
sim_compute_robot_state-npc0_mean0.06795338296911914
sim_compute_robot_state-npc0_median0.06966268341496305
sim_compute_robot_state-npc0_min0.059752928583245525
sim_compute_robot_state-npc1_max0.07368279420412503
sim_compute_robot_state-npc1_mean0.0686170246042618
sim_compute_robot_state-npc1_median0.07074029357345016
sim_compute_robot_state-npc1_min0.05789482593536377
sim_compute_robot_state-npc2_max0.07315275940714003
sim_compute_robot_state-npc2_mean0.06676402729515638
sim_compute_robot_state-npc2_median0.06719095890338604
sim_compute_robot_state-npc2_min0.05692828956403231
sim_compute_robot_state-npc3_max0.0697843763563368
sim_compute_robot_state-npc3_mean0.06604860490067817
sim_compute_robot_state-npc3_median0.06689897573219156
sim_compute_robot_state-npc3_min0.05878774429622449
sim_compute_sim_state_max0.03924468328367989
sim_compute_sim_state_mean0.03757987884389648
sim_compute_sim_state_median0.03814731194422795
sim_compute_sim_state_min0.03393776165811639
sim_physics_max0.15629318025377062
sim_physics_mean0.14355565600635467
sim_physics_median0.14430915392362154
sim_physics_min0.12447345884222734
sim_render-ego_max0.06414432878847476
sim_render-ego_mean0.05930480634846995
sim_render-ego_median0.05988472241621751
sim_render-ego_min0.051173235240735505
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.609999999999998
survival_time_min1.3000000000000005
202992835AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno8070:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202842876Andrea Danieleminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessno8070:12:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.658141340093886
survival_time_median6.999999999999983
deviation-center-line_median0.3805179887067449
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.17243033388386603
agent_compute-ego_mean0.1687139706699985
agent_compute-ego_median0.1684068374230828
agent_compute-ego_min0.16338521214674143
deviation-center-line_max0.8219069617270801
deviation-center-line_mean0.4622890220224802
deviation-center-line_min0.240946508088056
deviation-heading_max1.819384597985526
deviation-heading_mean0.9470500519861752
deviation-heading_median0.8064348941516836
deviation-heading_min0.5022393903257442
driven_any_max1.5790906665051212
driven_any_mean0.90897363561738
driven_any_median0.9970530395825568
driven_any_min0.2870933095253068
driven_lanedir_consec_max1.1522212258289768
driven_lanedir_consec_mean0.7286312661816596
driven_lanedir_consec_min0.2804952221609298
driven_lanedir_max1.1522212258289768
driven_lanedir_mean0.7286312661816596
driven_lanedir_median0.658141340093886
driven_lanedir_min0.2804952221609298
in-drivable-lane_max2.80000000000004
in-drivable-lane_mean1.0400000000000065
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.11204352038247244, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06587284633091518, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1672304323741368, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.10490657091140748, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.04104852846690587, "sim_compute_performance-ego": 0.07503373963492257, "sim_compute_robot_state-ego": 0.08072641747338431}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.12809753250068345, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.06801993242451843, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.1684068374230828, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.10782137890936624, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.04331202406278798, "sim_compute_performance-ego": 0.07754944076000804, "sim_compute_robot_state-ego": 0.08547520973313023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.11464060389477274, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.06769274110379427, "in-drivable-lane": 0, "agent_compute-ego": 0.17243033388386603, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.10517137465269669, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.0435880474422289, "sim_compute_performance-ego": 0.07558473815088687, "sim_compute_robot_state-ego": 0.08308624702951183}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.1093242745650442, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06499189075670744, "in-drivable-lane": 0, "agent_compute-ego": 0.1721170375221654, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.10862487742775365, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.04273630945306075, "sim_compute_performance-ego": 0.0737854606226871, "sim_compute_robot_state-ego": 0.08021437745345267}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.14100554681593372, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.06685615245098342, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.16338521214674143, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.10453470621240853, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.04181198260751188, "sim_compute_performance-ego": 0.07613751635573426, "sim_compute_robot_state-ego": 0.08591391304121589}}
set_robot_commands_max0.10862487742775365
set_robot_commands_mean0.10621178162272651
set_robot_commands_median0.10517137465269669
set_robot_commands_min0.10453470621240853
sim_compute_performance-ego_max0.07754944076000804
sim_compute_performance-ego_mean0.07561817910484778
sim_compute_performance-ego_median0.07558473815088687
sim_compute_performance-ego_min0.0737854606226871
sim_compute_robot_state-ego_max0.08591391304121589
sim_compute_robot_state-ego_mean0.08308323294613898
sim_compute_robot_state-ego_median0.08308624702951183
sim_compute_robot_state-ego_min0.08021437745345267
sim_compute_sim_state_max0.0435880474422289
sim_compute_sim_state_mean0.042499378406499075
sim_compute_sim_state_median0.04273630945306075
sim_compute_sim_state_min0.04104852846690587
sim_physics_max0.14100554681593372
sim_physics_mean0.12102229563178132
sim_physics_median0.11464060389477274
sim_physics_min0.1093242745650442
sim_render-ego_max0.06801993242451843
sim_render-ego_mean0.06668671261338374
sim_render-ego_median0.06685615245098342
sim_render-ego_min0.06499189075670744
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean6.399999999999995
survival_time_min2.3
202782948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno8070:09:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.062022045298948725
survival_time_median1.2500000000000004
deviation-center-line_median0.06367263209683718
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.26552375880154694
agent_compute-ego_mean0.19188546731521053
agent_compute-ego_median0.17399880409240723
agent_compute-ego_min0.17003538157488848
deviation-center-line_max0.09235503759619666
deviation-center-line_mean0.06677903886860923
deviation-center-line_min0.03636486940047102
deviation-heading_max0.7997265771535362
deviation-heading_mean0.669299074807683
deviation-heading_median0.6876974904005794
deviation-heading_min0.5425159606207464
driven_any_max0.2333169249222232
driven_any_mean0.15682149971094142
driven_any_median0.13817713243418897
driven_any_min0.09786744043340422
driven_lanedir_consec_max0.09434724319464571
driven_lanedir_consec_mean0.0677402015112041
driven_lanedir_consec_min0.05370683158025358
driven_lanedir_max0.09434724319464571
driven_lanedir_mean0.0677402015112041
driven_lanedir_median0.062022045298948725
driven_lanedir_min0.05370683158025358
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2333169249222232, "sim_physics": 0.171918688593684, "survival_time": 1.850000000000001, "driven_lanedir": 0.09434724319464571, "sim_render-ego": 0.06183778273092734, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.17003538157488848, "deviation-heading": 0.6876974904005794, "set_robot_commands": 0.09544511743493982, "deviation-center-line": 0.06367263209683718, "driven_lanedir_consec": 0.09434724319464571, "sim_compute_sim_state": 0.03853230218629579, "sim_compute_performance-ego": 0.07011429039207664, "sim_compute_robot_state-ego": 0.07719074068842707, "sim_compute_robot_state-npc0": 0.07047954121151485, "sim_compute_robot_state-npc1": 0.06891423302727777, "sim_compute_robot_state-npc2": 0.07052418347951528, "sim_compute_robot_state-npc3": 0.06798199705175452}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20325863373162156, "sim_physics": 0.15626079194685993, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05370683158025358, "sim_render-ego": 0.05867436352898093, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17122549169203816, "deviation-heading": 0.7997265771535362, "set_robot_commands": 0.1034177120994119, "deviation-center-line": 0.053364118877278766, "driven_lanedir_consec": 0.05370683158025358, "sim_compute_sim_state": 0.0397406395743875, "sim_compute_performance-ego": 0.06744058693156522, "sim_compute_robot_state-ego": 0.0752182076959049, "sim_compute_robot_state-npc0": 0.0692053893033196, "sim_compute_robot_state-npc1": 0.06582143727470846, "sim_compute_robot_state-npc2": 0.07219572628245634, "sim_compute_robot_state-npc3": 0.07150168278638054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09786744043340422, "sim_physics": 0.15463064027869183, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05496427285117811, "sim_render-ego": 0.06329139419223952, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17864390041517175, "deviation-heading": 0.5962568805053253, "set_robot_commands": 0.09685848070227582, "deviation-center-line": 0.09235503759619666, "driven_lanedir_consec": 0.05496427285117811, "sim_compute_sim_state": 0.040069497149923576, "sim_compute_performance-ego": 0.06497030672819717, "sim_compute_robot_state-ego": 0.06978291013966435, "sim_compute_robot_state-npc0": 0.06870944603629735, "sim_compute_robot_state-npc1": 0.07754169339719026, "sim_compute_robot_state-npc2": 0.06788867452870244, "sim_compute_robot_state-npc3": 0.07178190480107846}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11148736703326911, "sim_physics": 0.1778471903367476, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07366061463099438, "sim_render-ego": 0.06499561396512119, "in-drivable-lane": 0, "agent_compute-ego": 0.26552375880154694, "deviation-heading": 0.5425159606207464, "set_robot_commands": 0.11745527657595548, "deviation-center-line": 0.08813853637226249, "driven_lanedir_consec": 0.07366061463099438, "sim_compute_sim_state": 0.040841102600097656, "sim_compute_performance-ego": 0.0704135461287065, "sim_compute_robot_state-ego": 0.08560953357002953, "sim_compute_robot_state-npc0": 0.07576862248507413, "sim_compute_robot_state-npc1": 0.07950913906097412, "sim_compute_robot_state-npc2": 0.077734036879106, "sim_compute_robot_state-npc3": 0.0709182999350808}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13817713243418897, "sim_physics": 0.1341552257537842, "survival_time": 1.2500000000000004, "driven_lanedir": 0.062022045298948725, "sim_render-ego": 0.06138493537902832, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17399880409240723, "deviation-heading": 0.7202984653582282, "set_robot_commands": 0.09775976181030271, "deviation-center-line": 0.03636486940047102, "driven_lanedir_consec": 0.062022045298948725, "sim_compute_sim_state": 0.0394734001159668, "sim_compute_performance-ego": 0.06831073760986328, "sim_compute_robot_state-ego": 0.07931803703308106, "sim_compute_robot_state-npc0": 0.0686339282989502, "sim_compute_robot_state-npc1": 0.07543515205383301, "sim_compute_robot_state-npc2": 0.0686737823486328, "sim_compute_robot_state-npc3": 0.06864395141601562}}
set_robot_commands_max0.11745527657595548
set_robot_commands_mean0.10218726972457716
set_robot_commands_median0.09775976181030271
set_robot_commands_min0.09544511743493982
sim_compute_performance-ego_max0.0704135461287065
sim_compute_performance-ego_mean0.06824989355808177
sim_compute_performance-ego_median0.06831073760986328
sim_compute_performance-ego_min0.06497030672819717
sim_compute_robot_state-ego_max0.08560953357002953
sim_compute_robot_state-ego_mean0.07742388582542138
sim_compute_robot_state-ego_median0.07719074068842707
sim_compute_robot_state-ego_min0.06978291013966435
sim_compute_robot_state-npc0_max0.07576862248507413
sim_compute_robot_state-npc0_mean0.07055938546703122
sim_compute_robot_state-npc0_median0.0692053893033196
sim_compute_robot_state-npc0_min0.0686339282989502
sim_compute_robot_state-npc1_max0.07950913906097412
sim_compute_robot_state-npc1_mean0.07344433096279672
sim_compute_robot_state-npc1_median0.07543515205383301
sim_compute_robot_state-npc1_min0.06582143727470846
sim_compute_robot_state-npc2_max0.077734036879106
sim_compute_robot_state-npc2_mean0.07140328070368258
sim_compute_robot_state-npc2_median0.07052418347951528
sim_compute_robot_state-npc2_min0.06788867452870244
sim_compute_robot_state-npc3_max0.07178190480107846
sim_compute_robot_state-npc3_mean0.070165567198062
sim_compute_robot_state-npc3_median0.0709182999350808
sim_compute_robot_state-npc3_min0.06798199705175452
sim_compute_sim_state_max0.040841102600097656
sim_compute_sim_state_mean0.03973138832533426
sim_compute_sim_state_median0.0397406395743875
sim_compute_sim_state_min0.03853230218629579
sim_physics_max0.1778471903367476
sim_physics_mean0.15896250738195353
sim_physics_median0.15626079194685993
sim_physics_min0.1341552257537842
sim_render-ego_max0.06499561396512119
sim_render-ego_mean0.06203681795925946
sim_render-ego_median0.06183778273092734
sim_render-ego_min0.05867436352898093
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.4100000000000006
survival_time_min1.1000000000000003
202542910MYFtestaido2-LF-sim-validationstep1-simulationhost-errorno8070:16:57
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20254-369584', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202312960Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationsuccessno8070:20:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34593961179203836
survival_time_median6.349999999999985
deviation-center-line_median0.24087102948169464
in-drivable-lane_median2.499999999999991


other stats
agent_compute-ego_max0.20873291015625
agent_compute-ego_mean0.19037944692862507
agent_compute-ego_median0.19698805570602415
agent_compute-ego_min0.15135787771298334
deviation-center-line_max0.4184568661818192
deviation-center-line_mean0.2860696021898548
deviation-center-line_min0.19383355720964093
deviation-heading_max2.9309867454486027
deviation-heading_mean1.7878848861530887
deviation-heading_median1.586991268253102
deviation-heading_min0.7125851723468939
driven_any_max1.866868198311411
driven_any_mean1.019594414525446
driven_any_median0.7870319413072165
driven_any_min0.6101869510445624
driven_lanedir_consec_max0.6339497587176974
driven_lanedir_consec_mean0.3696653712059442
driven_lanedir_consec_min0.2383880900329518
driven_lanedir_max0.6627895711347058
driven_lanedir_mean0.3788363257891192
driven_lanedir_median0.34593961179203836
driven_lanedir_min0.2383880900329518
in-drivable-lane_max12.500000000000078
in-drivable-lane_mean4.280000000000017
in-drivable-lane_min1.499999999999995
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.160259962778786, "sim_physics": 0.15013384701583185, "survival_time": 10.15000000000001, "driven_lanedir": 0.6627895711347058, "sim_render-ego": 0.0606418466333098, "in-drivable-lane": 3.3500000000000254, "agent_compute-ego": 0.1993710137353155, "deviation-heading": 2.338798993819092, "set_robot_commands": 0.09046443107680148, "deviation-center-line": 0.4184568661818192, "driven_lanedir_consec": 0.6339497587176974, "sim_compute_sim_state": 0.03812551850755814, "sim_compute_performance-ego": 0.0662440431529078, "sim_compute_robot_state-ego": 0.06995928816020196, "sim_compute_robot_state-npc0": 0.06738507806373935, "sim_compute_robot_state-npc1": 0.06672760066140461, "sim_compute_robot_state-npc2": 0.06867966510979413, "sim_compute_robot_state-npc3": 0.06763415501035493}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.866868198311411, "sim_physics": 0.17845311721165974, "survival_time": 14.950000000000076, "driven_lanedir": 0.2383880900329518, "sim_render-ego": 0.0601069696744283, "in-drivable-lane": 12.500000000000078, "agent_compute-ego": 0.19698805570602415, "deviation-heading": 0.7125851723468939, "set_robot_commands": 0.09109277645746867, "deviation-center-line": 0.24087102948169464, "driven_lanedir_consec": 0.2383880900329518, "sim_compute_sim_state": 0.03800556500752767, "sim_compute_performance-ego": 0.06509129126866658, "sim_compute_robot_state-ego": 0.06963764429092408, "sim_compute_robot_state-npc0": 0.06878456751505534, "sim_compute_robot_state-npc1": 0.06668624560038248, "sim_compute_robot_state-npc2": 0.0654680061340332, "sim_compute_robot_state-npc3": 0.06706066290537516}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6736250191852543, "sim_physics": 0.1280587470437598, "survival_time": 6.349999999999985, "driven_lanedir": 0.36082400893476674, "sim_render-ego": 0.056145720594511256, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.1954473773325522, "deviation-heading": 2.9309867454486027, "set_robot_commands": 0.09008516289117768, "deviation-center-line": 0.3482991638396876, "driven_lanedir_consec": 0.34693143700977336, "sim_compute_sim_state": 0.03584050944470984, "sim_compute_performance-ego": 0.07225676033440537, "sim_compute_robot_state-ego": 0.0661276607062873, "sim_compute_robot_state-npc0": 0.07777761286637914, "sim_compute_robot_state-npc1": 0.06461588416512556, "sim_compute_robot_state-npc2": 0.06210137915423536, "sim_compute_robot_state-npc3": 0.06200020519767221}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7870319413072165, "sim_physics": 0.14288883972167968, "survival_time": 6.249999999999986, "driven_lanedir": 0.34593961179203836, "sim_render-ego": 0.0586039981842041, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.20873291015625, "deviation-heading": 1.3700622508977518, "set_robot_commands": 0.08787023162841796, "deviation-center-line": 0.2288873942364315, "driven_lanedir_consec": 0.34593961179203836, "sim_compute_sim_state": 0.03742860221862793, "sim_compute_performance-ego": 0.06483577346801758, "sim_compute_robot_state-ego": 0.06727952575683593, "sim_compute_robot_state-npc0": 0.0650634765625, "sim_compute_robot_state-npc1": 0.06425827980041504, "sim_compute_robot_state-npc2": 0.06440291786193848, "sim_compute_robot_state-npc3": 0.06450833129882813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6101869510445624, "sim_physics": 0.10808719121492824, "survival_time": 5.1999999999999895, "driven_lanedir": 0.28624034705113355, "sim_render-ego": 0.0460399160018334, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.15135787771298334, "deviation-heading": 1.586991268253102, "set_robot_commands": 0.0683868550337278, "deviation-center-line": 0.19383355720964093, "driven_lanedir_consec": 0.28311795847725996, "sim_compute_sim_state": 0.028909609867976263, "sim_compute_performance-ego": 0.051152123854710504, "sim_compute_robot_state-ego": 0.052261950877996594, "sim_compute_robot_state-npc0": 0.05235410195130568, "sim_compute_robot_state-npc1": 0.05074831614127526, "sim_compute_robot_state-npc2": 0.05074128737816444, "sim_compute_robot_state-npc3": 0.050817439189324014}}
set_robot_commands_max0.09109277645746867
set_robot_commands_mean0.08557989141751872
set_robot_commands_median0.09008516289117768
set_robot_commands_min0.0683868550337278
sim_compute_performance-ego_max0.07225676033440537
sim_compute_performance-ego_mean0.06391599841574157
sim_compute_performance-ego_median0.06509129126866658
sim_compute_performance-ego_min0.051152123854710504
sim_compute_robot_state-ego_max0.06995928816020196
sim_compute_robot_state-ego_mean0.06505321395844917
sim_compute_robot_state-ego_median0.06727952575683593
sim_compute_robot_state-ego_min0.052261950877996594
sim_compute_robot_state-npc0_max0.07777761286637914
sim_compute_robot_state-npc0_mean0.0662729673917959
sim_compute_robot_state-npc0_median0.06738507806373935
sim_compute_robot_state-npc0_min0.05235410195130568
sim_compute_robot_state-npc1_max0.06672760066140461
sim_compute_robot_state-npc1_mean0.0626072652737206
sim_compute_robot_state-npc1_median0.06461588416512556
sim_compute_robot_state-npc1_min0.05074831614127526
sim_compute_robot_state-npc2_max0.06867966510979413
sim_compute_robot_state-npc2_mean0.06227865112763311
sim_compute_robot_state-npc2_median0.06440291786193848
sim_compute_robot_state-npc2_min0.05074128737816444
sim_compute_robot_state-npc3_max0.06763415501035493
sim_compute_robot_state-npc3_mean0.06240415872031089
sim_compute_robot_state-npc3_median0.06450833129882813
sim_compute_robot_state-npc3_min0.050817439189324014
sim_compute_sim_state_max0.03812551850755814
sim_compute_sim_state_mean0.035661961009279965
sim_compute_sim_state_median0.03742860221862793
sim_compute_sim_state_min0.028909609867976263
sim_physics_max0.17845311721165974
sim_physics_mean0.14152434844157186
sim_physics_median0.14288883972167968
sim_physics_min0.10808719121492824
sim_render-ego_max0.0606418466333098
sim_render-ego_mean0.05630769021765737
sim_render-ego_median0.0586039981842041
sim_render-ego_min0.0460399160018334
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.580000000000009
survival_time_min5.1999999999999895
202142987ioartchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno8070:09:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6484136414234332
survival_time_median3.399999999999996
deviation-center-line_median0.1909822160345785
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15445299542278323
agent_compute-ego_mean0.14710888565230945
agent_compute-ego_median0.14361471448625837
agent_compute-ego_min0.14061563462018967
deviation-center-line_max0.22170094668066745
deviation-center-line_mean0.16868831051476302
deviation-center-line_min0.10506487786396092
deviation-heading_max1.6006068941187166
deviation-heading_mean1.0594481132844054
deviation-heading_median1.2405855277219906
deviation-heading_min0.41078212378775375
driven_any_max1.7860179099022448
driven_any_mean0.9729200161058988
driven_any_median0.9862929044127214
driven_any_min0.4864214977522009
driven_lanedir_consec_max0.6730160510584665
driven_lanedir_consec_mean0.5976346980955531
driven_lanedir_consec_min0.44061819790611745
driven_lanedir_max0.6730160510584665
driven_lanedir_mean0.5981547593997137
driven_lanedir_median0.6504595364882388
driven_lanedir_min0.44061819790611745
in-drivable-lane_max2.9499999999999895
in-drivable-lane_mean0.7299999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4864214977522009, "sim_physics": 0.1025351583957672, "survival_time": 1.6000000000000008, "driven_lanedir": 0.44061819790611745, "sim_render-ego": 0.06609877943992615, "in-drivable-lane": 0, "agent_compute-ego": 0.14061563462018967, "deviation-heading": 0.4908647695496521, "set_robot_commands": 0.0864119678735733, "deviation-center-line": 0.10506487786396092, "driven_lanedir_consec": 0.44061819790611745, "sim_compute_sim_state": 0.037740111351013184, "sim_compute_performance-ego": 0.07004030048847198, "sim_compute_robot_state-ego": 0.07266425341367722}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9862929044127214, "sim_physics": 0.09214012916773966, "survival_time": 3.649999999999995, "driven_lanedir": 0.6730160510584665, "sim_render-ego": 0.06129436950161032, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14302545051052146, "deviation-heading": 1.554401251243914, "set_robot_commands": 0.09213625241632332, "deviation-center-line": 0.22170094668066745, "driven_lanedir_consec": 0.6730160510584665, "sim_compute_sim_state": 0.0402023628966449, "sim_compute_performance-ego": 0.06515240342649695, "sim_compute_robot_state-ego": 0.07209008687163053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7860179099022448, "sim_physics": 0.10185372282605652, "survival_time": 5.449999999999989, "driven_lanedir": 0.6504595364882388, "sim_render-ego": 0.06046299978133735, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.15445299542278323, "deviation-heading": 1.2405855277219906, "set_robot_commands": 0.09544551700627038, "deviation-center-line": 0.1909822160345785, "driven_lanedir_consec": 0.6504595364882388, "sim_compute_sim_state": 0.03852842925885402, "sim_compute_performance-ego": 0.06799250348992304, "sim_compute_robot_state-ego": 0.07284270295309364}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.001019273229271, "sim_physics": 0.09396729749791764, "survival_time": 3.399999999999996, "driven_lanedir": 0.6510139479442363, "sim_render-ego": 0.06443445822771858, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15383563322179458, "deviation-heading": 1.6006068941187166, "set_robot_commands": 0.0958485813701854, "deviation-center-line": 0.2142380647295583, "driven_lanedir_consec": 0.6484136414234332, "sim_compute_sim_state": 0.03801520431742949, "sim_compute_performance-ego": 0.06659012331682093, "sim_compute_robot_state-ego": 0.07146489269593183}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6048484952330552, "sim_physics": 0.0971313408442906, "survival_time": 1.7500000000000009, "driven_lanedir": 0.5756660636015098, "sim_render-ego": 0.05922983033316476, "in-drivable-lane": 0, "agent_compute-ego": 0.14361471448625837, "deviation-heading": 0.41078212378775375, "set_robot_commands": 0.09217500686645508, "deviation-center-line": 0.11145544726505012, "driven_lanedir_consec": 0.5756660636015098, "sim_compute_sim_state": 0.03628269604274205, "sim_compute_performance-ego": 0.06818105152675084, "sim_compute_robot_state-ego": 0.06717523166111537}}
set_robot_commands_max0.0958485813701854
set_robot_commands_mean0.0924034651065615
set_robot_commands_median0.09217500686645508
set_robot_commands_min0.0864119678735733
sim_compute_performance-ego_max0.07004030048847198
sim_compute_performance-ego_mean0.06759127644969275
sim_compute_performance-ego_median0.06799250348992304
sim_compute_performance-ego_min0.06515240342649695
sim_compute_robot_state-ego_max0.07284270295309364
sim_compute_robot_state-ego_mean0.07124743351908971
sim_compute_robot_state-ego_median0.07209008687163053
sim_compute_robot_state-ego_min0.06717523166111537
sim_compute_sim_state_max0.0402023628966449
sim_compute_sim_state_mean0.03815376077333673
sim_compute_sim_state_median0.03801520431742949
sim_compute_sim_state_min0.03628269604274205
sim_physics_max0.1025351583957672
sim_physics_mean0.09752552974635433
sim_physics_median0.0971313408442906
sim_physics_min0.09214012916773966
sim_render-ego_max0.06609877943992615
sim_render-ego_mean0.06230408745675144
sim_render-ego_median0.06129436950161032
sim_render-ego_min0.05922983033316476
simulation-passed1
survival_time_max5.449999999999989
survival_time_mean3.169999999999996
survival_time_min1.6000000000000008
202112998Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerrorno8070:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202082999Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerrorno8070:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202063007Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerrorno8070:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202033011Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerrorno8070:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201993014Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrorno8070:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201973026Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrorno8070:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201923038Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrorno8070:01:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201893042Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerrorno8070:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201853047Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerrorno8070:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201693050Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerrorno8070:04:17
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201582903Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationhost-errorno8070:09:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20158-387087', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201392990Bnaichchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno8070:09:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6938003480617501
survival_time_median2.6999999999999984
deviation-center-line_median0.1516523249231353
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1626388669013977
agent_compute-ego_mean0.14779628717119195
agent_compute-ego_median0.14909951714263564
agent_compute-ego_min0.13091718719666262
deviation-center-line_max0.1973158696573789
deviation-center-line_mean0.1629072778180587
deviation-center-line_min0.12760599685152874
deviation-heading_max1.635929476455538
deviation-heading_mean1.0023018457230384
deviation-heading_median0.8160244785183065
deviation-heading_min0.5220457886378561
driven_any_max1.1196931395510552
driven_any_mean0.9398847149299168
driven_any_median1.074517527847484
driven_any_min0.550496450238808
driven_lanedir_consec_max0.7870020807084321
driven_lanedir_consec_mean0.6571316765701173
driven_lanedir_consec_min0.4919505802026425
driven_lanedir_max0.7870020807084321
driven_lanedir_mean0.6571316765701173
driven_lanedir_median0.6938003480617501
driven_lanedir_min0.4919505802026425
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.6299999999999979
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.074517527847484, "sim_physics": 0.05145123269822863, "survival_time": 2.6999999999999984, "driven_lanedir": 0.6938003480617501, "sim_render-ego": 0.06495200704645228, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15738723896167897, "deviation-heading": 0.8160244785183065, "set_robot_commands": 0.09534743538609255, "deviation-center-line": 0.14437780907348313, "driven_lanedir_consec": 0.6938003480617501, "sim_compute_sim_state": 0.040158496962653265, "sim_compute_performance-ego": 0.069221090387415, "sim_compute_robot_state-ego": 0.0774365884286386}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1196931395510552, "sim_physics": 0.044195309452626896, "survival_time": 4.3499999999999925, "driven_lanedir": 0.5845674586820551, "sim_render-ego": 0.05879632357893319, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.14909951714263564, "deviation-heading": 1.635929476455538, "set_robot_commands": 0.09420123867604924, "deviation-center-line": 0.19358438858476745, "driven_lanedir_consec": 0.5845674586820551, "sim_compute_sim_state": 0.03739983185954478, "sim_compute_performance-ego": 0.06670707669751398, "sim_compute_robot_state-ego": 0.07332626430467627}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.104355623939405, "sim_physics": 0.04003961114998324, "survival_time": 4.149999999999993, "driven_lanedir": 0.7283379151957066, "sim_render-ego": 0.0550241326711264, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.13091718719666262, "deviation-heading": 1.24512117441081, "set_robot_commands": 0.08522570276834879, "deviation-center-line": 0.1973158696573789, "driven_lanedir_consec": 0.7283379151957066, "sim_compute_sim_state": 0.03544157097138554, "sim_compute_performance-ego": 0.06217752020043063, "sim_compute_robot_state-ego": 0.06372757417609892}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8503608330728324, "sim_physics": 0.04333650182794641, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7870020807084321, "sim_render-ego": 0.05524974840658682, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1389386256535848, "deviation-heading": 0.7923883105926819, "set_robot_commands": 0.08499088552263048, "deviation-center-line": 0.1516523249231353, "driven_lanedir_consec": 0.7870020807084321, "sim_compute_sim_state": 0.03628272921950729, "sim_compute_performance-ego": 0.061572653275948984, "sim_compute_robot_state-ego": 0.06719525655110677}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.550496450238808, "sim_physics": 0.056916171312332155, "survival_time": 2.000000000000001, "driven_lanedir": 0.4919505802026425, "sim_render-ego": 0.06729492545127869, "in-drivable-lane": 0.1499999999999999, "agent_compute-ego": 0.1626388669013977, "deviation-heading": 0.5220457886378561, "set_robot_commands": 0.10017446279525756, "deviation-center-line": 0.12760599685152874, "driven_lanedir_consec": 0.4919505802026425, "sim_compute_sim_state": 0.04045846462249756, "sim_compute_performance-ego": 0.0740838885307312, "sim_compute_robot_state-ego": 0.08161905407905579}}
set_robot_commands_max0.10017446279525756
set_robot_commands_mean0.09198794502967574
set_robot_commands_median0.09420123867604924
set_robot_commands_min0.08499088552263048
sim_compute_performance-ego_max0.0740838885307312
sim_compute_performance-ego_mean0.06675244581840796
sim_compute_performance-ego_median0.06670707669751398
sim_compute_performance-ego_min0.061572653275948984
sim_compute_robot_state-ego_max0.08161905407905579
sim_compute_robot_state-ego_mean0.07266094750791527
sim_compute_robot_state-ego_median0.07332626430467627
sim_compute_robot_state-ego_min0.06372757417609892
sim_compute_sim_state_max0.04045846462249756
sim_compute_sim_state_mean0.03794821872711768
sim_compute_sim_state_median0.03739983185954478
sim_compute_sim_state_min0.03544157097138554
sim_physics_max0.056916171312332155
sim_physics_mean0.047187765288223465
sim_physics_median0.044195309452626896
sim_physics_min0.04003961114998324
sim_render-ego_max0.06729492545127869
sim_render-ego_mean0.06026342743087547
sim_render-ego_median0.05879632357893319
sim_render-ego_min0.0550241326711264
simulation-passed1
survival_time_max4.3499999999999925
survival_time_mean3.179999999999997
survival_time_min2.000000000000001
201263011Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerrorno8070:01:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200972711RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno8070:13:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2964165331703259
survival_time_median3.1999999999999966
deviation-center-line_median0.2338897728424024
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.09550918851579938
agent_compute-ego_mean0.09238366577295858
agent_compute-ego_median0.09098811820149422
agent_compute-ego_min0.08973031092171717
deviation-center-line_max0.682467951300583
deviation-center-line_mean0.2943822653698276
deviation-center-line_min0.09432510139180456
deviation-heading_max3.665132485726784
deviation-heading_mean1.6215157366801365
deviation-heading_median1.0781779272443104
deviation-heading_min0.5044061025423345
driven_any_max1.5417162801264834
driven_any_mean0.6284259785535156
driven_any_median0.46506767228558993
driven_any_min0.17576453339198922
driven_lanedir_consec_max0.618339218983615
driven_lanedir_consec_mean0.33227307377916404
driven_lanedir_consec_min0.1445656684060399
driven_lanedir_max0.7736285236119969
driven_lanedir_mean0.4104054999090705
driven_lanedir_median0.4520002341786171
driven_lanedir_min0.1445656684060399
in-drivable-lane_max3.300000000000016
in-drivable-lane_mean0.7500000000000032
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7275929077398147, "sim_physics": 0.0967987970430024, "survival_time": 4.899999999999991, "driven_lanedir": 0.5317893591914763, "sim_render-ego": 0.07018238427687665, "in-drivable-lane": 0.3500000000000001, "agent_compute-ego": 0.09550918851579938, "deviation-heading": 2.176259545684896, "set_robot_commands": 0.13007041142911327, "deviation-center-line": 0.3506183913110702, "driven_lanedir_consec": 0.2964165331703259, "sim_compute_sim_state": 0.043923721021535446, "sim_compute_performance-ego": 0.07711956452350227, "sim_compute_robot_state-ego": 0.08836050666108423, "sim_compute_robot_state-npc0": 0.08030000511480838, "sim_compute_robot_state-npc1": 0.08177820760376599, "sim_compute_robot_state-npc2": 0.07663846502498704, "sim_compute_robot_state-npc3": 0.0776656622789344}, "udem1-1-0": {"driven_any": 0.2319884992237008, "sim_physics": 0.10097523416791644, "survival_time": 1.7500000000000009, "driven_lanedir": 0.1500437141572224, "sim_render-ego": 0.07334507533482143, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09500278064182828, "deviation-heading": 1.0781779272443104, "set_robot_commands": 0.13066411018371582, "deviation-center-line": 0.09432510139180456, "driven_lanedir_consec": 0.1500437141572224, "sim_compute_sim_state": 0.0442514283316476, "sim_compute_performance-ego": 0.08118383543831961, "sim_compute_robot_state-ego": 0.09472007751464843, "sim_compute_robot_state-npc0": 0.07986164093017578, "sim_compute_robot_state-npc1": 0.07901438304356166, "sim_compute_robot_state-npc2": 0.08010352679661342, "sim_compute_robot_state-npc3": 0.0782543591090611}, "udem1-2-0": {"driven_any": 1.5417162801264834, "sim_physics": 0.08497506560701312, "survival_time": 9.900000000000006, "driven_lanedir": 0.7736285236119969, "sim_render-ego": 0.06996364665753914, "in-drivable-lane": 3.300000000000016, "agent_compute-ego": 0.08973031092171717, "deviation-heading": 3.665132485726784, "set_robot_commands": 0.11321290334065756, "deviation-center-line": 0.682467951300583, "driven_lanedir_consec": 0.618339218983615, "sim_compute_sim_state": 0.04363157171191591, "sim_compute_performance-ego": 0.07662846343685882, "sim_compute_robot_state-ego": 0.08429446726134329, "sim_compute_robot_state-npc0": 0.07690942769098763, "sim_compute_robot_state-npc1": 0.07802956513684205, "sim_compute_robot_state-npc2": 0.07763752311167091, "sim_compute_robot_state-npc3": 0.07764632774121834}, "udem1-3-0": {"driven_any": 0.17576453339198922, "sim_physics": 0.08978650399616786, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1445656684060399, "sim_render-ego": 0.076431257384164, "in-drivable-lane": 0, "agent_compute-ego": 0.09068793058395386, "deviation-heading": 0.5044061025423345, "set_robot_commands": 0.12276463849203928, "deviation-center-line": 0.11061011000327788, "driven_lanedir_consec": 0.1445656684060399, "sim_compute_sim_state": 0.044947411332811625, "sim_compute_performance-ego": 0.07602662699563163, "sim_compute_robot_state-ego": 0.0807223916053772, "sim_compute_robot_state-npc0": 0.08529383795601982, "sim_compute_robot_state-npc1": 0.0802516256059919, "sim_compute_robot_state-npc2": 0.08142810208456856, "sim_compute_robot_state-npc3": 0.0817208204950605}, "udem1-4-0": {"driven_any": 0.46506767228558993, "sim_physics": 0.0939488559961319, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4520002341786171, "sim_render-ego": 0.07088271528482437, "in-drivable-lane": 0, "agent_compute-ego": 0.09098811820149422, "deviation-heading": 0.6836026222023585, "set_robot_commands": 0.1152818650007248, "deviation-center-line": 0.2338897728424024, "driven_lanedir_consec": 0.4520002341786171, "sim_compute_sim_state": 0.04543296992778778, "sim_compute_performance-ego": 0.079033974558115, "sim_compute_robot_state-ego": 0.08999491110444069, "sim_compute_robot_state-npc0": 0.07904291898012161, "sim_compute_robot_state-npc1": 0.07905133813619614, "sim_compute_robot_state-npc2": 0.08027615770697594, "sim_compute_robot_state-npc3": 0.0811455175280571}}
set_robot_commands_max0.13066411018371582
set_robot_commands_mean0.12239878568925014
set_robot_commands_median0.12276463849203928
set_robot_commands_min0.11321290334065756
sim_compute_performance-ego_max0.08118383543831961
sim_compute_performance-ego_mean0.07799849299048547
sim_compute_performance-ego_median0.07711956452350227
sim_compute_performance-ego_min0.07602662699563163
sim_compute_robot_state-ego_max0.09472007751464843
sim_compute_robot_state-ego_mean0.08761847082937876
sim_compute_robot_state-ego_median0.08836050666108423
sim_compute_robot_state-ego_min0.0807223916053772
sim_compute_robot_state-npc0_max0.08529383795601982
sim_compute_robot_state-npc0_mean0.08028156613442264
sim_compute_robot_state-npc0_median0.07986164093017578
sim_compute_robot_state-npc0_min0.07690942769098763
sim_compute_robot_state-npc1_max0.08177820760376599
sim_compute_robot_state-npc1_mean0.07962502390527156
sim_compute_robot_state-npc1_median0.07905133813619614
sim_compute_robot_state-npc1_min0.07802956513684205
sim_compute_robot_state-npc2_max0.08142810208456856
sim_compute_robot_state-npc2_mean0.07921675494496318
sim_compute_robot_state-npc2_median0.08010352679661342
sim_compute_robot_state-npc2_min0.07663846502498704
sim_compute_robot_state-npc3_max0.0817208204950605
sim_compute_robot_state-npc3_mean0.07928653743046629
sim_compute_robot_state-npc3_median0.0782543591090611
sim_compute_robot_state-npc3_min0.07764632774121834
sim_compute_sim_state_max0.04543296992778778
sim_compute_sim_state_mean0.04443742046513967
sim_compute_sim_state_median0.0442514283316476
sim_compute_sim_state_min0.04363157171191591
sim_physics_max0.10097523416791644
sim_physics_mean0.09329689136204632
sim_physics_median0.0939488559961319
sim_physics_min0.08497506560701312
sim_render-ego_max0.076431257384164
sim_render-ego_mean0.07216101578764512
sim_render-ego_median0.07088271528482437
sim_render-ego_min0.06996364665753914
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean4.229999999999999
survival_time_min1.4000000000000006
200932516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno8070:02:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200652774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno8070:20:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4610916151723656
survival_time_median4.849999999999991
deviation-center-line_median0.45276698352946704
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.10740617794149064
agent_compute-ego_mean0.0974848856270518
agent_compute-ego_median0.096357758512202
agent_compute-ego_min0.0888194751739502
deviation-center-line_max0.8920565985855058
deviation-center-line_mean0.48665771018907816
deviation-center-line_min0.14878517045151526
deviation-heading_max5.590394782413816
deviation-heading_mean2.409177872207663
deviation-heading_median1.88827014016829
deviation-heading_min0.5387737474023465
driven_any_max2.3481774496539756
driven_any_mean1.0344466349959816
driven_any_median0.7192216566210685
driven_any_min0.21946392917965632
driven_lanedir_consec_max1.069865675058762
driven_lanedir_consec_mean0.6191910085715143
driven_lanedir_consec_min0.19553454300342188
driven_lanedir_max1.5416723159581756
driven_lanedir_mean0.767947028079514
driven_lanedir_median0.5715709912048453
driven_lanedir_min0.19553454300342188
in-drivable-lane_max2.9500000000000375
in-drivable-lane_mean0.8700000000000084
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7192216566210685, "sim_physics": 0.1689629751382415, "survival_time": 4.849999999999991, "driven_lanedir": 0.5715709912048453, "sim_render-ego": 0.05945467211536525, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.096357758512202, "deviation-heading": 1.88827014016829, "set_robot_commands": 0.09270533089785232, "deviation-center-line": 0.45276698352946704, "driven_lanedir_consec": 0.37282484425229906, "sim_compute_sim_state": 0.038741283810015806, "sim_compute_performance-ego": 0.06619467931924407, "sim_compute_robot_state-ego": 0.0716333168069112, "sim_compute_robot_state-npc0": 0.06770825386047363, "sim_compute_robot_state-npc1": 0.06736286153498384, "sim_compute_robot_state-npc2": 0.07119387449677457, "sim_compute_robot_state-npc3": 0.06805651949853012}, "udem1-1-0": {"driven_any": 0.49269325732533115, "sim_physics": 0.19289657298256369, "survival_time": 3.399999999999996, "driven_lanedir": 0.4610916151723656, "sim_render-ego": 0.07153643580044017, "in-drivable-lane": 0, "agent_compute-ego": 0.10740617794149064, "deviation-heading": 1.1009792762837594, "set_robot_commands": 0.10758546170066384, "deviation-center-line": 0.22231101114908083, "driven_lanedir_consec": 0.4610916151723656, "sim_compute_sim_state": 0.04134117154514089, "sim_compute_performance-ego": 0.0755239164128023, "sim_compute_robot_state-ego": 0.08622941900702084, "sim_compute_robot_state-npc0": 0.07506196288501515, "sim_compute_robot_state-npc1": 0.07389005142099717, "sim_compute_robot_state-npc2": 0.07289907160927267, "sim_compute_robot_state-npc3": 0.07438559041303747}, "udem1-2-0": {"driven_any": 2.3481774496539756, "sim_physics": 0.19945947885513304, "survival_time": 14.950000000000076, "driven_lanedir": 1.5416723159581756, "sim_render-ego": 0.058152720133463544, "in-drivable-lane": 2.9500000000000375, "agent_compute-ego": 0.0888194751739502, "deviation-heading": 5.590394782413816, "set_robot_commands": 0.0914736827214559, "deviation-center-line": 0.8920565985855058, "driven_lanedir_consec": 0.9966383653707234, "sim_compute_sim_state": 0.0374313481648763, "sim_compute_performance-ego": 0.06605641762415568, "sim_compute_robot_state-ego": 0.06949221928914388, "sim_compute_robot_state-npc0": 0.06721139748891194, "sim_compute_robot_state-npc1": 0.0660956358909607, "sim_compute_robot_state-npc2": 0.06559297482172648, "sim_compute_robot_state-npc3": 0.06510388771692911}, "udem1-3-0": {"driven_any": 0.21946392917965632, "sim_physics": 0.17837156267727122, "survival_time": 1.7000000000000008, "driven_lanedir": 0.19553454300342188, "sim_render-ego": 0.05897978474112118, "in-drivable-lane": 0, "agent_compute-ego": 0.09934999662287096, "deviation-heading": 0.5387737474023465, "set_robot_commands": 0.09515185215893912, "deviation-center-line": 0.14878517045151526, "driven_lanedir_consec": 0.19553454300342188, "sim_compute_sim_state": 0.04157113327699549, "sim_compute_performance-ego": 0.06533599601072423, "sim_compute_robot_state-ego": 0.06749247803407557, "sim_compute_robot_state-npc0": 0.06542510144850787, "sim_compute_robot_state-npc1": 0.06549784015206729, "sim_compute_robot_state-npc2": 0.07089714442982394, "sim_compute_robot_state-npc3": 0.06852858908036176}, "udem1-4-0": {"driven_any": 1.3926768821998767, "sim_physics": 0.21406842205259535, "survival_time": 8.999999999999993, "driven_lanedir": 1.069865675058762, "sim_render-ego": 0.06567460828357273, "in-drivable-lane": 1.100000000000004, "agent_compute-ego": 0.09549101988474527, "deviation-heading": 2.927471414770104, "set_robot_commands": 0.09785147110621134, "deviation-center-line": 0.717368787229822, "driven_lanedir_consec": 1.069865675058762, "sim_compute_sim_state": 0.03894011576970418, "sim_compute_performance-ego": 0.07078109449810452, "sim_compute_robot_state-ego": 0.07896152072482639, "sim_compute_robot_state-npc0": 0.07110564046435885, "sim_compute_robot_state-npc1": 0.07201767630047268, "sim_compute_robot_state-npc2": 0.07041087812847562, "sim_compute_robot_state-npc3": 0.06952949629889595}}
set_robot_commands_max0.10758546170066384
set_robot_commands_mean0.0969535597170245
set_robot_commands_median0.09515185215893912
set_robot_commands_min0.0914736827214559
sim_compute_performance-ego_max0.0755239164128023
sim_compute_performance-ego_mean0.06877842077300615
sim_compute_performance-ego_median0.06619467931924407
sim_compute_performance-ego_min0.06533599601072423
sim_compute_robot_state-ego_max0.08622941900702084
sim_compute_robot_state-ego_mean0.07476179077239556
sim_compute_robot_state-ego_median0.0716333168069112
sim_compute_robot_state-ego_min0.06749247803407557
sim_compute_robot_state-npc0_max0.07506196288501515
sim_compute_robot_state-npc0_mean0.06930247122945349
sim_compute_robot_state-npc0_median0.06770825386047363
sim_compute_robot_state-npc0_min0.06542510144850787
sim_compute_robot_state-npc1_max0.07389005142099717
sim_compute_robot_state-npc1_mean0.06897281305989633
sim_compute_robot_state-npc1_median0.06736286153498384
sim_compute_robot_state-npc1_min0.06549784015206729
sim_compute_robot_state-npc2_max0.07289907160927267
sim_compute_robot_state-npc2_mean0.07019878869721466
sim_compute_robot_state-npc2_median0.07089714442982394
sim_compute_robot_state-npc2_min0.06559297482172648
sim_compute_robot_state-npc3_max0.07438559041303747
sim_compute_robot_state-npc3_mean0.06912081660155087
sim_compute_robot_state-npc3_median0.06852858908036176
sim_compute_robot_state-npc3_min0.06510388771692911
sim_compute_sim_state_max0.04157113327699549
sim_compute_sim_state_mean0.039605010513346535
sim_compute_sim_state_median0.03894011576970418
sim_compute_sim_state_min0.0374313481648763
sim_physics_max0.21406842205259535
sim_physics_mean0.190751802341161
sim_physics_median0.19289657298256369
sim_physics_min0.1689629751382415
sim_render-ego_max0.07153643580044017
sim_render-ego_mean0.06275964421479258
sim_render-ego_median0.05945467211536525
sim_render-ego_min0.058152720133463544
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.780000000000011
survival_time_min1.7000000000000008
200403002Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8070:02:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20040-305793', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200042424Andrea Censirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessno8070:06:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.630782078032722
survival_time_median2.6499999999999986
deviation-center-line_median0.10342694179960472
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.13045658005608451
agent_compute-ego_mean0.09698571854625712
agent_compute-ego_median0.08343864181666698
agent_compute-ego_min0.07597101362128007
deviation-center-line_max0.24274593434117447
deviation-center-line_mean0.1423794188959262
deviation-center-line_min0.05838775199208855
deviation-heading_max0.9510803390140998
deviation-heading_mean0.5404741772455786
deviation-heading_median0.4662935751765816
deviation-heading_min0.3138996563005005
driven_any_max2.1937495917222662
driven_any_mean1.101203967779493
driven_any_median1.072953759306336
driven_any_min0.3121624499492532
driven_lanedir_consec_max1.8128454170816104
driven_lanedir_consec_mean0.8194262040404128
driven_lanedir_consec_min0.29255031695938905
driven_lanedir_max1.8128454170816104
driven_lanedir_mean0.8194262040404128
driven_lanedir_median0.630782078032722
driven_lanedir_min0.29255031695938905
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.04072495301564535, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.05850170718299018, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.118720057937834, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.0805099109808604, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.030799855788548783, "sim_compute_performance-ego": 0.05336981349521213, "sim_compute_robot_state-ego": 0.05818211038907369, "sim_compute_robot_state-npc0": 0.0550132691860199, "sim_compute_robot_state-npc1": 0.05443762077225579, "sim_compute_robot_state-npc2": 0.054849853118260704, "sim_compute_robot_state-npc3": 0.05299637383884854}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.03362323619701244, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.0556843810611301, "in-drivable-lane": 0, "agent_compute-ego": 0.13045658005608451, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.08223069155657733, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03130326447663484, "sim_compute_performance-ego": 0.0560518812250208, "sim_compute_robot_state-ego": 0.0581561459435357, "sim_compute_robot_state-npc0": 0.06354708141750759, "sim_compute_robot_state-npc1": 0.05521211800751863, "sim_compute_robot_state-npc2": 0.055425811696935584, "sim_compute_robot_state-npc3": 0.058741339930781615}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.03192920823699062, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.03988044933207984, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08343864181666698, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.06110258704250299, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.024314845649941453, "sim_compute_performance-ego": 0.04161832633527737, "sim_compute_robot_state-ego": 0.042404114621356855, "sim_compute_robot_state-npc0": 0.04397331163721177, "sim_compute_robot_state-npc1": 0.042393911232068704, "sim_compute_robot_state-npc2": 0.04336014766137577, "sim_compute_robot_state-npc3": 0.04306308042655871}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.024745806208196677, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.035915289285048, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.07634229929942005, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.05552375541543061, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.022777089532816184, "sim_compute_performance-ego": 0.04073105218275538, "sim_compute_robot_state-ego": 0.039519561911528965, "sim_compute_robot_state-npc0": 0.03977642419203272, "sim_compute_robot_state-npc1": 0.03964980143421101, "sim_compute_robot_state-npc2": 0.03974571317996619, "sim_compute_robot_state-npc3": 0.039744372637766714}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.02239679035387541, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.03522785086380808, "in-drivable-lane": 0, "agent_compute-ego": 0.07597101362128007, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.05506658554077149, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.022198840191489773, "sim_compute_performance-ego": 0.03795906117087916, "sim_compute_robot_state-ego": 0.039517615970812346, "sim_compute_robot_state-npc0": 0.03932024303235506, "sim_compute_robot_state-npc1": 0.03874579228852924, "sim_compute_robot_state-npc2": 0.03876790247465435, "sim_compute_robot_state-npc3": 0.03872107204638029}}
set_robot_commands_max0.08223069155657733
set_robot_commands_mean0.06688670610722855
set_robot_commands_median0.06110258704250299
set_robot_commands_min0.05506658554077149
sim_compute_performance-ego_max0.0560518812250208
sim_compute_performance-ego_mean0.045946026881828965
sim_compute_performance-ego_median0.04161832633527737
sim_compute_performance-ego_min0.03795906117087916
sim_compute_robot_state-ego_max0.05818211038907369
sim_compute_robot_state-ego_mean0.04755590976726151
sim_compute_robot_state-ego_median0.042404114621356855
sim_compute_robot_state-ego_min0.039517615970812346
sim_compute_robot_state-npc0_max0.06354708141750759
sim_compute_robot_state-npc0_mean0.04832606589302541
sim_compute_robot_state-npc0_median0.04397331163721177
sim_compute_robot_state-npc0_min0.03932024303235506
sim_compute_robot_state-npc1_max0.05521211800751863
sim_compute_robot_state-npc1_mean0.04608784874691667
sim_compute_robot_state-npc1_median0.042393911232068704
sim_compute_robot_state-npc1_min0.03874579228852924
sim_compute_robot_state-npc2_max0.055425811696935584
sim_compute_robot_state-npc2_mean0.04642988562623852
sim_compute_robot_state-npc2_median0.04336014766137577
sim_compute_robot_state-npc2_min0.03876790247465435
sim_compute_robot_state-npc3_max0.058741339930781615
sim_compute_robot_state-npc3_mean0.04665324777606717
sim_compute_robot_state-npc3_median0.04306308042655871
sim_compute_robot_state-npc3_min0.03872107204638029
sim_compute_sim_state_max0.03130326447663484
sim_compute_sim_state_mean0.026278779127886204
sim_compute_sim_state_median0.024314845649941453
sim_compute_sim_state_min0.022198840191489773
sim_physics_max0.04072495301564535
sim_physics_mean0.030683998802344094
sim_physics_median0.03192920823699062
sim_physics_min0.02239679035387541
sim_render-ego_max0.05850170718299018
sim_render-ego_mean0.04504193554501124
sim_render-ego_median0.03988044933207984
sim_render-ego_min0.03522785086380808
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.739999999999997
survival_time_min0.9500000000000004
199762487Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno8070:02:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
199552617Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationerrorno8070:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
199432819Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationerrorno8070:00:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
199252974Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationerrorno8070:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
199102665RamiNaimModidfied configaido2-LF-sim-validationstep1-simulationerrorno8070:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
198092964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessno8070:25:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3632709853899321
survival_time_median14.950000000000076
deviation-center-line_median0.2651556500958301
in-drivable-lane_median2.199999999999992


other stats
agent_compute-ego_max0.2403205143777948
agent_compute-ego_mean0.21406297965157303
agent_compute-ego_median0.21068809111913045
agent_compute-ego_min0.2007650647844587
deviation-center-line_max1.338768390486617
deviation-center-line_mean0.5833651019248329
deviation-center-line_min0.17956925054779688
deviation-heading_max1.911104817429614
deviation-heading_mean1.371509752151971
deviation-heading_median1.3652537939052305
deviation-heading_min0.7451138797018895
driven_any_max1.650928186830955
driven_any_mean1.21784380082501
driven_any_median1.502155110133958
driven_any_min0.6850636179225965
driven_lanedir_consec_max1.5499306361971164
driven_lanedir_consec_mean0.7329507511157798
driven_lanedir_consec_min0.2693312838668618
driven_lanedir_max1.5499306361971164
driven_lanedir_mean0.7329507511157798
driven_lanedir_median0.3632709853899321
driven_lanedir_min0.2693312838668618
in-drivable-lane_max11.200000000000085
in-drivable-lane_mean3.750000000000012
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.502155110133958, "sim_physics": 0.03986517667770386, "survival_time": 14.950000000000076, "driven_lanedir": 1.1673208440022462, "sim_render-ego": 0.05969158490498861, "in-drivable-lane": 3.5999999999999908, "agent_compute-ego": 0.20334578275680543, "deviation-heading": 1.911104817429614, "set_robot_commands": 0.09187567313512168, "deviation-center-line": 1.338768390486617, "driven_lanedir_consec": 1.1673208440022462, "sim_compute_sim_state": 0.03713069200515747, "sim_compute_performance-ego": 0.06541584253311157, "sim_compute_robot_state-ego": 0.06865583340326945, "sim_compute_robot_state-npc0": 0.06664136330286662, "sim_compute_robot_state-npc1": 0.06700712521870932, "sim_compute_robot_state-npc2": 0.06525582393010457, "sim_compute_robot_state-npc3": 0.06533918937047323}, "udem1-1-0": {"driven_any": 0.6850636179225965, "sim_physics": 0.04260722471743214, "survival_time": 4.899999999999991, "driven_lanedir": 0.2693312838668618, "sim_render-ego": 0.06057168269643978, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.2007650647844587, "deviation-heading": 0.7451138797018895, "set_robot_commands": 0.09172646366820043, "deviation-center-line": 0.2651556500958301, "driven_lanedir_consec": 0.2693312838668618, "sim_compute_sim_state": 0.03669844841470524, "sim_compute_performance-ego": 0.06429301962560537, "sim_compute_robot_state-ego": 0.06543077498066183, "sim_compute_robot_state-npc0": 0.06485108210116017, "sim_compute_robot_state-npc1": 0.06572820702377631, "sim_compute_robot_state-npc2": 0.06514873066726996, "sim_compute_robot_state-npc3": 0.06526582824940584}, "udem1-2-0": {"driven_any": 0.6876186580608464, "sim_physics": 0.047087576514796205, "survival_time": 4.749999999999991, "driven_lanedir": 0.3149000061227425, "sim_render-ego": 0.062468601527966953, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2403205143777948, "deviation-heading": 1.2083798606632024, "set_robot_commands": 0.09858937012521844, "deviation-center-line": 0.17956925054779688, "driven_lanedir_consec": 0.3149000061227425, "sim_compute_sim_state": 0.04046435356140136, "sim_compute_performance-ego": 0.06927243784854287, "sim_compute_robot_state-ego": 0.07659800178126284, "sim_compute_robot_state-npc0": 0.07000113286470112, "sim_compute_robot_state-npc1": 0.07065830481679816, "sim_compute_robot_state-npc2": 0.07195301055908203, "sim_compute_robot_state-npc3": 0.07260706048262747}, "udem1-3-0": {"driven_any": 1.650928186830955, "sim_physics": 0.0430057692527771, "survival_time": 14.950000000000076, "driven_lanedir": 0.3632709853899321, "sim_render-ego": 0.06107528289159139, "in-drivable-lane": 11.200000000000085, "agent_compute-ego": 0.2151954452196757, "deviation-heading": 1.3652537939052305, "set_robot_commands": 0.09324332555135093, "deviation-center-line": 0.24303355671047608, "driven_lanedir_consec": 0.3632709853899321, "sim_compute_sim_state": 0.03771128575007121, "sim_compute_performance-ego": 0.06677445729573568, "sim_compute_robot_state-ego": 0.07108130455017089, "sim_compute_robot_state-npc0": 0.06696974515914916, "sim_compute_robot_state-npc1": 0.06736607154210408, "sim_compute_robot_state-npc2": 0.06762938896814982, "sim_compute_robot_state-npc3": 0.06736282269159953}, "udem1-4-0": {"driven_any": 1.5634534311766934, "sim_physics": 0.03827539920806885, "survival_time": 14.950000000000076, "driven_lanedir": 1.5499306361971164, "sim_render-ego": 0.05965169350306193, "in-drivable-lane": 0, "agent_compute-ego": 0.21068809111913045, "deviation-heading": 1.6276964090599195, "set_robot_commands": 0.0942766531308492, "deviation-center-line": 0.8902986617834451, "driven_lanedir_consec": 1.5499306361971164, "sim_compute_sim_state": 0.0383815614382426, "sim_compute_performance-ego": 0.06598840395609538, "sim_compute_robot_state-ego": 0.07010128577550252, "sim_compute_robot_state-npc0": 0.0666686987876892, "sim_compute_robot_state-npc1": 0.06540005127588908, "sim_compute_robot_state-npc2": 0.0647949473063151, "sim_compute_robot_state-npc3": 0.06525809526443481}}
set_robot_commands_max0.09858937012521844
set_robot_commands_mean0.09394229712214812
set_robot_commands_median0.09324332555135093
set_robot_commands_min0.09172646366820043
sim_compute_performance-ego_max0.06927243784854287
sim_compute_performance-ego_mean0.06634883225181817
sim_compute_performance-ego_median0.06598840395609538
sim_compute_performance-ego_min0.06429301962560537
sim_compute_robot_state-ego_max0.07659800178126284
sim_compute_robot_state-ego_mean0.0703734400981735
sim_compute_robot_state-ego_median0.07010128577550252
sim_compute_robot_state-ego_min0.06543077498066183
sim_compute_robot_state-npc0_max0.07000113286470112
sim_compute_robot_state-npc0_mean0.06702640444311325
sim_compute_robot_state-npc0_median0.0666686987876892
sim_compute_robot_state-npc0_min0.06485108210116017
sim_compute_robot_state-npc1_max0.07065830481679816
sim_compute_robot_state-npc1_mean0.0672319519754554
sim_compute_robot_state-npc1_median0.06700712521870932
sim_compute_robot_state-npc1_min0.06540005127588908
sim_compute_robot_state-npc2_max0.07195301055908203
sim_compute_robot_state-npc2_mean0.0669563802861843
sim_compute_robot_state-npc2_median0.06525582393010457
sim_compute_robot_state-npc2_min0.0647949473063151
sim_compute_robot_state-npc3_max0.07260706048262747
sim_compute_robot_state-npc3_mean0.06716659921170817
sim_compute_robot_state-npc3_median0.06533918937047323
sim_compute_robot_state-npc3_min0.06525809526443481
sim_compute_sim_state_max0.04046435356140136
sim_compute_sim_state_mean0.03807726823391558
sim_compute_sim_state_median0.03771128575007121
sim_compute_sim_state_min0.03669844841470524
sim_physics_max0.047087576514796205
sim_physics_mean0.04216822927415563
sim_physics_median0.04260722471743214
sim_physics_min0.03827539920806885
sim_render-ego_max0.062468601527966953
sim_render-ego_mean0.06069176910480974
sim_render-ego_median0.06057168269643978
sim_render-ego_min0.05965169350306193
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.900000000000045
survival_time_min4.749999999999991
197872648zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessno8070:09:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4677520238097679
survival_time_median2.849999999999998
deviation-center-line_median0.13993923038273243
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.07544160516638505
agent_compute-ego_mean0.06812801526475358
agent_compute-ego_median0.06712697170398853
agent_compute-ego_min0.06398144521211323
deviation-center-line_max0.441991081977021
deviation-center-line_mean0.24301419493149473
deviation-center-line_min0.11233303566656118
deviation-heading_max1.965590298952019
deviation-heading_mean0.904977224642509
deviation-heading_median0.6817498444220604
deviation-heading_min0.23880859753921196
driven_any_max2.234618045439434
driven_any_mean1.1136680430892796
driven_any_median0.7854280860806753
driven_any_min0.3734823939695258
driven_lanedir_consec_max1.4162453958283412
driven_lanedir_consec_mean0.7217431069832176
driven_lanedir_consec_min0.3618460409658957
driven_lanedir_max1.4162453958283412
driven_lanedir_mean0.7217431069832176
driven_lanedir_median0.4677520238097679
driven_lanedir_min0.3618460409658957
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.04282885903765442, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06177498124966955, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06966054971051064, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.09017984882281845, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03630462118015168, "sim_compute_performance-ego": 0.06711908662395114, "sim_compute_robot_state-ego": 0.06954807688476174, "sim_compute_robot_state-npc0": 0.06569163055176948, "sim_compute_robot_state-npc1": 0.06543698432339225, "sim_compute_robot_state-npc2": 0.06476116484137857, "sim_compute_robot_state-npc3": 0.06474994246367437}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.04200396412297299, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.06470039016322086, "in-drivable-lane": 0, "agent_compute-ego": 0.07544160516638505, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.10326998484762091, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03918901242707905, "sim_compute_performance-ego": 0.06936484888980263, "sim_compute_robot_state-ego": 0.07331530043953344, "sim_compute_robot_state-npc0": 0.07017082289645546, "sim_compute_robot_state-npc1": 0.0668426375640066, "sim_compute_robot_state-npc2": 0.06704604625701904, "sim_compute_robot_state-npc3": 0.06656617867319208}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.04180845043115448, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.05957789588392826, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06398144521211323, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.08161811661301997, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03417824444017912, "sim_compute_performance-ego": 0.06549668730350963, "sim_compute_robot_state-ego": 0.07006826317101195, "sim_compute_robot_state-npc0": 0.06324334311903569, "sim_compute_robot_state-npc1": 0.06375572555943539, "sim_compute_robot_state-npc2": 0.06206117596542626, "sim_compute_robot_state-npc3": 0.06176816371449253}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.043116207476015446, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06108865914521394, "in-drivable-lane": 0, "agent_compute-ego": 0.06712697170398853, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.09635046676353172, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03770404391818576, "sim_compute_performance-ego": 0.06558160428647641, "sim_compute_robot_state-ego": 0.06301864871272335, "sim_compute_robot_state-npc0": 0.06650079621209039, "sim_compute_robot_state-npc1": 0.0629394495928729, "sim_compute_robot_state-npc2": 0.06449591671978985, "sim_compute_robot_state-npc3": 0.06230823198954264}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.04097558770860944, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.05659602937244233, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06442950453077044, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.08817848137446813, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03593378407614572, "sim_compute_performance-ego": 0.06166742529187884, "sim_compute_robot_state-ego": 0.06437347805689252, "sim_compute_robot_state-npc0": 0.06231158877175952, "sim_compute_robot_state-npc1": 0.06245580173674084, "sim_compute_robot_state-npc2": 0.06348648714640784, "sim_compute_robot_state-npc3": 0.060644588773212736}}
set_robot_commands_max0.10326998484762091
set_robot_commands_mean0.09191937968429184
set_robot_commands_median0.09017984882281845
set_robot_commands_min0.08161811661301997
sim_compute_performance-ego_max0.06936484888980263
sim_compute_performance-ego_mean0.06584593047912372
sim_compute_performance-ego_median0.06558160428647641
sim_compute_performance-ego_min0.06166742529187884
sim_compute_robot_state-ego_max0.07331530043953344
sim_compute_robot_state-ego_mean0.0680647534529846
sim_compute_robot_state-ego_median0.06954807688476174
sim_compute_robot_state-ego_min0.06301864871272335
sim_compute_robot_state-npc0_max0.07017082289645546
sim_compute_robot_state-npc0_mean0.0655836363102221
sim_compute_robot_state-npc0_median0.06569163055176948
sim_compute_robot_state-npc0_min0.06231158877175952
sim_compute_robot_state-npc1_max0.0668426375640066
sim_compute_robot_state-npc1_mean0.0642861197552896
sim_compute_robot_state-npc1_median0.06375572555943539
sim_compute_robot_state-npc1_min0.06245580173674084
sim_compute_robot_state-npc2_max0.06704604625701904
sim_compute_robot_state-npc2_mean0.0643701581860043
sim_compute_robot_state-npc2_median0.06449591671978985
sim_compute_robot_state-npc2_min0.06206117596542626
sim_compute_robot_state-npc3_max0.06656617867319208
sim_compute_robot_state-npc3_mean0.06320742112282288
sim_compute_robot_state-npc3_median0.06230823198954264
sim_compute_robot_state-npc3_min0.060644588773212736
sim_compute_sim_state_max0.03918901242707905
sim_compute_sim_state_mean0.03666194120834827
sim_compute_sim_state_median0.03630462118015168
sim_compute_sim_state_min0.03417824444017912
sim_physics_max0.043116207476015446
sim_physics_mean0.04214661375528136
sim_physics_median0.04200396412297299
sim_physics_min0.04097558770860944
sim_render-ego_max0.06470039016322086
sim_render-ego_mean0.060747591162894986
sim_render-ego_median0.06108865914521394
sim_render-ego_min0.05659602937244233
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.049999999999993
survival_time_min1.3500000000000003
197442981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8070:14:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19744-156327', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
197183038Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrorno8070:05:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.