Duckietown Challenges Home Challenges Submissions

Evaluator 791

ID791
evaluatorip-172-31-38-104-8056
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-8056
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success16 19293
# timeout
# failed
# error10 19277
# aborted
# host-error5 19246
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
197053014Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:01:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196922994Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:02:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196782363Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.146159913804796
agent_compute-ego_mean0.1306357454826073
agent_compute-ego_median0.127136101325353
agent_compute-ego_min0.1171217771137462
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021799303450674382, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05513229909932838, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12291461566709122, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08202693597325739, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.033973797312322654, "sim_compute_performance-ego": 0.060844385399008695, "sim_compute_robot_state-ego": 0.06317902960867253}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.0267084078355269, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06252001090483232, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13984631950205023, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09948571703650734, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03884972225535999, "sim_compute_performance-ego": 0.07197013226422397, "sim_compute_robot_state-ego": 0.07398979230360551}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.024480777316623265, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06600735982259115, "in-drivable-lane": 0, "agent_compute-ego": 0.146159913804796, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10860469606187607, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.039071342680189344, "sim_compute_performance-ego": 0.07083836131625705, "sim_compute_robot_state-ego": 0.07879983054267035}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.022840842604637143, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.057239179809888206, "in-drivable-lane": 0, "agent_compute-ego": 0.127136101325353, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08788324892520905, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03465354939301809, "sim_compute_performance-ego": 0.06373266379038493, "sim_compute_robot_state-ego": 0.06739363074302673}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.020640029626734117, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05358007024316227, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1171217771137462, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08153816882301779, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03209157901651719, "sim_compute_performance-ego": 0.057240899871377385, "sim_compute_robot_state-ego": 0.05971999729380888}}
set_robot_commands_max0.10860469606187607
set_robot_commands_mean0.09190775336397353
set_robot_commands_median0.08788324892520905
set_robot_commands_min0.08153816882301779
sim_compute_performance-ego_max0.07197013226422397
sim_compute_performance-ego_mean0.0649252885282504
sim_compute_performance-ego_median0.06373266379038493
sim_compute_performance-ego_min0.057240899871377385
sim_compute_robot_state-ego_max0.07879983054267035
sim_compute_robot_state-ego_mean0.0686164560983568
sim_compute_robot_state-ego_median0.06739363074302673
sim_compute_robot_state-ego_min0.05971999729380888
sim_compute_sim_state_max0.039071342680189344
sim_compute_sim_state_mean0.035727998131481455
sim_compute_sim_state_median0.03465354939301809
sim_compute_sim_state_min0.03209157901651719
sim_physics_max0.0267084078355269
sim_physics_mean0.02329387216683916
sim_physics_median0.022840842604637143
sim_physics_min0.020640029626734117
sim_render-ego_max0.06600735982259115
sim_render-ego_mean0.05889578397596047
sim_render-ego_median0.057239179809888206
sim_render-ego_min0.05358007024316227
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
196642376Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2394590679116675
survival_time_median5.549999999999988
deviation-center-line_median0.04756896992501765
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.06080120533436268
agent_compute-ego_mean0.05674019803156007
agent_compute-ego_median0.05858040849367777
agent_compute-ego_min0.04729885525173611
deviation-center-line_max0.06628159589691172
deviation-center-line_mean0.055053867384428454
deviation-center-line_min0.04756874938348469
deviation-heading_max0.3902119203851745
deviation-heading_mean0.3724667982759654
deviation-heading_median0.39020902164128224
deviation-heading_min0.34585149487811473
driven_any_max1.5771689201187185
driven_any_mean1.343168920198914
driven_any_median1.5771689201187176
driven_any_min0.992168920319208
driven_lanedir_consec_max1.344898529895705
driven_lanedir_consec_mean1.047634910702065
driven_lanedir_consec_min0.6544587706938922
driven_lanedir_max1.344898529895705
driven_lanedir_mean1.047634910702065
driven_lanedir_median1.2394590679116675
driven_lanedir_min0.6544587706938922
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.8799999999999969
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.018328246143129136, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.04567342665460375, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04729885525173611, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.07634370856814915, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.028959217998716567, "sim_compute_performance-ego": 0.05196664399570889, "sim_compute_robot_state-ego": 0.052758594353993736}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.02075156569480896, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.048990597327550255, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.05858040849367777, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.08188149333000183, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.03148198790020413, "sim_compute_performance-ego": 0.056338717540105186, "sim_compute_robot_state-ego": 0.06087335613038805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.02414747616192242, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.055670867095122464, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.06080120533436268, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.08714690938726202, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.03580607379878963, "sim_compute_performance-ego": 0.06349098575007808, "sim_compute_robot_state-ego": 0.06645583247279262}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.022008354599411424, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.05685419434899682, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.060476958214699686, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.0891155616657154, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.037205968891178165, "sim_compute_performance-ego": 0.06614921329257724, "sim_compute_robot_state-ego": 0.06737910090266047}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.02138212135246208, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.054149715750067086, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05654356286332414, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.08303632392539634, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03266031677658494, "sim_compute_performance-ego": 0.05911911070883811, "sim_compute_robot_state-ego": 0.05939056637050869}}
set_robot_commands_max0.0891155616657154
set_robot_commands_mean0.08350479937530494
set_robot_commands_median0.08303632392539634
set_robot_commands_min0.07634370856814915
sim_compute_performance-ego_max0.06614921329257724
sim_compute_performance-ego_mean0.059412934257461504
sim_compute_performance-ego_median0.05911911070883811
sim_compute_performance-ego_min0.05196664399570889
sim_compute_robot_state-ego_max0.06737910090266047
sim_compute_robot_state-ego_mean0.06137149004606872
sim_compute_robot_state-ego_median0.06087335613038805
sim_compute_robot_state-ego_min0.052758594353993736
sim_compute_sim_state_max0.037205968891178165
sim_compute_sim_state_mean0.033222713073094684
sim_compute_sim_state_median0.03266031677658494
sim_compute_sim_state_min0.028959217998716567
sim_physics_max0.02414747616192242
sim_physics_mean0.021323552790346804
sim_physics_median0.02138212135246208
sim_physics_min0.018328246143129136
sim_render-ego_max0.05685419434899682
sim_render-ego_mean0.05226776023526808
sim_render-ego_median0.054149715750067086
sim_render-ego_min0.04567342665460375
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean4.769999999999992
survival_time_min3.599999999999995
No reset possible
196522391Liam Paull 🇨🇦random_agentaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.1373882982465956
agent_compute-ego_mean0.12343515013850316
agent_compute-ego_median0.12602374951044715
agent_compute-ego_min0.10218766050518684
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015884790780409327, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04630233206838932, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.10218766050518684, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0695155161731648, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.029465747329424013, "sim_compute_performance-ego": 0.05035271284715185, "sim_compute_robot_state-ego": 0.05286209988144209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.018090562386946243, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05410419810901989, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.12874606522646817, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.09384878115220505, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.033136606216430664, "sim_compute_performance-ego": 0.06034130399877375, "sim_compute_robot_state-ego": 0.06166459213603626}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.022486358218722875, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06256270938449436, "in-drivable-lane": 0, "agent_compute-ego": 0.1373882982465956, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.10349630779690212, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.040295012791951496, "sim_compute_performance-ego": 0.06785844696892632, "sim_compute_robot_state-ego": 0.07331024275885688}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.021788289149602253, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05966062347094218, "in-drivable-lane": 0, "agent_compute-ego": 0.12602374951044715, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.086312601963679, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03531423211097717, "sim_compute_performance-ego": 0.06506861746311188, "sim_compute_robot_state-ego": 0.0645100325345993}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.021522437824922448, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05733862694572, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12282997720381791, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08976738242542043, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03517515168470495, "sim_compute_performance-ego": 0.06308009343988755, "sim_compute_robot_state-ego": 0.06306172118467443}}
set_robot_commands_max0.10349630779690212
set_robot_commands_mean0.08858811790227428
set_robot_commands_median0.08976738242542043
set_robot_commands_min0.0695155161731648
sim_compute_performance-ego_max0.06785844696892632
sim_compute_performance-ego_mean0.06134023494357026
sim_compute_performance-ego_median0.06308009343988755
sim_compute_performance-ego_min0.05035271284715185
sim_compute_robot_state-ego_max0.07331024275885688
sim_compute_robot_state-ego_mean0.0630817376991218
sim_compute_robot_state-ego_median0.06306172118467443
sim_compute_robot_state-ego_min0.05286209988144209
sim_compute_sim_state_max0.040295012791951496
sim_compute_sim_state_mean0.034677350026697654
sim_compute_sim_state_median0.03517515168470495
sim_compute_sim_state_min0.029465747329424013
sim_physics_max0.022486358218722875
sim_physics_mean0.01995448767212063
sim_physics_median0.021522437824922448
sim_physics_min0.015884790780409327
sim_render-ego_max0.06256270938449436
sim_render-ego_mean0.055993697995713146
sim_render-ego_median0.05733862694572
sim_render-ego_min0.04630233206838932
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
196472400Liam Paull 🇨🇦random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.1350987995824506
agent_compute-ego_mean0.12583236376568527
agent_compute-ego_median0.12405374202322451
agent_compute-ego_min0.11885751669223492
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03576774445791093, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05292688475714789, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1192044114309644, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07960019414387053, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.032091980888730005, "sim_compute_performance-ego": 0.05934404948401072, "sim_compute_robot_state-ego": 0.059202254764617435, "sim_compute_robot_state-npc0": 0.05739707416958279, "sim_compute_robot_state-npc1": 0.056765121126931814, "sim_compute_robot_state-npc2": 0.05743613318791465, "sim_compute_robot_state-npc3": 0.058415276663643975}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.039388086281570735, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0569909133163153, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13194734909955194, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.09608156540814568, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03665710898006663, "sim_compute_performance-ego": 0.06519811293658088, "sim_compute_robot_state-ego": 0.06928610801696777, "sim_compute_robot_state-npc0": 0.0669237725874957, "sim_compute_robot_state-npc1": 0.06534705442540786, "sim_compute_robot_state-npc2": 0.06239506310107661, "sim_compute_robot_state-npc3": 0.062045770532944626}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04051281175305767, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.061348330590032765, "in-drivable-lane": 0, "agent_compute-ego": 0.1350987995824506, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09706875201194518, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03643358907391949, "sim_compute_performance-ego": 0.06564698680754631, "sim_compute_robot_state-ego": 0.06578744995978571, "sim_compute_robot_state-npc0": 0.07066230235561248, "sim_compute_robot_state-npc1": 0.06654747070804719, "sim_compute_robot_state-npc2": 0.06547381800989951, "sim_compute_robot_state-npc3": 0.06479941260430121}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04198285366626496, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.055086896774616645, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12405374202322451, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08499534840279437, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03522935065817326, "sim_compute_performance-ego": 0.0598601889103017, "sim_compute_robot_state-ego": 0.06364340985074957, "sim_compute_robot_state-npc0": 0.06130450329882033, "sim_compute_robot_state-npc1": 0.061367600522142775, "sim_compute_robot_state-npc2": 0.06004708878537442, "sim_compute_robot_state-npc3": 0.06141031802968776}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.035301075531886175, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05570769768494826, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11885751669223492, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08401188942102286, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03257767512248112, "sim_compute_performance-ego": 0.06003432090465839, "sim_compute_robot_state-ego": 0.060765779935396634, "sim_compute_robot_state-npc0": 0.06101514284427349, "sim_compute_robot_state-npc1": 0.0611994037261376, "sim_compute_robot_state-npc2": 0.05979001522064209, "sim_compute_robot_state-npc3": 0.05986969287578876}}
set_robot_commands_max0.09706875201194518
set_robot_commands_mean0.08835154987755571
set_robot_commands_median0.08499534840279437
set_robot_commands_min0.07960019414387053
sim_compute_performance-ego_max0.06564698680754631
sim_compute_performance-ego_mean0.06201673180861959
sim_compute_performance-ego_median0.06003432090465839
sim_compute_performance-ego_min0.05934404948401072
sim_compute_robot_state-ego_max0.06928610801696777
sim_compute_robot_state-ego_mean0.06373700050550342
sim_compute_robot_state-ego_median0.06364340985074957
sim_compute_robot_state-ego_min0.059202254764617435
sim_compute_robot_state-npc0_max0.07066230235561248
sim_compute_robot_state-npc0_mean0.06346055905115697
sim_compute_robot_state-npc0_median0.06130450329882033
sim_compute_robot_state-npc0_min0.05739707416958279
sim_compute_robot_state-npc1_max0.06654747070804719
sim_compute_robot_state-npc1_mean0.06224533010173344
sim_compute_robot_state-npc1_median0.061367600522142775
sim_compute_robot_state-npc1_min0.056765121126931814
sim_compute_robot_state-npc2_max0.06547381800989951
sim_compute_robot_state-npc2_mean0.061028423660981455
sim_compute_robot_state-npc2_median0.06004708878537442
sim_compute_robot_state-npc2_min0.05743613318791465
sim_compute_robot_state-npc3_max0.06479941260430121
sim_compute_robot_state-npc3_mean0.061308094141273264
sim_compute_robot_state-npc3_median0.06141031802968776
sim_compute_robot_state-npc3_min0.058415276663643975
sim_compute_sim_state_max0.03665710898006663
sim_compute_sim_state_mean0.0345979409446741
sim_compute_sim_state_median0.03522935065817326
sim_compute_sim_state_min0.032091980888730005
sim_physics_max0.04198285366626496
sim_physics_mean0.03859051433813809
sim_physics_median0.039388086281570735
sim_physics_min0.035301075531886175
sim_render-ego_max0.061348330590032765
sim_render-ego_mean0.05641214462461217
sim_render-ego_median0.05570769768494826
sim_render-ego_min0.05292688475714789
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
196422403Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09051650683722068
survival_time_median1.3000000000000005
deviation-center-line_median0.055990222688146615
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19308953625815256
agent_compute-ego_mean0.1558436265187774
agent_compute-ego_median0.15664043793311486
agent_compute-ego_min0.11901640892028809
deviation-center-line_max0.06911146621945177
deviation-center-line_mean0.05492955086862337
deviation-center-line_min0.03640534054166274
deviation-heading_max0.7634340516814753
deviation-heading_mean0.7305722433886876
deviation-heading_median0.7404544951972891
deviation-heading_min0.6703214555753187
driven_any_max0.19549377541120225
driven_any_mean0.1627629166611407
driven_any_median0.15431945767089358
driven_any_min0.1458968448035718
driven_lanedir_consec_max0.1458963023328943
driven_lanedir_consec_mean0.10105936735547276
driven_lanedir_consec_min0.07551693965470374
driven_lanedir_max0.1458963023328943
driven_lanedir_mean0.10105936735547276
driven_lanedir_median0.09051650683722068
driven_lanedir_min0.07551693965470374
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1458968448035718, "sim_physics": 0.01665961742401123, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08204089560268191, "sim_render-ego": 0.042468518018722534, "in-drivable-lane": 0, "agent_compute-ego": 0.11901640892028809, "deviation-heading": 0.7470667460634683, "set_robot_commands": 0.06210479140281677, "deviation-center-line": 0.052156335952963706, "driven_lanedir_consec": 0.08204089560268191, "sim_compute_sim_state": 0.02677032351493835, "sim_compute_performance-ego": 0.044720083475112915, "sim_compute_robot_state-ego": 0.04602413376172384}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19549377541120225, "sim_physics": 0.026795898165021623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1458963023328943, "sim_render-ego": 0.05752663952963693, "in-drivable-lane": 0, "agent_compute-ego": 0.19308953625815256, "deviation-heading": 0.7315844684258864, "set_robot_commands": 0.10517443929399764, "deviation-center-line": 0.06911146621945177, "driven_lanedir_consec": 0.1458963023328943, "sim_compute_sim_state": 0.03668820858001709, "sim_compute_performance-ego": 0.07164158139910017, "sim_compute_robot_state-ego": 0.07883526597704206}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14968391991551006, "sim_physics": 0.021768264770507813, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09051650683722068, "sim_render-ego": 0.05775322914123535, "in-drivable-lane": 0, "agent_compute-ego": 0.15041498184204102, "deviation-heading": 0.7634340516814753, "set_robot_commands": 0.09504201889038086, "deviation-center-line": 0.055990222688146615, "driven_lanedir_consec": 0.09051650683722068, "sim_compute_sim_state": 0.0359719181060791, "sim_compute_performance-ego": 0.06324780464172364, "sim_compute_robot_state-ego": 0.06454475402832031}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15431945767089358, "sim_physics": 0.025629299658316153, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07551693965470374, "sim_render-ego": 0.06539728906419542, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.16005676764029045, "deviation-heading": 0.6703214555753187, "set_robot_commands": 0.09659829846134892, "deviation-center-line": 0.03640534054166274, "driven_lanedir_consec": 0.07551693965470374, "sim_compute_sim_state": 0.03754994604322645, "sim_compute_performance-ego": 0.07078969920123065, "sim_compute_robot_state-ego": 0.07204387806080005}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16842058550452585, "sim_physics": 0.02524413512303279, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11132619234986318, "sim_render-ego": 0.05599667475773738, "in-drivable-lane": 0, "agent_compute-ego": 0.15664043793311486, "deviation-heading": 0.7404544951972891, "set_robot_commands": 0.08994253782125619, "deviation-center-line": 0.06098438894089203, "driven_lanedir_consec": 0.11132619234986318, "sim_compute_sim_state": 0.034529878542973444, "sim_compute_performance-ego": 0.059094988382779635, "sim_compute_robot_state-ego": 0.06487997678609994}}
set_robot_commands_max0.10517443929399764
set_robot_commands_mean0.08977241717396008
set_robot_commands_median0.09504201889038086
set_robot_commands_min0.06210479140281677
sim_compute_performance-ego_max0.07164158139910017
sim_compute_performance-ego_mean0.061898831419989406
sim_compute_performance-ego_median0.06324780464172364
sim_compute_performance-ego_min0.044720083475112915
sim_compute_robot_state-ego_max0.07883526597704206
sim_compute_robot_state-ego_mean0.06526560172279723
sim_compute_robot_state-ego_median0.06487997678609994
sim_compute_robot_state-ego_min0.04602413376172384
sim_compute_sim_state_max0.03754994604322645
sim_compute_sim_state_mean0.03430205495744689
sim_compute_sim_state_median0.0359719181060791
sim_compute_sim_state_min0.02677032351493835
sim_physics_max0.026795898165021623
sim_physics_mean0.02321944302817792
sim_physics_median0.02524413512303279
sim_physics_min0.01665961742401123
sim_render-ego_max0.06539728906419542
sim_render-ego_mean0.05582847010230553
sim_render-ego_median0.05752663952963693
sim_render-ego_min0.042468518018722534
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3000000000000005
survival_time_min1.2000000000000004
No reset possible
196412406Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08438103385874385
survival_time_median1.1500000000000004
deviation-center-line_median0.046834026496191374
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.1616971492767334
agent_compute-ego_mean0.15404952997746674
agent_compute-ego_median0.1521343489487966
agent_compute-ego_min0.14857937978661578
deviation-center-line_max0.05111972015026863
deviation-center-line_mean0.046161069416481085
deviation-center-line_min0.0410378151693393
deviation-heading_max0.6925679360829191
deviation-heading_mean0.6663774644521805
deviation-heading_median0.6628471501849217
deviation-heading_min0.6407693806223403
driven_any_max0.16899886814241896
driven_any_mean0.15283471338170895
driven_any_median0.15099887894750214
driven_any_min0.14543182413261693
driven_lanedir_consec_max0.1124476142158124
driven_lanedir_consec_mean0.08971533687391994
driven_lanedir_consec_min0.07922565990131347
driven_lanedir_max0.1124476142158124
driven_lanedir_mean0.08971533687391994
driven_lanedir_median0.08438103385874385
driven_lanedir_min0.07922565990131347
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.15099887894750214, "sim_physics": 0.037966707478398865, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08987053448855531, "sim_render-ego": 0.06083877190299656, "in-drivable-lane": 0, "agent_compute-ego": 0.1616971492767334, "deviation-heading": 0.6925679360829191, "set_robot_commands": 0.08815511413242506, "deviation-center-line": 0.04960063126942189, "driven_lanedir_consec": 0.08987053448855531, "sim_compute_sim_state": 0.03769982379415761, "sim_compute_performance-ego": 0.06540269437043564, "sim_compute_robot_state-ego": 0.07360557887865149, "sim_compute_robot_state-npc0": 0.06630517088848611, "sim_compute_robot_state-npc1": 0.06219780963400136, "sim_compute_robot_state-npc2": 0.062010391898777176, "sim_compute_robot_state-npc3": 0.06522942625957986}, "udem1-1-0": {"driven_any": 0.15328957475821067, "sim_physics": 0.03734018405278524, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08438103385874385, "sim_render-ego": 0.056985308726628624, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1521343489487966, "deviation-heading": 0.6886158355890064, "set_robot_commands": 0.08736552794774373, "deviation-center-line": 0.046834026496191374, "driven_lanedir_consec": 0.08438103385874385, "sim_compute_sim_state": 0.032628665367762245, "sim_compute_performance-ego": 0.06381460030873616, "sim_compute_robot_state-ego": 0.06943004329999287, "sim_compute_robot_state-npc0": 0.061844309171040855, "sim_compute_robot_state-npc1": 0.06413103143374126, "sim_compute_robot_state-npc2": 0.06079180041948954, "sim_compute_robot_state-npc3": 0.06206547220547994}, "udem1-2-0": {"driven_any": 0.16899886814241896, "sim_physics": 0.04325980941454569, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1124476142158124, "sim_render-ego": 0.06071293354034424, "in-drivable-lane": 0, "agent_compute-ego": 0.15777562061945596, "deviation-heading": 0.6628471501849217, "set_robot_commands": 0.09361917773882548, "deviation-center-line": 0.05111972015026863, "driven_lanedir_consec": 0.1124476142158124, "sim_compute_sim_state": 0.03647403915723165, "sim_compute_performance-ego": 0.06453082958857219, "sim_compute_robot_state-ego": 0.06634294986724854, "sim_compute_robot_state-npc0": 0.06306268771489461, "sim_compute_robot_state-npc1": 0.06315140922864278, "sim_compute_robot_state-npc2": 0.06789288918177287, "sim_compute_robot_state-npc3": 0.06828706463177998}, "udem1-3-0": {"driven_any": 0.14545442092779612, "sim_physics": 0.03843485790750255, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07922565990131347, "sim_render-ego": 0.06113011940665867, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14857937978661578, "deviation-heading": 0.6470870197817149, "set_robot_commands": 0.07319108299587083, "deviation-center-line": 0.0410378151693393, "driven_lanedir_consec": 0.07922565990131347, "sim_compute_sim_state": 0.036027047945105514, "sim_compute_performance-ego": 0.062419497448465096, "sim_compute_robot_state-ego": 0.06536294066387674, "sim_compute_robot_state-npc0": 0.055097528125928795, "sim_compute_robot_state-npc1": 0.05604002786719281, "sim_compute_robot_state-npc2": 0.06008421856424083, "sim_compute_robot_state-npc3": 0.061203593793122665}, "udem1-4-0": {"driven_any": 0.14543182413261693, "sim_physics": 0.0346837043762207, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08265184190517472, "sim_render-ego": 0.05765725218731424, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.150061151255732, "deviation-heading": 0.6407693806223403, "set_robot_commands": 0.08201143015985904, "deviation-center-line": 0.042213153997184234, "driven_lanedir_consec": 0.08265184190517472, "sim_compute_sim_state": 0.03515333714692489, "sim_compute_performance-ego": 0.05960184594859248, "sim_compute_robot_state-ego": 0.06208450897880222, "sim_compute_robot_state-npc0": 0.05790570507878843, "sim_compute_robot_state-npc1": 0.06397119812343431, "sim_compute_robot_state-npc2": 0.06116464863652769, "sim_compute_robot_state-npc3": 0.05987583036008089}}
set_robot_commands_max0.09361917773882548
set_robot_commands_mean0.08486846659494482
set_robot_commands_median0.08736552794774373
set_robot_commands_min0.07319108299587083
sim_compute_performance-ego_max0.06540269437043564
sim_compute_performance-ego_mean0.06315389353296032
sim_compute_performance-ego_median0.06381460030873616
sim_compute_performance-ego_min0.05960184594859248
sim_compute_robot_state-ego_max0.07360557887865149
sim_compute_robot_state-ego_mean0.06736520433771438
sim_compute_robot_state-ego_median0.06634294986724854
sim_compute_robot_state-ego_min0.06208450897880222
sim_compute_robot_state-npc0_max0.06630517088848611
sim_compute_robot_state-npc0_mean0.06084308019582776
sim_compute_robot_state-npc0_median0.061844309171040855
sim_compute_robot_state-npc0_min0.055097528125928795
sim_compute_robot_state-npc1_max0.06413103143374126
sim_compute_robot_state-npc1_mean0.0618982952574025
sim_compute_robot_state-npc1_median0.06315140922864278
sim_compute_robot_state-npc1_min0.05604002786719281
sim_compute_robot_state-npc2_max0.06789288918177287
sim_compute_robot_state-npc2_mean0.06238878974016163
sim_compute_robot_state-npc2_median0.06116464863652769
sim_compute_robot_state-npc2_min0.06008421856424083
sim_compute_robot_state-npc3_max0.06828706463177998
sim_compute_robot_state-npc3_mean0.06333227745000866
sim_compute_robot_state-npc3_median0.06206547220547994
sim_compute_robot_state-npc3_min0.05987583036008089
sim_compute_sim_state_max0.03769982379415761
sim_compute_sim_state_mean0.03559658268223638
sim_compute_sim_state_median0.036027047945105514
sim_compute_sim_state_min0.032628665367762245
sim_physics_max0.04325980941454569
sim_physics_mean0.038337052645890615
sim_physics_median0.037966707478398865
sim_physics_min0.0346837043762207
sim_render-ego_max0.06113011940665867
sim_render-ego_mean0.05946487715278846
sim_render-ego_median0.06071293354034424
sim_render-ego_min0.056985308726628624
simulation-passed1
survival_time_max1.2000000000000004
survival_time_mean1.1700000000000004
survival_time_min1.1500000000000004
No reset possible
196182424Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.12797746506143123
agent_compute-ego_mean0.11934738110986154
agent_compute-ego_median0.1263451845415177
agent_compute-ego_min0.0949097963479849
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.041370232899983726, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05232120317126077, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12007546046423534, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.0842907882872082, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03361792413015214, "sim_compute_performance-ego": 0.058466483676244345, "sim_compute_robot_state-ego": 0.06006746443491134, "sim_compute_robot_state-npc0": 0.059854480955335826, "sim_compute_robot_state-npc1": 0.06171961436195979, "sim_compute_robot_state-npc2": 0.059339750380743114, "sim_compute_robot_state-npc3": 0.059873705818539576}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03668491980608772, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05845003034554276, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12742899913413852, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08824435402365292, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03421545963661343, "sim_compute_performance-ego": 0.06255682776955997, "sim_compute_robot_state-ego": 0.06698041336209166, "sim_compute_robot_state-npc0": 0.06285902098113415, "sim_compute_robot_state-npc1": 0.06721947239894493, "sim_compute_robot_state-npc2": 0.06128983871609557, "sim_compute_robot_state-npc3": 0.061840398638856174}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04333003490201889, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.058459654931099184, "in-drivable-lane": 0, "agent_compute-ego": 0.1263451845415177, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.0835013005041307, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.036393069451855074, "sim_compute_performance-ego": 0.06422207047862391, "sim_compute_robot_state-ego": 0.0658184289932251, "sim_compute_robot_state-npc0": 0.0630103349685669, "sim_compute_robot_state-npc1": 0.06416071230365385, "sim_compute_robot_state-npc2": 0.06369613062950873, "sim_compute_robot_state-npc3": 0.06379596648677703}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04414459999571455, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05893811773746572, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12797746506143123, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.09036411376709634, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03849765848606191, "sim_compute_performance-ego": 0.06491226845599235, "sim_compute_robot_state-ego": 0.06933191228420177, "sim_compute_robot_state-npc0": 0.06336079252527115, "sim_compute_robot_state-npc1": 0.06366053794292693, "sim_compute_robot_state-npc2": 0.06475240372596903, "sim_compute_robot_state-npc3": 0.06732628954217788}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027281770339378945, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04338882519648625, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0949097963479849, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.06560681874935444, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02737850409287673, "sim_compute_performance-ego": 0.045901092199178845, "sim_compute_robot_state-ego": 0.047955843118520886, "sim_compute_robot_state-npc0": 0.04927965769400963, "sim_compute_robot_state-npc1": 0.04759077842418964, "sim_compute_robot_state-npc2": 0.04939502477645874, "sim_compute_robot_state-npc3": 0.04833471316557664}}
set_robot_commands_max0.09036411376709634
set_robot_commands_mean0.08240147506628852
set_robot_commands_median0.0842907882872082
set_robot_commands_min0.06560681874935444
sim_compute_performance-ego_max0.06491226845599235
sim_compute_performance-ego_mean0.059211748515919885
sim_compute_performance-ego_median0.06255682776955997
sim_compute_performance-ego_min0.045901092199178845
sim_compute_robot_state-ego_max0.06933191228420177
sim_compute_robot_state-ego_mean0.06203081243859014
sim_compute_robot_state-ego_median0.0658184289932251
sim_compute_robot_state-ego_min0.047955843118520886
sim_compute_robot_state-npc0_max0.06336079252527115
sim_compute_robot_state-npc0_mean0.05967285742486352
sim_compute_robot_state-npc0_median0.06285902098113415
sim_compute_robot_state-npc0_min0.04927965769400963
sim_compute_robot_state-npc1_max0.06721947239894493
sim_compute_robot_state-npc1_mean0.06087022308633502
sim_compute_robot_state-npc1_median0.06366053794292693
sim_compute_robot_state-npc1_min0.04759077842418964
sim_compute_robot_state-npc2_max0.06475240372596903
sim_compute_robot_state-npc2_mean0.05969462964575504
sim_compute_robot_state-npc2_median0.06128983871609557
sim_compute_robot_state-npc2_min0.04939502477645874
sim_compute_robot_state-npc3_max0.06732628954217788
sim_compute_robot_state-npc3_mean0.06023421473038546
sim_compute_robot_state-npc3_median0.061840398638856174
sim_compute_robot_state-npc3_min0.04833471316557664
sim_compute_sim_state_max0.03849765848606191
sim_compute_sim_state_mean0.03402052315951186
sim_compute_sim_state_median0.03421545963661343
sim_compute_sim_state_min0.02737850409287673
sim_physics_max0.04414459999571455
sim_physics_mean0.038562311588636766
sim_physics_median0.041370232899983726
sim_physics_min0.027281770339378945
sim_render-ego_max0.05893811773746572
sim_render-ego_mean0.05431156627637094
sim_render-ego_median0.05845003034554276
sim_render-ego_min0.04338882519648625
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
195982447Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80560:06:58
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19598-960135', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195892452Liam Paull 🇨🇦Baseline solution using ROSaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:03:21
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195852456Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoip-172-31-38-104-80560:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195812463Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195782484Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-38-104-80560:01:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195642501jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195372528Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:02:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195292542Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80560:03:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194952594Julian Zillybaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:14:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24056463580365328
survival_time_median5.14999999999999
deviation-center-line_median0.2680092955032456
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2414101396949546
agent_compute-ego_mean0.227939162309636
agent_compute-ego_median0.2224889787343832
agent_compute-ego_min0.21769199651830337
deviation-center-line_max0.28220859840358753
deviation-center-line_mean0.2616154306198516
deviation-center-line_min0.23849895566489185
deviation-heading_max2.128659291301694
deviation-heading_mean2.028107595581917
deviation-heading_median2.032334066672542
deviation-heading_min1.9594553223265267
driven_any_max0.2859818814903161
driven_any_mean0.27865594359178997
driven_any_median0.2784020274019724
driven_any_min0.27043761596197047
driven_lanedir_consec_max0.24975542890840807
driven_lanedir_consec_mean0.24125415415598211
driven_lanedir_consec_min0.2315090932046382
driven_lanedir_max0.24975542890840807
driven_lanedir_mean0.24125415415598211
driven_lanedir_median0.24056463580365328
driven_lanedir_min0.2315090932046382
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2859818814903161, "sim_physics": 0.043634449394003856, "survival_time": 5.14999999999999, "driven_lanedir": 0.24975542890840807, "sim_render-ego": 0.062446249341501774, "in-drivable-lane": 0, "agent_compute-ego": 0.2414101396949546, "deviation-heading": 1.975067097252645, "set_robot_commands": 0.10022207602713872, "deviation-center-line": 0.2680092955032456, "driven_lanedir_consec": 0.24975542890840807, "sim_compute_sim_state": 0.03913455796473234, "sim_compute_performance-ego": 0.06774423886271357, "sim_compute_robot_state-ego": 0.0709228353592956, "sim_compute_robot_state-npc0": 0.06905778634895399, "sim_compute_robot_state-npc1": 0.06972641157872468, "sim_compute_robot_state-npc2": 0.07116100163135713, "sim_compute_robot_state-npc3": 0.06878017221839683}, "udem1-1-0": {"driven_any": 0.2784020274019724, "sim_physics": 0.04177699409998381, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24056463580365328, "sim_render-ego": 0.061671014015491195, "in-drivable-lane": 0, "agent_compute-ego": 0.2224889787343832, "deviation-heading": 1.9594553223265267, "set_robot_commands": 0.09321641463499802, "deviation-center-line": 0.23849895566489185, "driven_lanedir_consec": 0.24056463580365328, "sim_compute_sim_state": 0.037746500510435835, "sim_compute_performance-ego": 0.06864420038003188, "sim_compute_robot_state-ego": 0.06852163947545566, "sim_compute_robot_state-npc0": 0.06371879119139451, "sim_compute_robot_state-npc1": 0.06449979085188645, "sim_compute_robot_state-npc2": 0.06717930619533245, "sim_compute_robot_state-npc3": 0.06470065162732051}, "udem1-2-0": {"driven_any": 0.2754400469033636, "sim_physics": 0.049257248350717486, "survival_time": 5.14999999999999, "driven_lanedir": 0.23785073084129493, "sim_render-ego": 0.0589805390070943, "in-drivable-lane": 0, "agent_compute-ego": 0.21891846240145488, "deviation-heading": 2.128659291301694, "set_robot_commands": 0.09201603259855104, "deviation-center-line": 0.2802937238721823, "driven_lanedir_consec": 0.23785073084129493, "sim_compute_sim_state": 0.03833245073707359, "sim_compute_performance-ego": 0.0649826827558499, "sim_compute_robot_state-ego": 0.06940347245595987, "sim_compute_robot_state-npc0": 0.06614704039490339, "sim_compute_robot_state-npc1": 0.06915368154210952, "sim_compute_robot_state-npc2": 0.0686075733703317, "sim_compute_robot_state-npc3": 0.06697902633148489}, "udem1-3-0": {"driven_any": 0.27043761596197047, "sim_physics": 0.04814565410980812, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2315090932046382, "sim_render-ego": 0.06504629666988666, "in-drivable-lane": 0, "agent_compute-ego": 0.23918623419908375, "deviation-heading": 2.045022200356176, "set_robot_commands": 0.09883109193581802, "deviation-center-line": 0.2390665796553508, "driven_lanedir_consec": 0.2315090932046382, "sim_compute_sim_state": 0.03965836304884691, "sim_compute_performance-ego": 0.06964409351348877, "sim_compute_robot_state-ego": 0.07388484477996826, "sim_compute_robot_state-npc0": 0.06962114114027756, "sim_compute_robot_state-npc1": 0.06930158917720501, "sim_compute_robot_state-npc2": 0.06924107212286729, "sim_compute_robot_state-npc3": 0.0712563945696904}, "udem1-4-0": {"driven_any": 0.28301814620132737, "sim_physics": 0.0418244670419132, "survival_time": 5.09999999999999, "driven_lanedir": 0.24659088202191604, "sim_render-ego": 0.058136940002441406, "in-drivable-lane": 0, "agent_compute-ego": 0.21769199651830337, "deviation-heading": 2.032334066672542, "set_robot_commands": 0.09079114362305286, "deviation-center-line": 0.28220859840358753, "driven_lanedir_consec": 0.24659088202191604, "sim_compute_sim_state": 0.03872129028918697, "sim_compute_performance-ego": 0.0623165953393076, "sim_compute_robot_state-ego": 0.06446024717069139, "sim_compute_robot_state-npc0": 0.0658110216552136, "sim_compute_robot_state-npc1": 0.06346241399353626, "sim_compute_robot_state-npc2": 0.06368623995313458, "sim_compute_robot_state-npc3": 0.06534830261679257}}
set_robot_commands_max0.10022207602713872
set_robot_commands_mean0.09501535176391172
set_robot_commands_median0.09321641463499802
set_robot_commands_min0.09079114362305286
sim_compute_performance-ego_max0.06964409351348877
sim_compute_performance-ego_mean0.06666636217027835
sim_compute_performance-ego_median0.06774423886271357
sim_compute_performance-ego_min0.0623165953393076
sim_compute_robot_state-ego_max0.07388484477996826
sim_compute_robot_state-ego_mean0.06943860784827414
sim_compute_robot_state-ego_median0.06940347245595987
sim_compute_robot_state-ego_min0.06446024717069139
sim_compute_robot_state-npc0_max0.06962114114027756
sim_compute_robot_state-npc0_mean0.06687115614614861
sim_compute_robot_state-npc0_median0.06614704039490339
sim_compute_robot_state-npc0_min0.06371879119139451
sim_compute_robot_state-npc1_max0.06972641157872468
sim_compute_robot_state-npc1_mean0.06722877742869238
sim_compute_robot_state-npc1_median0.06915368154210952
sim_compute_robot_state-npc1_min0.06346241399353626
sim_compute_robot_state-npc2_max0.07116100163135713
sim_compute_robot_state-npc2_mean0.06797503865460464
sim_compute_robot_state-npc2_median0.0686075733703317
sim_compute_robot_state-npc2_min0.06368623995313458
sim_compute_robot_state-npc3_max0.0712563945696904
sim_compute_robot_state-npc3_mean0.06741290947273705
sim_compute_robot_state-npc3_median0.06697902633148489
sim_compute_robot_state-npc3_min0.06470065162732051
sim_compute_sim_state_max0.03965836304884691
sim_compute_sim_state_mean0.038718632510055126
sim_compute_sim_state_median0.03872129028918697
sim_compute_sim_state_min0.037746500510435835
sim_physics_max0.049257248350717486
sim_physics_mean0.04492776259928529
sim_physics_median0.043634449394003856
sim_physics_min0.04177699409998381
sim_render-ego_max0.06504629666988666
sim_render-ego_mean0.06125620780728307
sim_render-ego_median0.061671014015491195
sim_render-ego_min0.058136940002441406
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.15999999999999
survival_time_min5.09999999999999
No reset possible
194842609Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07729677150123998
agent_compute-ego_mean0.06679519823485983
agent_compute-ego_median0.06615566290341891
agent_compute-ego_min0.05959350198179811
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.03240779841818461, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.056728738110239915, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06450173331470024, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0921483039855957, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.034520338221294126, "sim_compute_performance-ego": 0.06335928672697486, "sim_compute_robot_state-ego": 0.06464183039781524, "sim_compute_robot_state-npc0": 0.06469974285218774, "sim_compute_robot_state-npc1": 0.06288942767352593, "sim_compute_robot_state-npc2": 0.06220513436852432, "sim_compute_robot_state-npc3": 0.06277602474863936}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.032553828679598294, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.055922278991112344, "in-drivable-lane": 0, "agent_compute-ego": 0.06615566290341891, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08419219347146842, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.033625089205228366, "sim_compute_performance-ego": 0.06204776580517109, "sim_compute_robot_state-ego": 0.06188526520362267, "sim_compute_robot_state-npc0": 0.06357578130868766, "sim_compute_robot_state-npc1": 0.05929375611818754, "sim_compute_robot_state-npc2": 0.06040815206674429, "sim_compute_robot_state-npc3": 0.060999191724337064}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.03526918938819398, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05815779909174493, "in-drivable-lane": 0, "agent_compute-ego": 0.06642832147314194, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08829194434145664, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03451008492327751, "sim_compute_performance-ego": 0.06562044772695988, "sim_compute_robot_state-ego": 0.06591420478009163, "sim_compute_robot_state-npc0": 0.06443198183749585, "sim_compute_robot_state-npc1": 0.06522049295141343, "sim_compute_robot_state-npc2": 0.06538842586760825, "sim_compute_robot_state-npc3": 0.06540527242295285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.029495708235017543, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.04792773068606199, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05959350198179811, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07765797468332145, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02958272315643646, "sim_compute_performance-ego": 0.05367783399728628, "sim_compute_robot_state-ego": 0.05341574385925964, "sim_compute_robot_state-npc0": 0.05453464225098327, "sim_compute_robot_state-npc1": 0.053175813549167505, "sim_compute_robot_state-npc2": 0.05737850692245986, "sim_compute_robot_state-npc3": 0.05290727824955197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.03537893295288086, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.057291846526296514, "in-drivable-lane": 0, "agent_compute-ego": 0.07729677150123998, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.09550670573585912, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.034630775451660156, "sim_compute_performance-ego": 0.06176518139086271, "sim_compute_robot_state-ego": 0.06806817180231998, "sim_compute_robot_state-npc0": 0.06761316249245092, "sim_compute_robot_state-npc1": 0.0661475658416748, "sim_compute_robot_state-npc2": 0.06157228193785015, "sim_compute_robot_state-npc3": 0.06292654338635896}}
set_robot_commands_max0.09550670573585912
set_robot_commands_mean0.08755942444354027
set_robot_commands_median0.08829194434145664
set_robot_commands_min0.07765797468332145
sim_compute_performance-ego_max0.06562044772695988
sim_compute_performance-ego_mean0.06129410312945097
sim_compute_performance-ego_median0.06204776580517109
sim_compute_performance-ego_min0.05367783399728628
sim_compute_robot_state-ego_max0.06806817180231998
sim_compute_robot_state-ego_mean0.06278504320862184
sim_compute_robot_state-ego_median0.06464183039781524
sim_compute_robot_state-ego_min0.05341574385925964
sim_compute_robot_state-npc0_max0.06761316249245092
sim_compute_robot_state-npc0_mean0.0629710621483611
sim_compute_robot_state-npc0_median0.06443198183749585
sim_compute_robot_state-npc0_min0.05453464225098327
sim_compute_robot_state-npc1_max0.0661475658416748
sim_compute_robot_state-npc1_mean0.06134541122679384
sim_compute_robot_state-npc1_median0.06288942767352593
sim_compute_robot_state-npc1_min0.053175813549167505
sim_compute_robot_state-npc2_max0.06538842586760825
sim_compute_robot_state-npc2_mean0.06139050023263738
sim_compute_robot_state-npc2_median0.06157228193785015
sim_compute_robot_state-npc2_min0.05737850692245986
sim_compute_robot_state-npc3_max0.06540527242295285
sim_compute_robot_state-npc3_mean0.06100286210636804
sim_compute_robot_state-npc3_median0.06277602474863936
sim_compute_robot_state-npc3_min0.05290727824955197
sim_compute_sim_state_max0.034630775451660156
sim_compute_sim_state_mean0.03337380219157932
sim_compute_sim_state_median0.03451008492327751
sim_compute_sim_state_min0.02958272315643646
sim_physics_max0.03537893295288086
sim_physics_mean0.03302109153477506
sim_physics_median0.032553828679598294
sim_physics_min0.029495708235017543
sim_render-ego_max0.05815779909174493
sim_render-ego_mean0.05520567868109114
sim_render-ego_median0.056728738110239915
sim_render-ego_min0.04792773068606199
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
194732625Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.1502289405235877
agent_compute-ego_mean0.13949062601045628
agent_compute-ego_median0.1405730785862092
agent_compute-ego_min0.12493495230979108
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.041708185559227354, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05620487152584015, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13996877745976524, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08402229490734282, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.033286548796154204, "sim_compute_performance-ego": 0.05989298744807168, "sim_compute_robot_state-ego": 0.06583498773120698, "sim_compute_robot_state-npc0": 0.0607498600369408, "sim_compute_robot_state-npc1": 0.06321423394339425, "sim_compute_robot_state-npc2": 0.06020659113687182, "sim_compute_robot_state-npc3": 0.05965197653997512}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03865675365223604, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05660815799937529, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14174738117292815, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0895082576602113, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03667312509873334, "sim_compute_performance-ego": 0.06743994881125058, "sim_compute_robot_state-ego": 0.06844011942545573, "sim_compute_robot_state-npc0": 0.073852398816277, "sim_compute_robot_state-npc1": 0.06408164547938927, "sim_compute_robot_state-npc2": 0.06364864461562213, "sim_compute_robot_state-npc3": 0.0649569922802495}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04401741873833441, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05518502189267066, "in-drivable-lane": 0, "agent_compute-ego": 0.1405730785862092, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09019490595786804, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03516066074371338, "sim_compute_performance-ego": 0.058544385817743114, "sim_compute_robot_state-ego": 0.06640303519464308, "sim_compute_robot_state-npc0": 0.06325950161103279, "sim_compute_robot_state-npc1": 0.06116471752043693, "sim_compute_robot_state-npc2": 0.06035156403818438, "sim_compute_robot_state-npc3": 0.06124336104239187}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0346830297023692, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.04870498434026191, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12493495230979108, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07602544541054583, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02999364568832073, "sim_compute_performance-ego": 0.05287630507286559, "sim_compute_robot_state-ego": 0.056886353391282105, "sim_compute_robot_state-npc0": 0.05405623862083922, "sim_compute_robot_state-npc1": 0.05431996507847563, "sim_compute_robot_state-npc2": 0.05290822018968298, "sim_compute_robot_state-npc3": 0.05178965406214937}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.03750823552791889, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05874870832149799, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1502289405235877, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.09015289636758658, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.033651301494011514, "sim_compute_performance-ego": 0.06415579410699698, "sim_compute_robot_state-ego": 0.06524846645501944, "sim_compute_robot_state-npc0": 0.0594175962301401, "sim_compute_robot_state-npc1": 0.06146038495577299, "sim_compute_robot_state-npc2": 0.06160310598520132, "sim_compute_robot_state-npc3": 0.061444640159606934}}
set_robot_commands_max0.09019490595786804
set_robot_commands_mean0.08598076006071091
set_robot_commands_median0.0895082576602113
set_robot_commands_min0.07602544541054583
sim_compute_performance-ego_max0.06743994881125058
sim_compute_performance-ego_mean0.06058188425138559
sim_compute_performance-ego_median0.05989298744807168
sim_compute_performance-ego_min0.05287630507286559
sim_compute_robot_state-ego_max0.06844011942545573
sim_compute_robot_state-ego_mean0.06456259243952148
sim_compute_robot_state-ego_median0.06583498773120698
sim_compute_robot_state-ego_min0.056886353391282105
sim_compute_robot_state-npc0_max0.073852398816277
sim_compute_robot_state-npc0_mean0.06226711906304598
sim_compute_robot_state-npc0_median0.0607498600369408
sim_compute_robot_state-npc0_min0.05405623862083922
sim_compute_robot_state-npc1_max0.06408164547938927
sim_compute_robot_state-npc1_mean0.060848189395493815
sim_compute_robot_state-npc1_median0.06146038495577299
sim_compute_robot_state-npc1_min0.05431996507847563
sim_compute_robot_state-npc2_max0.06364864461562213
sim_compute_robot_state-npc2_mean0.05974362519311253
sim_compute_robot_state-npc2_median0.06035156403818438
sim_compute_robot_state-npc2_min0.05290822018968298
sim_compute_robot_state-npc3_max0.0649569922802495
sim_compute_robot_state-npc3_mean0.05981732481687456
sim_compute_robot_state-npc3_median0.06124336104239187
sim_compute_robot_state-npc3_min0.05178965406214937
sim_compute_sim_state_max0.03667312509873334
sim_compute_sim_state_mean0.033753056364186636
sim_compute_sim_state_median0.033651301494011514
sim_compute_sim_state_min0.02999364568832073
sim_physics_max0.04401741873833441
sim_physics_mean0.039314724636017186
sim_physics_median0.03865675365223604
sim_physics_min0.0346830297023692
sim_render-ego_max0.05874870832149799
sim_render-ego_mean0.0550903488159292
sim_render-ego_median0.05620487152584015
sim_render-ego_min0.04870498434026191
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
194512636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:08:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.14878898666751
agent_compute-ego_mean0.1341624166063577
agent_compute-ego_median0.13515872047061012
agent_compute-ego_min0.1177900479390071
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03873615416269454, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05482882923550076, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13515872047061012, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08347910169571165, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03474986742413233, "sim_compute_performance-ego": 0.05876867354862274, "sim_compute_robot_state-ego": 0.06408916200910296, "sim_compute_robot_state-npc0": 0.06004254780118427, "sim_compute_robot_state-npc1": 0.06158620970589774, "sim_compute_robot_state-npc2": 0.06158638000488281, "sim_compute_robot_state-npc3": 0.05990484782627651}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03732025389577828, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0554650297351912, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13667741943808162, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08862660445419013, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03455464980181526, "sim_compute_performance-ego": 0.06092655424978219, "sim_compute_robot_state-ego": 0.0653675630980847, "sim_compute_robot_state-npc0": 0.06137274293338552, "sim_compute_robot_state-npc1": 0.06480020167780857, "sim_compute_robot_state-npc2": 0.061157605227302105, "sim_compute_robot_state-npc3": 0.06346402448766372}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0412622497927758, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.060324565056831606, "in-drivable-lane": 0, "agent_compute-ego": 0.14878898666751, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.090661883354187, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.0359762599391322, "sim_compute_performance-ego": 0.06432243700950377, "sim_compute_robot_state-ego": 0.0658613097283148, "sim_compute_robot_state-npc0": 0.06456755438158589, "sim_compute_robot_state-npc1": 0.06323562514397406, "sim_compute_robot_state-npc2": 0.06297506440070368, "sim_compute_robot_state-npc3": 0.0637071632569836}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0396867001310308, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.053180669216399495, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13239690851657948, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08205023978618865, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.0325798658614463, "sim_compute_performance-ego": 0.057763657671339966, "sim_compute_robot_state-ego": 0.06166771624950653, "sim_compute_robot_state-npc0": 0.057427269347170566, "sim_compute_robot_state-npc1": 0.05843590421879545, "sim_compute_robot_state-npc2": 0.05674274424289135, "sim_compute_robot_state-npc3": 0.05624920763867967}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02806015656544612, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04809883924630972, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1177900479390071, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0691487193107605, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.026455269410060003, "sim_compute_performance-ego": 0.05276210949971126, "sim_compute_robot_state-ego": 0.04992194359119122, "sim_compute_robot_state-npc0": 0.04904763056681706, "sim_compute_robot_state-npc1": 0.049128518654749945, "sim_compute_robot_state-npc2": 0.04931641541994535, "sim_compute_robot_state-npc3": 0.04799523720374474}}
set_robot_commands_max0.090661883354187
set_robot_commands_mean0.08279330972020758
set_robot_commands_median0.08347910169571165
set_robot_commands_min0.0691487193107605
sim_compute_performance-ego_max0.06432243700950377
sim_compute_performance-ego_mean0.058908686395791984
sim_compute_performance-ego_median0.05876867354862274
sim_compute_performance-ego_min0.05276210949971126
sim_compute_robot_state-ego_max0.0658613097283148
sim_compute_robot_state-ego_mean0.06138153893524005
sim_compute_robot_state-ego_median0.06408916200910296
sim_compute_robot_state-ego_min0.04992194359119122
sim_compute_robot_state-npc0_max0.06456755438158589
sim_compute_robot_state-npc0_mean0.05849154900602867
sim_compute_robot_state-npc0_median0.06004254780118427
sim_compute_robot_state-npc0_min0.04904763056681706
sim_compute_robot_state-npc1_max0.06480020167780857
sim_compute_robot_state-npc1_mean0.05943729188024516
sim_compute_robot_state-npc1_median0.06158620970589774
sim_compute_robot_state-npc1_min0.049128518654749945
sim_compute_robot_state-npc2_max0.06297506440070368
sim_compute_robot_state-npc2_mean0.05835564185914506
sim_compute_robot_state-npc2_median0.061157605227302105
sim_compute_robot_state-npc2_min0.04931641541994535
sim_compute_robot_state-npc3_max0.0637071632569836
sim_compute_robot_state-npc3_mean0.05826409608266965
sim_compute_robot_state-npc3_median0.05990484782627651
sim_compute_robot_state-npc3_min0.04799523720374474
sim_compute_sim_state_max0.0359762599391322
sim_compute_sim_state_mean0.03286318248731722
sim_compute_sim_state_median0.03455464980181526
sim_compute_sim_state_min0.026455269410060003
sim_physics_max0.0412622497927758
sim_physics_mean0.037013102909545105
sim_physics_median0.03873615416269454
sim_physics_min0.02806015656544612
sim_render-ego_max0.060324565056831606
sim_render-ego_mean0.05437958649804656
sim_render-ego_median0.05482882923550076
sim_render-ego_min0.04809883924630972
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
194432649Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80560:05:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19443-437927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194052708Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:25:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9940003362676816
survival_time_median13.05000000000005
deviation-center-line_median0.8156497959383973
in-drivable-lane_median1.750000000000015


other stats
agent_compute-ego_max0.09378837647839128
agent_compute-ego_mean0.08969972153649346
agent_compute-ego_median0.08981918334960938
agent_compute-ego_min0.08457835241295826
deviation-center-line_max0.9723511364404808
deviation-center-line_mean0.6807841971609401
deviation-center-line_min0.32236663551128514
deviation-heading_max6.7719638175575465
deviation-heading_mean3.8456530594362506
deviation-heading_median4.6205639543020744
deviation-heading_min0.7626681611106574
driven_any_max2.3553823552533815
driven_any_mean1.668695122093321
driven_any_median2.0500856106652763
driven_any_min0.7806693780160238
driven_lanedir_consec_max1.3679196990003089
driven_lanedir_consec_mean1.0015318300615244
driven_lanedir_consec_min0.7499990385650396
driven_lanedir_max1.689176892272246
driven_lanedir_mean1.164149485533915
driven_lanedir_median1.2212807718066745
driven_lanedir_min0.7499990385650396
in-drivable-lane_max4.450000000000007
in-drivable-lane_mean1.8400000000000076
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8020088466541154, "sim_physics": 0.0476960935325266, "survival_time": 5.349999999999989, "driven_lanedir": 0.7499990385650396, "sim_render-ego": 0.07152106160315398, "in-drivable-lane": 0, "agent_compute-ego": 0.09378837647839128, "deviation-heading": 1.4956603976025722, "set_robot_commands": 0.11733370629426476, "deviation-center-line": 0.32236663551128514, "driven_lanedir_consec": 0.7499990385650396, "sim_compute_sim_state": 0.04384741604885208, "sim_compute_performance-ego": 0.07774608825968805, "sim_compute_robot_state-ego": 0.08012530291191886, "sim_compute_robot_state-npc0": 0.07659173457421989, "sim_compute_robot_state-npc1": 0.07944065833760199, "sim_compute_robot_state-npc2": 0.07947686453846013, "sim_compute_robot_state-npc3": 0.07949332433326223}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355329419877808, "sim_physics": 0.04354924519856771, "survival_time": 14.950000000000076, "driven_lanedir": 1.689176892272246, "sim_render-ego": 0.06773686567942301, "in-drivable-lane": 1.750000000000015, "agent_compute-ego": 0.08981918334960938, "deviation-heading": 6.7719638175575465, "set_robot_commands": 0.11262656132380168, "deviation-center-line": 0.9723511364404808, "driven_lanedir_consec": 1.3679196990003089, "sim_compute_sim_state": 0.04249426364898681, "sim_compute_performance-ego": 0.07441637833913167, "sim_compute_robot_state-ego": 0.07862477858861287, "sim_compute_robot_state-npc0": 0.0751968789100647, "sim_compute_robot_state-npc1": 0.07576882521311443, "sim_compute_robot_state-npc2": 0.07588360786437988, "sim_compute_robot_state-npc3": 0.07502296447753906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7806693780160238, "sim_physics": 0.04540995486731668, "survival_time": 5.14999999999999, "driven_lanedir": 0.7666372600031672, "sim_render-ego": 0.06877258680399181, "in-drivable-lane": 0, "agent_compute-ego": 0.09065026912874388, "deviation-heading": 0.7626681611106574, "set_robot_commands": 0.11343043521769997, "deviation-center-line": 0.45189365578940954, "driven_lanedir_consec": 0.7666372600031672, "sim_compute_sim_state": 0.0421831515228864, "sim_compute_performance-ego": 0.07340508062862655, "sim_compute_robot_state-ego": 0.08144413846210369, "sim_compute_robot_state-npc0": 0.07483149037777799, "sim_compute_robot_state-npc1": 0.07443473408523116, "sim_compute_robot_state-npc2": 0.07564491438634187, "sim_compute_robot_state-npc3": 0.07423316159294648}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3553823552533815, "sim_physics": 0.041599178314208986, "survival_time": 14.950000000000076, "driven_lanedir": 1.3936534650224472, "sim_render-ego": 0.0665155816078186, "in-drivable-lane": 4.450000000000007, "agent_compute-ego": 0.08966242631276448, "deviation-heading": 4.6205639543020744, "set_robot_commands": 0.10971951405207316, "deviation-center-line": 0.8416597621251278, "driven_lanedir_consec": 1.1291028164714243, "sim_compute_sim_state": 0.04153342644373576, "sim_compute_performance-ego": 0.07392378091812134, "sim_compute_robot_state-ego": 0.07666513681411743, "sim_compute_robot_state-npc0": 0.07283376773198445, "sim_compute_robot_state-npc1": 0.0741311240196228, "sim_compute_robot_state-npc2": 0.07436803181966146, "sim_compute_robot_state-npc3": 0.07403980175654093}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0500856106652763, "sim_physics": 0.03853289012251229, "survival_time": 13.05000000000005, "driven_lanedir": 1.2212807718066745, "sim_render-ego": 0.062122918636862805, "in-drivable-lane": 3.000000000000017, "agent_compute-ego": 0.08457835241295826, "deviation-heading": 5.577408966608402, "set_robot_commands": 0.10224311105136212, "deviation-center-line": 0.8156497959383973, "driven_lanedir_consec": 0.9940003362676816, "sim_compute_sim_state": 0.03856723061923323, "sim_compute_performance-ego": 0.06764594713846843, "sim_compute_robot_state-ego": 0.07068545516880079, "sim_compute_robot_state-npc0": 0.07004584115127037, "sim_compute_robot_state-npc1": 0.07289505096230928, "sim_compute_robot_state-npc2": 0.06853601210875529, "sim_compute_robot_state-npc3": 0.07006461684274491}}
set_robot_commands_max0.11733370629426476
set_robot_commands_mean0.11107066558784032
set_robot_commands_median0.11262656132380168
set_robot_commands_min0.10224311105136212
sim_compute_performance-ego_max0.07774608825968805
sim_compute_performance-ego_mean0.07342745505680721
sim_compute_performance-ego_median0.07392378091812134
sim_compute_performance-ego_min0.06764594713846843
sim_compute_robot_state-ego_max0.08144413846210369
sim_compute_robot_state-ego_mean0.07750896238911072
sim_compute_robot_state-ego_median0.07862477858861287
sim_compute_robot_state-ego_min0.07068545516880079
sim_compute_robot_state-npc0_max0.07659173457421989
sim_compute_robot_state-npc0_mean0.07389994254906349
sim_compute_robot_state-npc0_median0.07483149037777799
sim_compute_robot_state-npc0_min0.07004584115127037
sim_compute_robot_state-npc1_max0.07944065833760199
sim_compute_robot_state-npc1_mean0.07533407852357592
sim_compute_robot_state-npc1_median0.07443473408523116
sim_compute_robot_state-npc1_min0.07289505096230928
sim_compute_robot_state-npc2_max0.07947686453846013
sim_compute_robot_state-npc2_mean0.07478188614351973
sim_compute_robot_state-npc2_median0.07564491438634187
sim_compute_robot_state-npc2_min0.06853601210875529
sim_compute_robot_state-npc3_max0.07949332433326223
sim_compute_robot_state-npc3_mean0.07457077380060673
sim_compute_robot_state-npc3_median0.07423316159294648
sim_compute_robot_state-npc3_min0.07006461684274491
sim_compute_sim_state_max0.04384741604885208
sim_compute_sim_state_mean0.04172509765673886
sim_compute_sim_state_median0.0421831515228864
sim_compute_sim_state_min0.03856723061923323
sim_physics_max0.0476960935325266
sim_physics_mean0.043357472407026455
sim_physics_median0.04354924519856771
sim_physics_min0.03853289012251229
sim_render-ego_max0.07152106160315398
sim_render-ego_mean0.06733380286625004
sim_render-ego_median0.06773686567942301
sim_render-ego_min0.062122918636862805
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.690000000000037
survival_time_min5.14999999999999
No reset possible
193652973Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80560:17:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0288239201842655
survival_time_median11.050000000000022
deviation-center-line_median0.40135253135827864
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20761467773338843
agent_compute-ego_mean0.18776739353884192
agent_compute-ego_median0.1899010354822332
agent_compute-ego_min0.14404008830834297
deviation-center-line_max0.5624371866279603
deviation-center-line_mean0.42495976017930576
deviation-center-line_min0.3019763805672595
deviation-heading_max1.222631692653237
deviation-heading_mean1.1317160939440254
deviation-heading_median1.1503948660382377
deviation-heading_min1.008864619324518
driven_any_max1.3875634241859125
driven_any_mean1.021966127776142
driven_any_median1.074317883175983
driven_any_min0.5071449377664291
driven_lanedir_consec_max1.3820930410823813
driven_lanedir_consec_mean0.9609240930921846
driven_lanedir_consec_min0.4902491431589544
driven_lanedir_max1.3820930410823813
driven_lanedir_mean0.9609240930921846
driven_lanedir_median1.0288239201842655
driven_lanedir_min0.4902491431589544
in-drivable-lane_max2.80000000000004
in-drivable-lane_mean0.5600000000000079
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5071449377664291, "sim_physics": 0.018606799299066716, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4902491431589544, "sim_render-ego": 0.04509279727935791, "in-drivable-lane": 0, "agent_compute-ego": 0.1899010354822332, "deviation-heading": 1.1503948660382377, "set_robot_commands": 0.0771801926872947, "deviation-center-line": 0.3274067508014412, "driven_lanedir_consec": 0.4902491431589544, "sim_compute_sim_state": 0.03250836242328991, "sim_compute_performance-ego": 0.05153256979855624, "sim_compute_robot_state-ego": 0.059145814722234555}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.074317883175983, "sim_physics": 0.02287939088097934, "survival_time": 11.60000000000003, "driven_lanedir": 0.8207369655159571, "sim_render-ego": 0.05977393840921336, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.20761467773338843, "deviation-heading": 1.222631692653237, "set_robot_commands": 0.0949668390997525, "deviation-center-line": 0.40135253135827864, "driven_lanedir_consec": 0.8207369655159571, "sim_compute_sim_state": 0.037355055069101264, "sim_compute_performance-ego": 0.06745339364841066, "sim_compute_robot_state-ego": 0.07025040737513838}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3875634241859125, "sim_physics": 0.022148425579071044, "survival_time": 14.950000000000076, "driven_lanedir": 1.3820930410823813, "sim_render-ego": 0.06208174308141073, "in-drivable-lane": 0, "agent_compute-ego": 0.2075293517112732, "deviation-heading": 1.008864619324518, "set_robot_commands": 0.09577643235524495, "deviation-center-line": 0.3019763805672595, "driven_lanedir_consec": 1.3820930410823813, "sim_compute_sim_state": 0.03739493131637573, "sim_compute_performance-ego": 0.06868616898854574, "sim_compute_robot_state-ego": 0.07032042900721232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.04427316960406, "sim_physics": 0.023386368127626792, "survival_time": 10.700000000000015, "driven_lanedir": 1.0288239201842655, "sim_render-ego": 0.05285812092718677, "in-drivable-lane": 0, "agent_compute-ego": 0.18975181445897185, "deviation-heading": 1.1038202937194082, "set_robot_commands": 0.08374969981541143, "deviation-center-line": 0.5624371866279603, "driven_lanedir_consec": 1.0288239201842655, "sim_compute_sim_state": 0.03423026900425136, "sim_compute_performance-ego": 0.05861546837280844, "sim_compute_robot_state-ego": 0.06356603631349368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0965312241483252, "sim_physics": 0.015571404366471649, "survival_time": 11.050000000000022, "driven_lanedir": 1.0827173955193643, "sim_render-ego": 0.04165822887852181, "in-drivable-lane": 0, "agent_compute-ego": 0.14404008830834297, "deviation-heading": 1.1728689979847262, "set_robot_commands": 0.06887117122632885, "deviation-center-line": 0.5316259515415891, "driven_lanedir_consec": 1.0827173955193643, "sim_compute_sim_state": 0.026457689466519593, "sim_compute_performance-ego": 0.044132541207706225, "sim_compute_robot_state-ego": 0.047304220329043016}}
set_robot_commands_max0.09577643235524495
set_robot_commands_mean0.08410886703680649
set_robot_commands_median0.08374969981541143
set_robot_commands_min0.06887117122632885
sim_compute_performance-ego_max0.06868616898854574
sim_compute_performance-ego_mean0.05808402840320546
sim_compute_performance-ego_median0.05861546837280844
sim_compute_performance-ego_min0.044132541207706225
sim_compute_robot_state-ego_max0.07032042900721232
sim_compute_robot_state-ego_mean0.06211738154942439
sim_compute_robot_state-ego_median0.06356603631349368
sim_compute_robot_state-ego_min0.047304220329043016
sim_compute_sim_state_max0.03739493131637573
sim_compute_sim_state_mean0.03358926145590757
sim_compute_sim_state_median0.03423026900425136
sim_compute_sim_state_min0.026457689466519593
sim_physics_max0.023386368127626792
sim_physics_mean0.02051847765064311
sim_physics_median0.022148425579071044
sim_physics_min0.015571404366471649
sim_render-ego_max0.06208174308141073
sim_render-ego_mean0.05229296571513812
sim_render-ego_median0.05285812092718677
sim_render-ego_min0.04165822887852181
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.760000000000028
survival_time_min5.4999999999999885
No reset possible
193542805Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.17518998185793558
agent_compute-ego_mean0.1365936377211164
agent_compute-ego_median0.11981886625289916
agent_compute-ego_min0.10876972410413954
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02863390490693866, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06914880140772406, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.16561294951528874, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10051444791397958, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.042010271324301664, "sim_compute_performance-ego": 0.0809633731842041, "sim_compute_robot_state-ego": 0.07986039035725144}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.017545792189511387, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.04574046351692893, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.11357666687531905, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07167724045840176, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.031233261932026257, "sim_compute_performance-ego": 0.052212287079204216, "sim_compute_robot_state-ego": 0.05415869301015681}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016470517052544487, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.044170506795247394, "in-drivable-lane": 0, "agent_compute-ego": 0.10876972410413954, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07016116778055827, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02713473637898763, "sim_compute_performance-ego": 0.04978825781080458, "sim_compute_robot_state-ego": 0.05038079155815972}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02875642478466034, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06346747279167175, "in-drivable-lane": 0, "agent_compute-ego": 0.17518998185793558, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10967579980691274, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.041506061951319374, "sim_compute_performance-ego": 0.07607783377170563, "sim_compute_robot_state-ego": 0.08268680671850841}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02058922893860761, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05009534429101383, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11981886625289916, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07349267426659079, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.031811672098496384, "sim_compute_performance-ego": 0.05312376513200648, "sim_compute_robot_state-ego": 0.05770640864091761}}
set_robot_commands_max0.10967579980691274
set_robot_commands_mean0.08510426604528862
set_robot_commands_median0.07349267426659079
set_robot_commands_min0.07016116778055827
sim_compute_performance-ego_max0.0809633731842041
sim_compute_performance-ego_mean0.06243310339558501
sim_compute_performance-ego_median0.05312376513200648
sim_compute_performance-ego_min0.04978825781080458
sim_compute_robot_state-ego_max0.08268680671850841
sim_compute_robot_state-ego_mean0.0649586180569988
sim_compute_robot_state-ego_median0.05770640864091761
sim_compute_robot_state-ego_min0.05038079155815972
sim_compute_sim_state_max0.042010271324301664
sim_compute_sim_state_mean0.03473920073702626
sim_compute_sim_state_median0.031811672098496384
sim_compute_sim_state_min0.02713473637898763
sim_physics_max0.02875642478466034
sim_physics_mean0.022399173574452497
sim_physics_median0.02058922893860761
sim_physics_min0.016470517052544487
sim_render-ego_max0.06914880140772406
sim_render-ego_mean0.054524517760517185
sim_render-ego_median0.05009534429101383
sim_render-ego_min0.044170506795247394
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
193402819Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80560:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.15099020302295685
agent_compute-ego_mean0.14123791478233066
agent_compute-ego_median0.14070814980400934
agent_compute-ego_min0.1353485404320483
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021760405234570773, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05583969602045023, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1353485404320483, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0868748628868247, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03411060909055314, "sim_compute_performance-ego": 0.0588939774711177, "sim_compute_robot_state-ego": 0.06525808010461195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.0208232348615473, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06015391241420399, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14176593043587424, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08618019385771318, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03686186942187222, "sim_compute_performance-ego": 0.06376551498066295, "sim_compute_robot_state-ego": 0.06505718556317416}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.02273983425564236, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.055399322509765626, "in-drivable-lane": 0, "agent_compute-ego": 0.14070814980400934, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08712330924140083, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03670128716362847, "sim_compute_performance-ego": 0.06434120072258843, "sim_compute_robot_state-ego": 0.06761950916714138}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.023246119419733684, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06073311964670817, "in-drivable-lane": 0, "agent_compute-ego": 0.15099020302295685, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09218600392341614, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03825316826502482, "sim_compute_performance-ego": 0.06706056495507558, "sim_compute_robot_state-ego": 0.07212768495082855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02411586747449987, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06207544312757604, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13737675021676457, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08487629890441895, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03436579073176665, "sim_compute_performance-ego": 0.06594713996438419, "sim_compute_robot_state-ego": 0.0672899835249957}}
set_robot_commands_max0.09218600392341614
set_robot_commands_mean0.08744813376275476
set_robot_commands_median0.0868748628868247
set_robot_commands_min0.08487629890441895
sim_compute_performance-ego_max0.06706056495507558
sim_compute_performance-ego_mean0.06400167961876577
sim_compute_performance-ego_median0.06434120072258843
sim_compute_performance-ego_min0.0588939774711177
sim_compute_robot_state-ego_max0.07212768495082855
sim_compute_robot_state-ego_mean0.06747048866215036
sim_compute_robot_state-ego_median0.0672899835249957
sim_compute_robot_state-ego_min0.06505718556317416
sim_compute_sim_state_max0.03825316826502482
sim_compute_sim_state_mean0.03605854493456906
sim_compute_sim_state_median0.03670128716362847
sim_compute_sim_state_min0.03411060909055314
sim_physics_max0.02411586747449987
sim_physics_mean0.0225370922491988
sim_physics_median0.02273983425564236
sim_physics_min0.0208232348615473
sim_render-ego_max0.06207544312757604
sim_render-ego_mean0.05884029874374082
sim_render-ego_median0.06015391241420399
sim_render-ego_min0.055399322509765626
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
192962877Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80560:10:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192932892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep2-scoringsuccessyesip-172-31-38-104-80560:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.803471188314425


other stats
efficiency-65.27552475325805
fleet_size-1000000000
No reset possible
192772800Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornoip-172-31-38-104-80560:10:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 88, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 88, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192742865Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80560:01:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 258, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 571, in run_single
    timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 646, in run_one
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192462929Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80560:14:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 993, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19246-210452', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 485, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19246-210452', 'down']:

   >  Command '['docker-compose', '-p', 'job19246-210452', 'down']' returned non-zero exit status 1.

stdout | 

stderr | Stopping job19246-210452_solution_1       ...
stderr | Stopping job19246-210452_evaluator_1      ...
stderr | Stopping job19246-210452_scenario_maker_1 ...
stderr | Stopping job19246-210452_simulator_1      ...
stderr | 
stderr | ERROR: for job19246-210452_simulator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr | 
stderr | ERROR: for job19246-210452_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr | 
stderr | ERROR: for job19246-210452_scenario_maker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr | 
stderr | ERROR: for job19246-210452_solution_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=70)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible