Duckietown Challenges Home Challenges Submissions

Evaluator 793

ID793
evaluatorip-172-31-42-167-28276
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-28276
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success13 19250
# timeout
# failed
# error3 19532
# aborted
# host-error4 19303
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
196983002Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-282760:05:05
Error while running [...]

stderr | Pulling evaluator      ... 
stderr | Pulling solution       ... 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for scenario_maker  Cannot overwrite digest sha256:05e710b86e6ab11de59540f75f9f95f3fe30c989f099986d47c462aab7356da1
stderr | Cannot overwrite digest sha256:05e710b86e6ab11de59540f75f9f95f3fe30c989f099986d47c462aab7356da1
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196762364Andrea Censi 🇨🇭random_agentaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14219459078528665
agent_compute-ego_mean0.12121244650360638
agent_compute-ego_median0.12669288887167876
agent_compute-ego_min0.0842603655422435
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03552492159717488, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05899734766978138, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12669288887167876, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08588113874759314, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03679688921514547, "sim_compute_performance-ego": 0.06472440485684376, "sim_compute_robot_state-ego": 0.06567975260176749, "sim_compute_robot_state-npc0": 0.06418847138026976, "sim_compute_robot_state-npc1": 0.062175026479757055, "sim_compute_robot_state-npc2": 0.06387217989507711, "sim_compute_robot_state-npc3": 0.0642223763016035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04201342300935225, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0671916820786216, "in-drivable-lane": 0, "agent_compute-ego": 0.14219459078528665, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09911257028579712, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.04094184528697621, "sim_compute_performance-ego": 0.07136251709677956, "sim_compute_robot_state-ego": 0.07288956642150879, "sim_compute_robot_state-npc0": 0.07409169457175514, "sim_compute_robot_state-npc1": 0.07363335110924461, "sim_compute_robot_state-npc2": 0.07282808152112094, "sim_compute_robot_state-npc3": 0.0719062089920044}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.034185568491617836, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05870019065009223, "in-drivable-lane": 0, "agent_compute-ego": 0.12120172712537976, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08238725662231446, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03328930536905925, "sim_compute_performance-ego": 0.07173456615871854, "sim_compute_robot_state-ego": 0.06285131772359212, "sim_compute_robot_state-npc0": 0.06252671347724068, "sim_compute_robot_state-npc1": 0.06188637945387099, "sim_compute_robot_state-npc2": 0.061689503987630206, "sim_compute_robot_state-npc3": 0.06068354712592231}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0380037526289622, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0629188468058904, "in-drivable-lane": 0, "agent_compute-ego": 0.1317126601934433, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09136282404263814, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.038408840696016945, "sim_compute_performance-ego": 0.06712054212888081, "sim_compute_robot_state-ego": 0.07199810445308685, "sim_compute_robot_state-npc0": 0.06609480082988739, "sim_compute_robot_state-npc1": 0.06694420178731282, "sim_compute_robot_state-npc2": 0.06585999329884847, "sim_compute_robot_state-npc3": 0.06562176843484242}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.023394395323360663, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.040495525388156664, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0842603655422435, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05920266403871424, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.025179543915916893, "sim_compute_performance-ego": 0.043220744413488055, "sim_compute_robot_state-ego": 0.04487356368233176, "sim_compute_robot_state-npc0": 0.04504963930915384, "sim_compute_robot_state-npc1": 0.04411052605685066, "sim_compute_robot_state-npc2": 0.04263397174723008, "sim_compute_robot_state-npc3": 0.043564586078419405}}
set_robot_commands_max0.09911257028579712
set_robot_commands_mean0.08358929074741142
set_robot_commands_median0.08588113874759314
set_robot_commands_min0.05920266403871424
sim_compute_performance-ego_max0.07173456615871854
sim_compute_performance-ego_mean0.06363255493094214
sim_compute_performance-ego_median0.06712054212888081
sim_compute_performance-ego_min0.043220744413488055
sim_compute_robot_state-ego_max0.07288956642150879
sim_compute_robot_state-ego_mean0.0636584609764574
sim_compute_robot_state-ego_median0.06567975260176749
sim_compute_robot_state-ego_min0.04487356368233176
sim_compute_robot_state-npc0_max0.07409169457175514
sim_compute_robot_state-npc0_mean0.06239026391366136
sim_compute_robot_state-npc0_median0.06418847138026976
sim_compute_robot_state-npc0_min0.04504963930915384
sim_compute_robot_state-npc1_max0.07363335110924461
sim_compute_robot_state-npc1_mean0.06174989697740722
sim_compute_robot_state-npc1_median0.062175026479757055
sim_compute_robot_state-npc1_min0.04411052605685066
sim_compute_robot_state-npc2_max0.07282808152112094
sim_compute_robot_state-npc2_mean0.06137674608998137
sim_compute_robot_state-npc2_median0.06387217989507711
sim_compute_robot_state-npc2_min0.04263397174723008
sim_compute_robot_state-npc3_max0.0719062089920044
sim_compute_robot_state-npc3_mean0.06119969738655841
sim_compute_robot_state-npc3_median0.0642223763016035
sim_compute_robot_state-npc3_min0.043564586078419405
sim_compute_sim_state_max0.04094184528697621
sim_compute_sim_state_mean0.034923284896622955
sim_compute_sim_state_median0.03679688921514547
sim_compute_sim_state_min0.025179543915916893
sim_physics_max0.04201342300935225
sim_physics_mean0.03462441221009356
sim_physics_median0.03552492159717488
sim_physics_min0.023394395323360663
sim_render-ego_max0.0671916820786216
sim_render-ego_mean0.05766071851850845
sim_render-ego_median0.05899734766978138
sim_render-ego_min0.040495525388156664
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
196702578Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-42-167-282760:02:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196572385Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0829126492451202
survival_time_median1.2500000000000004
deviation-center-line_median0.04392583588508732
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.19673864364624025
agent_compute-ego_mean0.1565584047408331
agent_compute-ego_median0.1624033832550049
agent_compute-ego_min0.1228567679723104
deviation-center-line_max0.0557719339629337
deviation-center-line_mean0.042522377544770576
deviation-center-line_min0.024050797440499292
deviation-heading_max0.7517543113562304
deviation-heading_mean0.671545327993486
deviation-heading_median0.6905942951845397
deviation-heading_min0.5835274340929161
driven_any_max0.16342221698000453
driven_any_mean0.15764939924196486
driven_any_median0.16211655696871788
driven_any_min0.14702614265263778
driven_lanedir_consec_max0.10625246701710632
driven_lanedir_consec_mean0.08430306952146331
driven_lanedir_consec_min0.058797813953510136
driven_lanedir_max0.10625246701710632
driven_lanedir_mean0.08430306952146331
driven_lanedir_median0.0829126492451202
driven_lanedir_min0.058797813953510136
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.16000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16211655696871788, "sim_physics": 0.02873275961194719, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0829126492451202, "sim_render-ego": 0.04724044459206717, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.13771096297672816, "deviation-heading": 0.6127767921502485, "set_robot_commands": 0.07906085252761841, "deviation-center-line": 0.033756733966509224, "driven_lanedir_consec": 0.0829126492451202, "sim_compute_sim_state": 0.030257489000047957, "sim_compute_performance-ego": 0.05063272374016898, "sim_compute_robot_state-ego": 0.050922232014792304, "sim_compute_robot_state-npc0": 0.05017104319163731, "sim_compute_robot_state-npc1": 0.05043986013957432, "sim_compute_robot_state-npc2": 0.05101744617734637, "sim_compute_robot_state-npc3": 0.0494410651070731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16342221698000453, "sim_physics": 0.029441165924072265, "survival_time": 1.5000000000000009, "driven_lanedir": 0.058797813953510136, "sim_render-ego": 0.04448413848876953, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1228567679723104, "deviation-heading": 0.5835274340929161, "set_robot_commands": 0.06953728993733724, "deviation-center-line": 0.024050797440499292, "driven_lanedir_consec": 0.058797813953510136, "sim_compute_sim_state": 0.029431939125061035, "sim_compute_performance-ego": 0.04699829419453939, "sim_compute_robot_state-ego": 0.04866247177124024, "sim_compute_robot_state-npc0": 0.051762024561564125, "sim_compute_robot_state-npc1": 0.05072431564331055, "sim_compute_robot_state-npc2": 0.05135288238525391, "sim_compute_robot_state-npc3": 0.0510122537612915}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16230654123978427, "sim_physics": 0.035826740264892576, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10625246701710632, "sim_render-ego": 0.05829207420349121, "in-drivable-lane": 0, "agent_compute-ego": 0.1624033832550049, "deviation-heading": 0.7190738071834952, "set_robot_commands": 0.09344379425048828, "deviation-center-line": 0.05510658646882333, "driven_lanedir_consec": 0.10625246701710632, "sim_compute_sim_state": 0.03827956199645996, "sim_compute_performance-ego": 0.06341635704040527, "sim_compute_robot_state-ego": 0.06796178817749024, "sim_compute_robot_state-npc0": 0.06710586547851563, "sim_compute_robot_state-npc1": 0.06470463752746582, "sim_compute_robot_state-npc2": 0.06972640991210938, "sim_compute_robot_state-npc3": 0.06811882972717286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14702614265263778, "sim_physics": 0.0453444766998291, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07890509865388484, "sim_render-ego": 0.0673145866394043, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19673864364624025, "deviation-heading": 0.6905942951845397, "set_robot_commands": 0.10366549491882324, "deviation-center-line": 0.04392583588508732, "driven_lanedir_consec": 0.07890509865388484, "sim_compute_sim_state": 0.04158125877380371, "sim_compute_performance-ego": 0.07222460746765137, "sim_compute_robot_state-ego": 0.07980679512023926, "sim_compute_robot_state-npc0": 0.07237082481384277, "sim_compute_robot_state-npc1": 0.07151211738586426, "sim_compute_robot_state-npc2": 0.07711247444152831, "sim_compute_robot_state-npc3": 0.07228410720825196}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1533755383686798, "sim_physics": 0.0330655574798584, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09464731873769504, "sim_render-ego": 0.06254037857055664, "in-drivable-lane": 0, "agent_compute-ego": 0.16308226585388183, "deviation-heading": 0.7517543113562304, "set_robot_commands": 0.08906733512878418, "deviation-center-line": 0.0557719339629337, "driven_lanedir_consec": 0.09464731873769504, "sim_compute_sim_state": 0.036471290588378905, "sim_compute_performance-ego": 0.06405582427978515, "sim_compute_robot_state-ego": 0.06440915107727051, "sim_compute_robot_state-npc0": 0.059090585708618165, "sim_compute_robot_state-npc1": 0.05998077392578125, "sim_compute_robot_state-npc2": 0.06281962394714355, "sim_compute_robot_state-npc3": 0.06870366096496582}}
set_robot_commands_max0.10366549491882324
set_robot_commands_mean0.08695495335261028
set_robot_commands_median0.08906733512878418
set_robot_commands_min0.06953728993733724
sim_compute_performance-ego_max0.07222460746765137
sim_compute_performance-ego_mean0.05946556134451002
sim_compute_performance-ego_median0.06341635704040527
sim_compute_performance-ego_min0.04699829419453939
sim_compute_robot_state-ego_max0.07980679512023926
sim_compute_robot_state-ego_mean0.06235248763220651
sim_compute_robot_state-ego_median0.06440915107727051
sim_compute_robot_state-ego_min0.04866247177124024
sim_compute_robot_state-npc0_max0.07237082481384277
sim_compute_robot_state-npc0_mean0.0601000687508356
sim_compute_robot_state-npc0_median0.059090585708618165
sim_compute_robot_state-npc0_min0.05017104319163731
sim_compute_robot_state-npc1_max0.07151211738586426
sim_compute_robot_state-npc1_mean0.05947234092439925
sim_compute_robot_state-npc1_median0.05998077392578125
sim_compute_robot_state-npc1_min0.05043986013957432
sim_compute_robot_state-npc2_max0.07711247444152831
sim_compute_robot_state-npc2_mean0.062405767372676314
sim_compute_robot_state-npc2_median0.06281962394714355
sim_compute_robot_state-npc2_min0.05101744617734637
sim_compute_robot_state-npc3_max0.07228410720825196
sim_compute_robot_state-npc3_mean0.061911983353751046
sim_compute_robot_state-npc3_median0.06811882972717286
sim_compute_robot_state-npc3_min0.0494410651070731
sim_compute_sim_state_max0.04158125877380371
sim_compute_sim_state_mean0.03520430789675031
sim_compute_sim_state_median0.036471290588378905
sim_compute_sim_state_min0.029431939125061035
sim_physics_max0.0453444766998291
sim_physics_mean0.03448213999611991
sim_physics_median0.0330655574798584
sim_physics_min0.02873275961194719
sim_render-ego_max0.0673145866394043
sim_render-ego_mean0.05597432449885777
sim_render-ego_median0.05829207420349121
sim_render-ego_min0.04448413848876953
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3300000000000003
survival_time_min1.2500000000000004
No reset possible
196372409jiang pengBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-282760:20:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614583993086016
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.1704488221804301
agent_compute-ego_mean0.1585214956601461
agent_compute-ego_median0.1608134881655375
agent_compute-ego_min0.14931798537572225
deviation-center-line_max1.0119709059919424
deviation-center-line_mean1.0119700704341597
deviation-center-line_min1.0119697838947566
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385317
driven_any_max4.390824152784936
driven_any_mean4.390824152784928
driven_any_median4.390824152784926
driven_any_min4.390824152784922
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614594960339783
driven_lanedir_consec_min-1.3614696049818191
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158178509092298
driven_lanedir_median-2.3158179462767055
driven_lanedir_min-2.315821760973971
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.022794102032979328, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.05740727265675863, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15105137427647908, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08482579151789348, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.03758922338485718, "sim_compute_performance-ego": 0.06289856592814128, "sim_compute_robot_state-ego": 0.06403964201609294}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.023184777895609535, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.06215247392654419, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.16097580830256145, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.09093519846598308, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.03882179101308187, "sim_compute_performance-ego": 0.06490331411361694, "sim_compute_robot_state-ego": 0.06952800671259562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.024862213134765623, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.06208552678426107, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1704488221804301, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.09391892751057944, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.038748566309611, "sim_compute_performance-ego": 0.06825909296671549, "sim_compute_robot_state-ego": 0.07114670197168986}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.022971450487772625, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.055940251350402835, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14931798537572225, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08511637528737385, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03562427282333374, "sim_compute_performance-ego": 0.06150150537490845, "sim_compute_robot_state-ego": 0.06514329195022583}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.02315868854522705, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.06019066095352173, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1608134881655375, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08782877763112386, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.036683037281036376, "sim_compute_performance-ego": 0.06652021090189617, "sim_compute_robot_state-ego": 0.06980939706166585}}
set_robot_commands_max0.09391892751057944
set_robot_commands_mean0.08852501408259074
set_robot_commands_median0.08782877763112386
set_robot_commands_min0.08482579151789348
sim_compute_performance-ego_max0.06825909296671549
sim_compute_performance-ego_mean0.06481653785705566
sim_compute_performance-ego_median0.06490331411361694
sim_compute_performance-ego_min0.06150150537490845
sim_compute_robot_state-ego_max0.07114670197168986
sim_compute_robot_state-ego_mean0.06793340794245402
sim_compute_robot_state-ego_median0.06952800671259562
sim_compute_robot_state-ego_min0.06403964201609294
sim_compute_sim_state_max0.03882179101308187
sim_compute_sim_state_mean0.03749337816238403
sim_compute_sim_state_median0.03758922338485718
sim_compute_sim_state_min0.03562427282333374
sim_physics_max0.024862213134765623
sim_physics_mean0.02339424641927083
sim_physics_median0.02315868854522705
sim_physics_min0.022794102032979328
sim_render-ego_max0.06215247392654419
sim_render-ego_mean0.05955523713429769
sim_render-ego_median0.06019066095352173
sim_render-ego_min0.055940251350402835
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
196292416Andrea Censi 🇨🇭random_agentaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.13952859242757162
agent_compute-ego_mean0.12507426972616362
agent_compute-ego_median0.12113480298024304
agent_compute-ego_min0.117898867410772
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.021927419698463298, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05833410766889464, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12113480298024304, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08132273745986651, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.034116101714799986, "sim_compute_performance-ego": 0.06311210146490133, "sim_compute_robot_state-ego": 0.061143042906275334}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020297586917877197, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05641026388515125, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1261673244563016, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08070151914249767, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03462454947558316, "sim_compute_performance-ego": 0.05854807116768577, "sim_compute_robot_state-ego": 0.06337172876704823}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.022644578086005316, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06140189700656467, "in-drivable-lane": 0, "agent_compute-ego": 0.12064176135592992, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08266222212049697, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.034365643395317926, "sim_compute_performance-ego": 0.06437586148579916, "sim_compute_robot_state-ego": 0.06433379915025499}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.024932483832041424, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06306338806947072, "in-drivable-lane": 0, "agent_compute-ego": 0.13952859242757162, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.10272613167762756, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03974499801794688, "sim_compute_performance-ego": 0.07179790238539378, "sim_compute_robot_state-ego": 0.07414243121941884}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02377176986021154, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.058980903204749614, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.117898867410772, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08394865428700167, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03335796384250417, "sim_compute_performance-ego": 0.0776693575522479, "sim_compute_robot_state-ego": 0.0660822777187123}}
set_robot_commands_max0.10272613167762756
set_robot_commands_mean0.08627225293749807
set_robot_commands_median0.08266222212049697
set_robot_commands_min0.08070151914249767
sim_compute_performance-ego_max0.0776693575522479
sim_compute_performance-ego_mean0.0671006588112056
sim_compute_performance-ego_median0.06437586148579916
sim_compute_performance-ego_min0.05854807116768577
sim_compute_robot_state-ego_max0.07414243121941884
sim_compute_robot_state-ego_mean0.06581465595234193
sim_compute_robot_state-ego_median0.06433379915025499
sim_compute_robot_state-ego_min0.061143042906275334
sim_compute_sim_state_max0.03974499801794688
sim_compute_sim_state_mean0.03524185128923042
sim_compute_sim_state_median0.034365643395317926
sim_compute_sim_state_min0.03335796384250417
sim_physics_max0.024932483832041424
sim_physics_mean0.02271476767891976
sim_physics_median0.022644578086005316
sim_physics_min0.020297586917877197
sim_render-ego_max0.06306338806947072
sim_render-ego_mean0.05963811196696619
sim_render-ego_median0.058980903204749614
sim_render-ego_min0.05641026388515125
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
196152413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-42-167-282760:01:41
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19615-6197', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196022440Jacopo Tanirandom_agentaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-282760:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.1548853079477946
agent_compute-ego_mean0.1448944113852378
agent_compute-ego_median0.14096960600684671
agent_compute-ego_min0.13699670557705862
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.022636562023522717, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05621425610668254, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13699670557705862, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08797020282385484, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03555277608475595, "sim_compute_performance-ego": 0.05904507637023926, "sim_compute_robot_state-ego": 0.0635982279507619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.022312180562452835, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0572234337980097, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1394194852222096, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08587990565733476, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03331232612783259, "sim_compute_performance-ego": 0.069088030945171, "sim_compute_robot_state-ego": 0.0677301666953347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.024074660407172307, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06329116291469998, "in-drivable-lane": 0, "agent_compute-ego": 0.1548853079477946, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09732037120395236, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04341418478224013, "sim_compute_performance-ego": 0.07333229912651909, "sim_compute_robot_state-ego": 0.08025570975409614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0243448664744695, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06163720786571503, "in-drivable-lane": 0, "agent_compute-ego": 0.15220095217227936, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0923914909362793, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03923061986764272, "sim_compute_performance-ego": 0.0681713471810023, "sim_compute_robot_state-ego": 0.0700582464536031}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.025127463481005505, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06145732893663294, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14096960600684671, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08672199880375582, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.036461500560536104, "sim_compute_performance-ego": 0.06401285003213321, "sim_compute_robot_state-ego": 0.0655251846593969}}
set_robot_commands_max0.09732037120395236
set_robot_commands_mean0.09005679388503542
set_robot_commands_median0.08797020282385484
set_robot_commands_min0.08587990565733476
sim_compute_performance-ego_max0.07333229912651909
sim_compute_performance-ego_mean0.06672992073101297
sim_compute_performance-ego_median0.0681713471810023
sim_compute_performance-ego_min0.05904507637023926
sim_compute_robot_state-ego_max0.08025570975409614
sim_compute_robot_state-ego_mean0.06943350710263854
sim_compute_robot_state-ego_median0.0677301666953347
sim_compute_robot_state-ego_min0.0635982279507619
sim_compute_sim_state_max0.04341418478224013
sim_compute_sim_state_mean0.0375942814846015
sim_compute_sim_state_median0.036461500560536104
sim_compute_sim_state_min0.03331232612783259
sim_physics_max0.025127463481005505
sim_physics_mean0.023699146589724572
sim_physics_median0.024074660407172307
sim_physics_min0.022312180562452835
sim_render-ego_max0.06329116291469998
sim_render-ego_mean0.05996467792434803
sim_render-ego_median0.06145732893663294
sim_render-ego_min0.05621425610668254
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
195792471Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15652814971076118
agent_compute-ego_mean0.14307726945734373
agent_compute-ego_median0.13867639794069178
agent_compute-ego_min0.13203303515911102
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.032870787494587446, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05733436008669295, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13616583932120846, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08860830990773327, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03587584675482984, "sim_compute_performance-ego": 0.06449090759709196, "sim_compute_robot_state-ego": 0.07074667372793522, "sim_compute_robot_state-npc0": 0.06453751168161068, "sim_compute_robot_state-npc1": 0.06299504244102622, "sim_compute_robot_state-npc2": 0.06033949132235545, "sim_compute_robot_state-npc3": 0.06123358798476885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04385761781172319, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.061768531799316406, "in-drivable-lane": 0, "agent_compute-ego": 0.15198292515494607, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09679127823222768, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.042240446264093574, "sim_compute_performance-ego": 0.07182512500069359, "sim_compute_robot_state-ego": 0.07298415899276733, "sim_compute_robot_state-npc0": 0.06785531477494673, "sim_compute_robot_state-npc1": 0.07033463499762795, "sim_compute_robot_state-npc2": 0.06597483158111572, "sim_compute_robot_state-npc3": 0.06622936508872292}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.041264141930474174, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0655013985104031, "in-drivable-lane": 0, "agent_compute-ego": 0.15652814971076118, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09322774145338272, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03959573109944661, "sim_compute_performance-ego": 0.0720197836558024, "sim_compute_robot_state-ego": 0.07328930430942111, "sim_compute_robot_state-npc0": 0.0695199383629693, "sim_compute_robot_state-npc1": 0.06912613444858128, "sim_compute_robot_state-npc2": 0.06860080824957954, "sim_compute_robot_state-npc3": 0.06865327623155382}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.034972826639811196, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.051075647274653115, "in-drivable-lane": 0, "agent_compute-ego": 0.13203303515911102, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07758828997612, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03360365331172943, "sim_compute_performance-ego": 0.053997586170832314, "sim_compute_robot_state-ego": 0.05722317099571228, "sim_compute_robot_state-npc0": 0.05978748699029287, "sim_compute_robot_state-npc1": 0.05862813194592794, "sim_compute_robot_state-npc2": 0.05775320033232371, "sim_compute_robot_state-npc3": 0.07006776332855225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03640715164296767, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05689457584829891, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13867639794069178, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08493974278954898, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0355534273035386, "sim_compute_performance-ego": 0.062187163268818575, "sim_compute_robot_state-ego": 0.06787148293326883, "sim_compute_robot_state-npc0": 0.06467038743636187, "sim_compute_robot_state-npc1": 0.06343410295598648, "sim_compute_robot_state-npc2": 0.06340673390556784, "sim_compute_robot_state-npc3": 0.0627636383561527}}
set_robot_commands_max0.09679127823222768
set_robot_commands_mean0.08823107247180252
set_robot_commands_median0.08860830990773327
set_robot_commands_min0.07758828997612
sim_compute_performance-ego_max0.0720197836558024
sim_compute_performance-ego_mean0.06490411313864777
sim_compute_performance-ego_median0.06449090759709196
sim_compute_performance-ego_min0.053997586170832314
sim_compute_robot_state-ego_max0.07328930430942111
sim_compute_robot_state-ego_mean0.06842295819182095
sim_compute_robot_state-ego_median0.07074667372793522
sim_compute_robot_state-ego_min0.05722317099571228
sim_compute_robot_state-npc0_max0.0695199383629693
sim_compute_robot_state-npc0_mean0.0652741278492363
sim_compute_robot_state-npc0_median0.06467038743636187
sim_compute_robot_state-npc0_min0.05978748699029287
sim_compute_robot_state-npc1_max0.07033463499762795
sim_compute_robot_state-npc1_mean0.06490360935782997
sim_compute_robot_state-npc1_median0.06343410295598648
sim_compute_robot_state-npc1_min0.05862813194592794
sim_compute_robot_state-npc2_max0.06860080824957954
sim_compute_robot_state-npc2_mean0.06321501307818846
sim_compute_robot_state-npc2_median0.06340673390556784
sim_compute_robot_state-npc2_min0.05775320033232371
sim_compute_robot_state-npc3_max0.07006776332855225
sim_compute_robot_state-npc3_mean0.06578952619795012
sim_compute_robot_state-npc3_median0.06622936508872292
sim_compute_robot_state-npc3_min0.06123358798476885
sim_compute_sim_state_max0.042240446264093574
sim_compute_sim_state_mean0.037373820946727615
sim_compute_sim_state_median0.03587584675482984
sim_compute_sim_state_min0.03360365331172943
sim_physics_max0.04385761781172319
sim_physics_mean0.037874505103912735
sim_physics_median0.03640715164296767
sim_physics_min0.032870787494587446
sim_render-ego_max0.0655013985104031
sim_render-ego_mean0.0585149027038729
sim_render-ego_median0.05733436008669295
sim_render-ego_min0.051075647274653115
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
195392529Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-validationstep1-simulationerrornoip-172-31-42-167-282760:04:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195322540jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoip-172-31-42-167-282760:02:02
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194932595Julian Zillybaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-42-167-282760:15:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23792084397112268
survival_time_median5.14999999999999
deviation-center-line_median0.25781725254353827
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2291106399224729
agent_compute-ego_mean0.2191631984467904
agent_compute-ego_median0.2206543239892698
agent_compute-ego_min0.21047169140407015
deviation-center-line_max0.2852377460275258
deviation-center-line_mean0.2607608351366192
deviation-center-line_min0.23853783968123832
deviation-heading_max2.1527916402025076
deviation-heading_mean2.028981049836761
deviation-heading_median2.01021410496083
deviation-heading_min1.950899187720357
driven_any_max0.2826031894333863
driven_any_mean0.2769345619360099
driven_any_median0.2762162341521128
driven_any_min0.2722613633207132
driven_lanedir_consec_max0.24661044187165992
driven_lanedir_consec_mean0.23925635376056023
driven_lanedir_consec_min0.23353482883371648
driven_lanedir_max0.24661044187165992
driven_lanedir_mean0.23925635376056023
driven_lanedir_median0.23792084397112268
driven_lanedir_min0.23353482883371648
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.275024657971044, "sim_physics": 0.04514305688896958, "survival_time": 4.899999999999991, "driven_lanedir": 0.2375596929641699, "sim_render-ego": 0.0591125877536073, "in-drivable-lane": 0, "agent_compute-ego": 0.2291106399224729, "deviation-heading": 1.950899187720357, "set_robot_commands": 0.0957201354357661, "deviation-center-line": 0.25781725254353827, "driven_lanedir_consec": 0.2375596929641699, "sim_compute_sim_state": 0.0361157412431678, "sim_compute_performance-ego": 0.06481080639119051, "sim_compute_robot_state-ego": 0.07058712657617063, "sim_compute_robot_state-npc0": 0.06430546118288624, "sim_compute_robot_state-npc1": 0.0625111570163649, "sim_compute_robot_state-npc2": 0.06511476818396121, "sim_compute_robot_state-npc3": 0.06251359472469407}, "udem1-1-0": {"driven_any": 0.2785673648027933, "sim_physics": 0.04241230625372667, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2406559611621324, "sim_render-ego": 0.0610453005020435, "in-drivable-lane": 0, "agent_compute-ego": 0.22099972229737505, "deviation-heading": 1.9592575580268967, "set_robot_commands": 0.09389051107259896, "deviation-center-line": 0.23853783968123832, "driven_lanedir_consec": 0.2406559611621324, "sim_compute_sim_state": 0.03779386098568256, "sim_compute_performance-ego": 0.06671052483411935, "sim_compute_robot_state-ego": 0.07072890721834622, "sim_compute_robot_state-npc0": 0.06648035232837383, "sim_compute_robot_state-npc1": 0.0662397421323336, "sim_compute_robot_state-npc2": 0.06628911999555734, "sim_compute_robot_state-npc3": 0.06521064043045044}, "udem1-2-0": {"driven_any": 0.2762162341521128, "sim_physics": 0.04727408955398115, "survival_time": 5.14999999999999, "driven_lanedir": 0.23792084397112268, "sim_render-ego": 0.05937677448235669, "in-drivable-lane": 0, "agent_compute-ego": 0.21457961462076428, "deviation-heading": 2.1527916402025076, "set_robot_commands": 0.08599971336068458, "deviation-center-line": 0.2852377460275258, "driven_lanedir_consec": 0.23792084397112268, "sim_compute_sim_state": 0.03672531970496317, "sim_compute_performance-ego": 0.06845275406698578, "sim_compute_robot_state-ego": 0.06728393591723396, "sim_compute_robot_state-npc0": 0.06480636642974558, "sim_compute_robot_state-npc1": 0.06458780372027055, "sim_compute_robot_state-npc2": 0.06340372215196924, "sim_compute_robot_state-npc3": 0.06348757142002143}, "udem1-3-0": {"driven_any": 0.2722613633207132, "sim_physics": 0.04337694531395322, "survival_time": 5.249999999999989, "driven_lanedir": 0.23353482883371648, "sim_render-ego": 0.05515955516270229, "in-drivable-lane": 0, "agent_compute-ego": 0.21047169140407015, "deviation-heading": 2.0717427582732126, "set_robot_commands": 0.08225189163571313, "deviation-center-line": 0.2456165083194027, "driven_lanedir_consec": 0.23353482883371648, "sim_compute_sim_state": 0.03344257672627767, "sim_compute_performance-ego": 0.05891943659101214, "sim_compute_robot_state-ego": 0.06401999791463216, "sim_compute_robot_state-npc0": 0.05838940484183175, "sim_compute_robot_state-npc1": 0.05929910114833287, "sim_compute_robot_state-npc2": 0.06359436398460752, "sim_compute_robot_state-npc3": 0.06051405952090309}, "udem1-4-0": {"driven_any": 0.2826031894333863, "sim_physics": 0.04255000750223795, "survival_time": 5.09999999999999, "driven_lanedir": 0.24661044187165992, "sim_render-ego": 0.05632243203181846, "in-drivable-lane": 0, "agent_compute-ego": 0.2206543239892698, "deviation-heading": 2.01021410496083, "set_robot_commands": 0.09337298075358072, "deviation-center-line": 0.2765948291113909, "driven_lanedir_consec": 0.24661044187165992, "sim_compute_sim_state": 0.03724049119388356, "sim_compute_performance-ego": 0.06198929337894216, "sim_compute_robot_state-ego": 0.06599103235730938, "sim_compute_robot_state-npc0": 0.06446840950087004, "sim_compute_robot_state-npc1": 0.06418264613432043, "sim_compute_robot_state-npc2": 0.06341046211766262, "sim_compute_robot_state-npc3": 0.06319905496111103}}
set_robot_commands_max0.0957201354357661
set_robot_commands_mean0.0902470464516687
set_robot_commands_median0.09337298075358072
set_robot_commands_min0.08225189163571313
sim_compute_performance-ego_max0.06845275406698578
sim_compute_performance-ego_mean0.06417656305244998
sim_compute_performance-ego_median0.06481080639119051
sim_compute_performance-ego_min0.05891943659101214
sim_compute_robot_state-ego_max0.07072890721834622
sim_compute_robot_state-ego_mean0.06772219999673848
sim_compute_robot_state-ego_median0.06728393591723396
sim_compute_robot_state-ego_min0.06401999791463216
sim_compute_robot_state-npc0_max0.06648035232837383
sim_compute_robot_state-npc0_mean0.0636899988567415
sim_compute_robot_state-npc0_median0.06446840950087004
sim_compute_robot_state-npc0_min0.05838940484183175
sim_compute_robot_state-npc1_max0.0662397421323336
sim_compute_robot_state-npc1_mean0.06336409003032446
sim_compute_robot_state-npc1_median0.06418264613432043
sim_compute_robot_state-npc1_min0.05929910114833287
sim_compute_robot_state-npc2_max0.06628911999555734
sim_compute_robot_state-npc2_mean0.06436248728675158
sim_compute_robot_state-npc2_median0.06359436398460752
sim_compute_robot_state-npc2_min0.06340372215196924
sim_compute_robot_state-npc3_max0.06521064043045044
sim_compute_robot_state-npc3_mean0.06298498421143602
sim_compute_robot_state-npc3_median0.06319905496111103
sim_compute_robot_state-npc3_min0.06051405952090309
sim_compute_sim_state_max0.03779386098568256
sim_compute_sim_state_mean0.03626359797079495
sim_compute_sim_state_median0.03672531970496317
sim_compute_sim_state_min0.03344257672627767
sim_physics_max0.04727408955398115
sim_physics_mean0.044151281102573714
sim_physics_median0.04337694531395322
sim_physics_min0.04241230625372667
sim_render-ego_max0.0610453005020435
sim_render-ego_mean0.058203329986505646
sim_render-ego_median0.0591125877536073
sim_render-ego_min0.05515955516270229
simulation-passed1
survival_time_max5.249999999999989
survival_time_mean5.1199999999999894
survival_time_min4.899999999999991
No reset possible
194862604Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0933418587634438
agent_compute-ego_mean0.07510217598786177
agent_compute-ego_median0.07283777195018726
agent_compute-ego_min0.06516814231872559
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02741894780135736, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0601323639474264, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06926387984578203, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.09851882225129664, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.038990529572091454, "sim_compute_performance-ego": 0.06825561348984881, "sim_compute_robot_state-ego": 0.07382560939323611}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02266561068021334, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05435808805318979, "in-drivable-lane": 0, "agent_compute-ego": 0.06516814231872559, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08978917965522179, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03910995446718656, "sim_compute_performance-ego": 0.06769206890693077, "sim_compute_robot_state-ego": 0.06719813897059514}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.023986547551256544, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.0630725901177589, "in-drivable-lane": 0, "agent_compute-ego": 0.0748992270611702, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.09561858785913344, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03580015770932461, "sim_compute_performance-ego": 0.06624924882929376, "sim_compute_robot_state-ego": 0.06714636214235996}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.03048551999605619, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06258633634546301, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07283777195018726, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.1012375485766065, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03881889647179908, "sim_compute_performance-ego": 0.07186895936400026, "sim_compute_robot_state-ego": 0.07224211588010683}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.03500043091021086, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.07514870794195878, "in-drivable-lane": 0, "agent_compute-ego": 0.0933418587634438, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.11460148660760176, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.046967933052464536, "sim_compute_performance-ego": 0.08259278849551552, "sim_compute_robot_state-ego": 0.09087192384820236}}
set_robot_commands_max0.11460148660760176
set_robot_commands_mean0.09995312498997204
set_robot_commands_median0.09851882225129664
set_robot_commands_min0.08978917965522179
sim_compute_performance-ego_max0.08259278849551552
sim_compute_performance-ego_mean0.07133173581711783
sim_compute_performance-ego_median0.06825561348984881
sim_compute_performance-ego_min0.06624924882929376
sim_compute_robot_state-ego_max0.09087192384820236
sim_compute_robot_state-ego_mean0.07425683004690008
sim_compute_robot_state-ego_median0.07224211588010683
sim_compute_robot_state-ego_min0.06714636214235996
sim_compute_sim_state_max0.046967933052464536
sim_compute_sim_state_mean0.03993749425457325
sim_compute_sim_state_median0.038990529572091454
sim_compute_sim_state_min0.03580015770932461
sim_physics_max0.03500043091021086
sim_physics_mean0.027911411387818857
sim_physics_median0.02741894780135736
sim_physics_min0.02266561068021334
sim_render-ego_max0.07514870794195878
sim_render-ego_mean0.06305961728115937
sim_render-ego_median0.06258633634546301
sim_render-ego_min0.05435808805318979
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
194552680Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:18:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0240093155136043
survival_time_median6.8999999999999835
deviation-center-line_median0.4768743338929914
in-drivable-lane_median0


other stats
agent_compute-ego_max0.091946595509847
agent_compute-ego_mean0.08684022580904638
agent_compute-ego_median0.08772176612507213
agent_compute-ego_min0.07876198879186658
deviation-center-line_max0.6680510785758133
deviation-center-line_mean0.4827280842553369
deviation-center-line_min0.27245655101549265
deviation-heading_max1.4219328001059632
deviation-heading_mean1.226393609169372
deviation-heading_median1.2670270328437836
deviation-heading_min0.9750786737419777
driven_any_max1.1583444269684966
driven_any_mean1.0404710094067904
driven_any_median1.061897793095121
driven_any_min0.826124985421427
driven_lanedir_consec_max1.1275355962650453
driven_lanedir_consec_mean1.0116781290253154
driven_lanedir_consec_min0.7926179835525367
driven_lanedir_max1.1275355962650453
driven_lanedir_mean1.0116781290253154
driven_lanedir_median1.0240093155136043
driven_lanedir_min0.7926179835525367
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.826124985421427, "sim_physics": 0.04794454141096635, "survival_time": 5.4999999999999885, "driven_lanedir": 0.7926179835525367, "sim_render-ego": 0.06943152384324507, "in-drivable-lane": 0, "agent_compute-ego": 0.08772176612507213, "deviation-heading": 1.1303159433032055, "set_robot_commands": 0.1102610718120228, "deviation-center-line": 0.27245655101549265, "driven_lanedir_consec": 0.7926179835525367, "sim_compute_sim_state": 0.04387309984727339, "sim_compute_performance-ego": 0.07631322253834118, "sim_compute_robot_state-ego": 0.08133997266942805, "sim_compute_robot_state-npc0": 0.07785440574992787, "sim_compute_robot_state-npc1": 0.07782458392056552, "sim_compute_robot_state-npc2": 0.07815422361547297, "sim_compute_robot_state-npc3": 0.07795810049230402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1342352788874617, "sim_physics": 0.04797448430742536, "survival_time": 7.349999999999982, "driven_lanedir": 1.1095075558762866, "sim_render-ego": 0.07153981234751591, "in-drivable-lane": 0, "agent_compute-ego": 0.08768382040010829, "deviation-heading": 1.2670270328437836, "set_robot_commands": 0.11161322820754278, "deviation-center-line": 0.6381826438294421, "driven_lanedir_consec": 1.1095075558762866, "sim_compute_sim_state": 0.043668904272066496, "sim_compute_performance-ego": 0.07892482783518681, "sim_compute_robot_state-ego": 0.08221117655436198, "sim_compute_robot_state-npc0": 0.07638412754551895, "sim_compute_robot_state-npc1": 0.07919608168050546, "sim_compute_robot_state-npc2": 0.07797589918383124, "sim_compute_robot_state-npc3": 0.07802939739357047}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0217525626614452, "sim_physics": 0.04862336467083236, "survival_time": 6.649999999999984, "driven_lanedir": 1.0047201939191042, "sim_render-ego": 0.0724440248388993, "in-drivable-lane": 0, "agent_compute-ego": 0.0880869582183379, "deviation-heading": 0.9750786737419777, "set_robot_commands": 0.11358853031818132, "deviation-center-line": 0.6680510785758133, "driven_lanedir_consec": 1.0047201939191042, "sim_compute_sim_state": 0.04302767165621421, "sim_compute_performance-ego": 0.0793965364757337, "sim_compute_robot_state-ego": 0.08714400915274943, "sim_compute_robot_state-npc0": 0.08240886559163717, "sim_compute_robot_state-npc1": 0.07793993519661122, "sim_compute_robot_state-npc2": 0.07874628296472076, "sim_compute_robot_state-npc3": 0.07833965021864812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1583444269684966, "sim_physics": 0.046646011670430504, "survival_time": 7.499999999999981, "driven_lanedir": 1.1275355962650453, "sim_render-ego": 0.07011596838633219, "in-drivable-lane": 0, "agent_compute-ego": 0.091946595509847, "deviation-heading": 1.3376135958519308, "set_robot_commands": 0.1171632973353068, "deviation-center-line": 0.4768743338929914, "driven_lanedir_consec": 1.1275355962650453, "sim_compute_sim_state": 0.0445082410176595, "sim_compute_performance-ego": 0.07905644893646241, "sim_compute_robot_state-ego": 0.08685746033986409, "sim_compute_robot_state-npc0": 0.07912398815155029, "sim_compute_robot_state-npc1": 0.07794795831044515, "sim_compute_robot_state-npc2": 0.0790939458211263, "sim_compute_robot_state-npc3": 0.07979381879170735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.061897793095121, "sim_physics": 0.039001660070557526, "survival_time": 6.8999999999999835, "driven_lanedir": 1.0240093155136043, "sim_render-ego": 0.06187779661537944, "in-drivable-lane": 0, "agent_compute-ego": 0.07876198879186658, "deviation-heading": 1.4219328001059632, "set_robot_commands": 0.0927256414855736, "deviation-center-line": 0.35807581396294486, "driven_lanedir_consec": 1.0240093155136043, "sim_compute_sim_state": 0.038469463154889534, "sim_compute_performance-ego": 0.0688541004623192, "sim_compute_robot_state-ego": 0.06995647540990857, "sim_compute_robot_state-npc0": 0.06827106683150581, "sim_compute_robot_state-npc1": 0.06852705064027206, "sim_compute_robot_state-npc2": 0.06812747492306474, "sim_compute_robot_state-npc3": 0.06906057095182115}}
set_robot_commands_max0.1171632973353068
set_robot_commands_mean0.10907035383172548
set_robot_commands_median0.11161322820754278
set_robot_commands_min0.0927256414855736
sim_compute_performance-ego_max0.0793965364757337
sim_compute_performance-ego_mean0.07650902724960866
sim_compute_performance-ego_median0.07892482783518681
sim_compute_performance-ego_min0.0688541004623192
sim_compute_robot_state-ego_max0.08714400915274943
sim_compute_robot_state-ego_mean0.08150181882526243
sim_compute_robot_state-ego_median0.08221117655436198
sim_compute_robot_state-ego_min0.06995647540990857
sim_compute_robot_state-npc0_max0.08240886559163717
sim_compute_robot_state-npc0_mean0.07680849077402802
sim_compute_robot_state-npc0_median0.07785440574992787
sim_compute_robot_state-npc0_min0.06827106683150581
sim_compute_robot_state-npc1_max0.07919608168050546
sim_compute_robot_state-npc1_mean0.07628712194967988
sim_compute_robot_state-npc1_median0.07793993519661122
sim_compute_robot_state-npc1_min0.06852705064027206
sim_compute_robot_state-npc2_max0.0790939458211263
sim_compute_robot_state-npc2_mean0.0764195653016432
sim_compute_robot_state-npc2_median0.07815422361547297
sim_compute_robot_state-npc2_min0.06812747492306474
sim_compute_robot_state-npc3_max0.07979381879170735
sim_compute_robot_state-npc3_mean0.07663630756961022
sim_compute_robot_state-npc3_median0.07802939739357047
sim_compute_robot_state-npc3_min0.06906057095182115
sim_compute_sim_state_max0.0445082410176595
sim_compute_sim_state_mean0.042709475989620625
sim_compute_sim_state_median0.043668904272066496
sim_compute_sim_state_min0.038469463154889534
sim_physics_max0.04862336467083236
sim_physics_mean0.04603801242604242
sim_physics_median0.04794454141096635
sim_physics_min0.039001660070557526
sim_render-ego_max0.0724440248388993
sim_render-ego_mean0.06908182520627439
sim_render-ego_median0.07011596838633219
sim_render-ego_min0.06187779661537944
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean6.779999999999984
survival_time_min5.4999999999999885
No reset possible
194412652Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-42-167-282760:05:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19441-596384', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193812965Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-42-167-282760:33:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5763173996467272
survival_time_median14.950000000000076
deviation-center-line_median0.3911228143725886
in-drivable-lane_median3.000000000000014


other stats
agent_compute-ego_max0.21422396739323937
agent_compute-ego_mean0.204718612108601
agent_compute-ego_median0.2124345954259237
agent_compute-ego_min0.18126836799135143
deviation-center-line_max0.8951117156378982
deviation-center-line_mean0.5488496750587151
deviation-center-line_min0.18272855721428313
deviation-heading_max5.7180555753723
deviation-heading_mean2.24957754453992
deviation-heading_median1.3887414101714666
deviation-heading_min1.3204172304203865
driven_any_max1.742340037573792
driven_any_mean1.4734045721775644
driven_any_median1.5350188837624157
driven_any_min0.9814403019069082
driven_lanedir_consec_max1.578764120892484
driven_lanedir_consec_mean0.8638562585541372
driven_lanedir_consec_min0.5264593436903899
driven_lanedir_max1.578764120892484
driven_lanedir_mean0.8668835955042095
driven_lanedir_median0.587771422298192
driven_lanedir_min0.5264593436903899
in-drivable-lane_max8.950000000000092
in-drivable-lane_mean4.490000000000038
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.742340037573792, "sim_physics": 0.03685688092404564, "survival_time": 14.900000000000077, "driven_lanedir": 1.1127451865038838, "sim_render-ego": 0.05370047668482633, "in-drivable-lane": 3.000000000000014, "agent_compute-ego": 0.18126836799135143, "deviation-heading": 5.7180555753723, "set_robot_commands": 0.08108847173268363, "deviation-center-line": 0.8883639139408307, "driven_lanedir_consec": 1.1090625244049872, "sim_compute_sim_state": 0.03425760717199953, "sim_compute_performance-ego": 0.05818897605742384, "sim_compute_robot_state-ego": 0.0596322437260775, "sim_compute_robot_state-npc0": 0.05965808814003964, "sim_compute_robot_state-npc1": 0.05914226474377933, "sim_compute_robot_state-npc2": 0.05854020502743305, "sim_compute_robot_state-npc3": 0.05962616965274683}, "udem1-1-0": {"driven_any": 0.9814403019069082, "sim_physics": 0.0416826699909411, "survival_time": 6.649999999999984, "driven_lanedir": 0.587771422298192, "sim_render-ego": 0.05985501296538159, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.2023988343719253, "deviation-heading": 1.3887414101714666, "set_robot_commands": 0.0948064865026259, "deviation-center-line": 0.18272855721428313, "driven_lanedir_consec": 0.5763173996467272, "sim_compute_sim_state": 0.03703560327228747, "sim_compute_performance-ego": 0.06739939424328338, "sim_compute_robot_state-ego": 0.06872485096293285, "sim_compute_robot_state-npc0": 0.06541938889295534, "sim_compute_robot_state-npc1": 0.0663046567959893, "sim_compute_robot_state-npc2": 0.06735915169680029, "sim_compute_robot_state-npc3": 0.06662379350877345}, "udem1-2-0": {"driven_any": 1.5350188837624157, "sim_physics": 0.04165470600128174, "survival_time": 14.950000000000076, "driven_lanedir": 0.5286779041360976, "sim_render-ego": 0.0628215750058492, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.21422396739323937, "deviation-heading": 1.3218320545233164, "set_robot_commands": 0.0941782546043396, "deviation-center-line": 0.3911228143725886, "driven_lanedir_consec": 0.5286779041360976, "sim_compute_sim_state": 0.03916319211324056, "sim_compute_performance-ego": 0.065614439646403, "sim_compute_robot_state-ego": 0.07043543577194214, "sim_compute_robot_state-npc0": 0.06793867349624634, "sim_compute_robot_state-npc1": 0.06694735606511434, "sim_compute_robot_state-npc2": 0.06831875960032145, "sim_compute_robot_state-npc3": 0.06871916055679321}, "udem1-3-0": {"driven_any": 1.5172680246062988, "sim_physics": 0.04388713200887044, "survival_time": 14.950000000000076, "driven_lanedir": 0.5264593436903899, "sim_render-ego": 0.06078401724497477, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.2124345954259237, "deviation-heading": 1.3204172304203865, "set_robot_commands": 0.09636871258417766, "deviation-center-line": 0.3869213741279744, "driven_lanedir_consec": 0.5264593436903899, "sim_compute_sim_state": 0.038197494347890215, "sim_compute_performance-ego": 0.0655510965983073, "sim_compute_robot_state-ego": 0.07168463468551636, "sim_compute_robot_state-npc0": 0.06833851973215739, "sim_compute_robot_state-npc1": 0.06817989031473795, "sim_compute_robot_state-npc2": 0.06799485365549723, "sim_compute_robot_state-npc3": 0.068014341990153}, "udem1-4-0": {"driven_any": 1.5909556130384073, "sim_physics": 0.04299930254618327, "survival_time": 14.950000000000076, "driven_lanedir": 1.578764120892484, "sim_render-ego": 0.061240493456522625, "in-drivable-lane": 0, "agent_compute-ego": 0.2132672953605652, "deviation-heading": 1.4988414522121318, "set_robot_commands": 0.0915544319152832, "deviation-center-line": 0.8951117156378982, "driven_lanedir_consec": 1.578764120892484, "sim_compute_sim_state": 0.039957746664683026, "sim_compute_performance-ego": 0.06796042362848918, "sim_compute_robot_state-ego": 0.07193906863530476, "sim_compute_robot_state-npc0": 0.06736022154490152, "sim_compute_robot_state-npc1": 0.0668534771601359, "sim_compute_robot_state-npc2": 0.0680749225616455, "sim_compute_robot_state-npc3": 0.0682423726717631}}
set_robot_commands_max0.09636871258417766
set_robot_commands_mean0.091599271467822
set_robot_commands_median0.0941782546043396
set_robot_commands_min0.08108847173268363
sim_compute_performance-ego_max0.06796042362848918
sim_compute_performance-ego_mean0.06494286603478135
sim_compute_performance-ego_median0.065614439646403
sim_compute_performance-ego_min0.05818897605742384
sim_compute_robot_state-ego_max0.07193906863530476
sim_compute_robot_state-ego_mean0.06848324675635473
sim_compute_robot_state-ego_median0.07043543577194214
sim_compute_robot_state-ego_min0.0596322437260775
sim_compute_robot_state-npc0_max0.06833851973215739
sim_compute_robot_state-npc0_mean0.06574297836126004
sim_compute_robot_state-npc0_median0.06736022154490152
sim_compute_robot_state-npc0_min0.05965808814003964
sim_compute_robot_state-npc1_max0.06817989031473795
sim_compute_robot_state-npc1_mean0.06548552901595137
sim_compute_robot_state-npc1_median0.0668534771601359
sim_compute_robot_state-npc1_min0.05914226474377933
sim_compute_robot_state-npc2_max0.06831875960032145
sim_compute_robot_state-npc2_mean0.0660575785083395
sim_compute_robot_state-npc2_median0.06799485365549723
sim_compute_robot_state-npc2_min0.05854020502743305
sim_compute_robot_state-npc3_max0.06871916055679321
sim_compute_robot_state-npc3_mean0.06624516767604591
sim_compute_robot_state-npc3_median0.068014341990153
sim_compute_robot_state-npc3_min0.05962616965274683
sim_compute_sim_state_max0.039957746664683026
sim_compute_sim_state_mean0.03772232871402016
sim_compute_sim_state_median0.038197494347890215
sim_compute_sim_state_min0.03425760717199953
sim_physics_max0.04388713200887044
sim_physics_mean0.04141613829426444
sim_physics_median0.0416826699909411
sim_physics_min0.03685688092404564
sim_render-ego_max0.0628215750058492
sim_render-ego_mean0.059680315071510906
sim_render-ego_median0.06078401724497477
sim_render-ego_min0.05370047668482633
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.280000000000058
survival_time_min6.649999999999984
No reset possible
193342860Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:19:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5177324595837185
survival_time_median7.299999999999982
deviation-center-line_median0.1621038927564964
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11234582180068606
agent_compute-ego_mean0.105472958929358
agent_compute-ego_median0.10528488569362188
agent_compute-ego_min0.09778356209075709
deviation-center-line_max0.2502866759220912
deviation-center-line_mean0.17396493741523614
deviation-center-line_min0.1214735246740866
deviation-heading_max1.781660788722
deviation-heading_mean1.6924744901497055
deviation-heading_median1.7279292154229322
deviation-heading_min1.5785678301240016
driven_any_max1.176677343799044
driven_any_mean0.655285191888143
driven_any_median0.5631093149803889
driven_any_min0.350146881476964
driven_lanedir_consec_max0.6186787020548552
driven_lanedir_consec_mean0.48703898156761055
driven_lanedir_consec_min0.30118830672574726
driven_lanedir_max0.6186787020548552
driven_lanedir_mean0.48703898156761055
driven_lanedir_median0.5177324595837185
driven_lanedir_min0.30118830672574726
in-drivable-lane_max7.550000000000094
in-drivable-lane_mean1.540000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.176677343799044, "sim_physics": 0.03881615241368612, "survival_time": 14.950000000000076, "driven_lanedir": 0.520699227613048, "sim_render-ego": 0.06571362257003784, "in-drivable-lane": 7.550000000000094, "agent_compute-ego": 0.10911217212677002, "deviation-heading": 1.781660788722, "set_robot_commands": 0.10491028547286987, "deviation-center-line": 0.1621038927564964, "driven_lanedir_consec": 0.520699227613048, "sim_compute_sim_state": 0.04056580702463786, "sim_compute_performance-ego": 0.07259453614552816, "sim_compute_robot_state-ego": 0.07664793173472087, "sim_compute_robot_state-npc0": 0.07251346429189046, "sim_compute_robot_state-npc1": 0.07403036594390869, "sim_compute_robot_state-npc2": 0.07455262819925944, "sim_compute_robot_state-npc3": 0.07203188021977742}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.350146881476964, "sim_physics": 0.04407526088017289, "survival_time": 4.6499999999999915, "driven_lanedir": 0.30118830672574726, "sim_render-ego": 0.06510578432390766, "in-drivable-lane": 0, "agent_compute-ego": 0.10528488569362188, "deviation-heading": 1.7279292154229322, "set_robot_commands": 0.10136960655130366, "deviation-center-line": 0.15380448251272097, "driven_lanedir_consec": 0.30118830672574726, "sim_compute_sim_state": 0.03959918791247952, "sim_compute_performance-ego": 0.07037220206311955, "sim_compute_robot_state-ego": 0.07524896180757912, "sim_compute_robot_state-npc0": 0.07304496662591094, "sim_compute_robot_state-npc1": 0.07283475322108116, "sim_compute_robot_state-npc2": 0.06963453241573866, "sim_compute_robot_state-npc3": 0.06959136070743684}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6515117721126895, "sim_physics": 0.04240355321339199, "survival_time": 8.399999999999984, "driven_lanedir": 0.6186787020548552, "sim_render-ego": 0.06715463314737592, "in-drivable-lane": 0, "agent_compute-ego": 0.11234582180068606, "deviation-heading": 1.6361796855923458, "set_robot_commands": 0.10862239911442712, "deviation-center-line": 0.2502866759220912, "driven_lanedir_consec": 0.6186787020548552, "sim_compute_sim_state": 0.04268607071467808, "sim_compute_performance-ego": 0.07332462923867362, "sim_compute_robot_state-ego": 0.07932571002415248, "sim_compute_robot_state-npc0": 0.07450272781508309, "sim_compute_robot_state-npc1": 0.0734321205388932, "sim_compute_robot_state-npc2": 0.07378799148968287, "sim_compute_robot_state-npc3": 0.0760819244952429}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5349806470716294, "sim_physics": 0.038985760091877666, "survival_time": 6.949999999999983, "driven_lanedir": 0.4768962118606837, "sim_render-ego": 0.05930405040439085, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09778356209075709, "deviation-heading": 1.5785678301240016, "set_robot_commands": 0.09416324286152132, "deviation-center-line": 0.1214735246740866, "driven_lanedir_consec": 0.4768962118606837, "sim_compute_sim_state": 0.03759848299643976, "sim_compute_performance-ego": 0.06790156501660244, "sim_compute_robot_state-ego": 0.06809535472513102, "sim_compute_robot_state-npc0": 0.06575985435101626, "sim_compute_robot_state-npc1": 0.06527223689950627, "sim_compute_robot_state-npc2": 0.0705800090762351, "sim_compute_robot_state-npc3": 0.0647625288517355}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5631093149803889, "sim_physics": 0.03527375769941774, "survival_time": 7.299999999999982, "driven_lanedir": 0.5177324595837185, "sim_render-ego": 0.060513718487465215, "in-drivable-lane": 0, "agent_compute-ego": 0.10283835293495493, "deviation-heading": 1.7380349308872487, "set_robot_commands": 0.09456540460455908, "deviation-center-line": 0.1821561112107856, "driven_lanedir_consec": 0.5177324595837185, "sim_compute_sim_state": 0.03664445877075195, "sim_compute_performance-ego": 0.06782262782527976, "sim_compute_robot_state-ego": 0.06923516809123836, "sim_compute_robot_state-npc0": 0.0679663795314423, "sim_compute_robot_state-npc1": 0.0660715250119771, "sim_compute_robot_state-npc2": 0.06642115769320972, "sim_compute_robot_state-npc3": 0.0644289304132331}}
set_robot_commands_max0.10862239911442712
set_robot_commands_mean0.1007261877209362
set_robot_commands_median0.10136960655130366
set_robot_commands_min0.09416324286152132
sim_compute_performance-ego_max0.07332462923867362
sim_compute_performance-ego_mean0.0704031120578407
sim_compute_performance-ego_median0.07037220206311955
sim_compute_performance-ego_min0.06782262782527976
sim_compute_robot_state-ego_max0.07932571002415248
sim_compute_robot_state-ego_mean0.07371062527656437
sim_compute_robot_state-ego_median0.07524896180757912
sim_compute_robot_state-ego_min0.06809535472513102
sim_compute_robot_state-npc0_max0.07450272781508309
sim_compute_robot_state-npc0_mean0.07075747852306861
sim_compute_robot_state-npc0_median0.07251346429189046
sim_compute_robot_state-npc0_min0.06575985435101626
sim_compute_robot_state-npc1_max0.07403036594390869
sim_compute_robot_state-npc1_mean0.07032820032307328
sim_compute_robot_state-npc1_median0.07283475322108116
sim_compute_robot_state-npc1_min0.06527223689950627
sim_compute_robot_state-npc2_max0.07455262819925944
sim_compute_robot_state-npc2_mean0.07099526377482515
sim_compute_robot_state-npc2_median0.0705800090762351
sim_compute_robot_state-npc2_min0.06642115769320972
sim_compute_robot_state-npc3_max0.0760819244952429
sim_compute_robot_state-npc3_mean0.06937932493748515
sim_compute_robot_state-npc3_median0.06959136070743684
sim_compute_robot_state-npc3_min0.0644289304132331
sim_compute_sim_state_max0.04268607071467808
sim_compute_sim_state_mean0.03941880148379744
sim_compute_sim_state_median0.03959918791247952
sim_compute_sim_state_min0.03664445877075195
sim_physics_max0.04407526088017289
sim_physics_mean0.03991089685970928
sim_physics_median0.038985760091877666
sim_physics_min0.03527375769941774
sim_render-ego_max0.06715463314737592
sim_render-ego_mean0.0635583617866355
sim_render-ego_median0.06510578432390766
sim_render-ego_min0.05930405040439085
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.450000000000005
survival_time_min4.6499999999999915
No reset possible
193032857Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-42-167-282760:07:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19303-648457', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192842891Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationsuccessyesip-172-31-42-167-282760:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
192502928Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-42-167-282760:22:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08238667281181611
survival_time_median1.3500000000000003
deviation-center-line_median0.04065667616435421
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.3555845309948099
agent_compute-ego_mean0.1956024702949835
agent_compute-ego_median0.16467605187342718
agent_compute-ego_min0.14219419161478675
deviation-center-line_max0.06620342472754193
deviation-center-line_mean0.0473441589144017
deviation-center-line_min0.034462049149360685
deviation-heading_max0.8363489530989983
deviation-heading_mean0.6843313602855202
deviation-heading_median0.6577131889044856
deviation-heading_min0.6042386307362206
driven_any_max0.18929707866635445
driven_any_mean0.16754923443693298
driven_any_median0.16268676116628014
driven_any_min0.1506392741327123
driven_lanedir_consec_max0.14273976803173394
driven_lanedir_consec_mean0.09685352680037664
driven_lanedir_consec_min0.07538253565936515
driven_lanedir_max0.14273976803173394
driven_lanedir_mean0.09685352680037664
driven_lanedir_median0.08238667281181611
driven_lanedir_min0.07538253565936515
in-drivable-lane_max0.3500000000000003
in-drivable-lane_mean0.16000000000000014
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.18929707866635445, "sim_physics": 0.03911954623002272, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14273976803173394, "sim_render-ego": 0.057150657360370345, "in-drivable-lane": 0, "agent_compute-ego": 0.16467605187342718, "deviation-heading": 0.6042386307362206, "set_robot_commands": 0.09311820910527156, "deviation-center-line": 0.05752495602446073, "driven_lanedir_consec": 0.14273976803173394, "sim_compute_sim_state": 0.03483159725482647, "sim_compute_performance-ego": 0.06010033534123348, "sim_compute_robot_state-ego": 0.06315436730018029, "sim_compute_robot_state-npc0": 0.06659049254197341, "sim_compute_robot_state-npc1": 0.06503858933081993, "sim_compute_robot_state-npc2": 0.06364265772012564, "sim_compute_robot_state-npc3": 0.0962442526450524}, "udem1-1-0": {"driven_any": 0.16268676116628014, "sim_physics": 0.07197435970964103, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08238667281181611, "sim_render-ego": 0.09171573869113264, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.3555845309948099, "deviation-heading": 0.6979751589534597, "set_robot_commands": 0.15729975700378418, "deviation-center-line": 0.04065667616435421, "driven_lanedir_consec": 0.08238667281181611, "sim_compute_sim_state": 0.056307661122289195, "sim_compute_performance-ego": 0.102147258561233, "sim_compute_robot_state-ego": 0.10942277415045376, "sim_compute_robot_state-npc0": 0.10745186641298492, "sim_compute_robot_state-npc1": 0.09667280624652733, "sim_compute_robot_state-npc2": 0.1048070397870294, "sim_compute_robot_state-npc3": 0.099444553769868}, "udem1-2-0": {"driven_any": 0.1506392741327123, "sim_physics": 0.049694573437726056, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07538253565936515, "sim_render-ego": 0.06149812980934426, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.16700191851015445, "deviation-heading": 0.6577131889044856, "set_robot_commands": 0.09380529544971608, "deviation-center-line": 0.03787368850629095, "driven_lanedir_consec": 0.07538253565936515, "sim_compute_sim_state": 0.04073981002525047, "sim_compute_performance-ego": 0.06415130473949292, "sim_compute_robot_state-ego": 0.06664649645487468, "sim_compute_robot_state-npc0": 0.06830207506815593, "sim_compute_robot_state-npc1": 0.06921667522854275, "sim_compute_robot_state-npc2": 0.07031031891151711, "sim_compute_robot_state-npc3": 0.07061530042577673}, "udem1-3-0": {"driven_any": 0.17252353346342972, "sim_physics": 0.03765534559885661, "survival_time": 1.5000000000000009, "driven_lanedir": 0.08189315062263702, "sim_render-ego": 0.057973480224609374, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.14219419161478675, "deviation-heading": 0.625380869734437, "set_robot_commands": 0.08101008733113607, "deviation-center-line": 0.034462049149360685, "driven_lanedir_consec": 0.08189315062263702, "sim_compute_sim_state": 0.03274555206298828, "sim_compute_performance-ego": 0.05748173395792643, "sim_compute_robot_state-ego": 0.062039939562479655, "sim_compute_robot_state-npc0": 0.056739036242167154, "sim_compute_robot_state-npc1": 0.053576421737670896, "sim_compute_robot_state-npc2": 0.05403548081715902, "sim_compute_robot_state-npc3": 0.05822705427805583}, "udem1-4-0": {"driven_any": 0.1625995247558882, "sim_physics": 0.03199585278828939, "survival_time": 1.3500000000000003, "driven_lanedir": 0.101865506876331, "sim_render-ego": 0.054427641409414786, "in-drivable-lane": 0, "agent_compute-ego": 0.14855565848173918, "deviation-heading": 0.8363489530989983, "set_robot_commands": 0.08183949965017813, "deviation-center-line": 0.06620342472754193, "driven_lanedir_consec": 0.101865506876331, "sim_compute_sim_state": 0.029462487609298146, "sim_compute_performance-ego": 0.05749515250877098, "sim_compute_robot_state-ego": 0.05591150566383645, "sim_compute_robot_state-npc0": 0.059401335539641206, "sim_compute_robot_state-npc1": 0.0599027121508563, "sim_compute_robot_state-npc2": 0.05801359812418619, "sim_compute_robot_state-npc3": 0.05463113608183684}}
set_robot_commands_max0.15729975700378418
set_robot_commands_mean0.1014145697080172
set_robot_commands_median0.09311820910527156
set_robot_commands_min0.08101008733113607
sim_compute_performance-ego_max0.102147258561233
sim_compute_performance-ego_mean0.06827515702173136
sim_compute_performance-ego_median0.06010033534123348
sim_compute_performance-ego_min0.05748173395792643
sim_compute_robot_state-ego_max0.10942277415045376
sim_compute_robot_state-ego_mean0.07143501662636496
sim_compute_robot_state-ego_median0.06315436730018029
sim_compute_robot_state-ego_min0.05591150566383645
sim_compute_robot_state-npc0_max0.10745186641298492
sim_compute_robot_state-npc0_mean0.07169696116098453
sim_compute_robot_state-npc0_median0.06659049254197341
sim_compute_robot_state-npc0_min0.056739036242167154
sim_compute_robot_state-npc1_max0.09667280624652733
sim_compute_robot_state-npc1_mean0.06888144093888345
sim_compute_robot_state-npc1_median0.06503858933081993
sim_compute_robot_state-npc1_min0.053576421737670896
sim_compute_robot_state-npc2_max0.1048070397870294
sim_compute_robot_state-npc2_mean0.07016181907200349
sim_compute_robot_state-npc2_median0.06364265772012564
sim_compute_robot_state-npc2_min0.05403548081715902
sim_compute_robot_state-npc3_max0.099444553769868
sim_compute_robot_state-npc3_mean0.07583245944011795
sim_compute_robot_state-npc3_median0.07061530042577673
sim_compute_robot_state-npc3_min0.05463113608183684
sim_compute_sim_state_max0.056307661122289195
sim_compute_sim_state_mean0.038817421614930514
sim_compute_sim_state_median0.03483159725482647
sim_compute_sim_state_min0.029462487609298146
sim_physics_max0.07197435970964103
sim_physics_mean0.04608793555290717
sim_physics_median0.03911954623002272
sim_physics_min0.03199585278828939
sim_render-ego_max0.09171573869113264
sim_render-ego_mean0.06455312949897428
sim_render-ego_median0.057973480224609374
sim_render-ego_min0.054427641409414786
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3900000000000006
survival_time_min1.3000000000000005
No reset possible