AI Driving Olympics Home Challenges Submissions Jobs

Submission 2660

Submission2660
Competingyes
Challengeaido2-LFVI-sim-testing
Userzamatory
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22248
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority60
User priority60

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222482660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessyes-0:41:37(hidden)
driven_lanedir_consec_median0.3744369855095764
survival_time_median5.349999999999989
deviation-center-line_median0.41322583478089375
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.06284222764483953
agent_compute-ego_mean0.0598180226842233
agent_compute-ego_median0.06022515860936975
agent_compute-ego_min0.056666685255947494
deviation-center-line_max1.4277660770683551
deviation-center-line_mean0.5699590046114346
deviation-center-line_min0.10528391939938037
deviation-heading_max8.011415255955212
deviation-heading_mean2.9876088847373135
deviation-heading_median2.511037383967619
deviation-heading_min0.4452772287064903
driven_any_max2.349012407490563
driven_any_mean1.1606560244536916
driven_any_median0.8060406108647351
driven_any_min0.22759468364392776
driven_lanedir_consec_max1.562996314827786
driven_lanedir_consec_mean0.5647839182239994
driven_lanedir_consec_min0.20043822543663925
driven_lanedir_max2.1692663408496187
driven_lanedir_mean0.8550368332935554
driven_lanedir_median0.49235774747415806
driven_lanedir_min0.20043822543663925
in-drivable-lane_max3.050000000000015
in-drivable-lane_mean0.8866666666666684
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6766920092147148, "sim_physics": 0.11856787435470088, "survival_time": 4.6499999999999915, "driven_lanedir": 0.46862371477565934, "sim_render-ego": 0.05157648619785104, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.06022515860936975, "deviation-heading": 2.3124953394690717, "set_robot_commands": 0.07080284241707094, "deviation-center-line": 0.41322583478089375, "driven_lanedir_consec": 0.2396137585344671, "sim_compute_sim_state": 0.03047881331495059, "sim_compute_performance-ego": 0.05553408335613948, "sim_compute_robot_state-ego": 0.05615650197511078, "sim_compute_robot_state-npc0": 0.05831845857763803, "sim_compute_robot_state-npc1": 0.05566111687690981, "sim_compute_robot_state-npc2": 0.054713905498545656, "sim_compute_robot_state-npc3": 0.05505694368834137}, "udem1-1-0": {"driven_any": 0.3320528115220338, "sim_physics": 0.11732761065165202, "survival_time": 2.3999999999999995, "driven_lanedir": 0.28746010952527934, "sim_render-ego": 0.050890197356541954, "in-drivable-lane": 0, "agent_compute-ego": 0.05819906791051229, "deviation-heading": 1.1259926988074107, "set_robot_commands": 0.06980881094932556, "deviation-center-line": 0.16123352420218662, "driven_lanedir_consec": 0.28746010952527934, "sim_compute_sim_state": 0.03241883714993795, "sim_compute_performance-ego": 0.057591850558916725, "sim_compute_robot_state-ego": 0.056261648734410606, "sim_compute_robot_state-npc0": 0.06032290061314901, "sim_compute_robot_state-npc1": 0.05760461091995239, "sim_compute_robot_state-npc2": 0.05872143805027008, "sim_compute_robot_state-npc3": 0.05465333660443624}, "udem1-2-0": {"driven_any": 1.159714963269019, "sim_physics": 0.12035511029477151, "survival_time": 7.549999999999981, "driven_lanedir": 0.651554276268469, "sim_render-ego": 0.05025646386557067, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.056666685255947494, "deviation-heading": 2.511037383967619, "set_robot_commands": 0.07026925623811633, "deviation-center-line": 0.5030048629294573, "driven_lanedir_consec": 0.4480167964040595, "sim_compute_sim_state": 0.03146203306337066, "sim_compute_performance-ego": 0.056064346768208685, "sim_compute_robot_state-ego": 0.05797899164111409, "sim_compute_robot_state-npc0": 0.0601529222450509, "sim_compute_robot_state-npc1": 0.05607708558341525, "sim_compute_robot_state-npc2": 0.05664677019940307, "sim_compute_robot_state-npc3": 0.05622966084259235}, "udem1-3-0": {"driven_any": 0.26777155931655544, "sim_physics": 0.13932420015335084, "survival_time": 2.000000000000001, "driven_lanedir": 0.24591262161692184, "sim_render-ego": 0.05287300944328308, "in-drivable-lane": 0, "agent_compute-ego": 0.06157699227333069, "deviation-heading": 0.5444399024131471, "set_robot_commands": 0.07079946994781494, "deviation-center-line": 0.16927550525163332, "driven_lanedir_consec": 0.24591262161692184, "sim_compute_sim_state": 0.03037852644920349, "sim_compute_performance-ego": 0.05664146542549133, "sim_compute_robot_state-ego": 0.06121456027030945, "sim_compute_robot_state-npc0": 0.05979829430580139, "sim_compute_robot_state-npc1": 0.05707260966300965, "sim_compute_robot_state-npc2": 0.057138574123382566, "sim_compute_robot_state-npc3": 0.054614096879959106}, "udem1-4-0": {"driven_any": 2.348944653163493, "sim_physics": 0.11570411523183188, "survival_time": 14.950000000000076, "driven_lanedir": 1.7376094585452742, "sim_render-ego": 0.050394580364227295, "in-drivable-lane": 2.450000000000024, "agent_compute-ego": 0.0570735764503479, "deviation-heading": 4.832848295094007, "set_robot_commands": 0.07133132457733155, "deviation-center-line": 0.894691563766659, "driven_lanedir_consec": 1.562996314827786, "sim_compute_sim_state": 0.03162718137105306, "sim_compute_performance-ego": 0.05512696345647176, "sim_compute_robot_state-ego": 0.05622188409169515, "sim_compute_robot_state-npc0": 0.05922927776972453, "sim_compute_robot_state-npc1": 0.057085148493448895, "sim_compute_robot_state-npc2": 0.056519328753153485, "sim_compute_robot_state-npc3": 0.05671172618865967}, "udem1-5-0": {"driven_any": 2.3488474218016058, "sim_physics": 0.11950595617294311, "survival_time": 14.950000000000076, "driven_lanedir": 1.7752780519615876, "sim_render-ego": 0.05162384907404582, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.057020275592803954, "deviation-heading": 6.2211618616377296, "set_robot_commands": 0.06965532382329305, "deviation-center-line": 1.3105970428193887, "driven_lanedir_consec": 0.6665334714304352, "sim_compute_sim_state": 0.03223538239796957, "sim_compute_performance-ego": 0.0548479970296224, "sim_compute_robot_state-ego": 0.0566922918955485, "sim_compute_robot_state-npc0": 0.059992650349934895, "sim_compute_robot_state-npc1": 0.056148793697357174, "sim_compute_robot_state-npc2": 0.05683799664179484, "sim_compute_robot_state-npc3": 0.05824853261311849}, "udem1-6-0": {"driven_any": 2.349012407490563, "sim_physics": 0.12305127223332724, "survival_time": 14.950000000000076, "driven_lanedir": 2.1692663408496187, "sim_render-ego": 0.05784912983576457, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.06156312306722005, "deviation-heading": 4.0595299397325215, "set_robot_commands": 0.07167346159617106, "deviation-center-line": 1.4277660770683551, "driven_lanedir_consec": 1.3093081739872476, "sim_compute_sim_state": 0.034407201608022055, "sim_compute_performance-ego": 0.06021138111750285, "sim_compute_robot_state-ego": 0.05923480669657389, "sim_compute_robot_state-npc0": 0.06523322661717733, "sim_compute_robot_state-npc1": 0.06203781207402547, "sim_compute_robot_state-npc2": 0.06154107332229614, "sim_compute_robot_state-npc3": 0.062161999543507894}, "udem1-7-0": {"driven_any": 0.4204187855352089, "sim_physics": 0.13024219415955623, "survival_time": 2.9499999999999975, "driven_lanedir": 0.34305660294652407, "sim_render-ego": 0.05826139450073242, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.06284222764483953, "deviation-heading": 1.3160874996516323, "set_robot_commands": 0.07392906334440587, "deviation-center-line": 0.12157936340093609, "driven_lanedir_consec": 0.34305660294652407, "sim_compute_sim_state": 0.03558506399898206, "sim_compute_performance-ego": 0.0605345984636727, "sim_compute_robot_state-ego": 0.060119851160857635, "sim_compute_robot_state-npc0": 0.06779430680355783, "sim_compute_robot_state-npc1": 0.0618183532003629, "sim_compute_robot_state-npc2": 0.061781091205144335, "sim_compute_robot_state-npc3": 0.061549178624557235}, "udem1-8-0": {"driven_any": 2.348408297695722, "sim_physics": 0.12416962305704753, "survival_time": 14.950000000000076, "driven_lanedir": 1.329366481794314, "sim_render-ego": 0.056814994812011715, "in-drivable-lane": 3.050000000000015, "agent_compute-ego": 0.06151749054590861, "deviation-heading": 8.011415255955212, "set_robot_commands": 0.07210596402486165, "deviation-center-line": 1.1152579848227766, "driven_lanedir_consec": 0.6989950660762463, "sim_compute_sim_state": 0.034530083338419594, "sim_compute_performance-ego": 0.06112556219100952, "sim_compute_robot_state-ego": 0.060827124118804934, "sim_compute_robot_state-npc0": 0.06556623220443726, "sim_compute_robot_state-npc1": 0.06135578870773315, "sim_compute_robot_state-npc2": 0.06171621799468994, "sim_compute_robot_state-npc3": 0.06155717213948568}, "udem1-9-0": {"driven_any": 2.3487882163357057, "sim_physics": 0.12408557415008543, "survival_time": 14.950000000000076, "driven_lanedir": 1.682779671598394, "sim_render-ego": 0.05509589354197184, "in-drivable-lane": 2.2499999999999973, "agent_compute-ego": 0.059813342094421386, "deviation-heading": 5.690747693133142, "set_robot_commands": 0.07195796728134156, "deviation-center-line": 1.0344089589515129, "driven_lanedir_consec": 0.9919693880498598, "sim_compute_sim_state": 0.033206663131713866, "sim_compute_performance-ego": 0.058381461302439375, "sim_compute_robot_state-ego": 0.05829482873280843, "sim_compute_robot_state-npc0": 0.06335246324539184, "sim_compute_robot_state-npc1": 0.060041903654734295, "sim_compute_robot_state-npc2": 0.05858258008956909, "sim_compute_robot_state-npc3": 0.0585453740755717}, "udem1-10-0": {"driven_any": 0.2918681902732104, "sim_physics": 0.1174235510271649, "survival_time": 2.1500000000000004, "driven_lanedir": 0.251007759123663, "sim_render-ego": 0.05880020940026571, "in-drivable-lane": 0, "agent_compute-ego": 0.06278237631154615, "deviation-heading": 0.9125165743715292, "set_robot_commands": 0.07235688386961471, "deviation-center-line": 0.10528391939938037, "driven_lanedir_consec": 0.251007759123663, "sim_compute_sim_state": 0.03445155121559321, "sim_compute_performance-ego": 0.061821793400964074, "sim_compute_robot_state-ego": 0.060504863428515056, "sim_compute_robot_state-npc0": 0.0669655910758085, "sim_compute_robot_state-npc1": 0.06287321933480196, "sim_compute_robot_state-npc2": 0.06010018947512605, "sim_compute_robot_state-npc3": 0.060499784558318385}, "udem1-11-0": {"driven_any": 0.3802929554000049, "sim_physics": 0.1196394231584337, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3744369855095764, "sim_render-ego": 0.05973883469899496, "in-drivable-lane": 0, "agent_compute-ego": 0.0614334918834545, "deviation-heading": 0.4452772287064903, "set_robot_commands": 0.07058639879579898, "deviation-center-line": 0.26721521921563773, "driven_lanedir_consec": 0.3744369855095764, "sim_compute_sim_state": 0.03453611444543909, "sim_compute_performance-ego": 0.05860204166836209, "sim_compute_robot_state-ego": 0.059322233553285954, "sim_compute_robot_state-npc0": 0.0645871603930438, "sim_compute_robot_state-npc1": 0.0611727723368892, "sim_compute_robot_state-npc2": 0.061692908958152486, "sim_compute_robot_state-npc3": 0.06092418564690484}, "udem1-12-0": {"driven_any": 1.103392801278877, "sim_physics": 0.11789780689610375, "survival_time": 7.199999999999982, "driven_lanedir": 0.8164044519772518, "sim_render-ego": 0.05295104947355059, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.05722485317124261, "deviation-heading": 3.5272616903169145, "set_robot_commands": 0.07093058360947503, "deviation-center-line": 0.5545433318438866, "driven_lanedir_consec": 0.6309504947878353, "sim_compute_sim_state": 0.032699535290400185, "sim_compute_performance-ego": 0.05526365008619097, "sim_compute_robot_state-ego": 0.05565965175628662, "sim_compute_robot_state-npc0": 0.06315619746843974, "sim_compute_robot_state-npc1": 0.05880080660184225, "sim_compute_robot_state-npc2": 0.05701009432474772, "sim_compute_robot_state-npc3": 0.057566233807139926}, "udem1-13-0": {"driven_any": 0.22759468364392776, "sim_physics": 0.11462272235325403, "survival_time": 1.7500000000000009, "driven_lanedir": 0.20043822543663925, "sim_render-ego": 0.052504164831978936, "in-drivable-lane": 0, "agent_compute-ego": 0.05908315522330148, "deviation-heading": 0.5717251758406036, "set_robot_commands": 0.06816421917506627, "deviation-center-line": 0.14420098506298534, "driven_lanedir_consec": 0.20043822543663925, "sim_compute_sim_state": 0.03015709604535784, "sim_compute_performance-ego": 0.05436615262712751, "sim_compute_robot_state-ego": 0.053991024834769114, "sim_compute_robot_state-npc0": 0.06071569578988212, "sim_compute_robot_state-npc1": 0.05342180388314383, "sim_compute_robot_state-npc2": 0.05381456102643694, "sim_compute_robot_state-npc3": 0.053432764325823105}, "udem1-14-0": {"driven_any": 0.8060406108647351, "sim_physics": 0.12106734124299522, "survival_time": 5.349999999999989, "driven_lanedir": 0.49235774747415806, "sim_render-ego": 0.054302217804382893, "in-drivable-lane": 0.799999999999998, "agent_compute-ego": 0.06024852422910316, "deviation-heading": 2.7315967319626737, "set_robot_commands": 0.0696185593293092, "deviation-center-line": 0.32710089565582834, "driven_lanedir_consec": 0.2210630051034483, "sim_compute_sim_state": 0.032888296608612914, "sim_compute_performance-ego": 0.057533170575293426, "sim_compute_robot_state-ego": 0.0577977171568113, "sim_compute_robot_state-npc0": 0.06204090608614628, "sim_compute_robot_state-npc1": 0.05843817185018664, "sim_compute_robot_state-npc2": 0.05808006937258711, "sim_compute_robot_state-npc3": 0.057418936880949505}}
set_robot_commands_max0.07392906334440587
set_robot_commands_mean0.07093267526526645
set_robot_commands_median0.07080284241707094
set_robot_commands_min0.06816421917506627
sim_compute_performance-ego_max0.061821793400964074
sim_compute_performance-ego_mean0.057576434535160856
sim_compute_performance-ego_median0.057533170575293426
sim_compute_performance-ego_min0.05436615262712751
sim_compute_robot_state-ego_max0.06121456027030945
sim_compute_robot_state-ego_mean0.05801853200312677
sim_compute_robot_state-ego_median0.05797899164111409
sim_compute_robot_state-ego_min0.053991024834769114
sim_compute_robot_state-npc0_max0.06779430680355783
sim_compute_robot_state-npc0_mean0.06248175223634556
sim_compute_robot_state-npc0_median0.06204090608614628
sim_compute_robot_state-npc0_min0.05831845857763803
sim_compute_robot_state-npc1_max0.06287321933480196
sim_compute_robot_state-npc1_mean0.05864066645852086
sim_compute_robot_state-npc1_median0.05843817185018664
sim_compute_robot_state-npc1_min0.05342180388314383
sim_compute_robot_state-npc2_max0.061781091205144335
sim_compute_robot_state-npc2_mean0.058326453269019966
sim_compute_robot_state-npc2_median0.05808006937258711
sim_compute_robot_state-npc2_min0.05381456102643694
sim_compute_robot_state-npc3_max0.062161999543507894
sim_compute_robot_state-npc3_mean0.05794466176129102
sim_compute_robot_state-npc3_median0.057566233807139926
sim_compute_robot_state-npc3_min0.053432764325823105
sim_compute_sim_state_max0.03558506399898206
sim_compute_sim_state_mean0.032737491961935074
sim_compute_sim_state_median0.032699535290400185
sim_compute_sim_state_min0.03015709604535784
sim_physics_max0.13932420015335084
sim_physics_mean0.12153229167581456
sim_physics_median0.1196394231584337
sim_physics_min0.11462272235325403
sim_render-ego_max0.05973883469899496
sim_render-ego_mean0.05426216501341157
sim_render-ego_median0.05295104947355059
sim_render-ego_min0.05025646386557067
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.563333333333357
survival_time_min1.7500000000000009
216542660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:47:06(hidden)
driven_lanedir_consec_median0.6585860509100432
survival_time_median6.449999999999985
deviation-center-line_median0.6318672715294984
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.0735366809239026
agent_compute-ego_mean0.07138984551557831
agent_compute-ego_median0.07159793456395468
agent_compute-ego_min0.06811601775033134
deviation-center-line_max1.28363462990207
deviation-center-line_mean0.5953965537737947
deviation-center-line_min0.13087440182364257
deviation-heading_max7.748766095161664
deviation-heading_mean3.194460486662275
deviation-heading_median2.0790328120040615
deviation-heading_min0.5389415647956504
driven_any_max2.348839797869971
driven_any_mean1.265657174608426
driven_any_median0.982961665059313
driven_any_min0.1713829686606922
driven_lanedir_consec_max1.35263348080637
driven_lanedir_consec_mean0.6777040953786695
driven_lanedir_consec_min0.14492173049252566
driven_lanedir_max1.8658797157489668
driven_lanedir_mean0.979248344891088
driven_lanedir_median0.961371430861022
driven_lanedir_min0.14492173049252566
in-drivable-lane_max2.700000000000019
in-drivable-lane_mean0.7466666666666723
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.155317987580848, "sim_physics": 0.11728686718303805, "survival_time": 13.850000000000062, "driven_lanedir": 1.7406049446494365, "sim_render-ego": 0.06898057934179203, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.0735366809239026, "deviation-heading": 5.33920427360572, "set_robot_commands": 0.07719724789423202, "deviation-center-line": 0.903104600371473, "driven_lanedir_consec": 0.9957741303811068, "sim_compute_sim_state": 0.04055017770842955, "sim_compute_performance-ego": 0.06934028842388938, "sim_compute_robot_state-ego": 0.06447670347854119, "sim_compute_robot_state-npc0": 0.07658836127188232, "sim_compute_robot_state-npc1": 0.07294702874193984, "sim_compute_robot_state-npc2": 0.07116433773660488, "sim_compute_robot_state-npc3": 0.07184034650506525}, "udem1-1-0": {"driven_any": 0.7177127159371829, "sim_physics": 0.11631961166858672, "survival_time": 4.799999999999991, "driven_lanedir": 0.5980456768737374, "sim_render-ego": 0.06861465175946553, "in-drivable-lane": 0, "agent_compute-ego": 0.07334905117750168, "deviation-heading": 2.0790328120040615, "set_robot_commands": 0.07574713478485744, "deviation-center-line": 0.22077281627786863, "driven_lanedir_consec": 0.5980456768737374, "sim_compute_sim_state": 0.04009439547856649, "sim_compute_performance-ego": 0.06850325564543407, "sim_compute_robot_state-ego": 0.06320743262767792, "sim_compute_robot_state-npc0": 0.07685285309950511, "sim_compute_robot_state-npc1": 0.0719053049882253, "sim_compute_robot_state-npc2": 0.07205479840437572, "sim_compute_robot_state-npc3": 0.07203877468903859}, "udem1-2-0": {"driven_any": 2.3248294717645988, "sim_physics": 0.11152932772765288, "survival_time": 14.800000000000075, "driven_lanedir": 1.8658797157489668, "sim_render-ego": 0.06660001906188759, "in-drivable-lane": 1.1000000000000068, "agent_compute-ego": 0.07202715245453087, "deviation-heading": 5.946982316300223, "set_robot_commands": 0.07650439723117931, "deviation-center-line": 0.9953660171301444, "driven_lanedir_consec": 1.2171090465671028, "sim_compute_sim_state": 0.04017484832454373, "sim_compute_performance-ego": 0.06844973483601131, "sim_compute_robot_state-ego": 0.06376857773677723, "sim_compute_robot_state-npc0": 0.07617302279214601, "sim_compute_robot_state-npc1": 0.07125411645786182, "sim_compute_robot_state-npc2": 0.0715827627761944, "sim_compute_robot_state-npc3": 0.07188578956835978}, "udem1-3-0": {"driven_any": 0.23562820064526988, "sim_physics": 0.12084318531884088, "survival_time": 1.800000000000001, "driven_lanedir": 0.21406932262140657, "sim_render-ego": 0.06670710775587294, "in-drivable-lane": 0, "agent_compute-ego": 0.07166135973400539, "deviation-heading": 0.5389415647956504, "set_robot_commands": 0.0755069719420539, "deviation-center-line": 0.16255302234825245, "driven_lanedir_consec": 0.21406932262140657, "sim_compute_sim_state": 0.03940002123514811, "sim_compute_performance-ego": 0.06643342309527928, "sim_compute_robot_state-ego": 0.062464886241488986, "sim_compute_robot_state-npc0": 0.07684671216540867, "sim_compute_robot_state-npc1": 0.06924511988957723, "sim_compute_robot_state-npc2": 0.06940372784932454, "sim_compute_robot_state-npc3": 0.06968447897169325}, "udem1-4-0": {"driven_any": 2.348839797869971, "sim_physics": 0.11486336469650268, "survival_time": 14.950000000000076, "driven_lanedir": 1.6976623297462876, "sim_render-ego": 0.06849059104919433, "in-drivable-lane": 2.4500000000000313, "agent_compute-ego": 0.07199657360712687, "deviation-heading": 5.080466929424764, "set_robot_commands": 0.07647521336873372, "deviation-center-line": 1.0044778117277442, "driven_lanedir_consec": 1.35263348080637, "sim_compute_sim_state": 0.03912551720937093, "sim_compute_performance-ego": 0.06894409735997518, "sim_compute_robot_state-ego": 0.06427804946899414, "sim_compute_robot_state-npc0": 0.0761616333325704, "sim_compute_robot_state-npc1": 0.07055832068125407, "sim_compute_robot_state-npc2": 0.07017587820688884, "sim_compute_robot_state-npc3": 0.06981698274612427}, "udem1-5-0": {"driven_any": 2.3487451495339076, "sim_physics": 0.10958864053090411, "survival_time": 14.950000000000076, "driven_lanedir": 1.82222726098947, "sim_render-ego": 0.06662001848220825, "in-drivable-lane": 1.1000000000000023, "agent_compute-ego": 0.07023915688196818, "deviation-heading": 6.340760850491856, "set_robot_commands": 0.07426167011260987, "deviation-center-line": 1.28363462990207, "driven_lanedir_consec": 0.9037777703276112, "sim_compute_sim_state": 0.038219676812489826, "sim_compute_performance-ego": 0.0675146230061849, "sim_compute_robot_state-ego": 0.06271129528681438, "sim_compute_robot_state-npc0": 0.07434632062911987, "sim_compute_robot_state-npc1": 0.0696190865834554, "sim_compute_robot_state-npc2": 0.06781532605489095, "sim_compute_robot_state-npc3": 0.06910140514373779}, "udem1-6-0": {"driven_any": 0.982961665059313, "sim_physics": 0.1253899326620176, "survival_time": 6.449999999999985, "driven_lanedir": 0.961371430861022, "sim_render-ego": 0.06830179044442583, "in-drivable-lane": 0, "agent_compute-ego": 0.07248354327771091, "deviation-heading": 1.096688835456738, "set_robot_commands": 0.07692664907884228, "deviation-center-line": 0.6508572565190109, "driven_lanedir_consec": 0.9469038102108096, "sim_compute_sim_state": 0.04027274597522824, "sim_compute_performance-ego": 0.06896771386612294, "sim_compute_robot_state-ego": 0.06452051059220189, "sim_compute_robot_state-npc0": 0.07621253553287004, "sim_compute_robot_state-npc1": 0.07171267317247021, "sim_compute_robot_state-npc2": 0.07110037175259849, "sim_compute_robot_state-npc3": 0.0707829571509546}, "udem1-7-0": {"driven_any": 0.4445503490002461, "sim_physics": 0.12906939368094167, "survival_time": 3.099999999999997, "driven_lanedir": 0.38105721765598455, "sim_render-ego": 0.06676703114663401, "in-drivable-lane": 0, "agent_compute-ego": 0.07275825931179908, "deviation-heading": 1.4008636910147092, "set_robot_commands": 0.07584104614873086, "deviation-center-line": 0.15300821031748807, "driven_lanedir_consec": 0.38105721765598455, "sim_compute_sim_state": 0.04009152612378521, "sim_compute_performance-ego": 0.06872272106908983, "sim_compute_robot_state-ego": 0.06381822016931349, "sim_compute_robot_state-npc0": 0.07545455425016341, "sim_compute_robot_state-npc1": 0.07089886742253457, "sim_compute_robot_state-npc2": 0.06986088522018925, "sim_compute_robot_state-npc3": 0.07049395961146201}, "udem1-8-0": {"driven_any": 2.3483652501727836, "sim_physics": 0.11412141799926756, "survival_time": 14.950000000000076, "driven_lanedir": 1.4569077894106908, "sim_render-ego": 0.06746369441350301, "in-drivable-lane": 2.450000000000014, "agent_compute-ego": 0.07065024693806966, "deviation-heading": 7.748766095161664, "set_robot_commands": 0.075206565062205, "deviation-center-line": 1.2692946643958156, "driven_lanedir_consec": 0.7630342975689666, "sim_compute_sim_state": 0.039058621724446616, "sim_compute_performance-ego": 0.06715850830078125, "sim_compute_robot_state-ego": 0.0638776691754659, "sim_compute_robot_state-npc0": 0.07523134469985962, "sim_compute_robot_state-npc1": 0.07049387693405151, "sim_compute_robot_state-npc2": 0.06987578630447387, "sim_compute_robot_state-npc3": 0.07032716433207194}, "udem1-9-0": {"driven_any": 0.5570694762276293, "sim_physics": 0.12409274201644094, "survival_time": 3.7999999999999945, "driven_lanedir": 0.4594283421127783, "sim_render-ego": 0.06830000877380371, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07146333707006354, "deviation-heading": 0.9765112153310744, "set_robot_commands": 0.07548181006782934, "deviation-center-line": 0.20082762680237023, "driven_lanedir_consec": 0.4594283421127783, "sim_compute_sim_state": 0.037957605562712014, "sim_compute_performance-ego": 0.06790639538513987, "sim_compute_robot_state-ego": 0.06408377070175975, "sim_compute_robot_state-npc0": 0.07624468364213642, "sim_compute_robot_state-npc1": 0.07079130411148071, "sim_compute_robot_state-npc2": 0.06978674625095568, "sim_compute_robot_state-npc3": 0.07056316262797306}, "udem1-10-0": {"driven_any": 1.3847089445909595, "sim_physics": 0.11105441381145456, "survival_time": 8.949999999999992, "driven_lanedir": 1.1787787910005805, "sim_render-ego": 0.06734961637571538, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.07034205990796649, "deviation-heading": 3.8869234511169974, "set_robot_commands": 0.07388033547214956, "deviation-center-line": 0.6318672715294984, "driven_lanedir_consec": 0.6585860509100432, "sim_compute_sim_state": 0.03865552214936837, "sim_compute_performance-ego": 0.06766383741155017, "sim_compute_robot_state-ego": 0.06155868349128595, "sim_compute_robot_state-npc0": 0.07309535761785241, "sim_compute_robot_state-npc1": 0.06919563282801452, "sim_compute_robot_state-npc2": 0.06922379818708536, "sim_compute_robot_state-npc3": 0.06782132953238887}, "udem1-11-0": {"driven_any": 0.1713829686606922, "sim_physics": 0.11101981571742468, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14492173049252566, "sim_render-ego": 0.06281204734529768, "in-drivable-lane": 0, "agent_compute-ego": 0.06811601775033134, "deviation-heading": 0.5712174718514345, "set_robot_commands": 0.07343122788837977, "deviation-center-line": 0.13087440182364257, "driven_lanedir_consec": 0.14492173049252566, "sim_compute_sim_state": 0.03419227259499686, "sim_compute_performance-ego": 0.06544939960752215, "sim_compute_robot_state-ego": 0.06136324575969151, "sim_compute_robot_state-npc0": 0.07032916375568934, "sim_compute_robot_state-npc1": 0.06514334678649902, "sim_compute_robot_state-npc2": 0.06248252732413156, "sim_compute_robot_state-npc3": 0.06222690003258841}, "udem1-12-0": {"driven_any": 0.3883143837714607, "sim_physics": 0.12085467685352672, "survival_time": 2.7499999999999982, "driven_lanedir": 0.34204159591430194, "sim_render-ego": 0.0624712120402943, "in-drivable-lane": 0, "agent_compute-ego": 0.07069113037802956, "deviation-heading": 1.0463869275497235, "set_robot_commands": 0.07359603968533603, "deviation-center-line": 0.16931730481476442, "driven_lanedir_consec": 0.34204159591430194, "sim_compute_sim_state": 0.03734413493763317, "sim_compute_performance-ego": 0.06113097017461604, "sim_compute_robot_state-ego": 0.05850266543301669, "sim_compute_robot_state-npc0": 0.07049726139415394, "sim_compute_robot_state-npc1": 0.0668673645366322, "sim_compute_robot_state-npc2": 0.06538595286282627, "sim_compute_robot_state-npc3": 0.0660014889457009}, "udem1-13-0": {"driven_any": 0.22760420548582924, "sim_physics": 0.11053159577505928, "survival_time": 1.7500000000000009, "driven_lanedir": 0.18229137703644183, "sim_render-ego": 0.0700960772378104, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.06993517875671387, "deviation-heading": 0.5616962351227285, "set_robot_commands": 0.07473186084202357, "deviation-center-line": 0.1436689677541819, "driven_lanedir_consec": 0.18229137703644183, "sim_compute_sim_state": 0.038654116221836635, "sim_compute_performance-ego": 0.06843647956848145, "sim_compute_robot_state-ego": 0.06173600469316755, "sim_compute_robot_state-npc0": 0.07753605161394392, "sim_compute_robot_state-npc1": 0.0734236444745745, "sim_compute_robot_state-npc2": 0.07266966274806431, "sim_compute_robot_state-npc3": 0.06999591418675014}, "udem1-14-0": {"driven_any": 2.3488270528256985, "sim_physics": 0.1223605751991272, "survival_time": 14.950000000000076, "driven_lanedir": 1.6434376482526891, "sim_render-ego": 0.06622992595036825, "in-drivable-lane": 2.700000000000019, "agent_compute-ego": 0.07159793456395468, "deviation-heading": 5.302464630706775, "set_robot_commands": 0.07541493892669678, "deviation-center-line": 1.011323704892598, "driven_lanedir_consec": 1.005887581200856, "sim_compute_sim_state": 0.03863284587860107, "sim_compute_performance-ego": 0.06821941296259562, "sim_compute_robot_state-ego": 0.06340009133021036, "sim_compute_robot_state-npc0": 0.07444586833318075, "sim_compute_robot_state-npc1": 0.06952916781107585, "sim_compute_robot_state-npc2": 0.0685656754175822, "sim_compute_robot_state-npc3": 0.06884191354115804}}
set_robot_commands_max0.07719724789423202
set_robot_commands_mean0.07534687390039063
set_robot_commands_median0.07548181006782934
set_robot_commands_min0.07343122788837977
sim_compute_performance-ego_max0.06934028842388938
sim_compute_performance-ego_mean0.06752272404751156
sim_compute_performance-ego_median0.06821941296259562
sim_compute_performance-ego_min0.06113097017461604
sim_compute_robot_state-ego_max0.06452051059220189
sim_compute_robot_state-ego_mean0.06291785374576046
sim_compute_robot_state-ego_median0.06340009133021036
sim_compute_robot_state-ego_min0.05850266543301669
sim_compute_robot_state-npc0_max0.07753605161394392
sim_compute_robot_state-npc0_mean0.07506771494203214
sim_compute_robot_state-npc0_median0.0761616333325704
sim_compute_robot_state-npc0_min0.07032916375568934
sim_compute_robot_state-npc1_max0.0734236444745745
sim_compute_robot_state-npc1_mean0.07023899036130979
sim_compute_robot_state-npc1_median0.07055832068125407
sim_compute_robot_state-npc1_min0.06514334678649902
sim_compute_robot_state-npc2_max0.07266966274806431
sim_compute_robot_state-npc2_mean0.06940988247307908
sim_compute_robot_state-npc2_median0.06986088522018925
sim_compute_robot_state-npc2_min0.06248252732413156
sim_compute_robot_state-npc3_max0.07203877468903859
sim_compute_robot_state-npc3_mean0.06942817117233778
sim_compute_robot_state-npc3_median0.06999591418675014
sim_compute_robot_state-npc3_min0.06222690003258841
sim_compute_sim_state_max0.04055017770842955
sim_compute_sim_state_mean0.03882826852914379
sim_compute_sim_state_median0.039058621724446616
sim_compute_sim_state_min0.03419227259499686
sim_physics_max0.12906939368094167
sim_physics_mean0.1172617040560524
sim_physics_median0.11631961166858672
sim_physics_min0.10958864053090411
sim_render-ego_max0.0700960772378104
sim_render-ego_mean0.06705362474521821
sim_render-ego_median0.06734961637571538
sim_render-ego_min0.0624712120402943
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.216666666666693
survival_time_min1.4000000000000006
208472660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:37:34(hidden)
driven_lanedir_consec_median0.4884906639335558
survival_time_median4.249999999999993
deviation-center-line_median0.2169293596413355
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.058514993190765384
agent_compute-ego_mean0.056384392745526306
agent_compute-ego_median0.056471940242882934
agent_compute-ego_min0.05454496594218464
deviation-center-line_max1.313285112111687
deviation-center-line_mean0.45498683398232465
deviation-center-line_min0.08628942198561647
deviation-heading_max5.661082548196244
deviation-heading_mean2.616466254264499
deviation-heading_median1.89627084901038
deviation-heading_min0.5126296718448115
driven_any_max2.3488649994785487
driven_any_mean1.0728103637622033
driven_any_median0.6294010694020641
driven_any_min0.21152847210085976
driven_lanedir_consec_max1.5919291449659847
driven_lanedir_consec_mean0.5983325186887953
driven_lanedir_consec_min0.17301319648308033
driven_lanedir_max1.919344941548614
driven_lanedir_mean0.7813169565732575
driven_lanedir_median0.5197521188544327
driven_lanedir_min0.18778689113473448
in-drivable-lane_max3.350000000000028
in-drivable-lane_mean0.9500000000000048
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.09905314142056, "sim_physics": 0.11000241703457304, "survival_time": 13.500000000000057, "driven_lanedir": 1.4629747071815575, "sim_render-ego": 0.04996562357302065, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.05575363900926378, "deviation-heading": 3.882766914269868, "set_robot_commands": 0.07252868899592647, "deviation-center-line": 0.5297497836690429, "driven_lanedir_consec": 1.0761279294584394, "sim_compute_sim_state": 0.030611998946578418, "sim_compute_performance-ego": 0.053830560931453, "sim_compute_robot_state-ego": 0.05643224892792879, "sim_compute_robot_state-npc0": 0.05586101302394161, "sim_compute_robot_state-npc1": 0.05468498247641104, "sim_compute_robot_state-npc2": 0.05479749396995262, "sim_compute_robot_state-npc3": 0.05412349259411847}, "udem1-1-0": {"driven_any": 0.6132590867241076, "sim_physics": 0.11580287692058518, "survival_time": 4.149999999999993, "driven_lanedir": 0.4884906639335558, "sim_render-ego": 0.04946866954665586, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.056910603879446006, "deviation-heading": 1.89627084901038, "set_robot_commands": 0.07195178859205131, "deviation-center-line": 0.17811092165580586, "driven_lanedir_consec": 0.4884906639335558, "sim_compute_sim_state": 0.03083712508879512, "sim_compute_performance-ego": 0.0532050477453025, "sim_compute_robot_state-ego": 0.05578163158462708, "sim_compute_robot_state-npc0": 0.056607766323779, "sim_compute_robot_state-npc1": 0.05419825358563159, "sim_compute_robot_state-npc2": 0.05427536906966244, "sim_compute_robot_state-npc3": 0.05488133430480957}, "udem1-2-0": {"driven_any": 1.6016097867314476, "sim_physics": 0.11463910051919882, "survival_time": 10.300000000000011, "driven_lanedir": 0.84592900548081, "sim_render-ego": 0.04955259688849588, "in-drivable-lane": 3.350000000000028, "agent_compute-ego": 0.056621551513671875, "deviation-heading": 3.741977662646753, "set_robot_commands": 0.07292499357056849, "deviation-center-line": 0.6657885132127592, "driven_lanedir_consec": 0.6626512697770752, "sim_compute_sim_state": 0.031049405486838332, "sim_compute_performance-ego": 0.05474042429507357, "sim_compute_robot_state-ego": 0.05563272434530906, "sim_compute_robot_state-npc0": 0.05641819319678742, "sim_compute_robot_state-npc1": 0.05452277938139091, "sim_compute_robot_state-npc2": 0.05459447277402415, "sim_compute_robot_state-npc3": 0.05477518942749616}, "udem1-3-0": {"driven_any": 0.6294010694020641, "sim_physics": 0.11811703233157889, "survival_time": 4.249999999999993, "driven_lanedir": 0.5347190025122709, "sim_render-ego": 0.048835229873657224, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.05495058227987851, "deviation-heading": 1.479715737188849, "set_robot_commands": 0.07227125448339125, "deviation-center-line": 0.22633019455192424, "driven_lanedir_consec": 0.5347190025122709, "sim_compute_sim_state": 0.03063690802630256, "sim_compute_performance-ego": 0.05301561355590821, "sim_compute_robot_state-ego": 0.05494521645938649, "sim_compute_robot_state-npc0": 0.05486592404982623, "sim_compute_robot_state-npc1": 0.05439390855676988, "sim_compute_robot_state-npc2": 0.05346911374260398, "sim_compute_robot_state-npc3": 0.05384705487419577}, "udem1-4-0": {"driven_any": 2.204239668108977, "sim_physics": 0.11379942605503936, "survival_time": 14.050000000000065, "driven_lanedir": 1.7365187720184114, "sim_render-ego": 0.04995121820117231, "in-drivable-lane": 1.1000000000000003, "agent_compute-ego": 0.05674707507747773, "deviation-heading": 5.249683290742375, "set_robot_commands": 0.07314069585019584, "deviation-center-line": 0.9921803669720248, "driven_lanedir_consec": 1.3138512513550118, "sim_compute_sim_state": 0.030835119430704896, "sim_compute_performance-ego": 0.053891836112080094, "sim_compute_robot_state-ego": 0.055787458962817206, "sim_compute_robot_state-npc0": 0.05666186037436923, "sim_compute_robot_state-npc1": 0.05514224907681611, "sim_compute_robot_state-npc2": 0.055087127719485464, "sim_compute_robot_state-npc3": 0.05462919774853038}, "udem1-5-0": {"driven_any": 2.3487276143846776, "sim_physics": 0.11341243823369344, "survival_time": 14.950000000000076, "driven_lanedir": 1.8132477840254595, "sim_render-ego": 0.051115074157714845, "in-drivable-lane": 1.5000000000000002, "agent_compute-ego": 0.058167288303375246, "deviation-heading": 5.507395132799178, "set_robot_commands": 0.07339840173721314, "deviation-center-line": 1.313285112111687, "driven_lanedir_consec": 0.8970948960060918, "sim_compute_sim_state": 0.03152025779088338, "sim_compute_performance-ego": 0.05509568850199382, "sim_compute_robot_state-ego": 0.05704077323277791, "sim_compute_robot_state-npc0": 0.05716799736022949, "sim_compute_robot_state-npc1": 0.056056476434071856, "sim_compute_robot_state-npc2": 0.055174554189046224, "sim_compute_robot_state-npc3": 0.055764748255411785}, "udem1-6-0": {"driven_any": 2.3488649994785487, "sim_physics": 0.11929137309392292, "survival_time": 14.950000000000076, "driven_lanedir": 1.919344941548614, "sim_render-ego": 0.05066357374191284, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.058514993190765384, "deviation-heading": 5.661082548196244, "set_robot_commands": 0.07317262093226115, "deviation-center-line": 1.2205980244880963, "driven_lanedir_consec": 1.5919291449659847, "sim_compute_sim_state": 0.03137863636016846, "sim_compute_performance-ego": 0.054752017656962075, "sim_compute_robot_state-ego": 0.05735914309819539, "sim_compute_robot_state-npc0": 0.056729602813720706, "sim_compute_robot_state-npc1": 0.055561339060465495, "sim_compute_robot_state-npc2": 0.05530784289042155, "sim_compute_robot_state-npc3": 0.0555182433128357}, "udem1-7-0": {"driven_any": 0.5651066296375538, "sim_physics": 0.12466046407625272, "survival_time": 3.8499999999999943, "driven_lanedir": 0.5197521188544327, "sim_render-ego": 0.04999934543262829, "in-drivable-lane": 0, "agent_compute-ego": 0.05454496594218464, "deviation-heading": 1.3992447208374548, "set_robot_commands": 0.073349531594809, "deviation-center-line": 0.2169293596413355, "driven_lanedir_consec": 0.5197521188544327, "sim_compute_sim_state": 0.03165200778416225, "sim_compute_performance-ego": 0.05380972329672281, "sim_compute_robot_state-ego": 0.05548589260547192, "sim_compute_robot_state-npc0": 0.05608688082013811, "sim_compute_robot_state-npc1": 0.054961294322818904, "sim_compute_robot_state-npc2": 0.0550858448078106, "sim_compute_robot_state-npc3": 0.054942939188573264}, "udem1-8-0": {"driven_any": 1.440611600737709, "sim_physics": 0.12208503676999, "survival_time": 9.299999999999995, "driven_lanedir": 0.846803293439057, "sim_render-ego": 0.05030723028285529, "in-drivable-lane": 1.9499999999999988, "agent_compute-ego": 0.05646581419052616, "deviation-heading": 4.574491080589815, "set_robot_commands": 0.074883254625464, "deviation-center-line": 0.621265401470623, "driven_lanedir_consec": 0.3902910644622702, "sim_compute_sim_state": 0.03165231853403071, "sim_compute_performance-ego": 0.05531220538641817, "sim_compute_robot_state-ego": 0.05703646649596512, "sim_compute_robot_state-npc0": 0.05686205945989137, "sim_compute_robot_state-npc1": 0.05531033392875425, "sim_compute_robot_state-npc2": 0.05555426177158151, "sim_compute_robot_state-npc3": 0.05555060345639465}, "udem1-9-0": {"driven_any": 0.2516841134085877, "sim_physics": 0.13411686294957212, "survival_time": 1.900000000000001, "driven_lanedir": 0.20232317306534164, "sim_render-ego": 0.05152262512006258, "in-drivable-lane": 0, "agent_compute-ego": 0.05784439413171066, "deviation-heading": 0.9091951916415372, "set_robot_commands": 0.07338996309983103, "deviation-center-line": 0.08628942198561647, "driven_lanedir_consec": 0.20232317306534164, "sim_compute_sim_state": 0.032171776420191714, "sim_compute_performance-ego": 0.053705102518985144, "sim_compute_robot_state-ego": 0.05838012067895187, "sim_compute_robot_state-npc0": 0.05682337284088135, "sim_compute_robot_state-npc1": 0.05511244347220973, "sim_compute_robot_state-npc2": 0.05576615584524054, "sim_compute_robot_state-npc3": 0.055270602828577944}, "udem1-10-0": {"driven_any": 0.4445660678931664, "sim_physics": 0.11734959387010144, "survival_time": 3.099999999999997, "driven_lanedir": 0.422719788154015, "sim_render-ego": 0.04980926359853437, "in-drivable-lane": 0, "agent_compute-ego": 0.055617509349699945, "deviation-heading": 0.856997693990446, "set_robot_commands": 0.07269692036413378, "deviation-center-line": 0.18203086157168455, "driven_lanedir_consec": 0.422719788154015, "sim_compute_sim_state": 0.03159779502499488, "sim_compute_performance-ego": 0.05423378944396973, "sim_compute_robot_state-ego": 0.05751547121232556, "sim_compute_robot_state-npc0": 0.055270341134840445, "sim_compute_robot_state-npc1": 0.05576573264214301, "sim_compute_robot_state-npc2": 0.05471223015939035, "sim_compute_robot_state-npc3": 0.054564314503823555}, "udem1-11-0": {"driven_any": 0.2275905948556486, "sim_physics": 0.11730907985142298, "survival_time": 1.7500000000000009, "driven_lanedir": 0.20834538782070355, "sim_render-ego": 0.05149859700884138, "in-drivable-lane": 0, "agent_compute-ego": 0.055010591234479635, "deviation-heading": 0.5126296718448115, "set_robot_commands": 0.07436947141374861, "deviation-center-line": 0.15871730960217498, "driven_lanedir_consec": 0.20834538782070355, "sim_compute_sim_state": 0.03175703457423619, "sim_compute_performance-ego": 0.05472136906215123, "sim_compute_robot_state-ego": 0.05533311026436942, "sim_compute_robot_state-npc0": 0.05613978249686105, "sim_compute_robot_state-npc1": 0.05598860468183245, "sim_compute_robot_state-npc2": 0.05419947079249791, "sim_compute_robot_state-npc3": 0.053919798987252375}, "udem1-12-0": {"driven_any": 0.3641927696209064, "sim_physics": 0.12652456301909226, "survival_time": 2.5999999999999988, "driven_lanedir": 0.30589200234892044, "sim_render-ego": 0.05032382103113028, "in-drivable-lane": 0, "agent_compute-ego": 0.05543440580368042, "deviation-heading": 1.0711795517217888, "set_robot_commands": 0.07322904696831337, "deviation-center-line": 0.15258292142644153, "driven_lanedir_consec": 0.30589200234892044, "sim_compute_sim_state": 0.03138342270484337, "sim_compute_performance-ego": 0.054445670201228216, "sim_compute_robot_state-ego": 0.05778344319416927, "sim_compute_robot_state-npc0": 0.05713588916338407, "sim_compute_robot_state-npc1": 0.054639568695655234, "sim_compute_robot_state-npc2": 0.055028787026038535, "sim_compute_robot_state-npc3": 0.05480565474583553}, "udem1-13-0": {"driven_any": 0.21152847210085976, "sim_physics": 0.11530393542665424, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18778689113473448, "sim_render-ego": 0.05183732870853308, "in-drivable-lane": 0, "agent_compute-ego": 0.056471940242882934, "deviation-heading": 0.5567836070884363, "set_robot_commands": 0.07140905929334236, "deviation-center-line": 0.14131222318213088, "driven_lanedir_consec": 0.18778689113473448, "sim_compute_sim_state": 0.0324351354078813, "sim_compute_performance-ego": 0.053948590249726265, "sim_compute_robot_state-ego": 0.05460429914069898, "sim_compute_robot_state-npc0": 0.05778849486148718, "sim_compute_robot_state-npc1": 0.05589369571570194, "sim_compute_robot_state-npc2": 0.05595237558538264, "sim_compute_robot_state-npc3": 0.0538299661694151}, "udem1-14-0": {"driven_any": 0.7417198419282318, "sim_physics": 0.11843633170079704, "survival_time": 4.94999999999999, "driven_lanedir": 0.22490681708097848, "sim_render-ego": 0.05041662370315706, "in-drivable-lane": 2.2999999999999927, "agent_compute-ego": 0.0567105370338517, "deviation-heading": 1.9475801613995496, "set_robot_commands": 0.07230921225114302, "deviation-center-line": 0.13963209419352224, "driven_lanedir_consec": 0.17301319648308033, "sim_compute_sim_state": 0.031011410433836657, "sim_compute_performance-ego": 0.054635262248492, "sim_compute_robot_state-ego": 0.05671518258374147, "sim_compute_robot_state-npc0": 0.05509749807492651, "sim_compute_robot_state-npc1": 0.05411357349819607, "sim_compute_robot_state-npc2": 0.05549415434249723, "sim_compute_robot_state-npc3": 0.055069427297572894}}
set_robot_commands_max0.074883254625464
set_robot_commands_mean0.07300166025149285
set_robot_commands_median0.07314069585019584
set_robot_commands_min0.07140905929334236
sim_compute_performance-ego_max0.05531220538641817
sim_compute_performance-ego_mean0.054222860080431125
sim_compute_performance-ego_median0.05423378944396973
sim_compute_performance-ego_min0.05301561355590821
sim_compute_robot_state-ego_max0.05838012067895187
sim_compute_robot_state-ego_mean0.05638887885244903
sim_compute_robot_state-ego_median0.05643224892792879
sim_compute_robot_state-ego_min0.05460429914069898
sim_compute_robot_state-npc0_max0.05778849486148718
sim_compute_robot_state-npc0_mean0.05636777839967091
sim_compute_robot_state-npc0_median0.056607766323779
sim_compute_robot_state-npc0_min0.05486592404982623
sim_compute_robot_state-npc1_max0.056056476434071856
sim_compute_robot_state-npc1_mean0.055089682368591235
sim_compute_robot_state-npc1_median0.05511244347220973
sim_compute_robot_state-npc1_min0.05411357349819607
sim_compute_robot_state-npc2_max0.05595237558538264
sim_compute_robot_state-npc2_mean0.054966616979042385
sim_compute_robot_state-npc2_median0.0550858448078106
sim_compute_robot_state-npc2_min0.05346911374260398
sim_compute_robot_state-npc3_max0.055764748255411785
sim_compute_robot_state-npc3_mean0.054766171179656216
sim_compute_robot_state-npc3_median0.05480565474583553
sim_compute_robot_state-npc3_min0.0538299661694151
sim_compute_sim_state_max0.0324351354078813
sim_compute_sim_state_mean0.031368690134296544
sim_compute_sim_state_median0.03138342270484337
sim_compute_sim_state_min0.030611998946578418
sim_physics_max0.13411686294957212
sim_physics_mean0.11872336879016496
sim_physics_median0.11734959387010144
sim_physics_min0.11000241703457304
sim_render-ego_max0.05183732870853308
sim_render-ego_mean0.050351121391224794
sim_render-ego_median0.05030723028285529
sim_render-ego_min0.048835229873657224
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.016666666666683
survival_time_min1.6500000000000008
208242660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:34:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 697, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/f0b9c538baf9e6c88b942746ee1815bddeaff1a1217070478de89579b4a8a3eb/json
(hidden)
207932660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:41:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2660/step1-simulation-ip-172-31-40-253-32059-job20793/logs/challenges-runner/stdout.log'
(hidden)
207292660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:33
I can see how the jo [...]
I can see how the job 20729 is timeout because passed 3933 seconds and the timeout is 3600.0.
(hidden)
201652660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:30(hidden)
driven_lanedir_consec_median0.6221509631973021
survival_time_median9.850000000000003
deviation-center-line_median0.46771045061219657
in-drivable-lane_median1.2500000000000178


other stats
agent_compute-ego_max0.060650377465574536
agent_compute-ego_mean0.059150685384702306
agent_compute-ego_median0.05933216038872214
agent_compute-ego_min0.057782143751780195
deviation-center-line_max1.0712966629299412
deviation-center-line_mean0.5390199594890948
deviation-center-line_min0.13707591378128714
deviation-heading_max5.7595024866444
deviation-heading_mean3.420227409707814
deviation-heading_median4.398848703549558
deviation-heading_min0.5301941248844619
driven_any_max2.3406504222359255
driven_any_mean1.429632116883734
driven_any_median1.5287753940621565
driven_any_min0.21945576820722149
driven_lanedir_consec_max1.1061182904977245
driven_lanedir_consec_mean0.6725018724771742
driven_lanedir_consec_min0.1937673077851083
driven_lanedir_max1.8340552903275975
driven_lanedir_mean0.8779312470383399
driven_lanedir_median0.6454741296536382
driven_lanedir_min0.1937673077851083
in-drivable-lane_max6.050000000000072
in-drivable-lane_mean2.2000000000000193
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3336136726322976, "sim_physics": 0.10642710129419962, "survival_time": 14.950000000000076, "driven_lanedir": 1.8340552903275975, "sim_render-ego": 0.05124106327692668, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.057782143751780195, "deviation-heading": 5.7595024866444, "set_robot_commands": 0.07275460720062256, "deviation-center-line": 1.0712966629299412, "driven_lanedir_consec": 1.1061182904977245, "sim_compute_sim_state": 0.03150747378667196, "sim_compute_performance-ego": 0.055335789521535235, "sim_compute_robot_state-ego": 0.05562243064244588, "sim_compute_robot_state-npc0": 0.059459562301635745, "sim_compute_robot_state-npc1": 0.056310217380523685, "sim_compute_robot_state-npc2": 0.055386106173197426, "sim_compute_robot_state-npc3": 0.056303977966308594}, "udem1-1-0": {"driven_any": 0.7256653272810686, "sim_physics": 0.09125309629538624, "survival_time": 4.849999999999991, "driven_lanedir": 0.6221509631973021, "sim_render-ego": 0.05137414047398518, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05781835624852131, "deviation-heading": 1.881560536082185, "set_robot_commands": 0.07514341098746073, "deviation-center-line": 0.2421716300566502, "driven_lanedir_consec": 0.6221509631973021, "sim_compute_sim_state": 0.03131709147974388, "sim_compute_performance-ego": 0.05513314119319326, "sim_compute_robot_state-ego": 0.05537840263130739, "sim_compute_robot_state-npc0": 0.05947286566508185, "sim_compute_robot_state-npc1": 0.05716671402921382, "sim_compute_robot_state-npc2": 0.05766191187593126, "sim_compute_robot_state-npc3": 0.05939490770556263}, "udem1-2-0": {"driven_any": 1.5287753940621565, "sim_physics": 0.10895194014922012, "survival_time": 9.850000000000003, "driven_lanedir": 0.6454741296536382, "sim_render-ego": 0.05403744387747673, "in-drivable-lane": 3.550000000000008, "agent_compute-ego": 0.06017038906891334, "deviation-heading": 4.398848703549558, "set_robot_commands": 0.07476493428806363, "deviation-center-line": 0.46771045061219657, "driven_lanedir_consec": 0.3542067814608556, "sim_compute_sim_state": 0.03245988109995266, "sim_compute_performance-ego": 0.05693311739694044, "sim_compute_robot_state-ego": 0.05789988053026538, "sim_compute_robot_state-npc0": 0.061423400936998086, "sim_compute_robot_state-npc1": 0.0589454621832988, "sim_compute_robot_state-npc2": 0.05842755651716049, "sim_compute_robot_state-npc3": 0.05850657351731044}, "udem1-3-0": {"driven_any": 0.21945576820722149, "sim_physics": 0.09951058556051816, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1937673077851083, "sim_render-ego": 0.052713387152727914, "in-drivable-lane": 0, "agent_compute-ego": 0.05933216038872214, "deviation-heading": 0.5301941248844619, "set_robot_commands": 0.07418292410233442, "deviation-center-line": 0.13707591378128714, "driven_lanedir_consec": 0.1937673077851083, "sim_compute_sim_state": 0.030876938034506404, "sim_compute_performance-ego": 0.055432277567246384, "sim_compute_robot_state-ego": 0.05754693816689884, "sim_compute_robot_state-npc0": 0.0635237273047952, "sim_compute_robot_state-npc1": 0.05982342888327206, "sim_compute_robot_state-npc2": 0.06011361234328326, "sim_compute_robot_state-npc3": 0.05937053175533519}, "udem1-4-0": {"driven_any": 2.3406504222359255, "sim_physics": 0.11348430582340932, "survival_time": 14.900000000000077, "driven_lanedir": 1.0942085442280536, "sim_render-ego": 0.05395575337762001, "in-drivable-lane": 6.050000000000072, "agent_compute-ego": 0.060650377465574536, "deviation-heading": 4.531031197378464, "set_robot_commands": 0.07527775092412961, "deviation-center-line": 0.7768451400653992, "driven_lanedir_consec": 1.0862660194448803, "sim_compute_sim_state": 0.03283856379105741, "sim_compute_performance-ego": 0.05767398472600335, "sim_compute_robot_state-ego": 0.058033274324148294, "sim_compute_robot_state-npc0": 0.062228414036283555, "sim_compute_robot_state-npc1": 0.05919182140555158, "sim_compute_robot_state-npc2": 0.058579906521227534, "sim_compute_robot_state-npc3": 0.05972687110004809}}
set_robot_commands_max0.07527775092412961
set_robot_commands_mean0.07442472550052219
set_robot_commands_median0.07476493428806363
set_robot_commands_min0.07275460720062256
sim_compute_performance-ego_max0.05767398472600335
sim_compute_performance-ego_mean0.05610166208098373
sim_compute_performance-ego_median0.055432277567246384
sim_compute_performance-ego_min0.05513314119319326
sim_compute_robot_state-ego_max0.058033274324148294
sim_compute_robot_state-ego_mean0.05689618525901315
sim_compute_robot_state-ego_median0.05754693816689884
sim_compute_robot_state-ego_min0.05537840263130739
sim_compute_robot_state-npc0_max0.0635237273047952
sim_compute_robot_state-npc0_mean0.06122159404895888
sim_compute_robot_state-npc0_median0.061423400936998086
sim_compute_robot_state-npc0_min0.059459562301635745
sim_compute_robot_state-npc1_max0.05982342888327206
sim_compute_robot_state-npc1_mean0.058287528776371986
sim_compute_robot_state-npc1_median0.0589454621832988
sim_compute_robot_state-npc1_min0.056310217380523685
sim_compute_robot_state-npc2_max0.06011361234328326
sim_compute_robot_state-npc2_mean0.05803381868615999
sim_compute_robot_state-npc2_median0.05842755651716049
sim_compute_robot_state-npc2_min0.055386106173197426
sim_compute_robot_state-npc3_max0.05972687110004809
sim_compute_robot_state-npc3_mean0.058660572408912995
sim_compute_robot_state-npc3_median0.05937053175533519
sim_compute_robot_state-npc3_min0.056303977966308594
sim_compute_sim_state_max0.03283856379105741
sim_compute_sim_state_mean0.031799989638386456
sim_compute_sim_state_median0.03150747378667196
sim_compute_sim_state_min0.030876938034506404
sim_physics_max0.11348430582340932
sim_physics_mean0.10392540582454672
sim_physics_median0.10642710129419962
sim_physics_min0.09125309629538624
sim_render-ego_max0.05403744387747673
sim_render-ego_mean0.0526643576317473
sim_render-ego_median0.052713387152727914
sim_render-ego_min0.05124106327692668
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.25000000000003
survival_time_min1.7000000000000008
200992660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:21:20(hidden)
driven_lanedir_consec_median0.6037021522723106
survival_time_median4.199999999999993
deviation-center-line_median0.4356815244714198
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0943722788705475
agent_compute-ego_mean0.09012527053068473
agent_compute-ego_median0.08887768075579688
agent_compute-ego_min0.08710401608393742
deviation-center-line_max1.3357571089036469
deviation-center-line_mean0.6396924407206184
deviation-center-line_min0.15015672517498888
deviation-heading_max5.698082646302257
deviation-heading_mean2.5643057965122367
deviation-heading_median1.1154935756515298
deviation-heading_min0.6330529649870218
driven_any_max2.353364978398695
driven_any_mean1.2247134343492805
driven_any_median0.6257641943439552
driven_any_min0.32842794479948056
driven_lanedir_consec_max1.7106795061833342
driven_lanedir_consec_mean0.9224500675384844
driven_lanedir_consec_min0.27985672561192576
driven_lanedir_max2.088636535312773
driven_lanedir_mean1.0737081346578656
driven_lanedir_median0.6037021522723106
driven_lanedir_min0.27985672561192576
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.25000000000000355
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3429135017187463, "sim_physics": 0.08508819182713827, "survival_time": 14.950000000000076, "driven_lanedir": 2.088636535312773, "sim_render-ego": 0.071193106174469, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.08782548666000366, "deviation-heading": 4.4786647793142045, "set_robot_commands": 0.11299999713897706, "deviation-center-line": 0.9266853790892486, "driven_lanedir_consec": 1.7106795061833342, "sim_compute_sim_state": 0.04366261879603068, "sim_compute_performance-ego": 0.07837633689244589, "sim_compute_robot_state-ego": 0.08602755626042684, "sim_compute_robot_state-npc0": 0.07913812398910522, "sim_compute_robot_state-npc1": 0.07932165225346884, "sim_compute_robot_state-npc2": 0.07862957159678141, "sim_compute_robot_state-npc3": 0.0782655922571818}, "udem1-1-0": {"driven_any": 0.32842794479948056, "sim_physics": 0.09473462814980364, "survival_time": 2.3499999999999996, "driven_lanedir": 0.27985672561192576, "sim_render-ego": 0.07177105863043602, "in-drivable-lane": 0, "agent_compute-ego": 0.0924468902831382, "deviation-heading": 1.1154935756515298, "set_robot_commands": 0.12101224635509734, "deviation-center-line": 0.15015672517498888, "driven_lanedir_consec": 0.27985672561192576, "sim_compute_sim_state": 0.04421372109271111, "sim_compute_performance-ego": 0.07889784650599703, "sim_compute_robot_state-ego": 0.08897794053909626, "sim_compute_robot_state-npc0": 0.07912613483185464, "sim_compute_robot_state-npc1": 0.07787226108794516, "sim_compute_robot_state-npc2": 0.079391895456517, "sim_compute_robot_state-npc3": 0.08111138546720464}, "udem1-2-0": {"driven_any": 0.6257641943439552, "sim_physics": 0.09617081994102114, "survival_time": 4.199999999999993, "driven_lanedir": 0.6037021522723106, "sim_render-ego": 0.07096133345649355, "in-drivable-lane": 0, "agent_compute-ego": 0.08887768075579688, "deviation-heading": 0.8962350163061694, "set_robot_commands": 0.11173674889973231, "deviation-center-line": 0.4356815244714198, "driven_lanedir_consec": 0.6037021522723106, "sim_compute_sim_state": 0.04528051898592994, "sim_compute_performance-ego": 0.07737224442618233, "sim_compute_robot_state-ego": 0.08784122410274688, "sim_compute_robot_state-npc0": 0.07624160108112153, "sim_compute_robot_state-npc1": 0.07753493672325498, "sim_compute_robot_state-npc2": 0.08113646223431542, "sim_compute_robot_state-npc3": 0.08030714591344197}, "udem1-3-0": {"driven_any": 0.4730965524855254, "sim_physics": 0.09119018774766188, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4578072071056016, "sim_render-ego": 0.06655156428997333, "in-drivable-lane": 0, "agent_compute-ego": 0.08710401608393742, "deviation-heading": 0.6330529649870218, "set_robot_commands": 0.1073477891775278, "deviation-center-line": 0.3501814659637874, "driven_lanedir_consec": 0.4578072071056016, "sim_compute_sim_state": 0.043411163183359, "sim_compute_performance-ego": 0.07244913761432355, "sim_compute_robot_state-ego": 0.07770993892963116, "sim_compute_robot_state-npc0": 0.07309075869046724, "sim_compute_robot_state-npc1": 0.07526743228618915, "sim_compute_robot_state-npc2": 0.0836636469914363, "sim_compute_robot_state-npc3": 0.07424823687626765}, "udem1-4-0": {"driven_any": 2.353364978398695, "sim_physics": 0.0857230165730352, "survival_time": 14.950000000000076, "driven_lanedir": 1.9385380529867176, "sim_render-ego": 0.0649420298062838, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.0943722788705475, "deviation-heading": 5.698082646302257, "set_robot_commands": 0.10907978995587914, "deviation-center-line": 1.3357571089036469, "driven_lanedir_consec": 1.5602047465192497, "sim_compute_sim_state": 0.04537857735037405, "sim_compute_performance-ego": 0.07275155794660383, "sim_compute_robot_state-ego": 0.0834825174465626, "sim_compute_robot_state-npc0": 0.07298404237498408, "sim_compute_robot_state-npc1": 0.07386813355130097, "sim_compute_robot_state-npc2": 0.07251875775314892, "sim_compute_robot_state-npc3": 0.07435171420757587}}
set_robot_commands_max0.12101224635509734
set_robot_commands_mean0.11243531430544274
set_robot_commands_median0.11173674889973231
set_robot_commands_min0.1073477891775278
sim_compute_performance-ego_max0.07889784650599703
sim_compute_performance-ego_mean0.07596942467711051
sim_compute_performance-ego_median0.07737224442618233
sim_compute_performance-ego_min0.07244913761432355
sim_compute_robot_state-ego_max0.08897794053909626
sim_compute_robot_state-ego_mean0.08480783545569273
sim_compute_robot_state-ego_median0.08602755626042684
sim_compute_robot_state-ego_min0.07770993892963116
sim_compute_robot_state-npc0_max0.07913812398910522
sim_compute_robot_state-npc0_mean0.07611613219350653
sim_compute_robot_state-npc0_median0.07624160108112153
sim_compute_robot_state-npc0_min0.07298404237498408
sim_compute_robot_state-npc1_max0.07932165225346884
sim_compute_robot_state-npc1_mean0.07677288318043182
sim_compute_robot_state-npc1_median0.07753493672325498
sim_compute_robot_state-npc1_min0.07386813355130097
sim_compute_robot_state-npc2_max0.0836636469914363
sim_compute_robot_state-npc2_mean0.07906806680643981
sim_compute_robot_state-npc2_median0.079391895456517
sim_compute_robot_state-npc2_min0.07251875775314892
sim_compute_robot_state-npc3_max0.08111138546720464
sim_compute_robot_state-npc3_mean0.07765681494433438
sim_compute_robot_state-npc3_median0.0782655922571818
sim_compute_robot_state-npc3_min0.07424823687626765
sim_compute_sim_state_max0.04537857735037405
sim_compute_sim_state_mean0.044389319881680954
sim_compute_sim_state_median0.04421372109271111
sim_compute_sim_state_min0.043411163183359
sim_physics_max0.09617081994102114
sim_physics_mean0.09058136884773205
sim_physics_median0.09119018774766188
sim_physics_min0.08508819182713827
sim_render-ego_max0.07177105863043602
sim_render-ego_mean0.06908381847153115
sim_render-ego_median0.07096133345649355
sim_render-ego_min0.0649420298062838
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.940000000000029
survival_time_min2.3499999999999996
200572660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:21:39(hidden)
driven_lanedir_consec_median0.6102529976910192
survival_time_median5.1999999999999895
deviation-center-line_median0.2652740716368691
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08742585863385882
agent_compute-ego_mean0.08264460876955218
agent_compute-ego_median0.08301451114507821
agent_compute-ego_min0.07599701007207235
deviation-center-line_max0.9776084239500996
deviation-center-line_mean0.5075548643768787
deviation-center-line_min0.1455692846025562
deviation-heading_max6.394734595229873
deviation-heading_mean3.0823126892644512
deviation-heading_median1.8371694013148736
deviation-heading_min0.5772374138703639
driven_any_max2.3331283464422365
driven_any_mean1.167623156134005
driven_any_median0.781921467511906
driven_any_min0.22749772573145133
driven_lanedir_consec_max0.7174176201998985
driven_lanedir_consec_mean0.5211213145956811
driven_lanedir_consec_min0.19964814616213775
driven_lanedir_max1.0022107308034591
driven_lanedir_mean0.6714799873676125
driven_lanedir_median0.7174176201998985
driven_lanedir_min0.19964814616213775
in-drivable-lane_max5.750000000000059
in-drivable-lane_mean1.8800000000000177
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3331283464422365, "sim_physics": 0.2119933478037516, "survival_time": 14.950000000000076, "driven_lanedir": 1.0022107308034591, "sim_render-ego": 0.0594193164507548, "in-drivable-lane": 5.750000000000059, "agent_compute-ego": 0.07599701007207235, "deviation-heading": 5.902017052243848, "set_robot_commands": 0.09369595686594644, "deviation-center-line": 0.918909250733303, "driven_lanedir_consec": 0.6102529976910192, "sim_compute_sim_state": 0.03754587570826213, "sim_compute_performance-ego": 0.06654017527898153, "sim_compute_robot_state-ego": 0.07051292975743612, "sim_compute_robot_state-npc0": 0.0674905800819397, "sim_compute_robot_state-npc1": 0.06781875292460124, "sim_compute_robot_state-npc2": 0.06611688534418741, "sim_compute_robot_state-npc3": 0.06663705507914225}, "udem1-1-0": {"driven_any": 0.781921467511906, "sim_physics": 0.2006782086995932, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7174176201998985, "sim_render-ego": 0.06892096767058739, "in-drivable-lane": 0, "agent_compute-ego": 0.08560335177641648, "deviation-heading": 1.8371694013148736, "set_robot_commands": 0.11189885781361508, "deviation-center-line": 0.2652740716368691, "driven_lanedir_consec": 0.7174176201998985, "sim_compute_sim_state": 0.042033603558173545, "sim_compute_performance-ego": 0.07539409169783959, "sim_compute_robot_state-ego": 0.07989939130269565, "sim_compute_robot_state-npc0": 0.07558923042737521, "sim_compute_robot_state-npc1": 0.07703174994542049, "sim_compute_robot_state-npc2": 0.07502592068452102, "sim_compute_robot_state-npc3": 0.07716105763728802}, "udem1-2-0": {"driven_any": 2.035024263028036, "sim_physics": 0.2245195168715257, "survival_time": 13.00000000000005, "driven_lanedir": 0.9916915316919396, "sim_render-ego": 0.06696943411460289, "in-drivable-lane": 3.650000000000028, "agent_compute-ego": 0.08301451114507821, "deviation-heading": 6.394734595229873, "set_robot_commands": 0.10655919863627508, "deviation-center-line": 0.9776084239500996, "driven_lanedir_consec": 0.6318559009447231, "sim_compute_sim_state": 0.04264712333679199, "sim_compute_performance-ego": 0.07434500180757962, "sim_compute_robot_state-ego": 0.08322842121124267, "sim_compute_robot_state-npc0": 0.0748882009432866, "sim_compute_robot_state-npc1": 0.07617710920480582, "sim_compute_robot_state-npc2": 0.07656197181114784, "sim_compute_robot_state-npc3": 0.07583957452040452}, "udem1-3-0": {"driven_any": 0.22749772573145133, "sim_physics": 0.2418175288609096, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19964814616213775, "sim_render-ego": 0.06705124037606376, "in-drivable-lane": 0, "agent_compute-ego": 0.08742585863385882, "deviation-heading": 0.5772374138703639, "set_robot_commands": 0.1144425732748849, "deviation-center-line": 0.1455692846025562, "driven_lanedir_consec": 0.19964814616213775, "sim_compute_sim_state": 0.046818208694458005, "sim_compute_performance-ego": 0.07599525451660157, "sim_compute_robot_state-ego": 0.08959469795227051, "sim_compute_robot_state-npc0": 0.07576501710074289, "sim_compute_robot_state-npc1": 0.07497108323233469, "sim_compute_robot_state-npc2": 0.07680219922746931, "sim_compute_robot_state-npc3": 0.07932702473231724}, "udem1-4-0": {"driven_any": 0.4605439779563947, "sim_physics": 0.1768621690571308, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4464319079806267, "sim_render-ego": 0.06645599380135536, "in-drivable-lane": 0, "agent_compute-ego": 0.081182312220335, "deviation-heading": 0.7004049836632976, "set_robot_commands": 0.1073167324066162, "deviation-center-line": 0.23041329096156568, "driven_lanedir_consec": 0.4464319079806267, "sim_compute_sim_state": 0.04168590530753136, "sim_compute_performance-ego": 0.07328728586435318, "sim_compute_robot_state-ego": 0.0809803381562233, "sim_compute_robot_state-npc0": 0.07643252611160278, "sim_compute_robot_state-npc1": 0.07379280775785446, "sim_compute_robot_state-npc2": 0.07515038177371025, "sim_compute_robot_state-npc3": 0.07726417481899261}}
set_robot_commands_max0.1144425732748849
set_robot_commands_mean0.10678266379946756
set_robot_commands_median0.1073167324066162
set_robot_commands_min0.09369595686594644
sim_compute_performance-ego_max0.07599525451660157
sim_compute_performance-ego_mean0.0731123618330711
sim_compute_performance-ego_median0.07434500180757962
sim_compute_performance-ego_min0.06654017527898153
sim_compute_robot_state-ego_max0.08959469795227051
sim_compute_robot_state-ego_mean0.08084315567597364
sim_compute_robot_state-ego_median0.0809803381562233
sim_compute_robot_state-ego_min0.07051292975743612
sim_compute_robot_state-npc0_max0.07643252611160278
sim_compute_robot_state-npc0_mean0.07403311093298943
sim_compute_robot_state-npc0_median0.07558923042737521
sim_compute_robot_state-npc0_min0.0674905800819397
sim_compute_robot_state-npc1_max0.07703174994542049
sim_compute_robot_state-npc1_mean0.07395830061300333
sim_compute_robot_state-npc1_median0.07497108323233469
sim_compute_robot_state-npc1_min0.06781875292460124
sim_compute_robot_state-npc2_max0.07680219922746931
sim_compute_robot_state-npc2_mean0.07393147176820716
sim_compute_robot_state-npc2_median0.07515038177371025
sim_compute_robot_state-npc2_min0.06611688534418741
sim_compute_robot_state-npc3_max0.07932702473231724
sim_compute_robot_state-npc3_mean0.07524577735762893
sim_compute_robot_state-npc3_median0.07716105763728802
sim_compute_robot_state-npc3_min0.06663705507914225
sim_compute_sim_state_max0.046818208694458005
sim_compute_sim_state_mean0.04214614332104341
sim_compute_sim_state_median0.042033603558173545
sim_compute_sim_state_min0.03754587570826213
sim_physics_max0.2418175288609096
sim_physics_mean0.2111741542585822
sim_physics_median0.2119933478037516
sim_physics_min0.1768621690571308
sim_render-ego_max0.06892096767058739
sim_render-ego_mean0.06576339048267284
sim_render-ego_median0.06696943411460289
sim_render-ego_min0.0594193164507548
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.620000000000023
survival_time_min1.7500000000000009
200462660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:01:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
198022660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:11:48(hidden)
driven_lanedir_consec_median0.4615557169467661
survival_time_median3.4999999999999956
deviation-center-line_median0.3389924730399202
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07739016503998727
agent_compute-ego_mean0.07162808789422502
agent_compute-ego_median0.07205048288617816
agent_compute-ego_min0.06741366704305013
deviation-center-line_max1.3668625896446585
deviation-center-line_mean0.5671847605928119
deviation-center-line_min0.12184105327993287
deviation-heading_max3.31612654849037
deviation-heading_mean1.498271924619187
deviation-heading_median1.200015996043308
deviation-heading_min0.5433313373427111
driven_any_max2.3557016573021934
driven_any_mean0.9585068683959872
driven_any_median0.5154632091919716
driven_any_min0.21812893445976075
driven_lanedir_consec_max2.2517720923603637
driven_lanedir_consec_mean0.900641283628208
driven_lanedir_consec_min0.16277880841911865
driven_lanedir_max2.252936105410885
driven_lanedir_mean0.9009194308414544
driven_lanedir_median0.4615557169467661
driven_lanedir_min0.16277880841911865
in-drivable-lane_max0.1999999999999993
in-drivable-lane_mean0.039999999999999855
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4690337028860367, "sim_physics": 0.0280931083779586, "survival_time": 9.5, "driven_lanedir": 1.435385083487429, "sim_render-ego": 0.06152471492165013, "in-drivable-lane": 0, "agent_compute-ego": 0.07274296283721923, "deviation-heading": 1.6996093313514915, "set_robot_commands": 0.08066333846042031, "deviation-center-line": 0.8645306295248034, "driven_lanedir_consec": 1.435158360471718, "sim_compute_sim_state": 0.036172070001301015, "sim_compute_performance-ego": 0.06335190597333407, "sim_compute_robot_state-ego": 0.06156828779923289, "sim_compute_robot_state-npc0": 0.07050237530156185, "sim_compute_robot_state-npc1": 0.06681238224631862, "sim_compute_robot_state-npc2": 0.06585109610306589, "sim_compute_robot_state-npc3": 0.06548894330074913}, "udem1-1-0": {"driven_any": 0.23420683813997276, "sim_physics": 0.02713650975908552, "survival_time": 1.7500000000000009, "driven_lanedir": 0.16277880841911865, "sim_render-ego": 0.06149276324680873, "in-drivable-lane": 0, "agent_compute-ego": 0.0685431616646903, "deviation-heading": 1.200015996043308, "set_robot_commands": 0.0743098327091762, "deviation-center-line": 0.12184105327993287, "driven_lanedir_consec": 0.16277880841911865, "sim_compute_sim_state": 0.03298495156424386, "sim_compute_performance-ego": 0.06069009644644601, "sim_compute_robot_state-ego": 0.059365647179739814, "sim_compute_robot_state-npc0": 0.0638094357081822, "sim_compute_robot_state-npc1": 0.06213089397975376, "sim_compute_robot_state-npc2": 0.0626401696886335, "sim_compute_robot_state-npc3": 0.05618523188999721}, "udem1-2-0": {"driven_any": 0.5154632091919716, "sim_physics": 0.033331891468593056, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4615557169467661, "sim_render-ego": 0.0632990632738386, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07205048288617816, "deviation-heading": 0.7322764098680526, "set_robot_commands": 0.07839365346091134, "deviation-center-line": 0.3389924730399202, "driven_lanedir_consec": 0.4615557169467661, "sim_compute_sim_state": 0.03648723193577358, "sim_compute_performance-ego": 0.06448981080736432, "sim_compute_robot_state-ego": 0.06281285626547677, "sim_compute_robot_state-npc0": 0.07266110692705427, "sim_compute_robot_state-npc1": 0.06725279944283621, "sim_compute_robot_state-npc2": 0.06440728051321847, "sim_compute_robot_state-npc3": 0.06399476528167725}, "udem1-3-0": {"driven_any": 0.21812893445976075, "sim_physics": 0.028655370076497395, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1919414399430728, "sim_render-ego": 0.058510816458499794, "in-drivable-lane": 0, "agent_compute-ego": 0.07739016503998727, "deviation-heading": 0.5433313373427111, "set_robot_commands": 0.08200178001866196, "deviation-center-line": 0.14369705747474448, "driven_lanedir_consec": 0.1919414399430728, "sim_compute_sim_state": 0.03433518698721221, "sim_compute_performance-ego": 0.060809092088179154, "sim_compute_robot_state-ego": 0.06127590121644916, "sim_compute_robot_state-npc0": 0.06500584428960626, "sim_compute_robot_state-npc1": 0.05955909237717137, "sim_compute_robot_state-npc2": 0.06003112503976533, "sim_compute_robot_state-npc3": 0.059140595522793854}, "udem1-4-0": {"driven_any": 2.3557016573021934, "sim_physics": 0.0274207599957784, "survival_time": 14.950000000000076, "driven_lanedir": 2.252936105410885, "sim_render-ego": 0.057664663791656495, "in-drivable-lane": 0, "agent_compute-ego": 0.06741366704305013, "deviation-heading": 3.31612654849037, "set_robot_commands": 0.07686870098114014, "deviation-center-line": 1.3668625896446585, "driven_lanedir_consec": 2.2517720923603637, "sim_compute_sim_state": 0.03430793285369873, "sim_compute_performance-ego": 0.06101203838984171, "sim_compute_robot_state-ego": 0.06117953062057495, "sim_compute_robot_state-npc0": 0.06766036033630371, "sim_compute_robot_state-npc1": 0.06387495915095011, "sim_compute_robot_state-npc2": 0.06206997791926066, "sim_compute_robot_state-npc3": 0.062400243282318114}}
set_robot_commands_max0.08200178001866196
set_robot_commands_mean0.07844746112606199
set_robot_commands_median0.07839365346091134
set_robot_commands_min0.0743098327091762
sim_compute_performance-ego_max0.06448981080736432
sim_compute_performance-ego_mean0.06207058874103305
sim_compute_performance-ego_median0.06101203838984171
sim_compute_performance-ego_min0.06069009644644601
sim_compute_robot_state-ego_max0.06281285626547677
sim_compute_robot_state-ego_mean0.06124044461629472
sim_compute_robot_state-ego_median0.06127590121644916
sim_compute_robot_state-ego_min0.059365647179739814
sim_compute_robot_state-npc0_max0.07266110692705427
sim_compute_robot_state-npc0_mean0.06792782451254167
sim_compute_robot_state-npc0_median0.06766036033630371
sim_compute_robot_state-npc0_min0.0638094357081822
sim_compute_robot_state-npc1_max0.06725279944283621
sim_compute_robot_state-npc1_mean0.06392602543940601
sim_compute_robot_state-npc1_median0.06387495915095011
sim_compute_robot_state-npc1_min0.05955909237717137
sim_compute_robot_state-npc2_max0.06585109610306589
sim_compute_robot_state-npc2_mean0.06299992985278877
sim_compute_robot_state-npc2_median0.0626401696886335
sim_compute_robot_state-npc2_min0.06003112503976533
sim_compute_robot_state-npc3_max0.06548894330074913
sim_compute_robot_state-npc3_mean0.06144195585550712
sim_compute_robot_state-npc3_median0.062400243282318114
sim_compute_robot_state-npc3_min0.05618523188999721
sim_compute_sim_state_max0.03648723193577358
sim_compute_sim_state_mean0.03485747466844588
sim_compute_sim_state_median0.03433518698721221
sim_compute_sim_state_min0.03298495156424386
sim_physics_max0.033331891468593056
sim_physics_mean0.028927527935582592
sim_physics_median0.0280931083779586
sim_physics_min0.02713650975908552
sim_render-ego_max0.0632990632738386
sim_render-ego_mean0.060498404338490755
sim_render-ego_median0.06149276324680873
sim_render-ego_min0.057664663791656495
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.270000000000016
survival_time_min1.6500000000000008
197852660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:15:09(hidden)
driven_lanedir_consec_median0.590545989884475
survival_time_median4.049999999999994
deviation-center-line_median0.4154343882918444
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08911264687776566
agent_compute-ego_mean0.08351740237668737
agent_compute-ego_median0.08302743094308036
agent_compute-ego_min0.08095749051947343
deviation-center-line_max0.9494562903675527
deviation-center-line_mean0.49500183260475633
deviation-center-line_min0.12905295618091642
deviation-heading_max2.41248308148414
deviation-heading_mean1.284507081837006
deviation-heading_median1.155052743487068
deviation-heading_min0.5041323878744777
driven_any_max1.8493711640216144
driven_any_mean0.8845581534377885
driven_any_median0.6038526640592228
driven_any_min0.21009525590710537
driven_lanedir_consec_max1.43478998902125
driven_lanedir_consec_mean0.7629448342885939
driven_lanedir_consec_min0.18651150255237892
driven_lanedir_max1.4349757163310457
driven_lanedir_mean0.7635661025527746
driven_lanedir_median0.590545989884475
driven_lanedir_min0.18651150255237892
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean0.4800000000000068
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.469030749513949, "sim_physics": 0.04519731621993216, "survival_time": 9.5, "driven_lanedir": 1.4349757163310457, "sim_render-ego": 0.06362477227261192, "in-drivable-lane": 0, "agent_compute-ego": 0.08095749051947343, "deviation-heading": 1.7033642977205472, "set_robot_commands": 0.09972510965246904, "deviation-center-line": 0.8465798591571909, "driven_lanedir_consec": 1.43478998902125, "sim_compute_sim_state": 0.040288341672796955, "sim_compute_performance-ego": 0.06976835853175113, "sim_compute_robot_state-ego": 0.07413327819422671, "sim_compute_robot_state-npc0": 0.06954736835078189, "sim_compute_robot_state-npc1": 0.06956626741509689, "sim_compute_robot_state-npc2": 0.0720025614688271, "sim_compute_robot_state-npc3": 0.07121028523696096}, "udem1-1-0": {"driven_any": 0.29044093368705126, "sim_physics": 0.042930495171319874, "survival_time": 2.1000000000000005, "driven_lanedir": 0.22562558192707716, "sim_render-ego": 0.06434291317349389, "in-drivable-lane": 0, "agent_compute-ego": 0.08302743094308036, "deviation-heading": 1.155052743487068, "set_robot_commands": 0.10479334422520228, "deviation-center-line": 0.12905295618091642, "driven_lanedir_consec": 0.22562558192707716, "sim_compute_sim_state": 0.03919201805478051, "sim_compute_performance-ego": 0.06957720007215228, "sim_compute_robot_state-ego": 0.07314364683060419, "sim_compute_robot_state-npc0": 0.07073850291115898, "sim_compute_robot_state-npc1": 0.07023842561812628, "sim_compute_robot_state-npc2": 0.07178938956487746, "sim_compute_robot_state-npc3": 0.07078553381420317}, "udem1-2-0": {"driven_any": 0.6038526640592228, "sim_physics": 0.04992270764009452, "survival_time": 4.049999999999994, "driven_lanedir": 0.590545989884475, "sim_render-ego": 0.06392122492378141, "in-drivable-lane": 0, "agent_compute-ego": 0.08108757160328052, "deviation-heading": 0.6475028986187973, "set_robot_commands": 0.0994557598490774, "deviation-center-line": 0.4154343882918444, "driven_lanedir_consec": 0.590545989884475, "sim_compute_sim_state": 0.04042870321391541, "sim_compute_performance-ego": 0.07051234186431508, "sim_compute_robot_state-ego": 0.07514324600313917, "sim_compute_robot_state-npc0": 0.06861940136662235, "sim_compute_robot_state-npc1": 0.07039709738743158, "sim_compute_robot_state-npc2": 0.06958462868207767, "sim_compute_robot_state-npc3": 0.06999025227111062}, "udem1-3-0": {"driven_any": 0.21009525590710537, "sim_physics": 0.045076556503772736, "survival_time": 1.6000000000000008, "driven_lanedir": 0.18651150255237892, "sim_render-ego": 0.05893561244010925, "in-drivable-lane": 0, "agent_compute-ego": 0.08911264687776566, "deviation-heading": 0.5041323878744777, "set_robot_commands": 0.10126835107803343, "deviation-center-line": 0.13448566902627723, "driven_lanedir_consec": 0.18651150255237892, "sim_compute_sim_state": 0.03604152053594589, "sim_compute_performance-ego": 0.06617554277181625, "sim_compute_robot_state-ego": 0.07057269662618637, "sim_compute_robot_state-npc0": 0.06844186037778854, "sim_compute_robot_state-npc1": 0.07050904631614685, "sim_compute_robot_state-npc2": 0.0676681250333786, "sim_compute_robot_state-npc3": 0.0723525807261467}, "udem1-4-0": {"driven_any": 1.8493711640216144, "sim_physics": 0.04773965932555118, "survival_time": 11.800000000000033, "driven_lanedir": 1.380171722068896, "sim_render-ego": 0.06729685957148923, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.08340187193983692, "deviation-heading": 2.41248308148414, "set_robot_commands": 0.1034508125256684, "deviation-center-line": 0.9494562903675527, "driven_lanedir_consec": 1.3772511080577885, "sim_compute_sim_state": 0.0417491955272222, "sim_compute_performance-ego": 0.07157579316931256, "sim_compute_robot_state-ego": 0.07782294285499443, "sim_compute_robot_state-npc0": 0.07201796770095825, "sim_compute_robot_state-npc1": 0.07442135831057015, "sim_compute_robot_state-npc2": 0.0728130896212691, "sim_compute_robot_state-npc3": 0.07277283830157781}}
set_robot_commands_max0.10479334422520228
set_robot_commands_mean0.1017386754660901
set_robot_commands_median0.10126835107803343
set_robot_commands_min0.0994557598490774
sim_compute_performance-ego_max0.07157579316931256
sim_compute_performance-ego_mean0.06952184728186947
sim_compute_performance-ego_median0.06976835853175113
sim_compute_performance-ego_min0.06617554277181625
sim_compute_robot_state-ego_max0.07782294285499443
sim_compute_robot_state-ego_mean0.07416316210183017
sim_compute_robot_state-ego_median0.07413327819422671
sim_compute_robot_state-ego_min0.07057269662618637
sim_compute_robot_state-npc0_max0.07201796770095825
sim_compute_robot_state-npc0_mean0.069873020141462
sim_compute_robot_state-npc0_median0.06954736835078189
sim_compute_robot_state-npc0_min0.06844186037778854
sim_compute_robot_state-npc1_max0.07442135831057015
sim_compute_robot_state-npc1_mean0.07102643900947436
sim_compute_robot_state-npc1_median0.07039709738743158
sim_compute_robot_state-npc1_min0.06956626741509689
sim_compute_robot_state-npc2_max0.0728130896212691
sim_compute_robot_state-npc2_mean0.07077155887408598
sim_compute_robot_state-npc2_median0.07178938956487746
sim_compute_robot_state-npc2_min0.0676681250333786
sim_compute_robot_state-npc3_max0.07277283830157781
sim_compute_robot_state-npc3_mean0.07142229806999986
sim_compute_robot_state-npc3_median0.07121028523696096
sim_compute_robot_state-npc3_min0.06999025227111062
sim_compute_sim_state_max0.0417491955272222
sim_compute_sim_state_mean0.0395399558009322
sim_compute_sim_state_median0.040288341672796955
sim_compute_sim_state_min0.03604152053594589
sim_physics_max0.04992270764009452
sim_physics_mean0.04617334697213409
sim_physics_median0.04519731621993216
sim_physics_min0.042930495171319874
sim_render-ego_max0.06729685957148923
sim_render-ego_mean0.06362427647629713
sim_render-ego_median0.06392122492378141
sim_render-ego_min0.05893561244010925
simulation-passed1
survival_time_max11.800000000000033
survival_time_mean5.810000000000006
survival_time_min1.6000000000000008
197532660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:13:59
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
193982660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:20:11(hidden)
driven_lanedir_consec_median0.4725546764682309
survival_time_median3.7499999999999942
deviation-center-line_median0.2318475612666791
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10391579656039968
agent_compute-ego_mean0.0963609252290394
agent_compute-ego_median0.0987846117753249
agent_compute-ego_min0.0806053075413246
deviation-center-line_max1.0810907593495376
deviation-center-line_mean0.4723397308374004
deviation-center-line_min0.07880716082236432
deviation-heading_max4.3762036819363646
deviation-heading_mean1.5941829982958822
deviation-heading_median0.9480091782017134
deviation-heading_min0.6720250628814004
driven_any_max2.3556198723889996
driven_any_mean0.9536600317617372
driven_any_median0.5556374863277342
driven_any_min0.2261520078050874
driven_lanedir_consec_max2.203105646153547
driven_lanedir_consec_mean0.8875371946314997
driven_lanedir_consec_min0.18959772566764288
driven_lanedir_max2.2037304124001436
driven_lanedir_mean0.8883371626291409
driven_lanedir_median0.4725546764682309
driven_lanedir_min0.18959772566764288
in-drivable-lane_max0.29999999999999893
in-drivable-lane_mean0.05999999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3645636959163912, "sim_physics": 0.0458581609241033, "survival_time": 8.84999999999999, "driven_lanedir": 1.3416299311104327, "sim_render-ego": 0.06538671288786635, "in-drivable-lane": 0, "agent_compute-ego": 0.0806053075413246, "deviation-heading": 1.2927454719507216, "set_robot_commands": 0.1044663749845688, "deviation-center-line": 0.8680557774979514, "driven_lanedir_consec": 1.338254857368823, "sim_compute_sim_state": 0.04170473147246797, "sim_compute_performance-ego": 0.07113651232530842, "sim_compute_robot_state-ego": 0.07499172862640209, "sim_compute_robot_state-npc0": 0.0730405419559802, "sim_compute_robot_state-npc1": 0.07350393877191058, "sim_compute_robot_state-npc2": 0.07266052429285427, "sim_compute_robot_state-npc3": 0.07161663750470695}, "udem1-1-0": {"driven_any": 0.2261520078050874, "sim_physics": 0.05708312287050135, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18959772566764288, "sim_render-ego": 0.07523544395671171, "in-drivable-lane": 0, "agent_compute-ego": 0.10391579656039968, "deviation-heading": 0.6720250628814004, "set_robot_commands": 0.1421800921945011, "deviation-center-line": 0.07880716082236432, "driven_lanedir_consec": 0.18959772566764288, "sim_compute_sim_state": 0.04586338295656092, "sim_compute_performance-ego": 0.08526535595164579, "sim_compute_robot_state-ego": 0.09252321018892176, "sim_compute_robot_state-npc0": 0.08887917153975543, "sim_compute_robot_state-npc1": 0.09447398606468647, "sim_compute_robot_state-npc2": 0.08443939685821533, "sim_compute_robot_state-npc3": 0.0866841989405015}, "udem1-2-0": {"driven_any": 0.5556374863277342, "sim_physics": 0.06882602691650391, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4725546764682309, "sim_render-ego": 0.07980796178181966, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1021869150797526, "deviation-heading": 0.9480091782017134, "set_robot_commands": 0.13589739481608074, "deviation-center-line": 0.2318475612666791, "driven_lanedir_consec": 0.4725546764682309, "sim_compute_sim_state": 0.05039762179056803, "sim_compute_performance-ego": 0.08845828056335449, "sim_compute_robot_state-ego": 0.09868295669555664, "sim_compute_robot_state-npc0": 0.08967665672302245, "sim_compute_robot_state-npc1": 0.09011315981547038, "sim_compute_robot_state-npc2": 0.08828666687011719, "sim_compute_robot_state-npc3": 0.08945293744405111}, "udem1-3-0": {"driven_any": 0.2663270963704733, "sim_physics": 0.059503671450492665, "survival_time": 1.950000000000001, "driven_lanedir": 0.23417306749925437, "sim_render-ego": 0.07378301253685585, "in-drivable-lane": 0, "agent_compute-ego": 0.0987846117753249, "deviation-heading": 0.6819315965092105, "set_robot_commands": 0.12689574559529623, "deviation-center-line": 0.10189739525046956, "driven_lanedir_consec": 0.23417306749925437, "sim_compute_sim_state": 0.04457957316667606, "sim_compute_performance-ego": 0.08140832949907352, "sim_compute_robot_state-ego": 0.09436261959564991, "sim_compute_robot_state-npc0": 0.07968818224393405, "sim_compute_robot_state-npc1": 0.08143465946882199, "sim_compute_robot_state-npc2": 0.07988281127734062, "sim_compute_robot_state-npc3": 0.07965391721480931}, "udem1-4-0": {"driven_any": 2.3556198723889996, "sim_physics": 0.05291146993637085, "survival_time": 14.950000000000076, "driven_lanedir": 2.2037304124001436, "sim_render-ego": 0.0723766533533732, "in-drivable-lane": 0, "agent_compute-ego": 0.0963119951883952, "deviation-heading": 4.3762036819363646, "set_robot_commands": 0.12490700483322144, "deviation-center-line": 1.0810907593495376, "driven_lanedir_consec": 2.203105646153547, "sim_compute_sim_state": 0.04529801050821941, "sim_compute_performance-ego": 0.08164201180140178, "sim_compute_robot_state-ego": 0.09272791862487792, "sim_compute_robot_state-npc0": 0.08221226056416829, "sim_compute_robot_state-npc1": 0.08195485909779866, "sim_compute_robot_state-npc2": 0.08234562714894612, "sim_compute_robot_state-npc3": 0.08261575222015381}}
set_robot_commands_max0.1421800921945011
set_robot_commands_mean0.12686932248473365
set_robot_commands_median0.12689574559529623
set_robot_commands_min0.1044663749845688
sim_compute_performance-ego_max0.08845828056335449
sim_compute_performance-ego_mean0.0815820980281568
sim_compute_performance-ego_median0.08164201180140178
sim_compute_performance-ego_min0.07113651232530842
sim_compute_robot_state-ego_max0.09868295669555664
sim_compute_robot_state-ego_mean0.09065768674628168
sim_compute_robot_state-ego_median0.09272791862487792
sim_compute_robot_state-ego_min0.07499172862640209
sim_compute_robot_state-npc0_max0.08967665672302245
sim_compute_robot_state-npc0_mean0.08269936260537208
sim_compute_robot_state-npc0_median0.08221226056416829
sim_compute_robot_state-npc0_min0.0730405419559802
sim_compute_robot_state-npc1_max0.09447398606468647
sim_compute_robot_state-npc1_mean0.08429612064373762
sim_compute_robot_state-npc1_median0.08195485909779866
sim_compute_robot_state-npc1_min0.07350393877191058
sim_compute_robot_state-npc2_max0.08828666687011719
sim_compute_robot_state-npc2_mean0.0815230052894947
sim_compute_robot_state-npc2_median0.08234562714894612
sim_compute_robot_state-npc2_min0.07266052429285427
sim_compute_robot_state-npc3_max0.08945293744405111
sim_compute_robot_state-npc3_mean0.08200468866484453
sim_compute_robot_state-npc3_median0.08261575222015381
sim_compute_robot_state-npc3_min0.07161663750470695
sim_compute_sim_state_max0.05039762179056803
sim_compute_sim_state_mean0.045568663978898485
sim_compute_sim_state_median0.04529801050821941
sim_compute_sim_state_min0.04170473147246797
sim_physics_max0.06882602691650391
sim_physics_mean0.05683649041959442
sim_physics_median0.05708312287050135
sim_physics_min0.0458581609241033
sim_render-ego_max0.07980796178181966
sim_render-ego_mean0.07331795690332535
sim_render-ego_median0.07378301253685585
sim_render-ego_min0.06538671288786635
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.240000000000013
survival_time_min1.7000000000000008
186982660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:07
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
(hidden)
183572660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:20:58
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
(hidden)
180522660zamatorychallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:20:55
Waited 1205 seconds [...]
Waited 1205 seconds for container to finish. Giving up. 
(hidden)