Duckietown Challenges Home Challenges Submissions

Submission 4266

Submission4266
Competingyes
Challengeaido3-LFVI-sim-testing
UserGianmarco Bernasconi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27615
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27615step1-simulationsuccessyes0:37:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0292261964306586
survival_time_median9.5
deviation-center-line_median0.6942015144639536
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.07118233589276876
agent_compute-ego_mean0.04237456483570869
agent_compute-ego_median0.04865442117055257
agent_compute-ego_min0.0235028466778601
deviation-center-line_max1.1954462314981005
deviation-center-line_mean0.597066900329514
deviation-center-line_min0.10345847486713908
deviation-heading_max5.018517235586111
deviation-heading_mean2.3879968416512893
deviation-heading_median1.7711946037926871
deviation-heading_min0.585025940997589
driven_any_max2.3491554427615498
driven_any_mean1.511731639625551
driven_any_median1.4731222420142276
driven_any_min0.3240066580038156
driven_lanedir_consec_max2.2954599770064252
driven_lanedir_consec_mean1.1236687869676352
driven_lanedir_consec_min0.09486276650518533
driven_lanedir_max2.295459980546162
driven_lanedir_mean1.347737464289954
driven_lanedir_median1.3362091356434431
driven_lanedir_min0.09486276650518533
in-drivable-lane_max2.5499999999999945
in-drivable-lane_mean0.39333333333333376
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.341312672238657, "sim_physics": 0.18285958131154376, "survival_time": 14.950000000000076, "driven_lanedir": 2.088118575624793, "sim_render-ego": 0.012090046405792237, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.025809679826100666, "deviation-heading": 5.018517235586111, "set_robot_commands": 0.008559282620747883, "deviation-center-line": 0.7830573111465131, "driven_lanedir_consec": 1.3731433392283188, "sim_compute_sim_state": 0.005322573184967041, "sim_compute_performance-ego": 0.007612251440684001, "sim_compute_robot_state-ego": 0.009161546230316162, "sim_compute_robot_state-npc0": 0.00962660312652588, "sim_compute_robot_state-npc1": 0.008740483125050862, "sim_compute_robot_state-npc2": 0.00841641664505005, "sim_compute_robot_state-npc3": 0.008356690406799316}, "udem1-1-0": {"driven_any": 1.2883582932927728, "sim_physics": 0.18319661460236877, "survival_time": 8.349999999999984, "driven_lanedir": 1.26595679434162, "sim_render-ego": 0.012459777786346252, "in-drivable-lane": 0, "agent_compute-ego": 0.0235028466778601, "deviation-heading": 1.096694590933062, "set_robot_commands": 0.008091883745022163, "deviation-center-line": 0.3246507083682965, "driven_lanedir_consec": 1.26595679434162, "sim_compute_sim_state": 0.0052984331896205146, "sim_compute_performance-ego": 0.007230577354659577, "sim_compute_robot_state-ego": 0.008843124983553401, "sim_compute_robot_state-npc0": 0.00866749900543761, "sim_compute_robot_state-npc1": 0.008368106659301027, "sim_compute_robot_state-npc2": 0.008128203317790688, "sim_compute_robot_state-npc3": 0.00806753792448672}, "udem1-2-0": {"driven_any": 0.3240066580038156, "sim_physics": 0.17864788846766694, "survival_time": 2.3499999999999996, "driven_lanedir": 0.24900856247925815, "sim_render-ego": 0.01228507528913782, "in-drivable-lane": 0, "agent_compute-ego": 0.027164200518993625, "deviation-heading": 1.251270315732469, "set_robot_commands": 0.008419331083906459, "deviation-center-line": 0.16946318921234613, "driven_lanedir_consec": 0.24900856247925815, "sim_compute_sim_state": 0.005311570268996218, "sim_compute_performance-ego": 0.006986252805019947, "sim_compute_robot_state-ego": 0.00906111331696206, "sim_compute_robot_state-npc0": 0.009498839682721078, "sim_compute_robot_state-npc1": 0.008159170759485123, "sim_compute_robot_state-npc2": 0.008793744635074697, "sim_compute_robot_state-npc3": 0.008760081960799847}, "udem1-3-0": {"driven_any": 2.3489577088683724, "sim_physics": 0.1756169001261393, "survival_time": 14.950000000000076, "driven_lanedir": 1.966293125336944, "sim_render-ego": 0.012307491302490236, "in-drivable-lane": 0.9000000000000083, "agent_compute-ego": 0.025278770128885904, "deviation-heading": 5.001946855194434, "set_robot_commands": 0.008409433364868164, "deviation-center-line": 0.986100985878306, "driven_lanedir_consec": 1.0292261964306586, "sim_compute_sim_state": 0.005418750445048014, "sim_compute_performance-ego": 0.007484835783640544, "sim_compute_robot_state-ego": 0.008962492942810058, "sim_compute_robot_state-npc0": 0.008681637446085612, "sim_compute_robot_state-npc1": 0.008651848634084065, "sim_compute_robot_state-npc2": 0.008659138679504394, "sim_compute_robot_state-npc3": 0.008275643189748128}, "udem1-4-0": {"driven_any": 0.4847440962796544, "sim_physics": 0.20652135094599935, "survival_time": 3.349999999999996, "driven_lanedir": 0.44414617522096345, "sim_render-ego": 0.012353071525915344, "in-drivable-lane": 0, "agent_compute-ego": 0.024060427252926044, "deviation-heading": 0.9410975037839204, "set_robot_commands": 0.007835373949648729, "deviation-center-line": 0.10345847486713908, "driven_lanedir_consec": 0.44414617522096345, "sim_compute_sim_state": 0.005308450157962628, "sim_compute_performance-ego": 0.007334598854406556, "sim_compute_robot_state-ego": 0.009183389037402708, "sim_compute_robot_state-npc0": 0.008482708859799513, "sim_compute_robot_state-npc1": 0.008225473005380204, "sim_compute_robot_state-npc2": 0.008323466599877202, "sim_compute_robot_state-npc3": 0.00799231031047764}, "udem1-5-0": {"driven_any": 0.7016869305233112, "sim_physics": 0.1750405595657673, "survival_time": 4.699999999999991, "driven_lanedir": 0.6705733149041515, "sim_render-ego": 0.012860574620835324, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02440472866626496, "deviation-heading": 0.8850848817836237, "set_robot_commands": 0.00893955281440248, "deviation-center-line": 0.2645608560469785, "driven_lanedir_consec": 0.6705733149041515, "sim_compute_sim_state": 0.005209116225546979, "sim_compute_performance-ego": 0.007226073995549628, "sim_compute_robot_state-ego": 0.008805645273086872, "sim_compute_robot_state-npc0": 0.008565428409170597, "sim_compute_robot_state-npc1": 0.008354595366944658, "sim_compute_robot_state-npc2": 0.008524194676825341, "sim_compute_robot_state-npc3": 0.008919923863512404}, "udem1-6-0": {"driven_any": 2.3490836224498706, "sim_physics": 0.16620365460713704, "survival_time": 14.950000000000076, "driven_lanedir": 2.2385744766680493, "sim_render-ego": 0.01165524959564209, "in-drivable-lane": 0, "agent_compute-ego": 0.035451345443725586, "deviation-heading": 3.6263222415256817, "set_robot_commands": 0.008065120379130045, "deviation-center-line": 1.0505134880432412, "driven_lanedir_consec": 2.235103894876498, "sim_compute_sim_state": 0.005092089176177979, "sim_compute_performance-ego": 0.007062071959177653, "sim_compute_robot_state-ego": 0.00833879550298055, "sim_compute_robot_state-npc0": 0.008641418615976969, "sim_compute_robot_state-npc1": 0.0084035595258077, "sim_compute_robot_state-npc2": 0.008475863933563232, "sim_compute_robot_state-npc3": 0.008311018149058024}, "udem1-7-0": {"driven_any": 2.3491491614241764, "sim_physics": 0.17385703166325886, "survival_time": 14.950000000000076, "driven_lanedir": 2.295459980546162, "sim_render-ego": 0.012116201718648276, "in-drivable-lane": 0, "agent_compute-ego": 0.05900820414225261, "deviation-heading": 2.0640210451708563, "set_robot_commands": 0.00802992343902588, "deviation-center-line": 1.1954462314981005, "driven_lanedir_consec": 2.2954599770064252, "sim_compute_sim_state": 0.005295436382293701, "sim_compute_performance-ego": 0.007367435296376546, "sim_compute_robot_state-ego": 0.009050938288370768, "sim_compute_robot_state-npc0": 0.008643895785013834, "sim_compute_robot_state-npc1": 0.008577192624409993, "sim_compute_robot_state-npc2": 0.008660806814829508, "sim_compute_robot_state-npc3": 0.008383593559265136}, "udem1-8-0": {"driven_any": 2.349050004833725, "sim_physics": 0.17897727966308594, "survival_time": 14.950000000000076, "driven_lanedir": 2.051917262899798, "sim_render-ego": 0.012182941436767578, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.05182815631230672, "deviation-heading": 4.217906459718592, "set_robot_commands": 0.007882229487101237, "deviation-center-line": 0.866127689521222, "driven_lanedir_consec": 1.6182701675480804, "sim_compute_sim_state": 0.005161970456441243, "sim_compute_performance-ego": 0.00691463311513265, "sim_compute_robot_state-ego": 0.008753600120544434, "sim_compute_robot_state-npc0": 0.008985962867736817, "sim_compute_robot_state-npc1": 0.008329241275787354, "sim_compute_robot_state-npc2": 0.007981564203898112, "sim_compute_robot_state-npc3": 0.008116610050201416}, "udem1-9-0": {"driven_any": 0.5328786162154291, "sim_physics": 0.22236956635566607, "survival_time": 3.649999999999995, "driven_lanedir": 0.09486276650518533, "sim_render-ego": 0.012871787972646216, "in-drivable-lane": 2.5499999999999945, "agent_compute-ego": 0.07118233589276876, "deviation-heading": 0.585025940997589, "set_robot_commands": 0.008681685957190108, "deviation-center-line": 0.10980042254238466, "driven_lanedir_consec": 0.09486276650518533, "sim_compute_sim_state": 0.005260402209138217, "sim_compute_performance-ego": 0.00732487195158658, "sim_compute_robot_state-ego": 0.009511607967010916, "sim_compute_robot_state-npc0": 0.008651772590532694, "sim_compute_robot_state-npc1": 0.008583663261100037, "sim_compute_robot_state-npc2": 0.008867979049682617, "sim_compute_robot_state-npc3": 0.008643927639477874}, "udem1-10-0": {"driven_any": 0.6775927254675113, "sim_physics": 0.16880423420078153, "survival_time": 4.549999999999992, "driven_lanedir": 0.6156413283004009, "sim_render-ego": 0.011755288302243412, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.05301752195253477, "deviation-heading": 0.8518006178596832, "set_robot_commands": 0.007722629295600639, "deviation-center-line": 0.2000304582438022, "driven_lanedir_consec": 0.6156413283004009, "sim_compute_sim_state": 0.005385267865526807, "sim_compute_performance-ego": 0.007072894127814324, "sim_compute_robot_state-ego": 0.008432466905195635, "sim_compute_robot_state-npc0": 0.008375521544571761, "sim_compute_robot_state-npc1": 0.008055647650917808, "sim_compute_robot_state-npc2": 0.008403138799981757, "sim_compute_robot_state-npc3": 0.008410909673669836}, "udem1-11-0": {"driven_any": 1.3365479889481684, "sim_physics": 0.17988536812666522, "survival_time": 8.649999999999988, "driven_lanedir": 1.2980818773379568, "sim_render-ego": 0.011752371154079549, "in-drivable-lane": 0, "agent_compute-ego": 0.04974809823008631, "deviation-heading": 1.2421090775396495, "set_robot_commands": 0.007788119288538233, "deviation-center-line": 0.29216145017048206, "driven_lanedir_consec": 1.2980818773379568, "sim_compute_sim_state": 0.00543415339695925, "sim_compute_performance-ego": 0.007124534232078949, "sim_compute_robot_state-ego": 0.00863864104871805, "sim_compute_robot_state-npc0": 0.008340364246699162, "sim_compute_robot_state-npc1": 0.007976930265481762, "sim_compute_robot_state-npc2": 0.00813584658451852, "sim_compute_robot_state-npc3": 0.007913488873167535}, "udem1-12-0": {"driven_any": 2.3491554427615498, "sim_physics": 0.16928290843963625, "survival_time": 14.950000000000076, "driven_lanedir": 2.1751166791160492, "sim_render-ego": 0.011827890078226726, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.04865442117055257, "deviation-heading": 1.7711946037926871, "set_robot_commands": 0.007669144471486409, "deviation-center-line": 1.073115036128073, "driven_lanedir_consec": 2.1751087917213385, "sim_compute_sim_state": 0.005181309382120768, "sim_compute_performance-ego": 0.007329785823822021, "sim_compute_robot_state-ego": 0.0085579252243042, "sim_compute_robot_state-npc0": 0.008254296779632568, "sim_compute_robot_state-npc1": 0.008001742362976074, "sim_compute_robot_state-npc2": 0.0080306077003479, "sim_compute_robot_state-npc3": 0.009238470395406088}, "udem1-13-0": {"driven_any": 1.770328431062021, "sim_physics": 0.20085034496458615, "survival_time": 11.350000000000026, "driven_lanedir": 1.426101909424539, "sim_render-ego": 0.01453914201207098, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.05775167973556183, "deviation-heading": 4.5077387368836215, "set_robot_commands": 0.008332181081897887, "deviation-center-line": 0.6942015144639536, "driven_lanedir_consec": 0.928597241447, "sim_compute_sim_state": 0.005259837348030527, "sim_compute_performance-ego": 0.0074111112939103585, "sim_compute_robot_state-ego": 0.009013042575987423, "sim_compute_robot_state-npc0": 0.008746281594431873, "sim_compute_robot_state-npc1": 0.00866371209400866, "sim_compute_robot_state-npc2": 0.008687347042403032, "sim_compute_robot_state-npc3": 0.008770514164727164}, "udem1-14-0": {"driven_any": 1.4731222420142276, "sim_physics": 0.1904036296041388, "survival_time": 9.5, "driven_lanedir": 1.3362091356434431, "sim_render-ego": 0.011874195149070338, "in-drivable-lane": 0, "agent_compute-ego": 0.05875605658480996, "deviation-heading": 2.7592225182673658, "set_robot_commands": 0.008051272442466334, "deviation-center-line": 0.8433156888118718, "driven_lanedir_consec": 0.5618513771666732, "sim_compute_sim_state": 0.005426871149163497, "sim_compute_performance-ego": 0.007040248419109144, "sim_compute_robot_state-ego": 0.008898228093197472, "sim_compute_robot_state-npc0": 0.008485326014066997, "sim_compute_robot_state-npc1": 0.007955808388559442, "sim_compute_robot_state-npc2": 0.00870243373670076, "sim_compute_robot_state-npc3": 0.008165771082827919}}
set_robot_commands_max0.00893955281440248
set_robot_commands_mean0.008165144228068844
set_robot_commands_median0.008065120379130045
set_robot_commands_min0.007669144471486409
sim_compute_performance-ego_max0.007612251440684001
sim_compute_performance-ego_mean0.007234811763531232
sim_compute_performance-ego_median0.007230577354659577
sim_compute_performance-ego_min0.00691463311513265
sim_compute_robot_state-ego_max0.009511607967010916
sim_compute_robot_state-ego_mean0.008880837167362713
sim_compute_robot_state-ego_median0.008898228093197472
sim_compute_robot_state-ego_min0.00833879550298055
sim_compute_robot_state-npc0_max0.00962660312652588
sim_compute_robot_state-npc0_mean0.008709837104560197
sim_compute_robot_state-npc0_median0.008643895785013834
sim_compute_robot_state-npc0_min0.008254296779632568
sim_compute_robot_state-npc1_max0.008740483125050862
sim_compute_robot_state-npc1_mean0.008336478333286318
sim_compute_robot_state-npc1_median0.008354595366944658
sim_compute_robot_state-npc1_min0.007955808388559442
sim_compute_robot_state-npc2_max0.008867979049682617
sim_compute_robot_state-npc2_mean0.008452716828003188
sim_compute_robot_state-npc2_median0.008475863933563232
sim_compute_robot_state-npc2_min0.007981564203898112
sim_compute_robot_state-npc3_max0.009238470395406088
sim_compute_robot_state-npc3_mean0.008421766082908337
sim_compute_robot_state-npc3_median0.008356690406799316
sim_compute_robot_state-npc3_min0.007913488873167535
sim_compute_sim_state_max0.00543415339695925
sim_compute_sim_state_mean0.0052910820558662265
sim_compute_sim_state_median0.0052984331896205146
sim_compute_sim_state_min0.005092089176177979
sim_physics_max0.22236956635566607
sim_physics_mean0.18350112750962944
sim_physics_median0.17897727966308594
sim_physics_min0.16620365460713704
sim_render-ego_max0.01453914201207098
sim_render-ego_mean0.01232874028999416
sim_render-ego_median0.012182941436767578
sim_render-ego_min0.01165524959564209
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.743333333333362
survival_time_min2.3499999999999996
No reset possible
27614step1-simulationerroryes0:03:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible