Duckietown Challenges Home Challenges Submissions

Submission 5642

Submission5642
Competingyes
Challengeaido3-LFVI-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29126
Next
User label2019-12-05|FrankNet|v3
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
29126step1-simulationsuccessyes0:50:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.909899057915524
survival_time_median14.950000000000076
deviation-center-line_median0.9031663815535156
in-drivable-lane_median2.0999999999999925


other stats
agent_compute-ego_max0.05110248327255249
agent_compute-ego_mean0.048135567224949376
agent_compute-ego_median0.047996133092849974
agent_compute-ego_min0.04639836231867472
deviation-center-line_max1.1637033141191309
deviation-center-line_mean0.844741404460672
deviation-center-line_min0.3419882653880616
deviation-heading_max3.5637283490154443
deviation-heading_mean2.5423927068283656
deviation-heading_median2.616546431612351
deviation-heading_min0.968265671537506
driven_any_max6.704888495114097
driven_any_mean5.52568421777365
driven_any_median5.613074889637495
driven_any_min2.2171148435270727
driven_lanedir_consec_max5.853356914059951
driven_lanedir_consec_mean4.535656789768861
driven_lanedir_consec_min1.569479166351356
driven_lanedir_max5.853356914059951
driven_lanedir_mean4.704405637920883
driven_lanedir_median4.957244076142663
driven_lanedir_min1.5699075345420983
in-drivable-lane_max3.750000000000025
in-drivable-lane_mean1.8533333333333395
in-drivable-lane_min0.5000000000000036
per-episodes
details{"udem1-0-0": {"driven_any": 4.240273849508026, "sim_physics": 0.17981847018411715, "survival_time": 10.95000000000002, "driven_lanedir": 3.541445628147376, "sim_render-ego": 0.012453209863950128, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.049261270592746126, "deviation-heading": 1.263463173219492, "set_robot_commands": 0.00807605704216108, "deviation-center-line": 0.3419882653880616, "driven_lanedir_consec": 3.541445628147376, "sim_compute_sim_state": 0.005395553972078785, "sim_compute_performance-ego": 0.0072927540295744595, "sim_compute_robot_state-ego": 0.008975805212917938, "sim_compute_robot_state-npc0": 0.00868936216450173, "sim_compute_robot_state-npc1": 0.00830350727795466, "sim_compute_robot_state-npc2": 0.008434558023600817, "sim_compute_robot_state-npc3": 0.008360600362629651}, "udem1-1-0": {"driven_any": 5.587293441833433, "sim_physics": 0.1766165272394816, "survival_time": 14.950000000000076, "driven_lanedir": 4.776234145294383, "sim_render-ego": 0.012619759241739909, "in-drivable-lane": 2.150000000000004, "agent_compute-ego": 0.04639836231867472, "deviation-heading": 3.145064637725755, "set_robot_commands": 0.008120203018188476, "deviation-center-line": 0.8340619609441244, "driven_lanedir_consec": 4.350414717387762, "sim_compute_sim_state": 0.005390435059865316, "sim_compute_performance-ego": 0.007388648986816407, "sim_compute_robot_state-ego": 0.008861916065216064, "sim_compute_robot_state-npc0": 0.008660926024119059, "sim_compute_robot_state-npc1": 0.008656116326649983, "sim_compute_robot_state-npc2": 0.008684993584950765, "sim_compute_robot_state-npc3": 0.008526988824208577}, "udem1-2-0": {"driven_any": 6.185999719405455, "sim_physics": 0.16982340653737385, "survival_time": 14.950000000000076, "driven_lanedir": 4.41238179244205, "sim_render-ego": 0.012799447377522786, "in-drivable-lane": 3.250000000000012, "agent_compute-ego": 0.04665940761566162, "deviation-heading": 3.5637283490154443, "set_robot_commands": 0.008150197664896648, "deviation-center-line": 0.9031663815535156, "driven_lanedir_consec": 4.089945875318204, "sim_compute_sim_state": 0.005535436471303304, "sim_compute_performance-ego": 0.007742775281270345, "sim_compute_robot_state-ego": 0.009194453557332356, "sim_compute_robot_state-npc0": 0.008811397552490234, "sim_compute_robot_state-npc1": 0.008234850565592448, "sim_compute_robot_state-npc2": 0.008575087388356526, "sim_compute_robot_state-npc3": 0.008554084300994873}, "udem1-3-0": {"driven_any": 6.180122449856183, "sim_physics": 0.17983869632085164, "survival_time": 14.950000000000076, "driven_lanedir": 5.157434986087894, "sim_render-ego": 0.013537658850351969, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.04973769187927246, "deviation-heading": 2.172398931602744, "set_robot_commands": 0.008562700748443603, "deviation-center-line": 0.9638326866705892, "driven_lanedir_consec": 5.15662428156406, "sim_compute_sim_state": 0.005725914637247721, "sim_compute_performance-ego": 0.007914807796478272, "sim_compute_robot_state-ego": 0.009810460408528648, "sim_compute_robot_state-npc0": 0.009267117977142334, "sim_compute_robot_state-npc1": 0.008828083674112955, "sim_compute_robot_state-npc2": 0.008900461196899414, "sim_compute_robot_state-npc3": 0.008754134972890218}, "udem1-4-0": {"driven_any": 5.548528239148436, "sim_physics": 0.19030992485381465, "survival_time": 14.800000000000075, "driven_lanedir": 3.956317088387492, "sim_render-ego": 0.012995835897084827, "in-drivable-lane": 3.750000000000025, "agent_compute-ego": 0.048312634229660034, "deviation-heading": 3.2698479162687133, "set_robot_commands": 0.008481322108088312, "deviation-center-line": 0.8079818319843007, "driven_lanedir_consec": 3.5578670713974603, "sim_compute_sim_state": 0.0054135088985030715, "sim_compute_performance-ego": 0.0077759494652619235, "sim_compute_robot_state-ego": 0.009404031006065575, "sim_compute_robot_state-npc0": 0.00909637035550298, "sim_compute_robot_state-npc1": 0.008699267297177701, "sim_compute_robot_state-npc2": 0.00867758087209753, "sim_compute_robot_state-npc3": 0.008651868717090503}, "udem1-5-0": {"driven_any": 5.613074889637495, "sim_physics": 0.17615474303563436, "survival_time": 14.950000000000076, "driven_lanedir": 5.273735610148831, "sim_render-ego": 0.012789296309153238, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.04762397845586141, "deviation-heading": 2.4768826175472425, "set_robot_commands": 0.007905629475911459, "deviation-center-line": 0.908339829156524, "driven_lanedir_consec": 5.271452199219084, "sim_compute_sim_state": 0.005361230373382569, "sim_compute_performance-ego": 0.007730573813120524, "sim_compute_robot_state-ego": 0.008967955112457276, "sim_compute_robot_state-npc0": 0.00883299191792806, "sim_compute_robot_state-npc1": 0.008474140167236329, "sim_compute_robot_state-npc2": 0.008612786134084066, "sim_compute_robot_state-npc3": 0.008429051240285238}, "udem1-6-0": {"driven_any": 2.2171148435270727, "sim_physics": 0.15921543893359957, "survival_time": 6.299999999999986, "driven_lanedir": 1.5699075345420983, "sim_render-ego": 0.01358689959087069, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.047996133092849974, "deviation-heading": 0.968265671537506, "set_robot_commands": 0.008846858191111731, "deviation-center-line": 0.35550251774373004, "driven_lanedir_consec": 1.569479166351356, "sim_compute_sim_state": 0.005369589442298526, "sim_compute_performance-ego": 0.008101673353286017, "sim_compute_robot_state-ego": 0.009530035276261587, "sim_compute_robot_state-npc0": 0.008959238491361104, "sim_compute_robot_state-npc1": 0.00849699784838964, "sim_compute_robot_state-npc2": 0.008947111311412993, "sim_compute_robot_state-npc3": 0.00844280303470672}, "udem1-7-0": {"driven_any": 5.914833624780672, "sim_physics": 0.19378007729848223, "survival_time": 14.950000000000076, "driven_lanedir": 5.40577375309702, "sim_render-ego": 0.012754573027292888, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04804574171702067, "deviation-heading": 1.6767093390680246, "set_robot_commands": 0.008218858242034912, "deviation-center-line": 0.7794168078917937, "driven_lanedir_consec": 4.92091370756838, "sim_compute_sim_state": 0.00533314863840739, "sim_compute_performance-ego": 0.007497700850168864, "sim_compute_robot_state-ego": 0.00927048603693644, "sim_compute_robot_state-npc0": 0.008605636755625408, "sim_compute_robot_state-npc1": 0.008500226338704427, "sim_compute_robot_state-npc2": 0.008518186410268148, "sim_compute_robot_state-npc3": 0.008321074644724528}, "udem1-8-0": {"driven_any": 6.185090986342866, "sim_physics": 0.1752133051554362, "survival_time": 14.950000000000076, "driven_lanedir": 4.957244076142663, "sim_render-ego": 0.013088200092315674, "in-drivable-lane": 2.2000000000000144, "agent_compute-ego": 0.04709709882736206, "deviation-heading": 3.31178063973835, "set_robot_commands": 0.008263731002807617, "deviation-center-line": 1.001873387363887, "driven_lanedir_consec": 4.429210998793302, "sim_compute_sim_state": 0.005270332495371501, "sim_compute_performance-ego": 0.007862133979797363, "sim_compute_robot_state-ego": 0.00939719279607137, "sim_compute_robot_state-npc0": 0.00873309055964152, "sim_compute_robot_state-npc1": 0.008619024753570556, "sim_compute_robot_state-npc2": 0.008771585623423258, "sim_compute_robot_state-npc3": 0.008473218282063802}, "udem1-9-0": {"driven_any": 6.545989406492017, "sim_physics": 0.1894439466794332, "survival_time": 14.950000000000076, "driven_lanedir": 5.853356914059951, "sim_render-ego": 0.012947046756744384, "in-drivable-lane": 1.200000000000002, "agent_compute-ego": 0.04937246163686117, "deviation-heading": 2.8275134304039495, "set_robot_commands": 0.008460699717203776, "deviation-center-line": 0.992933666473614, "driven_lanedir_consec": 5.853356914059951, "sim_compute_sim_state": 0.00559742291768392, "sim_compute_performance-ego": 0.007884557247161866, "sim_compute_robot_state-ego": 0.00975738286972046, "sim_compute_robot_state-npc0": 0.009052929878234865, "sim_compute_robot_state-npc1": 0.008823525905609132, "sim_compute_robot_state-npc2": 0.008674697081247965, "sim_compute_robot_state-npc3": 0.009018447399139404}, "udem1-10-0": {"driven_any": 5.678456069822535, "sim_physics": 0.17020119269688924, "survival_time": 14.950000000000076, "driven_lanedir": 5.355469675941433, "sim_render-ego": 0.01298838456471761, "in-drivable-lane": 0.6000000000000032, "agent_compute-ego": 0.04799005111058553, "deviation-heading": 2.616546431612351, "set_robot_commands": 0.008210541407267253, "deviation-center-line": 1.1637033141191309, "driven_lanedir_consec": 5.355469675941433, "sim_compute_sim_state": 0.005345001220703125, "sim_compute_performance-ego": 0.007794868946075439, "sim_compute_robot_state-ego": 0.00922052303949992, "sim_compute_robot_state-npc0": 0.008790540695190429, "sim_compute_robot_state-npc1": 0.00858791430791219, "sim_compute_robot_state-npc2": 0.008552900155385335, "sim_compute_robot_state-npc3": 0.008378128210703531}, "udem1-11-0": {"driven_any": 5.196984916793209, "sim_physics": 0.18225656270980836, "survival_time": 14.950000000000076, "driven_lanedir": 4.354424332975018, "sim_render-ego": 0.01324287176132202, "in-drivable-lane": 2.150000000000013, "agent_compute-ego": 0.04722793420155843, "deviation-heading": 3.075708271641347, "set_robot_commands": 0.008376786708831787, "deviation-center-line": 0.7524367488511748, "driven_lanedir_consec": 4.339895959619517, "sim_compute_sim_state": 0.005581957499186198, "sim_compute_performance-ego": 0.007924698193868, "sim_compute_robot_state-ego": 0.009506981372833252, "sim_compute_robot_state-npc0": 0.00905858834584554, "sim_compute_robot_state-npc1": 0.008775780200958252, "sim_compute_robot_state-npc2": 0.009084495703379313, "sim_compute_robot_state-npc3": 0.008559335867563883}, "udem1-12-0": {"driven_any": 6.704888495114097, "sim_physics": 0.17525753021240234, "survival_time": 14.950000000000076, "driven_lanedir": 5.741879796528717, "sim_render-ego": 0.012777246634165448, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0464645258585612, "deviation-heading": 2.3562277197427037, "set_robot_commands": 0.008058500289916993, "deviation-center-line": 0.9879084523929672, "driven_lanedir_consec": 5.417586416269482, "sim_compute_sim_state": 0.0053214430809021, "sim_compute_performance-ego": 0.007532439231872559, "sim_compute_robot_state-ego": 0.009376074473063153, "sim_compute_robot_state-npc0": 0.008769292831420899, "sim_compute_robot_state-npc1": 0.008636800448099773, "sim_compute_robot_state-npc2": 0.008528733253479004, "sim_compute_robot_state-npc3": 0.00845749298731486}, "udem1-13-0": {"driven_any": 5.562319612646837, "sim_physics": 0.1804556131362915, "survival_time": 14.950000000000076, "driven_lanedir": 5.278896781683297, "sim_render-ego": 0.013327921231587728, "in-drivable-lane": 0.5000000000000036, "agent_compute-ego": 0.05110248327255249, "deviation-heading": 3.074015428329531, "set_robot_commands": 0.008448206583658854, "deviation-center-line": 0.8805792365592041, "driven_lanedir_consec": 5.271290176980033, "sim_compute_sim_state": 0.005492289861043294, "sim_compute_performance-ego": 0.008086828390757243, "sim_compute_robot_state-ego": 0.009760197003682454, "sim_compute_robot_state-npc0": 0.009065377712249755, "sim_compute_robot_state-npc1": 0.008942108949025472, "sim_compute_robot_state-npc2": 0.00918477694193522, "sim_compute_robot_state-npc3": 0.008969249725341797}, "udem1-14-0": {"driven_any": 5.52429272169642, "sim_physics": 0.18903939485549923, "survival_time": 14.950000000000076, "driven_lanedir": 4.931582453335027, "sim_render-ego": 0.013156886100769044, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.04874373356501261, "deviation-heading": 2.3377380449723235, "set_robot_commands": 0.008259190718332926, "deviation-center-line": 0.997395979817466, "driven_lanedir_consec": 4.909899057915524, "sim_compute_sim_state": 0.005754592418670654, "sim_compute_performance-ego": 0.008488574822743733, "sim_compute_robot_state-ego": 0.009531360467274983, "sim_compute_robot_state-npc0": 0.009045990308125812, "sim_compute_robot_state-npc1": 0.00876634915669759, "sim_compute_robot_state-npc2": 0.008842782179514567, "sim_compute_robot_state-npc3": 0.00876237710316976}}
set_robot_commands_max0.008846858191111731
set_robot_commands_mean0.008295965527923693
set_robot_commands_median0.008259190718332926
set_robot_commands_min0.007905629475911459
sim_compute_performance-ego_max0.008488574822743733
sim_compute_performance-ego_mean0.007801265625883533
sim_compute_performance-ego_median0.007794868946075439
sim_compute_performance-ego_min0.0072927540295744595
sim_compute_robot_state-ego_max0.009810460408528648
sim_compute_robot_state-ego_mean0.009370990313190766
sim_compute_robot_state-ego_median0.00939719279607137
sim_compute_robot_state-ego_min0.008861916065216064
sim_compute_robot_state-npc0_max0.009267117977142334
sim_compute_robot_state-npc0_mean0.008895923437958649
sim_compute_robot_state-npc0_median0.00883299191792806
sim_compute_robot_state-npc0_min0.008605636755625408
sim_compute_robot_state-npc1_max0.008942108949025472
sim_compute_robot_state-npc1_mean0.008622979547846073
sim_compute_robot_state-npc1_median0.008636800448099773
sim_compute_robot_state-npc1_min0.008234850565592448
sim_compute_robot_state-npc2_max0.00918477694193522
sim_compute_robot_state-npc2_mean0.008732715724002327
sim_compute_robot_state-npc2_median0.00867758087209753
sim_compute_robot_state-npc2_min0.008434558023600817
sim_compute_robot_state-npc3_max0.009018447399139404
sim_compute_robot_state-npc3_mean0.008577257044855157
sim_compute_robot_state-npc3_median0.008526988824208577
sim_compute_robot_state-npc3_min0.008321074644724528
sim_compute_sim_state_max0.005754592418670654
sim_compute_sim_state_mean0.005459190465776498
sim_compute_sim_state_median0.005395553972078785
sim_compute_sim_state_min0.005270332495371501
sim_physics_max0.19378007729848223
sim_physics_mean0.17916165532327433
sim_physics_median0.17981847018411715
sim_physics_min0.15921543893359957
sim_render-ego_max0.01358689959087069
sim_render-ego_mean0.013004349153305887
sim_render-ego_median0.01298838456471761
sim_render-ego_min0.012453209863950128
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.096666666666732
survival_time_min6.299999999999986
No reset possible
29116step1-simulationsuccessyes0:47:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29107step1-simulationerroryes0:43:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible