Duckietown Challenges Home Challenges Submissions

Submission 2379

Submission2379
Competingyes
Challengeaido2-LFVI-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23018
Next
User labelminimal_agent_python2 (Python 2)
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23018step1-simulationsuccessyes0:20:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4674075261701268
survival_time_median3.699999999999995
deviation-center-line_median0.2037212999690195
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03325364806435325
agent_compute-ego_mean0.03248116808109725
agent_compute-ego_median0.03249249395155749
agent_compute-ego_min0.03171076625585556
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.2365365432439713
deviation-center-line_min0.1001276403534276
deviation-heading_max1.8192903310562811
deviation-heading_mean0.7195980419067693
deviation-heading_median0.5070424162880826
deviation-heading_min0.2495279988048577
driven_any_max2.764827318571964
driven_any_mean1.0818349506618754
driven_any_median1.0098273192909006
driven_any_min0.3648701917101222
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean0.759860328609196
driven_lanedir_consec_min0.3272146444894328
driven_lanedir_max1.9045033171069223
driven_lanedir_mean0.7732651243581526
driven_lanedir_median0.6173586051289615
driven_lanedir_min0.3272146444894328
in-drivable-lane_max3.7999999999999887
in-drivable-lane_mean0.8633333333333326
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.0745156563080109, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.03236122174305959, "in-drivable-lane": 0, "agent_compute-ego": 0.03265463983690416, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.0503698426323968, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.02011624542442528, "sim_compute_performance-ego": 0.03496484069136886, "sim_compute_robot_state-ego": 0.03762842298627974, "sim_compute_robot_state-npc0": 0.03583744195130494, "sim_compute_robot_state-npc1": 0.03586632926184852, "sim_compute_robot_state-npc2": 0.035856824737411364, "sim_compute_robot_state-npc3": 0.0356718956887185}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.07845770990526355, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.033194181081411, "in-drivable-lane": 0, "agent_compute-ego": 0.03251635061727988, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.04980333431346996, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.02019351237529033, "sim_compute_performance-ego": 0.03543474223162677, "sim_compute_robot_state-ego": 0.03666121250874287, "sim_compute_robot_state-npc0": 0.03604819967940047, "sim_compute_robot_state-npc1": 0.03637819032411318, "sim_compute_robot_state-npc2": 0.03577627362431707, "sim_compute_robot_state-npc3": 0.03522409619511785}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.07417537518684438, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.032225002516184424, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.03249249395155749, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.04979640284910897, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.020267006577245446, "sim_compute_performance-ego": 0.03495922783352681, "sim_compute_robot_state-ego": 0.036905681850104934, "sim_compute_robot_state-npc0": 0.035924575186723116, "sim_compute_robot_state-npc1": 0.035870032594693416, "sim_compute_robot_state-npc2": 0.03551517101313105, "sim_compute_robot_state-npc3": 0.035530475591192184}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.07485942815610876, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.03220597237192523, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.03318822695946818, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.04974684665340404, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.019947052001953125, "sim_compute_performance-ego": 0.03493750157780672, "sim_compute_robot_state-ego": 0.03710156335880619, "sim_compute_robot_state-npc0": 0.035641705178465516, "sim_compute_robot_state-npc1": 0.035823090538304514, "sim_compute_robot_state-npc2": 0.03584593628089466, "sim_compute_robot_state-npc3": 0.03538878675530718}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.07681906223297119, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.03885068744421005, "in-drivable-lane": 0, "agent_compute-ego": 0.03171076625585556, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.04921960085630417, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.020246252417564392, "sim_compute_performance-ego": 0.03485196828842163, "sim_compute_robot_state-ego": 0.03700580447912216, "sim_compute_robot_state-npc0": 0.036048732697963715, "sim_compute_robot_state-npc1": 0.035823799669742584, "sim_compute_robot_state-npc2": 0.03538917750120163, "sim_compute_robot_state-npc3": 0.03562343865633011}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.07560531814377029, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.0325054441179548, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.03228118512537572, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.04974115978587757, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.02013089130451153, "sim_compute_performance-ego": 0.03501032234786393, "sim_compute_robot_state-ego": 0.03754183224269322, "sim_compute_robot_state-npc0": 0.03613819085158311, "sim_compute_robot_state-npc1": 0.03584871973310198, "sim_compute_robot_state-npc2": 0.035907172537469244, "sim_compute_robot_state-npc3": 0.035959866139795876}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.08429012876568419, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.032016566305449516, "in-drivable-lane": 0, "agent_compute-ego": 0.03210632006327311, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.05069940740411931, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.020017732273448597, "sim_compute_performance-ego": 0.035054069576841415, "sim_compute_robot_state-ego": 0.03721287395014907, "sim_compute_robot_state-npc0": 0.03573886914686723, "sim_compute_robot_state-npc1": 0.03514311169133042, "sim_compute_robot_state-npc2": 0.03541539293346983, "sim_compute_robot_state-npc3": 0.03537081227158055}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.08329488780047442, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.032906983349774335, "in-drivable-lane": 0, "agent_compute-ego": 0.03230967714979842, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.049454150973139585, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.020055413246154785, "sim_compute_performance-ego": 0.034874278145867424, "sim_compute_robot_state-ego": 0.03645615319947939, "sim_compute_robot_state-npc0": 0.036023574906426506, "sim_compute_robot_state-npc1": 0.03639141933338062, "sim_compute_robot_state-npc2": 0.035136261501827755, "sim_compute_robot_state-npc3": 0.03566246741526836}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.07417799631754557, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.03232115109761556, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.03224224726359049, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.04958165168762207, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.01997259775797526, "sim_compute_performance-ego": 0.03564883550008138, "sim_compute_robot_state-ego": 0.03666954676310221, "sim_compute_robot_state-npc0": 0.03607378641764323, "sim_compute_robot_state-npc1": 0.035685946146647135, "sim_compute_robot_state-npc2": 0.03681977907816569, "sim_compute_robot_state-npc3": 0.03548841794331869}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.08800168939538904, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.03270205291541847, "in-drivable-lane": 0, "agent_compute-ego": 0.03261435998452676, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.05241576400963035, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.02051653733124604, "sim_compute_performance-ego": 0.03505168089995513, "sim_compute_robot_state-ego": 0.03714143907701647, "sim_compute_robot_state-npc0": 0.0360848517031283, "sim_compute_robot_state-npc1": 0.03589751913740828, "sim_compute_robot_state-npc2": 0.03582440840231406, "sim_compute_robot_state-npc3": 0.035611867904663086}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.07976305869317823, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.033283695097892516, "in-drivable-lane": 0, "agent_compute-ego": 0.032740116119384766, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.050033015589560234, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.02035190213111139, "sim_compute_performance-ego": 0.035315490538074125, "sim_compute_robot_state-ego": 0.03675145487631521, "sim_compute_robot_state-npc0": 0.03580281811375772, "sim_compute_robot_state-npc1": 0.035977778896208734, "sim_compute_robot_state-npc2": 0.03605051194467852, "sim_compute_robot_state-npc3": 0.03647822718466482}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.0765990649952608, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.032596987836501175, "in-drivable-lane": 0, "agent_compute-ego": 0.032210770775290096, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.0509188455693862, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.020020071197958553, "sim_compute_performance-ego": 0.03494712885688333, "sim_compute_robot_state-ego": 0.037166714668273926, "sim_compute_robot_state-npc0": 0.03556365125319537, "sim_compute_robot_state-npc1": 0.03597136806039249, "sim_compute_robot_state-npc2": 0.03540610565858729, "sim_compute_robot_state-npc3": 0.035819011576035446}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.0788203375680106, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.03307132266816639, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.03251548494611468, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.050716456912812735, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.020835985456194195, "sim_compute_performance-ego": 0.03617973554702032, "sim_compute_robot_state-ego": 0.03723642712547665, "sim_compute_robot_state-npc0": 0.037023700986589705, "sim_compute_robot_state-npc1": 0.03657564889817011, "sim_compute_robot_state-npc2": 0.03627385866074335, "sim_compute_robot_state-npc3": 0.03619758061000279}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.0743726671558537, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.03265874679774454, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.032381234103686186, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.049474980733166, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.020176982226437084, "sim_compute_performance-ego": 0.03520908094432256, "sim_compute_robot_state-ego": 0.03739174098184664, "sim_compute_robot_state-npc0": 0.03607236522517792, "sim_compute_robot_state-npc1": 0.035593029570906126, "sim_compute_robot_state-npc2": 0.03538371438849462, "sim_compute_robot_state-npc3": 0.03540828783218175}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.08021905476396735, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.03222511031410911, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.03325364806435325, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.050864347002723, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.01981769095767628, "sim_compute_performance-ego": 0.03505371917377819, "sim_compute_robot_state-ego": 0.03682995384389704, "sim_compute_robot_state-npc0": 0.03555477478287437, "sim_compute_robot_state-npc1": 0.03556106307289817, "sim_compute_robot_state-npc2": 0.0361792499368841, "sim_compute_robot_state-npc3": 0.0358753962950273}}
set_robot_commands_max0.05241576400963035
set_robot_commands_mean0.0501890537981814
set_robot_commands_median0.04980333431346996
set_robot_commands_min0.04921960085630417
sim_compute_performance-ego_max0.03617973554702032
sim_compute_performance-ego_mean0.03516617481022924
sim_compute_performance-ego_median0.03505168089995513
sim_compute_performance-ego_min0.03485196828842163
sim_compute_robot_state-ego_max0.03762842298627974
sim_compute_robot_state-ego_mean0.03704672146075372
sim_compute_robot_state-ego_median0.03710156335880619
sim_compute_robot_state-ego_min0.03645615319947939
sim_compute_robot_state-npc0_max0.037023700986589705
sim_compute_robot_state-npc0_mean0.03597181587207342
sim_compute_robot_state-npc0_median0.036023574906426506
sim_compute_robot_state-npc0_min0.03555477478287437
sim_compute_robot_state-npc1_max0.03657564889817011
sim_compute_robot_state-npc1_mean0.03589380312860976
sim_compute_robot_state-npc1_median0.03586632926184852
sim_compute_robot_state-npc1_min0.03514311169133042
sim_compute_robot_state-npc2_max0.03681977907816569
sim_compute_robot_state-npc2_mean0.035785322546639346
sim_compute_robot_state-npc2_median0.03582440840231406
sim_compute_robot_state-npc2_min0.035136261501827755
sim_compute_robot_state-npc3_max0.03647822718466482
sim_compute_robot_state-npc3_mean0.035687375203946964
sim_compute_robot_state-npc3_median0.03562343865633011
sim_compute_robot_state-npc3_min0.03522409619511785
sim_compute_sim_state_max0.020835985456194195
sim_compute_sim_state_mean0.020177724845279486
sim_compute_sim_state_median0.02013089130451153
sim_compute_sim_state_min0.01981769095767628
sim_physics_max0.08800168939538904
sim_physics_mean0.07826476235922221
sim_physics_median0.07681906223297119
sim_physics_min0.07417537518684438
sim_render-ego_max0.03885068744421005
sim_render-ego_mean0.03300834171049445
sim_render-ego_median0.032596987836501175
sim_render-ego_min0.032016566305449516
simulation-passed1
survival_time_max9.55
survival_time_mean3.939999999999995
survival_time_min1.5500000000000007
No reset possible