Duckietown Challenges Home Challenges Submissions

Submission 2475

Submission2475
Competingyes
Challengeaido2-LFVI-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22956
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22956step1-simulationsuccessyes0:30:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17412402413108133
agent_compute-ego_mean0.154200522948289
agent_compute-ego_median0.15538409162074962
agent_compute-ego_min0.1367428024995674
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1976207902159872, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06499857540372052, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15714134445673303, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09539934653270092, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03838699678831463, "sim_compute_performance-ego": 0.07084072390689125, "sim_compute_robot_state-ego": 0.07595160641247713, "sim_compute_robot_state-npc0": 0.07048926775968528, "sim_compute_robot_state-npc1": 0.0695547212528277, "sim_compute_robot_state-npc2": 0.06736355793627002, "sim_compute_robot_state-npc3": 0.07037203824972804}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.21309841530663623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06449314526149205, "in-drivable-lane": 0, "agent_compute-ego": 0.15793501479285105, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09220729555402483, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.037895781653268, "sim_compute_performance-ego": 0.07002625295094081, "sim_compute_robot_state-ego": 0.0764613321849278, "sim_compute_robot_state-npc0": 0.0741613336971828, "sim_compute_robot_state-npc1": 0.07300867353166852, "sim_compute_robot_state-npc2": 0.06749141216278076, "sim_compute_robot_state-npc3": 0.07262401069913592}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1626883224376197, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05630422101437467, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1367428024995674, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08527792541726122, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.034236391771186904, "sim_compute_performance-ego": 0.061607476577018074, "sim_compute_robot_state-ego": 0.06551192802132912, "sim_compute_robot_state-npc0": 0.060799036211180456, "sim_compute_robot_state-npc1": 0.05878972312779102, "sim_compute_robot_state-npc2": 0.061155664110646664, "sim_compute_robot_state-npc3": 0.05975306149825309}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2159754435221354, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06416038672129314, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1598391979932785, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.104247584939003, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04096456368764242, "sim_compute_performance-ego": 0.07105049987634023, "sim_compute_robot_state-ego": 0.07843329012393951, "sim_compute_robot_state-npc0": 0.07379781703154246, "sim_compute_robot_state-npc1": 0.07456512252489726, "sim_compute_robot_state-npc2": 0.07053802410761516, "sim_compute_robot_state-npc3": 0.06856083869934082}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20686836469741093, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06501991408211845, "in-drivable-lane": 0, "agent_compute-ego": 0.15108831723531088, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09848143940880186, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.037214438120524086, "sim_compute_performance-ego": 0.06889954067411877, "sim_compute_robot_state-ego": 0.07704061553591773, "sim_compute_robot_state-npc0": 0.06968956901913598, "sim_compute_robot_state-npc1": 0.06970491863432385, "sim_compute_robot_state-npc2": 0.07324177878243583, "sim_compute_robot_state-npc3": 0.06574911162966773}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19748681747984745, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.061960107552077245, "in-drivable-lane": 2, "agent_compute-ego": 0.1536810926334587, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09940130981856478, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03864911930289811, "sim_compute_performance-ego": 0.06944221079706432, "sim_compute_robot_state-ego": 0.07634277115325014, "sim_compute_robot_state-npc0": 0.07049134248744941, "sim_compute_robot_state-npc1": 0.07154752394396388, "sim_compute_robot_state-npc2": 0.0695460813488075, "sim_compute_robot_state-npc3": 0.06815689480947164}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.21045379036838568, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.062440603682138385, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15490249522681376, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09492462121167228, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042361095113661686, "sim_compute_performance-ego": 0.06800484888761946, "sim_compute_robot_state-ego": 0.07199583007293997, "sim_compute_robot_state-npc0": 0.0685471863422579, "sim_compute_robot_state-npc1": 0.06779961678588274, "sim_compute_robot_state-npc2": 0.06797658124016327, "sim_compute_robot_state-npc3": 0.0703975251577433}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2020800542831421, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.057714285850524905, "in-drivable-lane": 0, "agent_compute-ego": 0.14666602611541749, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09159983158111572, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.035182218551635745, "sim_compute_performance-ego": 0.06402599811553955, "sim_compute_robot_state-ego": 0.07185805797576904, "sim_compute_robot_state-npc0": 0.06508849143981933, "sim_compute_robot_state-npc1": 0.06432080745697022, "sim_compute_robot_state-npc2": 0.062427306175231935, "sim_compute_robot_state-npc3": 0.06356832027435302}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.18600991139045128, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06122112732667189, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15554557396815374, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10383522510528564, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.0384983649620643, "sim_compute_performance-ego": 0.06801757445702186, "sim_compute_robot_state-ego": 0.07101151576408973, "sim_compute_robot_state-npc0": 0.07218125691780677, "sim_compute_robot_state-npc1": 0.07134356865516076, "sim_compute_robot_state-npc2": 0.06903801056054923, "sim_compute_robot_state-npc3": 0.07186119831525363}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.21387430337759164, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.05978566866654616, "in-drivable-lane": 0, "agent_compute-ego": 0.14396708745222825, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09592940257145809, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0378116827744704, "sim_compute_performance-ego": 0.06246007405794584, "sim_compute_robot_state-ego": 0.07136213779449463, "sim_compute_robot_state-npc0": 0.0659338510953463, "sim_compute_robot_state-npc1": 0.06900202311002292, "sim_compute_robot_state-npc2": 0.06585023036369911, "sim_compute_robot_state-npc3": 0.06416451930999756}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.26939479871229693, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.0670692812312733, "in-drivable-lane": 0, "agent_compute-ego": 0.17412402413108133, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10279607772827148, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.041072997179898346, "sim_compute_performance-ego": 0.07821978222240102, "sim_compute_robot_state-ego": 0.09291907874020663, "sim_compute_robot_state-npc0": 0.07053936611522328, "sim_compute_robot_state-npc1": 0.0723455168984153, "sim_compute_robot_state-npc2": 0.0714555328542536, "sim_compute_robot_state-npc3": 0.07144856452941895}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1747810411453247, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06522799015045166, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15706328868865968, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09390983581542968, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.040579938888549806, "sim_compute_performance-ego": 0.07095235347747803, "sim_compute_robot_state-ego": 0.07363887310028076, "sim_compute_robot_state-npc0": 0.07171241760253906, "sim_compute_robot_state-npc1": 0.08314579486846924, "sim_compute_robot_state-npc2": 0.06951510429382324, "sim_compute_robot_state-npc3": 0.06935508728027344}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.19827670746661247, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.062242624607492, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15538409162074962, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.0961774765176976, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.038689912633692966, "sim_compute_performance-ego": 0.07077295222180954, "sim_compute_robot_state-ego": 0.07392407985443765, "sim_compute_robot_state-npc0": 0.06664836153070977, "sim_compute_robot_state-npc1": 0.06763570105775873, "sim_compute_robot_state-npc2": 0.06915657824658333, "sim_compute_robot_state-npc3": 0.06817178016013288}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.18926908419682428, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06027910801080557, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1504930487045875, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09145686259636512, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03880825868019691, "sim_compute_performance-ego": 0.0669540075155405, "sim_compute_robot_state-ego": 0.06970994747602023, "sim_compute_robot_state-npc0": 0.06733190554838914, "sim_compute_robot_state-npc1": 0.06543983862950252, "sim_compute_robot_state-npc2": 0.0670210260611314, "sim_compute_robot_state-npc3": 0.06858439628894512}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18919004031590053, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06201843080066499, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15843443870544432, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09789356277102516, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03961439586821056, "sim_compute_performance-ego": 0.06793211755298433, "sim_compute_robot_state-ego": 0.08054266203017461, "sim_compute_robot_state-npc0": 0.0719549156370617, "sim_compute_robot_state-npc1": 0.0717031683240618, "sim_compute_robot_state-npc2": 0.07114186286926269, "sim_compute_robot_state-npc3": 0.06973339262462798}}
set_robot_commands_max0.104247584939003
set_robot_commands_mean0.09623585317124518
set_robot_commands_median0.09592940257145809
set_robot_commands_min0.08527792541726122
sim_compute_performance-ego_max0.07821978222240102
sim_compute_performance-ego_mean0.06861376088604756
sim_compute_performance-ego_median0.06889954067411877
sim_compute_performance-ego_min0.061607476577018074
sim_compute_robot_state-ego_max0.09291907874020663
sim_compute_robot_state-ego_mean0.0751135817493503
sim_compute_robot_state-ego_median0.07392407985443765
sim_compute_robot_state-ego_min0.06551192802132912
sim_compute_robot_state-npc0_max0.0741613336971828
sim_compute_robot_state-npc0_mean0.06929107456235532
sim_compute_robot_state-npc0_median0.07048926775968528
sim_compute_robot_state-npc0_min0.060799036211180456
sim_compute_robot_state-npc1_max0.08314579486846924
sim_compute_robot_state-npc1_mean0.06999378125344775
sim_compute_robot_state-npc1_median0.06970491863432385
sim_compute_robot_state-npc1_min0.05878972312779102
sim_compute_robot_state-npc2_max0.07324177878243583
sim_compute_robot_state-npc2_mean0.06819458340755026
sim_compute_robot_state-npc2_median0.06903801056054923
sim_compute_robot_state-npc2_min0.061155664110646664
sim_compute_robot_state-npc3_max0.07262401069913592
sim_compute_robot_state-npc3_mean0.06816671596842289
sim_compute_robot_state-npc3_median0.06858439628894512
sim_compute_robot_state-npc3_min0.05975306149825309
sim_compute_sim_state_max0.042361095113661686
sim_compute_sim_state_mean0.03866441039841432
sim_compute_sim_state_median0.03864911930289811
sim_compute_sim_state_min0.034236391771186904
sim_physics_max0.26939479871229693
sim_physics_mean0.20180452566107773
sim_physics_median0.19827670746661247
sim_physics_min0.1626883224376197
sim_render-ego_max0.0670692812312733
sim_render-ego_mean0.062329031357442985
sim_render-ego_median0.062242624607492
sim_render-ego_min0.05630422101437467
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible