Duckietown Challenges Home Challenges Submissions

Submission 2475

Submission2475
Competingyes
Challengeaido2-LFVI-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22956
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22956step1-simulationsuccessyes0:30:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17412402413108133
agent_compute-ego_mean0.154200522948289
agent_compute-ego_median0.15538409162074962
agent_compute-ego_min0.1367428024995674
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1976207902159872, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06499857540372052, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15714134445673303, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09539934653270092, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03838699678831463, "sim_compute_performance-ego": 0.07084072390689125, "sim_compute_robot_state-ego": 0.07595160641247713, "sim_compute_robot_state-npc0": 0.07048926775968528, "sim_compute_robot_state-npc1": 0.0695547212528277, "sim_compute_robot_state-npc2": 0.06736355793627002, "sim_compute_robot_state-npc3": 0.07037203824972804}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.21309841530663623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06449314526149205, "in-drivable-lane": 0, "agent_compute-ego": 0.15793501479285105, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09220729555402483, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.037895781653268, "sim_compute_performance-ego": 0.07002625295094081, "sim_compute_robot_state-ego": 0.0764613321849278, "sim_compute_robot_state-npc0": 0.0741613336971828, "sim_compute_robot_state-npc1": 0.07300867353166852, "sim_compute_robot_state-npc2": 0.06749141216278076, "sim_compute_robot_state-npc3": 0.07262401069913592}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1626883224376197, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05630422101437467, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1367428024995674, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08527792541726122, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.034236391771186904, "sim_compute_performance-ego": 0.061607476577018074, "sim_compute_robot_state-ego": 0.06551192802132912, "sim_compute_robot_state-npc0": 0.060799036211180456, "sim_compute_robot_state-npc1": 0.05878972312779102, "sim_compute_robot_state-npc2": 0.061155664110646664, "sim_compute_robot_state-npc3": 0.05975306149825309}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2159754435221354, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06416038672129314, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1598391979932785, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.104247584939003, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04096456368764242, "sim_compute_performance-ego": 0.07105049987634023, "sim_compute_robot_state-ego": 0.07843329012393951, "sim_compute_robot_state-npc0": 0.07379781703154246, "sim_compute_robot_state-npc1": 0.07456512252489726, "sim_compute_robot_state-npc2": 0.07053802410761516, "sim_compute_robot_state-npc3": 0.06856083869934082}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20686836469741093, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06501991408211845, "in-drivable-lane": 0, "agent_compute-ego": 0.15108831723531088, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09848143940880186, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.037214438120524086, "sim_compute_performance-ego": 0.06889954067411877, "sim_compute_robot_state-ego": 0.07704061553591773, "sim_compute_robot_state-npc0": 0.06968956901913598, "sim_compute_robot_state-npc1": 0.06970491863432385, "sim_compute_robot_state-npc2": 0.07324177878243583, "sim_compute_robot_state-npc3": 0.06574911162966773}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19748681747984745, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.061960107552077245, "in-drivable-lane": 2, "agent_compute-ego": 0.1536810926334587, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09940130981856478, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03864911930289811, "sim_compute_performance-ego": 0.06944221079706432, "sim_compute_robot_state-ego": 0.07634277115325014, "sim_compute_robot_state-npc0": 0.07049134248744941, "sim_compute_robot_state-npc1": 0.07154752394396388, "sim_compute_robot_state-npc2": 0.0695460813488075, "sim_compute_robot_state-npc3": 0.06815689480947164}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.21045379036838568, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.062440603682138385, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15490249522681376, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09492462121167228, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042361095113661686, "sim_compute_performance-ego": 0.06800484888761946, "sim_compute_robot_state-ego": 0.07199583007293997, "sim_compute_robot_state-npc0": 0.0685471863422579, "sim_compute_robot_state-npc1": 0.06779961678588274, "sim_compute_robot_state-npc2": 0.06797658124016327, "sim_compute_robot_state-npc3": 0.0703975251577433}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2020800542831421, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.057714285850524905, "in-drivable-lane": 0, "agent_compute-ego": 0.14666602611541749, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09159983158111572, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.035182218551635745, "sim_compute_performance-ego": 0.06402599811553955, "sim_compute_robot_state-ego": 0.07185805797576904, "sim_compute_robot_state-npc0": 0.06508849143981933, "sim_compute_robot_state-npc1": 0.06432080745697022, "sim_compute_robot_state-npc2": 0.062427306175231935, "sim_compute_robot_state-npc3": 0.06356832027435302}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.18600991139045128, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06122112732667189, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15554557396815374, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10383522510528564, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.0384983649620643, "sim_compute_performance-ego": 0.06801757445702186, "sim_compute_robot_state-ego": 0.07101151576408973, "sim_compute_robot_state-npc0": 0.07218125691780677, "sim_compute_robot_state-npc1": 0.07134356865516076, "sim_compute_robot_state-npc2": 0.06903801056054923, "sim_compute_robot_state-npc3": 0.07186119831525363}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.21387430337759164, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.05978566866654616, "in-drivable-lane": 0, "agent_compute-ego": 0.14396708745222825, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09592940257145809, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0378116827744704, "sim_compute_performance-ego": 0.06246007405794584, "sim_compute_robot_state-ego": 0.07136213779449463, "sim_compute_robot_state-npc0": 0.0659338510953463, "sim_compute_robot_state-npc1": 0.06900202311002292, "sim_compute_robot_state-npc2": 0.06585023036369911, "sim_compute_robot_state-npc3": 0.06416451930999756}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.26939479871229693, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.0670692812312733, "in-drivable-lane": 0, "agent_compute-ego": 0.17412402413108133, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10279607772827148, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.041072997179898346, "sim_compute_performance-ego": 0.07821978222240102, "sim_compute_robot_state-ego": 0.09291907874020663, "sim_compute_robot_state-npc0": 0.07053936611522328, "sim_compute_robot_state-npc1": 0.0723455168984153, "sim_compute_robot_state-npc2": 0.0714555328542536, "sim_compute_robot_state-npc3": 0.07144856452941895}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1747810411453247, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06522799015045166, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15706328868865968, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09390983581542968, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.040579938888549806, "sim_compute_performance-ego": 0.07095235347747803, "sim_compute_robot_state-ego": 0.07363887310028076, "sim_compute_robot_state-npc0": 0.07171241760253906, "sim_compute_robot_state-npc1": 0.08314579486846924, "sim_compute_robot_state-npc2": 0.06951510429382324, "sim_compute_robot_state-npc3": 0.06935508728027344}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.19827670746661247, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.062242624607492, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15538409162074962, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.0961774765176976, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.038689912633692966, "sim_compute_performance-ego": 0.07077295222180954, "sim_compute_robot_state-ego": 0.07392407985443765, "sim_compute_robot_state-npc0": 0.06664836153070977, "sim_compute_robot_state-npc1": 0.06763570105775873, "sim_compute_robot_state-npc2": 0.06915657824658333, "sim_compute_robot_state-npc3": 0.06817178016013288}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.18926908419682428, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06027910801080557, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1504930487045875, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09145686259636512, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03880825868019691, "sim_compute_performance-ego": 0.0669540075155405, "sim_compute_robot_state-ego": 0.06970994747602023, "sim_compute_robot_state-npc0": 0.06733190554838914, "sim_compute_robot_state-npc1": 0.06543983862950252, "sim_compute_robot_state-npc2": 0.0670210260611314, "sim_compute_robot_state-npc3": 0.06858439628894512}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18919004031590053, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06201843080066499, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15843443870544432, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09789356277102516, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03961439586821056, "sim_compute_performance-ego": 0.06793211755298433, "sim_compute_robot_state-ego": 0.08054266203017461, "sim_compute_robot_state-npc0": 0.0719549156370617, "sim_compute_robot_state-npc1": 0.0717031683240618, "sim_compute_robot_state-npc2": 0.07114186286926269, "sim_compute_robot_state-npc3": 0.06973339262462798}}
set_robot_commands_max0.104247584939003
set_robot_commands_mean0.09623585317124518
set_robot_commands_median0.09592940257145809
set_robot_commands_min0.08527792541726122
sim_compute_performance-ego_max0.07821978222240102
sim_compute_performance-ego_mean0.06861376088604756
sim_compute_performance-ego_median0.06889954067411877
sim_compute_performance-ego_min0.061607476577018074
sim_compute_robot_state-ego_max0.09291907874020663
sim_compute_robot_state-ego_mean0.0751135817493503
sim_compute_robot_state-ego_median0.07392407985443765
sim_compute_robot_state-ego_min0.06551192802132912
sim_compute_robot_state-npc0_max0.0741613336971828
sim_compute_robot_state-npc0_mean0.06929107456235532
sim_compute_robot_state-npc0_median0.07048926775968528
sim_compute_robot_state-npc0_min0.060799036211180456
sim_compute_robot_state-npc1_max0.08314579486846924
sim_compute_robot_state-npc1_mean0.06999378125344775
sim_compute_robot_state-npc1_median0.06970491863432385
sim_compute_robot_state-npc1_min0.05878972312779102
sim_compute_robot_state-npc2_max0.07324177878243583
sim_compute_robot_state-npc2_mean0.06819458340755026
sim_compute_robot_state-npc2_median0.06903801056054923
sim_compute_robot_state-npc2_min0.061155664110646664
sim_compute_robot_state-npc3_max0.07262401069913592
sim_compute_robot_state-npc3_mean0.06816671596842289
sim_compute_robot_state-npc3_median0.06858439628894512
sim_compute_robot_state-npc3_min0.05975306149825309
sim_compute_sim_state_max0.042361095113661686
sim_compute_sim_state_mean0.03866441039841432
sim_compute_sim_state_median0.03864911930289811
sim_compute_sim_state_min0.034236391771186904
sim_physics_max0.26939479871229693
sim_physics_mean0.20180452566107773
sim_physics_median0.19827670746661247
sim_physics_min0.1626883224376197
sim_render-ego_max0.0670692812312733
sim_render-ego_mean0.062329031357442985
sim_render-ego_median0.062242624607492
sim_render-ego_min0.05630422101437467
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
21745step1-simulationsuccessno0:24:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21249step1-simulationsuccessno0:30:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20541step1-simulationsuccessno0:08:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19991step1-simulationsuccessno0:07:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19799step1-simulationsuccessno0:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19567step1-simulationsuccessno0:08:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18832step1-simulationsuccessno0:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18473step1-simulationsuccessno0:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17806step1-simulationsuccessno0:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17652step1-simulationsuccessno0:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible