Duckietown Challenges Home Challenges Submissions

Submission 3216

Submission3216
Competingyes
Challengeaido2-LFV-sim-testing
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22528
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22528step1-simulationsuccessyes0:23:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.18558798053047873
agent_compute-ego_mean0.16771302538803143
agent_compute-ego_median0.16839048597547743
agent_compute-ego_min0.14556263111255788
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1841918539117884, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06669935915205213, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16640047232309976, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10531156151383012, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.041582712420710814, "sim_compute_performance-ego": 0.07146479906859221, "sim_compute_robot_state-ego": 0.07916772365570068, "sim_compute_robot_state-npc0": 0.07364228478184452, "sim_compute_robot_state-npc1": 0.07344466668588144, "sim_compute_robot_state-npc2": 0.07316720927203144, "sim_compute_robot_state-npc3": 0.07280545322983353}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21964591026306152, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.07006390571594238, "in-drivable-lane": 0, "agent_compute-ego": 0.17868724822998047, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10256429672241212, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.042442426681518555, "sim_compute_performance-ego": 0.07575247764587402, "sim_compute_robot_state-ego": 0.08479806900024414, "sim_compute_robot_state-npc0": 0.07886828422546387, "sim_compute_robot_state-npc1": 0.0771558952331543, "sim_compute_robot_state-npc2": 0.07662708282470704, "sim_compute_robot_state-npc3": 0.0742447566986084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2059096662621749, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0669531037932948, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.173457638213509, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10395438420145137, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04330487627732126, "sim_compute_performance-ego": 0.07568341179897911, "sim_compute_robot_state-ego": 0.08218082628752056, "sim_compute_robot_state-npc0": 0.07374032233890734, "sim_compute_robot_state-npc1": 0.07363101369456242, "sim_compute_robot_state-npc2": 0.07787485812839709, "sim_compute_robot_state-npc3": 0.0791799551562259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.20940720884105823, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06664753563796418, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16548979735072655, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10545239871061302, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04409139669394192, "sim_compute_performance-ego": 0.0730357592618918, "sim_compute_robot_state-ego": 0.0792756442782245, "sim_compute_robot_state-npc0": 0.07651343526719492, "sim_compute_robot_state-npc1": 0.07490334933317161, "sim_compute_robot_state-npc2": 0.07388515713848645, "sim_compute_robot_state-npc3": 0.07342706752728813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19379250492368424, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06942329236439296, "in-drivable-lane": 0, "agent_compute-ego": 0.15940514632633754, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10563452754701888, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04263894047055926, "sim_compute_performance-ego": 0.07317190510886055, "sim_compute_robot_state-ego": 0.08617837088448661, "sim_compute_robot_state-npc0": 0.07463194642748151, "sim_compute_robot_state-npc1": 0.07769771984645299, "sim_compute_robot_state-npc2": 0.07616837535585676, "sim_compute_robot_state-npc3": 0.07736774001802717}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16098683410220677, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.0560035264050519, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14556263111255788, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08803979555765788, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03694372265427201, "sim_compute_performance-ego": 0.06427836859667743, "sim_compute_robot_state-ego": 0.06916160053677028, "sim_compute_robot_state-npc0": 0.06520439518822564, "sim_compute_robot_state-npc1": 0.06269454073022913, "sim_compute_robot_state-npc2": 0.06127713786231147, "sim_compute_robot_state-npc3": 0.06319104742120814}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16885932286580405, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0614050582603172, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16021750149903474, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0971367800677264, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.041023435416045015, "sim_compute_performance-ego": 0.06656101897910789, "sim_compute_robot_state-ego": 0.06920925776163737, "sim_compute_robot_state-npc0": 0.06679706220273618, "sim_compute_robot_state-npc1": 0.06641137599945068, "sim_compute_robot_state-npc2": 0.06835721157215259, "sim_compute_robot_state-npc3": 0.06923619464591697}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.2293098025851779, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06963152355617946, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16839048597547743, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10285886128743488, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04301788542005751, "sim_compute_performance-ego": 0.07284389601813422, "sim_compute_robot_state-ego": 0.09412121772766112, "sim_compute_robot_state-npc0": 0.07714955541822645, "sim_compute_robot_state-npc1": 0.07568264537387424, "sim_compute_robot_state-npc2": 0.07439694404602051, "sim_compute_robot_state-npc3": 0.07163724369472928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18127056308414624, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06602502905804178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1767899990081787, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10118246078491212, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04395038666932479, "sim_compute_performance-ego": 0.07453404820483664, "sim_compute_robot_state-ego": 0.07869316702303679, "sim_compute_robot_state-npc0": 0.07440162741619608, "sim_compute_robot_state-npc1": 0.07183959691420845, "sim_compute_robot_state-npc2": 0.07199816081834876, "sim_compute_robot_state-npc3": 0.07250842322473941}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.22980791568756104, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06464943885803223, "in-drivable-lane": 0, "agent_compute-ego": 0.16442211151123046, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10584687232971192, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04356727600097656, "sim_compute_performance-ego": 0.07479335308074951, "sim_compute_robot_state-ego": 0.08168753623962402, "sim_compute_robot_state-npc0": 0.07355381965637207, "sim_compute_robot_state-npc1": 0.07346429347991944, "sim_compute_robot_state-npc2": 0.0725813341140747, "sim_compute_robot_state-npc3": 0.07424563884735108}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22942489385604856, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.059107851982116696, "in-drivable-lane": 0, "agent_compute-ego": 0.15398484468460083, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.0966774582862854, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04213227033615112, "sim_compute_performance-ego": 0.06652286052703857, "sim_compute_robot_state-ego": 0.07736668586730958, "sim_compute_robot_state-npc0": 0.06710387468338012, "sim_compute_robot_state-npc1": 0.068203604221344, "sim_compute_robot_state-npc2": 0.06819850206375122, "sim_compute_robot_state-npc3": 0.07170964479446411}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.22171833640650696, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0748570718263325, "in-drivable-lane": 0, "agent_compute-ego": 0.17415590035287956, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10918997463427092, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04681139243276496, "sim_compute_performance-ego": 0.07869623836718108, "sim_compute_robot_state-ego": 0.0873847760652241, "sim_compute_robot_state-npc0": 0.08446591778805382, "sim_compute_robot_state-npc1": 0.08519035891482704, "sim_compute_robot_state-npc2": 0.07840618334318462, "sim_compute_robot_state-npc3": 0.07815299536052503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.18161917209625245, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06906653881072998, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17349743843078613, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10214418888092042, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04325260162353515, "sim_compute_performance-ego": 0.07658947467803955, "sim_compute_robot_state-ego": 0.07686699390411376, "sim_compute_robot_state-npc0": 0.0738038969039917, "sim_compute_robot_state-npc1": 0.07555490493774414, "sim_compute_robot_state-npc2": 0.07496204853057861, "sim_compute_robot_state-npc3": 0.07585082530975341}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2331175370649858, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.07461444898085161, "in-drivable-lane": 0, "agent_compute-ego": 0.18558798053047873, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.11516994779760188, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.043981042775240814, "sim_compute_performance-ego": 0.0835910818793557, "sim_compute_robot_state-ego": 0.0879405520179055, "sim_compute_robot_state-npc0": 0.07471727241169322, "sim_compute_robot_state-npc1": 0.07754746350375089, "sim_compute_robot_state-npc2": 0.07853617451407692, "sim_compute_robot_state-npc3": 0.07768203995444557}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2333805415095115, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0749469873856525, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.169646185271594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10251868014432948, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04430532455444336, "sim_compute_performance-ego": 0.07606752064763284, "sim_compute_robot_state-ego": 0.08100746115859674, "sim_compute_robot_state-npc0": 0.07646169467848174, "sim_compute_robot_state-npc1": 0.07699213222581514, "sim_compute_robot_state-npc2": 0.07642358176562251, "sim_compute_robot_state-npc3": 0.07561824759658502}}
set_robot_commands_max0.11516994779760188
set_robot_commands_mean0.10291214589774512
set_robot_commands_median0.10285886128743488
set_robot_commands_min0.08803979555765788
sim_compute_performance-ego_max0.0835910818793557
sim_compute_performance-ego_mean0.07357241425753007
sim_compute_performance-ego_median0.07453404820483664
sim_compute_performance-ego_min0.06427836859667743
sim_compute_robot_state-ego_max0.09412121772766112
sim_compute_robot_state-ego_mean0.08100265882720371
sim_compute_robot_state-ego_median0.08100746115859674
sim_compute_robot_state-ego_min0.06916160053677028
sim_compute_robot_state-npc0_max0.08446591778805382
sim_compute_robot_state-npc0_mean0.07407035929254994
sim_compute_robot_state-npc0_median0.07440162741619608
sim_compute_robot_state-npc0_min0.06520439518822564
sim_compute_robot_state-npc1_max0.08519035891482704
sim_compute_robot_state-npc1_mean0.07402757073962575
sim_compute_robot_state-npc1_median0.07490334933317161
sim_compute_robot_state-npc1_min0.06269454073022913
sim_compute_robot_state-npc2_max0.07853617451407692
sim_compute_robot_state-npc2_mean0.0735239974233067
sim_compute_robot_state-npc2_median0.07439694404602051
sim_compute_robot_state-npc2_min0.06127713786231147
sim_compute_robot_state-npc3_max0.0791799551562259
sim_compute_robot_state-npc3_mean0.07379048489864674
sim_compute_robot_state-npc3_median0.0742447566986084
sim_compute_robot_state-npc3_min0.06319104742120814
sim_compute_sim_state_max0.04681139243276496
sim_compute_sim_state_mean0.042869712695124206
sim_compute_sim_state_median0.04325260162353515
sim_compute_sim_state_min0.03694372265427201
sim_physics_max0.2333805415095115
sim_physics_mean0.20549613756399793
sim_physics_median0.20940720884105823
sim_physics_min0.16098683410220677
sim_render-ego_max0.0749469873856525
sim_render-ego_mean0.0673396447857968
sim_render-ego_median0.0669531037932948
sim_render-ego_min0.0560035264050519
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible