Duckietown Challenges Home Challenges Submissions

Submission 3371

Submission3371
Competingyes
Challengeaido2-LFVI-sim-testing
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23289
Next
User labelchallenge-aido_LF-template-random
Admin priority60
Blessingn/a
User priority60

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23289step1-simulationsuccessyes0:24:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1629484494527181
agent_compute-ego_mean0.15963028937625826
agent_compute-ego_median0.161068029746324
agent_compute-ego_min0.14594786680197414
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1252277983894831, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06258802776095233, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14594786680197414, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07953342606749715, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03743079644215258, "sim_compute_performance-ego": 0.06544481349896782, "sim_compute_robot_state-ego": 0.06529447700403913, "sim_compute_robot_state-npc0": 0.07118546208248863, "sim_compute_robot_state-npc1": 0.06751272044604338, "sim_compute_robot_state-npc2": 0.06676908082599882, "sim_compute_robot_state-npc3": 0.06585060493855537}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.12005534342357092, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06529641151428223, "in-drivable-lane": 0, "agent_compute-ego": 0.15505916731698172, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08048896278653826, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0420600346156529, "sim_compute_performance-ego": 0.06743182454790388, "sim_compute_robot_state-ego": 0.0653096182005746, "sim_compute_robot_state-npc0": 0.07384597403662545, "sim_compute_robot_state-npc1": 0.06819110257284981, "sim_compute_robot_state-npc2": 0.06930247374943324, "sim_compute_robot_state-npc3": 0.07006526844842094}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.12049130328650612, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0674398917596317, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16088173227402772, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08261076223503039, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04049987931853359, "sim_compute_performance-ego": 0.0689723352784092, "sim_compute_robot_state-ego": 0.06589487918372293, "sim_compute_robot_state-npc0": 0.07905219133617808, "sim_compute_robot_state-npc1": 0.0743841083304396, "sim_compute_robot_state-npc2": 0.07364645282041679, "sim_compute_robot_state-npc3": 0.07194781071931414}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.13356979688008627, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06937492887179057, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1617559790611267, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08371436099211375, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.042205060521761574, "sim_compute_performance-ego": 0.06959299246470134, "sim_compute_robot_state-ego": 0.06973591943581899, "sim_compute_robot_state-npc0": 0.07894423107306163, "sim_compute_robot_state-npc1": 0.08057087163130443, "sim_compute_robot_state-npc2": 0.07331401606400807, "sim_compute_robot_state-npc3": 0.0726335843404134}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.12901602472577775, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0692433516184489, "in-drivable-lane": 0, "agent_compute-ego": 0.1629484494527181, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08194610050746373, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.041876520429338725, "sim_compute_performance-ego": 0.0680872258685884, "sim_compute_robot_state-ego": 0.06611347198486328, "sim_compute_robot_state-npc0": 0.07801728021530878, "sim_compute_robot_state-npc1": 0.07539863813491095, "sim_compute_robot_state-npc2": 0.07883309182666597, "sim_compute_robot_state-npc3": 0.0721565428234282}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.12253830247296545, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06890964079759791, "in-drivable-lane": 2, "agent_compute-ego": 0.161068029746324, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.0816909652984071, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.040790108149637, "sim_compute_performance-ego": 0.07067379266202092, "sim_compute_robot_state-ego": 0.06591526334157247, "sim_compute_robot_state-npc0": 0.07817895969230972, "sim_compute_robot_state-npc1": 0.07378408152186228, "sim_compute_robot_state-npc2": 0.0733814510756624, "sim_compute_robot_state-npc3": 0.07214937952464212}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.1335912260037024, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06914781366737144, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16159158771477858, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.0825446948264409, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.045189813502783914, "sim_compute_performance-ego": 0.06993069695037546, "sim_compute_robot_state-ego": 0.0662460743802265, "sim_compute_robot_state-npc0": 0.07881450421601824, "sim_compute_robot_state-npc1": 0.07411215374770674, "sim_compute_robot_state-npc2": 0.0724372215641355, "sim_compute_robot_state-npc3": 0.07234476145031382}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.13654024600982667, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.07096753120422364, "in-drivable-lane": 0, "agent_compute-ego": 0.16066981315612794, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07971779823303222, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.04075984001159668, "sim_compute_performance-ego": 0.06815164089202881, "sim_compute_robot_state-ego": 0.06427773952484131, "sim_compute_robot_state-npc0": 0.07722917556762696, "sim_compute_robot_state-npc1": 0.07308873176574707, "sim_compute_robot_state-npc2": 0.07268391609191895, "sim_compute_robot_state-npc3": 0.0724925947189331}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.12095118027466994, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06785444571421696, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16189833329274103, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.08237473781292255, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.041576468027555026, "sim_compute_performance-ego": 0.07270431518554688, "sim_compute_robot_state-ego": 0.0682033896446228, "sim_compute_robot_state-npc0": 0.0772252999819242, "sim_compute_robot_state-npc1": 0.07219703380878155, "sim_compute_robot_state-npc2": 0.07107760356022762, "sim_compute_robot_state-npc3": 0.07377871641745934}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.1481232918225802, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06957806073702298, "in-drivable-lane": 0, "agent_compute-ego": 0.15823581585517296, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.08038830757141113, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.04223911578838642, "sim_compute_performance-ego": 0.07152973688565768, "sim_compute_robot_state-ego": 0.0695123764184805, "sim_compute_robot_state-npc0": 0.07846470062549298, "sim_compute_robot_state-npc1": 0.07729253402123085, "sim_compute_robot_state-npc2": 0.07345905670752892, "sim_compute_robot_state-npc3": 0.07244564019716702}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.12839656526392157, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.0693435777317394, "in-drivable-lane": 0, "agent_compute-ego": 0.159536058252508, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.08420003544200551, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03932211615822532, "sim_compute_performance-ego": 0.07360062815926292, "sim_compute_robot_state-ego": 0.06669389117847789, "sim_compute_robot_state-npc0": 0.07691568678075617, "sim_compute_robot_state-npc1": 0.0705544189973311, "sim_compute_robot_state-npc2": 0.07248531688343395, "sim_compute_robot_state-npc3": 0.07081639766693115}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.11554006576538084, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06819735050201416, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15949831962585448, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08101520538330079, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.042120380401611326, "sim_compute_performance-ego": 0.06797662258148193, "sim_compute_robot_state-ego": 0.06461921215057373, "sim_compute_robot_state-npc0": 0.07626969814300537, "sim_compute_robot_state-npc1": 0.07158577919006348, "sim_compute_robot_state-npc2": 0.07120477199554444, "sim_compute_robot_state-npc3": 0.0722083568572998}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1263508568418787, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06903107622836499, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1621416375992146, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.0823677879698733, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04093683780507838, "sim_compute_performance-ego": 0.07161745111993019, "sim_compute_robot_state-ego": 0.06705436554360897, "sim_compute_robot_state-npc0": 0.07942732090645648, "sim_compute_robot_state-npc1": 0.07416283577046495, "sim_compute_robot_state-npc2": 0.0720203531549332, "sim_compute_robot_state-npc3": 0.07210549395135109}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.12396160914347722, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06938882515980647, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16199670388148382, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.08014159936171311, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.042665719985961914, "sim_compute_performance-ego": 0.06963024689601018, "sim_compute_robot_state-ego": 0.06688347229590783, "sim_compute_robot_state-npc0": 0.0767315671994136, "sim_compute_robot_state-npc1": 0.07320162424674401, "sim_compute_robot_state-npc2": 0.07337201100129348, "sim_compute_robot_state-npc3": 0.07501921286949745}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1238079002925328, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06923779078892299, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.16122484661283948, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08137209074837821, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04197164944240025, "sim_compute_performance-ego": 0.0719964481535412, "sim_compute_robot_state-ego": 0.0673215321132115, "sim_compute_robot_state-npc0": 0.07870503834315709, "sim_compute_robot_state-npc1": 0.07534246217636835, "sim_compute_robot_state-npc2": 0.07283385140555246, "sim_compute_robot_state-npc3": 0.07358592124212356}}
set_robot_commands_max0.08420003544200551
set_robot_commands_mean0.08160712234907522
set_robot_commands_median0.0816909652984071
set_robot_commands_min0.07953342606749715
sim_compute_performance-ego_max0.07360062815926292
sim_compute_performance-ego_mean0.06982271807629513
sim_compute_performance-ego_median0.06963024689601018
sim_compute_performance-ego_min0.06544481349896782
sim_compute_robot_state-ego_max0.06973591943581899
sim_compute_robot_state-ego_mean0.0666050454933695
sim_compute_robot_state-ego_median0.0662460743802265
sim_compute_robot_state-ego_min0.06427773952484131
sim_compute_robot_state-npc0_max0.07942732090645648
sim_compute_robot_state-npc0_mean0.07726713934665487
sim_compute_robot_state-npc0_median0.07801728021530878
sim_compute_robot_state-npc0_min0.07118546208248863
sim_compute_robot_state-npc1_max0.08057087163130443
sim_compute_robot_state-npc1_mean0.07342527309078987
sim_compute_robot_state-npc1_median0.07378408152186228
sim_compute_robot_state-npc1_min0.06751272044604338
sim_compute_robot_state-npc2_max0.07883309182666597
sim_compute_robot_state-npc2_mean0.07245471124845025
sim_compute_robot_state-npc2_median0.07268391609191895
sim_compute_robot_state-npc2_min0.06676908082599882
sim_compute_robot_state-npc3_max0.07501921286949745
sim_compute_robot_state-npc3_mean0.07197335241105669
sim_compute_robot_state-npc3_median0.0722083568572998
sim_compute_robot_state-npc3_min0.06585060493855537
sim_compute_sim_state_max0.045189813502783914
sim_compute_sim_state_mean0.04144295604004504
sim_compute_sim_state_median0.041876520429338725
sim_compute_sim_state_min0.03743079644215258
sim_physics_max0.1481232918225802
sim_physics_mean0.12721076737309067
sim_physics_median0.1252277983894831
sim_physics_min0.11554006576538084
sim_render-ego_max0.07096753120422364
sim_render-ego_mean0.06837324827042578
sim_render-ego_median0.06914781366737144
sim_render-ego_min0.06258802776095233
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
22243step1-simulationsuccessyes0:27:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible