Duckietown Challenges Home Challenges Submissions

Submission 2385

Submission2385
Competingyes
Challengeaido2-LFV-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23014
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23014step1-simulationsuccessyes0:44:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08510334771231687
survival_time_median1.7000000000000008
deviation-center-line_median0.1022089282560985
in-drivable-lane_median0.6500000000000006


other stats
agent_compute-ego_max0.18321098731114313
agent_compute-ego_mean0.14787584059083192
agent_compute-ego_median0.1694653188028643
agent_compute-ego_min0.09736391992279976
deviation-center-line_max0.513472697884007
deviation-center-line_mean0.19020199254672968
deviation-center-line_min0.027282485519790952
deviation-heading_max6.048475674802702
deviation-heading_mean2.641030814102052
deviation-heading_median0.7104917115254321
deviation-heading_min0.5341655512814498
driven_any_max1.602593678184747
driven_any_mean0.6579026318465446
driven_any_median0.15818326346729497
driven_any_min0.10299023933601764
driven_lanedir_consec_max0.578861969252721
driven_lanedir_consec_mean0.2289687251306853
driven_lanedir_consec_min0.03700417373868914
driven_lanedir_max0.578861969252721
driven_lanedir_mean0.2289687251306853
driven_lanedir_median0.08510334771231687
driven_lanedir_min0.03700417373868914
in-drivable-lane_max7.35000000000004
in-drivable-lane_mean3.0133333333333434
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.700897181079569, "sim_physics": 0.17242584712263467, "survival_time": 6.8999999999999835, "driven_lanedir": 0.21518492532445463, "sim_render-ego": 0.06404490920080655, "in-drivable-lane": 3.1499999999999932, "agent_compute-ego": 0.1770435917204705, "deviation-heading": 2.762872247408002, "set_robot_commands": 0.10015040204144908, "deviation-center-line": 0.14176458768376918, "driven_lanedir_consec": 0.21518492532445463, "sim_compute_sim_state": 0.040238532467164856, "sim_compute_performance-ego": 0.0695452862891598, "sim_compute_robot_state-ego": 0.07766435111778369, "sim_compute_robot_state-npc0": 0.0707142508548239, "sim_compute_robot_state-npc1": 0.07072856288025345, "sim_compute_robot_state-npc2": 0.0716051485227502, "sim_compute_robot_state-npc3": 0.07175904944323111}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4705121448738985, "sim_physics": 0.15926894982655845, "survival_time": 14.950000000000076, "driven_lanedir": 0.4913132136120972, "sim_render-ego": 0.06097488244374593, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.17119683742523192, "deviation-heading": 6.048475674802702, "set_robot_commands": 0.0966720978418986, "deviation-center-line": 0.48028821544328026, "driven_lanedir_consec": 0.4913132136120972, "sim_compute_sim_state": 0.03833464860916138, "sim_compute_performance-ego": 0.06718165079752604, "sim_compute_robot_state-ego": 0.0740491493542989, "sim_compute_robot_state-npc0": 0.06872492074966431, "sim_compute_robot_state-npc1": 0.06765748739242554, "sim_compute_robot_state-npc2": 0.06775407393773397, "sim_compute_robot_state-npc3": 0.06815799395243327}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12342779812560144, "sim_physics": 0.18746387041532075, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08510334771231687, "sim_render-ego": 0.06043379123394306, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18321098731114313, "deviation-heading": 0.6594187057635568, "set_robot_commands": 0.09800202112931472, "deviation-center-line": 0.1105180042874409, "driven_lanedir_consec": 0.08510334771231687, "sim_compute_sim_state": 0.03722010209010197, "sim_compute_performance-ego": 0.06870752114516038, "sim_compute_robot_state-ego": 0.07410848140716553, "sim_compute_robot_state-npc0": 0.06977247274838962, "sim_compute_robot_state-npc1": 0.06514666630671574, "sim_compute_robot_state-npc2": 0.06438927467052753, "sim_compute_robot_state-npc3": 0.06716190851651706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1418542106144053, "sim_physics": 0.19347522335667763, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07484867868460032, "sim_render-ego": 0.0656819958840647, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1694653188028643, "deviation-heading": 0.5625883392197477, "set_robot_commands": 0.0959558948393791, "deviation-center-line": 0.08746265469157435, "driven_lanedir_consec": 0.07484867868460032, "sim_compute_sim_state": 0.041789062561527375, "sim_compute_performance-ego": 0.07379547242195375, "sim_compute_robot_state-ego": 0.07280676595626338, "sim_compute_robot_state-npc0": 0.07201392419876591, "sim_compute_robot_state-npc1": 0.07295213976214009, "sim_compute_robot_state-npc2": 0.07288726683585875, "sim_compute_robot_state-npc3": 0.0730674882088938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6565742911863668, "sim_physics": 0.1665616982123431, "survival_time": 6.799999999999984, "driven_lanedir": 0.22369468807928392, "sim_render-ego": 0.06329913875635933, "in-drivable-lane": 3.0499999999999936, "agent_compute-ego": 0.17424308201845953, "deviation-heading": 2.872172155748011, "set_robot_commands": 0.0952127102543326, "deviation-center-line": 0.1022089282560985, "driven_lanedir_consec": 0.22369468807928392, "sim_compute_sim_state": 0.04000440765829647, "sim_compute_performance-ego": 0.07093148021137013, "sim_compute_robot_state-ego": 0.07476611172451693, "sim_compute_robot_state-npc0": 0.07003468625685748, "sim_compute_robot_state-npc1": 0.06945035212180194, "sim_compute_robot_state-npc2": 0.06976432484738967, "sim_compute_robot_state-npc3": 0.07049627514446483}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5534133603380018, "sim_physics": 0.16854915142059326, "survival_time": 14.950000000000076, "driven_lanedir": 0.47820139478128487, "sim_render-ego": 0.06431814432144164, "in-drivable-lane": 7.350000000000034, "agent_compute-ego": 0.17384034872055054, "deviation-heading": 5.650546769826332, "set_robot_commands": 0.09747639417648316, "deviation-center-line": 0.2902328148140882, "driven_lanedir_consec": 0.47820139478128487, "sim_compute_sim_state": 0.0396053155263265, "sim_compute_performance-ego": 0.07070090373357137, "sim_compute_robot_state-ego": 0.07669894059499105, "sim_compute_robot_state-npc0": 0.07053784847259521, "sim_compute_robot_state-npc1": 0.07007915576299031, "sim_compute_robot_state-npc2": 0.07008890151977538, "sim_compute_robot_state-npc3": 0.07003012975056966}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11018966052696016, "sim_physics": 0.17281080114430394, "survival_time": 1.4500000000000006, "driven_lanedir": 0.03700417373868914, "sim_render-ego": 0.061558887876313306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16474752590574068, "deviation-heading": 0.5935942134064083, "set_robot_commands": 0.09417450839075547, "deviation-center-line": 0.058094519106512664, "driven_lanedir_consec": 0.03700417373868914, "sim_compute_sim_state": 0.0381328401894405, "sim_compute_performance-ego": 0.06756800618664972, "sim_compute_robot_state-ego": 0.0696926528009875, "sim_compute_robot_state-npc0": 0.06949074514980974, "sim_compute_robot_state-npc1": 0.06752959613142342, "sim_compute_robot_state-npc2": 0.07015520950843548, "sim_compute_robot_state-npc3": 0.0677480779845139}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11939190393472694, "sim_physics": 0.1731755661241936, "survival_time": 1.6500000000000008, "driven_lanedir": 0.046772363860278166, "sim_render-ego": 0.0577561566323945, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1722210320559415, "deviation-heading": 0.5341655512814498, "set_robot_commands": 0.09646473508892638, "deviation-center-line": 0.06663161104884709, "driven_lanedir_consec": 0.046772363860278166, "sim_compute_sim_state": 0.036692417029178505, "sim_compute_performance-ego": 0.06667328603339917, "sim_compute_robot_state-ego": 0.0723239364046039, "sim_compute_robot_state-npc0": 0.06689200979290587, "sim_compute_robot_state-npc1": 0.0698244571685791, "sim_compute_robot_state-npc2": 0.06921179366834236, "sim_compute_robot_state-npc3": 0.06903795762495561}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.602593678184747, "sim_physics": 0.16138318538665772, "survival_time": 14.950000000000076, "driven_lanedir": 0.578861969252721, "sim_render-ego": 0.06337691783905029, "in-drivable-lane": 6.950000000000033, "agent_compute-ego": 0.17444109360376994, "deviation-heading": 5.7249003617368865, "set_robot_commands": 0.09778342962265014, "deviation-center-line": 0.3860329098478613, "driven_lanedir_consec": 0.578861969252721, "sim_compute_sim_state": 0.03936089277267456, "sim_compute_performance-ego": 0.06907296816507975, "sim_compute_robot_state-ego": 0.07581380367279053, "sim_compute_robot_state-npc0": 0.07043318748474121, "sim_compute_robot_state-npc1": 0.06830210208892823, "sim_compute_robot_state-npc2": 0.06952282349268596, "sim_compute_robot_state-npc3": 0.07030684073766072}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4213902669948524, "sim_physics": 0.1588708734512329, "survival_time": 14.950000000000076, "driven_lanedir": 0.47044781515163425, "sim_render-ego": 0.05903428475062052, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16512853940327962, "deviation-heading": 5.752213327417323, "set_robot_commands": 0.09195372899373372, "deviation-center-line": 0.3589128525658105, "driven_lanedir_consec": 0.47044781515163425, "sim_compute_sim_state": 0.035989924271901445, "sim_compute_performance-ego": 0.0671133550008138, "sim_compute_robot_state-ego": 0.07164649804433187, "sim_compute_robot_state-npc0": 0.06542588551839193, "sim_compute_robot_state-npc1": 0.06538055102030436, "sim_compute_robot_state-npc2": 0.06449900309244792, "sim_compute_robot_state-npc3": 0.06507683992385864}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15818326346729497, "sim_physics": 0.09725253509752678, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05510013025102944, "sim_render-ego": 0.03545076196843928, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09736391992279976, "deviation-heading": 0.7104917115254321, "set_robot_commands": 0.05554038105588971, "deviation-center-line": 0.027282485519790952, "driven_lanedir_consec": 0.05510013025102944, "sim_compute_sim_state": 0.02316796418392297, "sim_compute_performance-ego": 0.03979704596779563, "sim_compute_robot_state-ego": 0.04110186027758049, "sim_compute_robot_state-npc0": 0.03908587224555738, "sim_compute_robot_state-npc1": 0.03952956922126539, "sim_compute_robot_state-npc2": 0.03872830217534846, "sim_compute_robot_state-npc3": 0.03888133077910452}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10299023933601764, "sim_physics": 0.08262198621576483, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06418652184737894, "sim_render-ego": 0.035058086568659004, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09824534979733554, "deviation-heading": 0.6355363679687314, "set_robot_commands": 0.05644976009022106, "deviation-center-line": 0.092508268758589, "driven_lanedir_consec": 0.06418652184737894, "sim_compute_sim_state": 0.02280194109136408, "sim_compute_performance-ego": 0.03918931700966575, "sim_compute_robot_state-ego": 0.040906765244223854, "sim_compute_robot_state-npc0": 0.04038342562588779, "sim_compute_robot_state-npc1": 0.03991462967612527, "sim_compute_robot_state-npc2": 0.039489453489130195, "sim_compute_robot_state-npc3": 0.03990938446738503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4367811584302546, "sim_physics": 0.08848835468292236, "survival_time": 14.950000000000076, "driven_lanedir": 0.49657883746216536, "sim_render-ego": 0.03627137581507365, "in-drivable-lane": 7.100000000000033, "agent_compute-ego": 0.0993251117070516, "deviation-heading": 5.834450950732524, "set_robot_commands": 0.05522981564203898, "deviation-center-line": 0.513472697884007, "driven_lanedir_consec": 0.49657883746216536, "sim_compute_sim_state": 0.022628060976664224, "sim_compute_performance-ego": 0.03929254134496053, "sim_compute_robot_state-ego": 0.041265888214111326, "sim_compute_robot_state-npc0": 0.040891098181406654, "sim_compute_robot_state-npc1": 0.03970698356628418, "sim_compute_robot_state-npc2": 0.03937402725219727, "sim_compute_robot_state-npc3": 0.03940949281056722}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12360991581163938, "sim_physics": 0.09416565100351967, "survival_time": 1.5000000000000009, "driven_lanedir": 0.049145823611127515, "sim_render-ego": 0.03669851620992025, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0993758996327718, "deviation-heading": 0.6389956454260292, "set_robot_commands": 0.05538311799367269, "deviation-center-line": 0.0753920942093212, "driven_lanedir_consec": 0.049145823611127515, "sim_compute_sim_state": 0.022565523783365887, "sim_compute_performance-ego": 0.038694214820861814, "sim_compute_robot_state-ego": 0.041929284731547035, "sim_compute_robot_state-npc0": 0.04177592595418294, "sim_compute_robot_state-npc1": 0.040172235171000166, "sim_compute_robot_state-npc2": 0.04018445014953613, "sim_compute_robot_state-npc3": 0.039882532755533856}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1467304047938315, "sim_physics": 0.09179292706882251, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06808699359121784, "sim_render-ego": 0.03689179700963637, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09828897083506864, "deviation-heading": 0.6350401892676449, "set_robot_commands": 0.05516907748054056, "deviation-center-line": 0.06222724408395405, "driven_lanedir_consec": 0.06808699359121784, "sim_compute_sim_state": 0.02252022659077364, "sim_compute_performance-ego": 0.0391988333533792, "sim_compute_robot_state-ego": 0.0422595879610847, "sim_compute_robot_state-npc0": 0.04044861653271843, "sim_compute_robot_state-npc1": 0.039478238891152775, "sim_compute_robot_state-npc2": 0.03903207358191995, "sim_compute_robot_state-npc3": 0.0393447104622336}}
set_robot_commands_max0.10015040204144908
set_robot_commands_mean0.08277453830941907
set_robot_commands_median0.0952127102543326
set_robot_commands_min0.05516907748054056
sim_compute_performance-ego_max0.07379547242195375
sim_compute_performance-ego_mean0.05916412549875646
sim_compute_performance-ego_median0.06718165079752604
sim_compute_performance-ego_min0.038694214820861814
sim_compute_robot_state-ego_max0.07766435111778369
sim_compute_robot_state-ego_mean0.06313560516708537
sim_compute_robot_state-ego_median0.0723239364046039
sim_compute_robot_state-ego_min0.040906765244223854
sim_compute_robot_state-npc0_max0.07201392419876591
sim_compute_robot_state-npc0_mean0.05977499131777989
sim_compute_robot_state-npc0_median0.06872492074966431
sim_compute_robot_state-npc0_min0.03908587224555738
sim_compute_robot_state-npc1_max0.07295213976214009
sim_compute_robot_state-npc1_mean0.059056848477426
sim_compute_robot_state-npc1_median0.06752959613142342
sim_compute_robot_state-npc1_min0.039478238891152775
sim_compute_robot_state-npc2_max0.07288726683585875
sim_compute_robot_state-npc2_mean0.05911240844960529
sim_compute_robot_state-npc2_median0.06775407393773397
sim_compute_robot_state-npc2_min0.03872830217534846
sim_compute_robot_state-npc3_max0.0730674882088938
sim_compute_robot_state-npc3_mean0.059351334170794856
sim_compute_robot_state-npc3_median0.0677480779845139
sim_compute_robot_state-npc3_min0.03888133077910452
sim_compute_sim_state_max0.041789062561527375
sim_compute_sim_state_mean0.03340345732012429
sim_compute_sim_state_median0.03722010209010197
sim_compute_sim_state_min0.02252022659077364
sim_physics_max0.19347522335667763
sim_physics_mean0.14455377470193814
sim_physics_median0.16138318538665772
sim_physics_min0.08262198621576483
sim_render-ego_max0.0656819958840647
sim_render-ego_mean0.05338997643403123
sim_render-ego_median0.06043379123394306
sim_render-ego_min0.035058086568659004
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.6900000000000235
survival_time_min1.1000000000000003
No reset possible