Duckietown Challenges Home Challenges Submissions

Submission 2448

Submission2448
Competingyes
Challengeaido2-LFV-sim-testing
UserNicky Eichmann
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22968
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22968step1-simulationsuccessyes0:58:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.355676207214709
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.08804394324620565
agent_compute-ego_mean0.08726267194747923
agent_compute-ego_median0.08715522289276123
agent_compute-ego_min0.08640182971954345
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.8536767524476552
deviation-center-line_min0.2656525762859935
deviation-heading_max8.682256325592228
deviation-heading_mean6.927230740477735
deviation-heading_median7.090641611385013
deviation-heading_min5.52174661383955
driven_any_max4.378506444052824
driven_any_mean4.378506444052809
driven_any_median4.378506444052808
driven_any_min4.378506444052796
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.352643582087815
driven_lanedir_consec_min-1.388190292394527
driven_lanedir_max-1.3477913186786226
driven_lanedir_mean-2.005867861365606
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7253255736285684
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean4.9200000000000275
in-drivable-lane_min2.100000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.06691507339477538, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.0320353372891744, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08773498217264811, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.04895198663075765, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.019980932076772057, "sim_compute_performance-ego": 0.034768020311991374, "sim_compute_robot_state-ego": 0.0368092155456543, "sim_compute_robot_state-npc0": 0.03571815331776937, "sim_compute_robot_state-npc1": 0.03559604485829671, "sim_compute_robot_state-npc2": 0.03534209410349528, "sim_compute_robot_state-npc3": 0.03534570058186849}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.06592342217763265, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03232653458913167, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.08760421673456828, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.049942440191904705, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.020406312147776287, "sim_compute_performance-ego": 0.035073644320170086, "sim_compute_robot_state-ego": 0.03683694839477539, "sim_compute_robot_state-npc0": 0.03574262301127116, "sim_compute_robot_state-npc1": 0.035724650224049886, "sim_compute_robot_state-npc2": 0.03557552099227905, "sim_compute_robot_state-npc3": 0.03576503992080689}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06603608290354411, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.03230990489323934, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08695316394170126, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.048811421394348145, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.020166085561116535, "sim_compute_performance-ego": 0.034819173812866214, "sim_compute_robot_state-ego": 0.03656471093495687, "sim_compute_robot_state-npc0": 0.03628172477086385, "sim_compute_robot_state-npc1": 0.03566601435343424, "sim_compute_robot_state-npc2": 0.035728437105814616, "sim_compute_robot_state-npc3": 0.0355171545346578}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.0675003719329834, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.03248183886210124, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.08791068077087402, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.04991426467895508, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.020283076763153076, "sim_compute_performance-ego": 0.03513687372207642, "sim_compute_robot_state-ego": 0.03665859619776408, "sim_compute_robot_state-npc0": 0.03604266007741292, "sim_compute_robot_state-npc1": 0.03588028907775879, "sim_compute_robot_state-npc2": 0.03555025815963745, "sim_compute_robot_state-npc3": 0.03566125392913819}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.06647817691167196, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03240268309911092, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.08804394324620565, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.049210122426350915, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.0202068829536438, "sim_compute_performance-ego": 0.03479743719100952, "sim_compute_robot_state-ego": 0.03665672620137533, "sim_compute_robot_state-npc0": 0.03564338604609171, "sim_compute_robot_state-npc1": 0.03575398921966553, "sim_compute_robot_state-npc2": 0.035478333632151283, "sim_compute_robot_state-npc3": 0.0355373485883077}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.06545099258422851, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.03185211737950643, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.08640182971954345, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.049461113611857094, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.020181787808736164, "sim_compute_performance-ego": 0.034665056069691974, "sim_compute_robot_state-ego": 0.03654384692509969, "sim_compute_robot_state-npc0": 0.035563241640726724, "sim_compute_robot_state-npc1": 0.03565384308497111, "sim_compute_robot_state-npc2": 0.0352836012840271, "sim_compute_robot_state-npc3": 0.03542617638905843}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.06692968606948853, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.031893750031789146, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.08707944711049398, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.0486759090423584, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.020210254987080893, "sim_compute_performance-ego": 0.03518201430638631, "sim_compute_robot_state-ego": 0.03665552775065104, "sim_compute_robot_state-npc0": 0.03562407811482748, "sim_compute_robot_state-npc1": 0.03645795583724976, "sim_compute_robot_state-npc2": 0.035356604258219404, "sim_compute_robot_state-npc3": 0.035545984109242756}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.0661188260714213, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.032050597667694095, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.08796389738718668, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.0491202187538147, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.020187315940856935, "sim_compute_performance-ego": 0.03487899621327718, "sim_compute_robot_state-ego": 0.03681859413782756, "sim_compute_robot_state-npc0": 0.03570538520812988, "sim_compute_robot_state-npc1": 0.036769155661265054, "sim_compute_robot_state-npc2": 0.03545811494191488, "sim_compute_robot_state-npc3": 0.03562698443730672}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.06536930958429972, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03206898132960002, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.08663775126139323, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.04865646918614706, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.02010954777399699, "sim_compute_performance-ego": 0.03476674159367879, "sim_compute_robot_state-ego": 0.03670417388280233, "sim_compute_robot_state-npc0": 0.03544912020365397, "sim_compute_robot_state-npc1": 0.035543406009674074, "sim_compute_robot_state-npc2": 0.035284396012624106, "sim_compute_robot_state-npc3": 0.03549855470657349}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06676714102427164, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.03214550574620565, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.0869089968999227, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.04901083469390869, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.02038749059041341, "sim_compute_performance-ego": 0.03495707591374715, "sim_compute_robot_state-ego": 0.03751779635747274, "sim_compute_robot_state-npc0": 0.03550026257832845, "sim_compute_robot_state-npc1": 0.035844080448150635, "sim_compute_robot_state-npc2": 0.035581978956858315, "sim_compute_robot_state-npc3": 0.035668092568715414}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.06567803223927816, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.032221238613128665, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.08742235024770101, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.04925671259562175, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.020126797358194982, "sim_compute_performance-ego": 0.03469544410705566, "sim_compute_robot_state-ego": 0.036454696655273434, "sim_compute_robot_state-npc0": 0.03552056392033895, "sim_compute_robot_state-npc1": 0.03564504861831665, "sim_compute_robot_state-npc2": 0.03543694734573364, "sim_compute_robot_state-npc3": 0.035484859943389895}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06600751717885335, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.032186501026153565, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.0867678173383077, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.048815788427988685, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.02021359364191691, "sim_compute_performance-ego": 0.03477487881978353, "sim_compute_robot_state-ego": 0.03674472411473592, "sim_compute_robot_state-npc0": 0.03560601313908895, "sim_compute_robot_state-npc1": 0.035868821938832604, "sim_compute_robot_state-npc2": 0.03537476857503255, "sim_compute_robot_state-npc3": 0.035578418572743735}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.06662119626998901, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.0322514812151591, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.08749290704727172, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.04887799580891927, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.020183809598286948, "sim_compute_performance-ego": 0.034828532536824545, "sim_compute_robot_state-ego": 0.03672581434249878, "sim_compute_robot_state-npc0": 0.03559701124827067, "sim_compute_robot_state-npc1": 0.03663534879684448, "sim_compute_robot_state-npc2": 0.03549665451049805, "sim_compute_robot_state-npc3": 0.035417293707529704}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.06569416046142579, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.03226106961568197, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.08715522289276123, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.04868130286534627, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.020106682777404784, "sim_compute_performance-ego": 0.03493185838063558, "sim_compute_robot_state-ego": 0.03669173081715902, "sim_compute_robot_state-npc0": 0.035437649885813396, "sim_compute_robot_state-npc1": 0.035773420333862306, "sim_compute_robot_state-npc2": 0.03529057661692302, "sim_compute_robot_state-npc3": 0.035618983904520674}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.06480865955352783, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03216062148412069, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.0868628724416097, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.0488236403465271, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.020078457991282144, "sim_compute_performance-ego": 0.03492203632990519, "sim_compute_robot_state-ego": 0.036640957196553546, "sim_compute_robot_state-npc0": 0.03551154295603434, "sim_compute_robot_state-npc1": 0.035988214015960696, "sim_compute_robot_state-npc2": 0.03572889407475789, "sim_compute_robot_state-npc3": 0.035588428179423016}}
set_robot_commands_max0.049942440191904705
set_robot_commands_mean0.04908068137698704
set_robot_commands_median0.04895198663075765
set_robot_commands_min0.04865646918614706
sim_compute_performance-ego_max0.03518201430638631
sim_compute_performance-ego_mean0.034879852241939964
sim_compute_performance-ego_median0.034828532536824545
sim_compute_performance-ego_min0.034665056069691974
sim_compute_robot_state-ego_max0.03751779635747274
sim_compute_robot_state-ego_mean0.03673493729697334
sim_compute_robot_state-ego_median0.03669173081715902
sim_compute_robot_state-ego_min0.036454696655273434
sim_compute_robot_state-npc0_max0.03628172477086385
sim_compute_robot_state-npc0_mean0.035662894407908124
sim_compute_robot_state-npc0_median0.03560601313908895
sim_compute_robot_state-npc0_min0.035437649885813396
sim_compute_robot_state-npc1_max0.036769155661265054
sim_compute_robot_state-npc1_mean0.03592001883188883
sim_compute_robot_state-npc1_median0.035773420333862306
sim_compute_robot_state-npc1_min0.035543406009674074
sim_compute_robot_state-npc2_max0.03572889407475789
sim_compute_robot_state-npc2_mean0.035464478704664446
sim_compute_robot_state-npc2_median0.03545811494191488
sim_compute_robot_state-npc2_min0.0352836012840271
sim_compute_robot_state-npc3_max0.03576503992080689
sim_compute_robot_state-npc3_mean0.035552018271552195
sim_compute_robot_state-npc3_median0.035545984109242756
sim_compute_robot_state-npc3_min0.03534570058186849
sim_compute_sim_state_max0.020406312147776287
sim_compute_sim_state_mean0.020188601864708795
sim_compute_sim_state_median0.020183809598286948
sim_compute_sim_state_min0.019980932076772057
sim_physics_max0.0675003719329834
sim_physics_mean0.06615324322382608
sim_physics_median0.06603608290354411
sim_physics_min0.06480865955352783
sim_render-ego_max0.03248183886210124
sim_render-ego_mean0.03217654418945312
sim_render-ego_median0.032186501026153565
sim_render-ego_min0.03185211737950643
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible