Duckietown Challenges Home Challenges Submissions

Submission 3624

Submission3624
Competingyes
Challengeaido2-LFV-sim-validation
UserNicky Eichmann
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23385
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

23385

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23385step1-simulationsuccessyes0:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6697553564194623
survival_time_median2.1500000000000004
deviation-center-line_median0.09456974525815567
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.10441312124562818
agent_compute-ego_mean0.10210482539968677
agent_compute-ego_median0.10169291496276855
agent_compute-ego_min0.10064723094304402
deviation-center-line_max0.503163430692759
deviation-center-line_mean0.17389659377056038
deviation-center-line_min0.06073337098493198
deviation-heading_max3.618647345464983
deviation-heading_mean0.9650800437283672
deviation-heading_median0.28606528190679475
deviation-heading_min0.25835188233260464
driven_any_max1.9443144905238257
driven_any_mean1.081551363909535
driven_any_median1.013221468008895
driven_any_min0.400811386017316
driven_lanedir_consec_max1.2187176370157662
driven_lanedir_consec_mean0.7837794328337001
driven_lanedir_consec_min0.3869401393359331
driven_lanedir_max1.6963787175922933
driven_lanedir_mean0.8793116489490055
driven_lanedir_median0.6697553564194623
driven_lanedir_min0.3869401393359331
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean0.5399999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.013221468008895, "sim_physics": 0.09507047298342684, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6697553564194623, "sim_render-ego": 0.03814778771511344, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.10441312124562818, "deviation-heading": 0.25835188233260464, "set_robot_commands": 0.05737736613251442, "deviation-center-line": 0.09456974525815567, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.024350848308829373, "sim_compute_performance-ego": 0.04232852403507676, "sim_compute_robot_state-ego": 0.04352931643641272, "sim_compute_robot_state-npc0": 0.04296573927236158, "sim_compute_robot_state-npc1": 0.04266153934390046, "sim_compute_robot_state-npc2": 0.042110592819923576, "sim_compute_robot_state-npc3": 0.04209241201711256}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.44975478626762105, "sim_physics": 0.11044593652089436, "survival_time": 1.2000000000000004, "driven_lanedir": 0.4251041431319904, "sim_render-ego": 0.037722229957580566, "in-drivable-lane": 0, "agent_compute-ego": 0.10064723094304402, "deviation-heading": 0.3984686189931251, "set_robot_commands": 0.05443200469017029, "deviation-center-line": 0.09297933544284252, "driven_lanedir_consec": 0.4251041431319904, "sim_compute_sim_state": 0.022952218850453697, "sim_compute_performance-ego": 0.04012012481689453, "sim_compute_robot_state-ego": 0.042745620012283325, "sim_compute_robot_state-npc0": 0.04414867361386617, "sim_compute_robot_state-npc1": 0.040582080682118736, "sim_compute_robot_state-npc2": 0.041343510150909424, "sim_compute_robot_state-npc3": 0.04030778010686239}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.10060771703720092, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.03636098305384318, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10169291496276855, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.05635313987731934, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.022985732555389403, "sim_compute_performance-ego": 0.04036392370859782, "sim_compute_robot_state-ego": 0.042432610193888345, "sim_compute_robot_state-npc0": 0.04123912652333577, "sim_compute_robot_state-npc1": 0.04181240797042847, "sim_compute_robot_state-npc2": 0.039862505594889325, "sim_compute_robot_state-npc3": 0.051853458086649575}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9443144905238257, "sim_physics": 0.09199617779444134, "survival_time": 9.45, "driven_lanedir": 1.6963787175922933, "sim_render-ego": 0.03685347365323829, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.10094873488895476, "deviation-heading": 3.618647345464983, "set_robot_commands": 0.05701288596662895, "deviation-center-line": 0.503163430692759, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.023610836614376653, "sim_compute_performance-ego": 0.04078733101092949, "sim_compute_robot_state-ego": 0.04286861545825131, "sim_compute_robot_state-npc0": 0.04234183402288528, "sim_compute_robot_state-npc1": 0.04158751295987891, "sim_compute_robot_state-npc2": 0.04126862874106755, "sim_compute_robot_state-npc3": 0.04130945508442228}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.400811386017316, "sim_physics": 0.09936574697494507, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3869401393359331, "sim_render-ego": 0.0375630259513855, "in-drivable-lane": 0, "agent_compute-ego": 0.10282212495803832, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.0572325587272644, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3869401393359331, "sim_compute_sim_state": 0.03510905504226684, "sim_compute_performance-ego": 0.04193875789642334, "sim_compute_robot_state-ego": 0.04286588430404663, "sim_compute_robot_state-npc0": 0.04237196445465088, "sim_compute_robot_state-npc1": 0.043501853942871094, "sim_compute_robot_state-npc2": 0.04182214736938476, "sim_compute_robot_state-npc3": 0.043076741695404056}}
set_robot_commands_max0.05737736613251442
set_robot_commands_mean0.05648159107877948
set_robot_commands_median0.05701288596662895
set_robot_commands_min0.05443200469017029
sim_compute_performance-ego_max0.04232852403507676
sim_compute_performance-ego_mean0.04110773229358439
sim_compute_performance-ego_median0.04078733101092949
sim_compute_performance-ego_min0.04012012481689453
sim_compute_robot_state-ego_max0.04352931643641272
sim_compute_robot_state-ego_mean0.04288840928097647
sim_compute_robot_state-ego_median0.04286588430404663
sim_compute_robot_state-ego_min0.042432610193888345
sim_compute_robot_state-npc0_max0.04414867361386617
sim_compute_robot_state-npc0_mean0.04261346757741994
sim_compute_robot_state-npc0_median0.04237196445465088
sim_compute_robot_state-npc0_min0.04123912652333577
sim_compute_robot_state-npc1_max0.043501853942871094
sim_compute_robot_state-npc1_mean0.04202907897983953
sim_compute_robot_state-npc1_median0.04181240797042847
sim_compute_robot_state-npc1_min0.040582080682118736
sim_compute_robot_state-npc2_max0.042110592819923576
sim_compute_robot_state-npc2_mean0.04128147693523493
sim_compute_robot_state-npc2_median0.041343510150909424
sim_compute_robot_state-npc2_min0.039862505594889325
sim_compute_robot_state-npc3_max0.051853458086649575
sim_compute_robot_state-npc3_mean0.04372796939809017
sim_compute_robot_state-npc3_median0.04209241201711256
sim_compute_robot_state-npc3_min0.04030778010686239
sim_compute_sim_state_max0.03510905504226684
sim_compute_sim_state_mean0.025801738274263197
sim_compute_sim_state_median0.023610836614376653
sim_compute_sim_state_min0.022952218850453697
sim_physics_max0.11044593652089436
sim_physics_mean0.0994972102621817
sim_physics_median0.09936574697494507
sim_physics_min0.09199617779444134
sim_render-ego_max0.03814778771511344
sim_render-ego_mean0.037329500066232195
sim_render-ego_median0.0375630259513855
sim_render-ego_min0.03636098305384318
simulation-passed1
survival_time_max9.45
survival_time_mean3.359999999999999
survival_time_min1.0000000000000002
No reset possible