Duckietown Challenges Home Challenges Submissions

Submission 3510

Submission3510
Competingyes
Challengeaido2-LFV-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23293
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority60
Blessingn/a
User priority60

23293

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23293step1-simulationsuccessyes0:07:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10498481784762737
survival_time_median1.2000000000000004
deviation-center-line_median0.08930251992149642
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19667299934055493
agent_compute-ego_mean0.18301277414013037
agent_compute-ego_median0.1883728273453251
agent_compute-ego_min0.16100138425827026
deviation-center-line_max0.10673455599715458
deviation-center-line_mean0.08411594578089707
deviation-center-line_min0.05688335098421611
deviation-heading_max0.9603811805615188
deviation-heading_mean0.7432090329903567
deviation-heading_median0.8016980183826987
deviation-heading_min0.47246531402529984
driven_any_max0.22001710516113968
driven_any_mean0.16944626381591144
driven_any_median0.14500050694460015
driven_any_min0.13965868045368818
driven_lanedir_consec_max0.12480656567992998
driven_lanedir_consec_mean0.10310933999494484
driven_lanedir_consec_min0.0826586746355924
driven_lanedir_max0.12480656567992998
driven_lanedir_mean0.10310933999494484
driven_lanedir_median0.10498481784762737
driven_lanedir_min0.0826586746355924
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22001710516113968, "sim_physics": 0.22556249052286148, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12480656567992998, "sim_render-ego": 0.06965093314647675, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19403984397649765, "deviation-heading": 0.9603811805615188, "set_robot_commands": 0.10197784751653673, "deviation-center-line": 0.08930251992149642, "driven_lanedir_consec": 0.12480656567992998, "sim_compute_sim_state": 0.04337746649980545, "sim_compute_performance-ego": 0.07721303403377533, "sim_compute_robot_state-ego": 0.08459248393774033, "sim_compute_robot_state-npc0": 0.07125004380941391, "sim_compute_robot_state-npc1": 0.0729890987277031, "sim_compute_robot_state-npc2": 0.07112251967191696, "sim_compute_robot_state-npc3": 0.07346013933420181}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20084797868596377, "sim_physics": 0.1962070080541795, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0875542054028009, "sim_render-ego": 0.07539187708208638, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1883728273453251, "deviation-heading": 0.9486630580181108, "set_robot_commands": 0.10951606688960906, "deviation-center-line": 0.0675181123444764, "driven_lanedir_consec": 0.0875542054028009, "sim_compute_sim_state": 0.04430870086916031, "sim_compute_performance-ego": 0.07055691749818864, "sim_compute_robot_state-ego": 0.0809316635131836, "sim_compute_robot_state-npc0": 0.07840914880075762, "sim_compute_robot_state-npc1": 0.07795144665625788, "sim_compute_robot_state-npc2": 0.0754283397428451, "sim_compute_robot_state-npc3": 0.07690539667683263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13965868045368818, "sim_physics": 0.18427163362503052, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10498481784762737, "sim_render-ego": 0.06268425782521565, "in-drivable-lane": 0, "agent_compute-ego": 0.16100138425827026, "deviation-heading": 0.5328375939641545, "set_robot_commands": 0.09481573104858398, "deviation-center-line": 0.10673455599715458, "driven_lanedir_consec": 0.10498481784762737, "sim_compute_sim_state": 0.040402074654897056, "sim_compute_performance-ego": 0.0640411376953125, "sim_compute_robot_state-ego": 0.07327331105868022, "sim_compute_robot_state-npc0": 0.07531364758809407, "sim_compute_robot_state-npc1": 0.06865089138348897, "sim_compute_robot_state-npc2": 0.07018132011095683, "sim_compute_robot_state-npc3": 0.067236989736557}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14500050694460015, "sim_physics": 0.20872812469800311, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1155424364087736, "sim_render-ego": 0.06315056482950847, "in-drivable-lane": 0, "agent_compute-ego": 0.17497681578000387, "deviation-heading": 0.47246531402529984, "set_robot_commands": 0.09442585706710815, "deviation-center-line": 0.10014118965714187, "driven_lanedir_consec": 0.1155424364087736, "sim_compute_sim_state": 0.04294249415397644, "sim_compute_performance-ego": 0.06880988677342732, "sim_compute_robot_state-ego": 0.07839194933573405, "sim_compute_robot_state-npc0": 0.06985259056091309, "sim_compute_robot_state-npc1": 0.06584579745928447, "sim_compute_robot_state-npc2": 0.07277112205823262, "sim_compute_robot_state-npc3": 0.07344958186149597}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14170704783416546, "sim_physics": 0.19323246375374173, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0826586746355924, "sim_render-ego": 0.06540060043334961, "in-drivable-lane": 0, "agent_compute-ego": 0.19667299934055493, "deviation-heading": 0.8016980183826987, "set_robot_commands": 0.10143506008645764, "deviation-center-line": 0.05688335098421611, "driven_lanedir_consec": 0.0826586746355924, "sim_compute_sim_state": 0.0519266646841298, "sim_compute_performance-ego": 0.06845221312149712, "sim_compute_robot_state-ego": 0.07393700143565303, "sim_compute_robot_state-npc0": 0.07287211003510849, "sim_compute_robot_state-npc1": 0.06822197333626125, "sim_compute_robot_state-npc2": 0.06642716863880986, "sim_compute_robot_state-npc3": 0.07096903220466945}}
set_robot_commands_max0.10951606688960906
set_robot_commands_mean0.1004341125216591
set_robot_commands_median0.10143506008645764
set_robot_commands_min0.09442585706710815
sim_compute_performance-ego_max0.07721303403377533
sim_compute_performance-ego_mean0.06981463782444018
sim_compute_performance-ego_median0.06880988677342732
sim_compute_performance-ego_min0.0640411376953125
sim_compute_robot_state-ego_max0.08459248393774033
sim_compute_robot_state-ego_mean0.07822528185619824
sim_compute_robot_state-ego_median0.07839194933573405
sim_compute_robot_state-ego_min0.07327331105868022
sim_compute_robot_state-npc0_max0.07840914880075762
sim_compute_robot_state-npc0_mean0.07353950815885743
sim_compute_robot_state-npc0_median0.07287211003510849
sim_compute_robot_state-npc0_min0.06985259056091309
sim_compute_robot_state-npc1_max0.07795144665625788
sim_compute_robot_state-npc1_mean0.07073184151259912
sim_compute_robot_state-npc1_median0.06865089138348897
sim_compute_robot_state-npc1_min0.06584579745928447
sim_compute_robot_state-npc2_max0.0754283397428451
sim_compute_robot_state-npc2_mean0.07118609404455227
sim_compute_robot_state-npc2_median0.07112251967191696
sim_compute_robot_state-npc2_min0.06642716863880986
sim_compute_robot_state-npc3_max0.07690539667683263
sim_compute_robot_state-npc3_mean0.07240422796275137
sim_compute_robot_state-npc3_median0.07344958186149597
sim_compute_robot_state-npc3_min0.067236989736557
sim_compute_sim_state_max0.0519266646841298
sim_compute_sim_state_mean0.04459148017239381
sim_compute_sim_state_median0.04337746649980545
sim_compute_sim_state_min0.040402074654897056
sim_physics_max0.22556249052286148
sim_physics_mean0.2016003441307633
sim_physics_median0.1962070080541795
sim_physics_min0.18427163362503052
sim_render-ego_max0.07539187708208638
sim_render-ego_mean0.06725564666332737
sim_render-ego_median0.06540060043334961
sim_render-ego_min0.06268425782521565
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1500000000000004
No reset possible
22253step1-simulationsuccessyes0:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible