Duckietown Challenges Home Challenges Submissions

Submission 4721

Submission4721
Competingyes
Challengeaido3-LF-sim-validation
UserNikolaus Howe
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27136
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

27136

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27136step1-simulationsuccessyes0:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.951659072966931
survival_time_median14.950000000000076
deviation-center-line_median0.8076490204190861
in-drivable-lane_median0


other stats
agent_compute-ego_max0.052561737696329755
agent_compute-ego_mean0.048992859045664465
agent_compute-ego_median0.050445761680603024
agent_compute-ego_min0.04393434762954712
deviation-center-line_max0.9203813614434933
deviation-center-line_mean0.7762604631933361
deviation-center-line_min0.6265588727864797
deviation-heading_max4.256404049237662
deviation-heading_mean3.5497509073553237
deviation-heading_median3.714285574714689
deviation-heading_min2.6121634097191655
driven_any_max3.2235832035178156
driven_any_mean3.119945187379254
driven_any_median3.128570661508165
driven_any_min2.969000924158581
driven_lanedir_consec_max3.1494889026750617
driven_lanedir_consec_mean2.984952861771578
driven_lanedir_consec_min2.857055638972661
driven_lanedir_max3.1494889026750617
driven_lanedir_mean2.984952861771578
driven_lanedir_median2.951659072966931
driven_lanedir_min2.857055638972661
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.969000924158581, "sim_physics": 0.07461824019749959, "survival_time": 14.950000000000076, "driven_lanedir": 2.857055638972661, "sim_render-ego": 0.01142898956934611, "in-drivable-lane": 0, "agent_compute-ego": 0.04393434762954712, "deviation-heading": 3.3171619303701374, "set_robot_commands": 0.00825980027516683, "deviation-center-line": 0.8076490204190861, "driven_lanedir_consec": 2.857055638972661, "sim_compute_sim_state": 0.004947990576426188, "sim_compute_performance-ego": 0.006912449995676677, "sim_compute_robot_state-ego": 0.00819093942642212}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.2235832035178156, "sim_physics": 0.07098951657613119, "survival_time": 14.950000000000076, "driven_lanedir": 3.1494889026750617, "sim_render-ego": 0.01207084019978841, "in-drivable-lane": 0, "agent_compute-ego": 0.04740361293156942, "deviation-heading": 2.6121634097191655, "set_robot_commands": 0.009057924747467042, "deviation-center-line": 0.6265588727864797, "driven_lanedir_consec": 3.1494889026750617, "sim_compute_sim_state": 0.005092439651489258, "sim_compute_performance-ego": 0.007090067068735759, "sim_compute_robot_state-ego": 0.008221291700998942}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.128570661508165, "sim_physics": 0.07124847730000813, "survival_time": 14.950000000000076, "driven_lanedir": 2.951659072966931, "sim_render-ego": 0.012149276733398438, "in-drivable-lane": 0, "agent_compute-ego": 0.05061883529027303, "deviation-heading": 4.256404049237662, "set_robot_commands": 0.008682151635487875, "deviation-center-line": 0.9203813614434933, "driven_lanedir_consec": 2.951659072966931, "sim_compute_sim_state": 0.005166436831156413, "sim_compute_performance-ego": 0.006924436887105306, "sim_compute_robot_state-ego": 0.008460970719655354}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.186144282043364, "sim_physics": 0.07032307386398315, "survival_time": 14.950000000000076, "driven_lanedir": 3.0471080212928867, "sim_render-ego": 0.01241462469100952, "in-drivable-lane": 0, "agent_compute-ego": 0.052561737696329755, "deviation-heading": 3.714285574714689, "set_robot_commands": 0.009477893511454264, "deviation-center-line": 0.8507325460090079, "driven_lanedir_consec": 3.0471080212928867, "sim_compute_sim_state": 0.005719217459360758, "sim_compute_performance-ego": 0.007558260758717855, "sim_compute_robot_state-ego": 0.009042141437530515}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0924268656683447, "sim_physics": 0.06825654665629069, "survival_time": 14.950000000000076, "driven_lanedir": 2.9194526729503494, "sim_render-ego": 0.012499946753184, "in-drivable-lane": 0, "agent_compute-ego": 0.050445761680603024, "deviation-heading": 3.8487395727349663, "set_robot_commands": 0.008808691501617432, "deviation-center-line": 0.6759805153086133, "driven_lanedir_consec": 2.9194526729503494, "sim_compute_sim_state": 0.005016849835713704, "sim_compute_performance-ego": 0.00709201176961263, "sim_compute_robot_state-ego": 0.008414109547932943}}
set_robot_commands_max0.009477893511454264
set_robot_commands_mean0.00885729233423869
set_robot_commands_median0.008808691501617432
set_robot_commands_min0.00825980027516683
sim_compute_performance-ego_max0.007558260758717855
sim_compute_performance-ego_mean0.007115445295969645
sim_compute_performance-ego_median0.007090067068735759
sim_compute_performance-ego_min0.006912449995676677
sim_compute_robot_state-ego_max0.009042141437530515
sim_compute_robot_state-ego_mean0.008465890566507974
sim_compute_robot_state-ego_median0.008414109547932943
sim_compute_robot_state-ego_min0.00819093942642212
sim_compute_sim_state_max0.005719217459360758
sim_compute_sim_state_mean0.005188586870829264
sim_compute_sim_state_median0.005092439651489258
sim_compute_sim_state_min0.004947990576426188
sim_physics_max0.07461824019749959
sim_physics_mean0.07108717091878254
sim_physics_median0.07098951657613119
sim_physics_min0.06825654665629069
sim_render-ego_max0.012499946753184
sim_render-ego_mean0.012112735589345296
sim_render-ego_median0.012149276733398438
sim_render-ego_min0.01142898956934611
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
27135step1-simulationerroryes0:02:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible