Duckietown Challenges Home Challenges Submissions

Submission 4920

Submission4920
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 26844
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

26844

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
26844step1-simulationsuccessyes0:15:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.111724743144641
survival_time_median14.950000000000076
deviation-center-line_median0.8463091316635137
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.051517414251963295
agent_compute-ego_mean0.04536637369791667
agent_compute-ego_median0.04949597120285034
agent_compute-ego_min0.026226504643758135
deviation-center-line_max0.9544597238764436
deviation-center-line_mean0.7564572323980999
deviation-center-line_min0.5115497621100872
deviation-heading_max4.156684119095153
deviation-heading_mean3.0727509372848916
deviation-heading_median3.167566595253494
deviation-heading_min2.1521874702074046
driven_any_max4.6068372465633525
driven_any_mean4.1083310373249216
driven_any_median4.233191790805724
driven_any_min3.385175609138136
driven_lanedir_consec_max4.247140141920131
driven_lanedir_consec_mean3.8722119080030537
driven_lanedir_consec_min3.138785621408447
driven_lanedir_max4.247140141920131
driven_lanedir_mean3.8722119080030537
driven_lanedir_median4.111724743144641
driven_lanedir_min3.138785621408447
in-drivable-lane_max2.450000000000017
in-drivable-lane_mean1.1200000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.385175609138136, "sim_physics": 0.10429605484008787, "survival_time": 14.950000000000076, "driven_lanedir": 3.138785621408447, "sim_render-ego": 0.011868707338968911, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.026226504643758135, "deviation-heading": 4.156684119095153, "set_robot_commands": 0.011247045993804931, "deviation-center-line": 0.9544597238764436, "driven_lanedir_consec": 3.138785621408447, "sim_compute_sim_state": 0.005718538761138916, "sim_compute_performance-ego": 0.007005837758382162, "sim_compute_robot_state-ego": 0.00885814666748047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.054979891341895, "sim_physics": 0.11365871747334798, "survival_time": 14.950000000000076, "driven_lanedir": 3.714521199603453, "sim_render-ego": 0.01300879955291748, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.04949597120285034, "deviation-heading": 3.167566595253494, "set_robot_commands": 0.009909720420837402, "deviation-center-line": 0.5914000005507488, "driven_lanedir_consec": 3.714521199603453, "sim_compute_sim_state": 0.005124911467234294, "sim_compute_performance-ego": 0.007623046239217122, "sim_compute_robot_state-ego": 0.00948342720667521}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.6068372465633525, "sim_physics": 0.11317153215408324, "survival_time": 14.950000000000076, "driven_lanedir": 4.247140141920131, "sim_render-ego": 0.012937761942545574, "in-drivable-lane": 2.450000000000017, "agent_compute-ego": 0.049342865943908694, "deviation-heading": 2.6490901556175896, "set_robot_commands": 0.010424966017405193, "deviation-center-line": 0.8463091316635137, "driven_lanedir_consec": 4.247140141920131, "sim_compute_sim_state": 0.005298667748769124, "sim_compute_performance-ego": 0.008010626633961996, "sim_compute_robot_state-ego": 0.009615671634674071}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.233191790805724, "sim_physics": 0.11497656981150307, "survival_time": 14.950000000000076, "driven_lanedir": 4.111724743144641, "sim_render-ego": 0.012914323806762697, "in-drivable-lane": 0, "agent_compute-ego": 0.05024911244710287, "deviation-heading": 3.238226346250815, "set_robot_commands": 0.010384886264801026, "deviation-center-line": 0.8785675437897066, "driven_lanedir_consec": 4.111724743144641, "sim_compute_sim_state": 0.005459511280059814, "sim_compute_performance-ego": 0.007679859797159831, "sim_compute_robot_state-ego": 0.00963048219680786}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.261470648775505, "sim_physics": 0.10899149258931476, "survival_time": 14.950000000000076, "driven_lanedir": 4.148887833938596, "sim_render-ego": 0.012534409364064535, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.051517414251963295, "deviation-heading": 2.1521874702074046, "set_robot_commands": 0.010201637744903564, "deviation-center-line": 0.5115497621100872, "driven_lanedir_consec": 4.148887833938596, "sim_compute_sim_state": 0.005449923674265543, "sim_compute_performance-ego": 0.0075605575243632, "sim_compute_robot_state-ego": 0.009187411467234294}}
set_robot_commands_max0.011247045993804931
set_robot_commands_mean0.010433651288350422
set_robot_commands_median0.010384886264801026
set_robot_commands_min0.009909720420837402
sim_compute_performance-ego_max0.008010626633961996
sim_compute_performance-ego_mean0.007575985590616861
sim_compute_performance-ego_median0.007623046239217122
sim_compute_performance-ego_min0.007005837758382162
sim_compute_robot_state-ego_max0.00963048219680786
sim_compute_robot_state-ego_mean0.00935502783457438
sim_compute_robot_state-ego_median0.00948342720667521
sim_compute_robot_state-ego_min0.00885814666748047
sim_compute_sim_state_max0.005718538761138916
sim_compute_sim_state_mean0.005410310586293538
sim_compute_sim_state_median0.005449923674265543
sim_compute_sim_state_min0.005124911467234294
sim_physics_max0.11497656981150307
sim_physics_mean0.11101887337366738
sim_physics_median0.11317153215408324
sim_physics_min0.10429605484008787
sim_render-ego_max0.01300879955291748
sim_render-ego_mean0.01265280040105184
sim_render-ego_median0.012914323806762697
sim_render-ego_min0.011868707338968911
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
26737step1-simulationsuccessno0:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26736step1-simulationsuccessno0:10:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26734step1-simulationhost-errorno0:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job26734-865240', 'ps', '-q', 'evaluator']:

   >  Command '['docker-compose', '-p', 'job26734-865240', 'ps', '-q', 'evaluator']' returned non-zero exit status 255.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26732step1-simulationerrorno0:00:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible