Duckietown Challenges Home Challenges Submissions

Submission 5570

Submission5570
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29007
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

29007

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
29007step1-simulationsuccessyes0:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1440594772488566
survival_time_median2.849999999999998
deviation-center-line_median0.11764917856807484
in-drivable-lane_median0.8499999999999999


other stats
agent_compute-ego_max0.02080417515938742
agent_compute-ego_mean0.020425334372919008
agent_compute-ego_median0.02065072218577067
agent_compute-ego_min0.01968727111816406
deviation-center-line_max0.6517825177809339
deviation-center-line_mean0.20071186155042817
deviation-center-line_min0.04352425114438549
deviation-heading_max5.316082287730095
deviation-heading_mean1.94417742123952
deviation-heading_median1.2661251893175782
deviation-heading_min0.4541081251156902
driven_any_max3.1212780395077764
driven_any_mean1.1267830003010606
driven_any_median0.7993655921615196
driven_any_min0.16458975861204506
driven_lanedir_consec_max0.6698090019588758
driven_lanedir_consec_mean0.2684776389049979
driven_lanedir_consec_min0.026637512065297964
driven_lanedir_max0.8808945996846829
driven_lanedir_mean0.31069475845015926
driven_lanedir_median0.1440594772488566
driven_lanedir_min0.026637512065297964
in-drivable-lane_max7.850000000000038
in-drivable-lane_mean2.6300000000000057
in-drivable-lane_min0.6000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1212780395077764, "sim_physics": 0.05571577390034994, "survival_time": 14.950000000000076, "driven_lanedir": 0.8808945996846829, "sim_render-ego": 0.007117977937062581, "in-drivable-lane": 7.850000000000038, "agent_compute-ego": 0.02065072218577067, "deviation-heading": 5.316082287730095, "set_robot_commands": 0.005303452014923096, "deviation-center-line": 0.6517825177809339, "driven_lanedir_consec": 0.6698090019588758, "sim_compute_sim_state": 0.0030037689208984373, "sim_compute_performance-ego": 0.00418725331624349, "sim_compute_robot_state-ego": 0.005139497915903727}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16458975861204506, "sim_physics": 0.05961879869786704, "survival_time": 2.0500000000000007, "driven_lanedir": 0.032442048690072944, "sim_render-ego": 0.007364313776900128, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.020181795445884148, "deviation-heading": 1.1107434595964856, "set_robot_commands": 0.005148044446619545, "deviation-center-line": 0.06085111661000793, "driven_lanedir_consec": 0.032442048690072944, "sim_compute_sim_state": 0.002998386941305021, "sim_compute_performance-ego": 0.004000006652459866, "sim_compute_robot_state-ego": 0.005052758426201053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7993655921615196, "sim_physics": 0.057439657679775304, "survival_time": 2.849999999999998, "driven_lanedir": 0.4694401545618861, "sim_render-ego": 0.007336369731970001, "in-drivable-lane": 0.8499999999999999, "agent_compute-ego": 0.02080417515938742, "deviation-heading": 1.2661251893175782, "set_robot_commands": 0.005303905721296344, "deviation-center-line": 0.11764917856807484, "driven_lanedir_consec": 0.4694401545618861, "sim_compute_sim_state": 0.003065749218589381, "sim_compute_performance-ego": 0.004067747216475637, "sim_compute_robot_state-ego": 0.005141735076904297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.114568185110749, "sim_physics": 0.056000041489553926, "survival_time": 5.04999999999999, "driven_lanedir": 0.1440594772488566, "sim_render-ego": 0.007244754545759446, "in-drivable-lane": 3.0999999999999903, "agent_compute-ego": 0.02080270795538874, "deviation-heading": 1.5738280444377508, "set_robot_commands": 0.005209186289570119, "deviation-center-line": 0.12975224364873847, "driven_lanedir_consec": 0.1440594772488566, "sim_compute_sim_state": 0.002942708459230933, "sim_compute_performance-ego": 0.00409375795043341, "sim_compute_robot_state-ego": 0.005110228415763024}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.43411342611321335, "sim_physics": 0.05672190189361572, "survival_time": 1.5000000000000009, "driven_lanedir": 0.026637512065297964, "sim_render-ego": 0.01232912540435791, "in-drivable-lane": 0.7500000000000006, "agent_compute-ego": 0.01968727111816406, "deviation-heading": 0.4541081251156902, "set_robot_commands": 0.0050661563873291016, "deviation-center-line": 0.04352425114438549, "driven_lanedir_consec": 0.026637512065297964, "sim_compute_sim_state": 0.0029349486033121747, "sim_compute_performance-ego": 0.004175551732381185, "sim_compute_robot_state-ego": 0.00523527463277181}}
set_robot_commands_max0.005303905721296344
set_robot_commands_mean0.005206148971947641
set_robot_commands_median0.005209186289570119
set_robot_commands_min0.0050661563873291016
sim_compute_performance-ego_max0.00418725331624349
sim_compute_performance-ego_mean0.004104863373598717
sim_compute_performance-ego_median0.00409375795043341
sim_compute_performance-ego_min0.004000006652459866
sim_compute_robot_state-ego_max0.00523527463277181
sim_compute_robot_state-ego_mean0.005135898893508782
sim_compute_robot_state-ego_median0.005139497915903727
sim_compute_robot_state-ego_min0.005052758426201053
sim_compute_sim_state_max0.003065749218589381
sim_compute_sim_state_mean0.00298911242866719
sim_compute_sim_state_median0.002998386941305021
sim_compute_sim_state_min0.0029349486033121747
sim_physics_max0.05961879869786704
sim_physics_mean0.057099234732232385
sim_physics_median0.05672190189361572
sim_physics_min0.05571577390034994
sim_render-ego_max0.01232912540435791
sim_render-ego_mean0.008278508279210013
sim_render-ego_median0.007336369731970001
sim_render-ego_min0.007117977937062581
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.280000000000014
survival_time_min1.5000000000000009
No reset possible
29006step1-simulationsuccessyes0:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29005step1-simulationhost-erroryes0:00:37
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 924, in run_one
    exit_code = exit_code_for_container(container_id)
  File "/project/src/duckietown_challenges_runner/runner.py", line 844, in exit_code_for_container
    out = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'inspect', '63c6c724bf0e70d4c592d5880e532667b5de299d2efbc003a243097298d9e9f4', '--format={{.State.ExitCode}}']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible