Duckietown Challenges Home Challenges Submissions

Submission 3421

Submission3421
Competingyes
Challengeaido2-LFVI-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22315
Next
User labelRL-TH-shi
Admin priority50
Blessingn/a
User priority50

22315

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22315step1-simulationsuccessyes0:30:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.916094626819949
survival_time_median14.950000000000076
deviation-center-line_median0.8606150122378815
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.21380928993225096
agent_compute-ego_mean0.2081428949038188
agent_compute-ego_median0.2103812305132548
agent_compute-ego_min0.20084268252054852
deviation-center-line_max1.0483696454307876
deviation-center-line_mean0.7993229731576768
deviation-center-line_min0.5281324390193615
deviation-heading_max11.473691444175358
deviation-heading_mean5.32009724202293
deviation-heading_median4.65083314339173
deviation-heading_min2.4704191522071404
driven_any_max3.893676864522855
driven_any_mean3.18684995738453
driven_any_median3.2970029099472744
driven_any_min2.012996464488273
driven_lanedir_consec_max3.401995979504061
driven_lanedir_consec_mean2.654219016449592
driven_lanedir_consec_min1.3502694785696452
driven_lanedir_max3.8077683127665303
driven_lanedir_mean3.0006873508398764
driven_lanedir_median3.1924599668555924
driven_lanedir_min1.7753450088765883
in-drivable-lane_max1.500000000000021
in-drivable-lane_mean0.7200000000000099
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.995786748282571, "sim_physics": 0.11409135739008586, "survival_time": 14.950000000000076, "driven_lanedir": 2.5560552680510304, "sim_render-ego": 0.060377734502156576, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.2103812305132548, "deviation-heading": 4.65083314339173, "set_robot_commands": 0.07784984668095907, "deviation-center-line": 0.923138445806659, "driven_lanedir_consec": 2.3208870990580786, "sim_compute_sim_state": 0.035714773337046306, "sim_compute_performance-ego": 0.06352473735809326, "sim_compute_robot_state-ego": 0.06243804454803467, "sim_compute_robot_state-npc0": 0.06889247099558513, "sim_compute_robot_state-npc1": 0.06555973370869954, "sim_compute_robot_state-npc2": 0.06380946715672811, "sim_compute_robot_state-npc3": 0.06317624886830647}, "udem1-1-0": {"driven_any": 3.7347867996816766, "sim_physics": 0.11490883429845174, "survival_time": 14.950000000000076, "driven_lanedir": 3.671808197649641, "sim_render-ego": 0.06102855682373047, "in-drivable-lane": 0, "agent_compute-ego": 0.21077405373255412, "deviation-heading": 2.680620794569201, "set_robot_commands": 0.07806799173355103, "deviation-center-line": 0.8606150122378815, "driven_lanedir_consec": 3.281847898296226, "sim_compute_sim_state": 0.03646273295084635, "sim_compute_performance-ego": 0.06528626124064128, "sim_compute_robot_state-ego": 0.06224062442779541, "sim_compute_robot_state-npc0": 0.06974755128224691, "sim_compute_robot_state-npc1": 0.06553961674372355, "sim_compute_robot_state-npc2": 0.06584622701009114, "sim_compute_robot_state-npc3": 0.06523630619049073}, "udem1-2-0": {"driven_any": 2.012996464488273, "sim_physics": 0.11165128231048584, "survival_time": 14.950000000000076, "driven_lanedir": 1.7753450088765883, "sim_render-ego": 0.06072304566701253, "in-drivable-lane": 1.400000000000018, "agent_compute-ego": 0.21380928993225096, "deviation-heading": 11.473691444175358, "set_robot_commands": 0.07676722129185995, "deviation-center-line": 0.636359323293694, "driven_lanedir_consec": 1.3502694785696452, "sim_compute_sim_state": 0.03632591247558594, "sim_compute_performance-ego": 0.06270304044087728, "sim_compute_robot_state-ego": 0.06185733954111735, "sim_compute_robot_state-npc0": 0.07032565196355184, "sim_compute_robot_state-npc1": 0.06464678923288981, "sim_compute_robot_state-npc2": 0.06358572562535604, "sim_compute_robot_state-npc3": 0.06492186705271404}, "udem1-3-0": {"driven_any": 3.893676864522855, "sim_physics": 0.11190664291381835, "survival_time": 14.950000000000076, "driven_lanedir": 3.8077683127665303, "sim_render-ego": 0.05457657416661581, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.20490721782048543, "deviation-heading": 2.4704191522071404, "set_robot_commands": 0.07601261695226033, "deviation-center-line": 0.5281324390193615, "driven_lanedir_consec": 3.401995979504061, "sim_compute_sim_state": 0.032897809346516926, "sim_compute_performance-ego": 0.0588598903020223, "sim_compute_robot_state-ego": 0.059347006479899087, "sim_compute_robot_state-npc0": 0.06279758214950562, "sim_compute_robot_state-npc1": 0.05908893903096517, "sim_compute_robot_state-npc2": 0.0592145578066508, "sim_compute_robot_state-npc3": 0.05888271649678548}, "udem1-4-0": {"driven_any": 3.2970029099472744, "sim_physics": 0.11164735555648804, "survival_time": 14.950000000000076, "driven_lanedir": 3.1924599668555924, "sim_render-ego": 0.054304958979288734, "in-drivable-lane": 0, "agent_compute-ego": 0.20084268252054852, "deviation-heading": 5.324921675771223, "set_robot_commands": 0.07452600161234538, "deviation-center-line": 1.0483696454307876, "driven_lanedir_consec": 2.916094626819949, "sim_compute_sim_state": 0.03290920893351237, "sim_compute_performance-ego": 0.05992117722829183, "sim_compute_robot_state-ego": 0.05942683696746826, "sim_compute_robot_state-npc0": 0.06361538489659627, "sim_compute_robot_state-npc1": 0.06071796814600627, "sim_compute_robot_state-npc2": 0.05930263678232829, "sim_compute_robot_state-npc3": 0.05929578463236491}}
set_robot_commands_max0.07806799173355103
set_robot_commands_mean0.07664473565419513
set_robot_commands_median0.07676722129185995
set_robot_commands_min0.07452600161234538
sim_compute_performance-ego_max0.06528626124064128
sim_compute_performance-ego_mean0.0620590213139852
sim_compute_performance-ego_median0.06270304044087728
sim_compute_performance-ego_min0.0588598903020223
sim_compute_robot_state-ego_max0.06243804454803467
sim_compute_robot_state-ego_mean0.06106197039286295
sim_compute_robot_state-ego_median0.06185733954111735
sim_compute_robot_state-ego_min0.059347006479899087
sim_compute_robot_state-npc0_max0.07032565196355184
sim_compute_robot_state-npc0_mean0.06707572825749715
sim_compute_robot_state-npc0_median0.06889247099558513
sim_compute_robot_state-npc0_min0.06279758214950562
sim_compute_robot_state-npc1_max0.06555973370869954
sim_compute_robot_state-npc1_mean0.06311060937245687
sim_compute_robot_state-npc1_median0.06464678923288981
sim_compute_robot_state-npc1_min0.05908893903096517
sim_compute_robot_state-npc2_max0.06584622701009114
sim_compute_robot_state-npc2_mean0.06235172287623088
sim_compute_robot_state-npc2_median0.06358572562535604
sim_compute_robot_state-npc2_min0.0592145578066508
sim_compute_robot_state-npc3_max0.06523630619049073
sim_compute_robot_state-npc3_mean0.062302584648132334
sim_compute_robot_state-npc3_median0.06317624886830647
sim_compute_robot_state-npc3_min0.05888271649678548
sim_compute_sim_state_max0.03646273295084635
sim_compute_sim_state_mean0.03486208740870158
sim_compute_sim_state_median0.035714773337046306
sim_compute_sim_state_min0.032897809346516926
sim_physics_max0.11490883429845174
sim_physics_mean0.11284109449386596
sim_physics_median0.11190664291381835
sim_physics_min0.11164735555648804
sim_render-ego_max0.06102855682373047
sim_render-ego_mean0.058202174027760824
sim_render-ego_median0.060377734502156576
sim_render-ego_min0.054304958979288734
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
22083step1-simulationsuccessno0:18:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
22070step1-simulationhost-errorno0:31:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22070-659364', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22070-659364', 'down']:

   >  Command '['docker-compose', '-p', 'job22070-659364', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible