Duckietown Challenges Home Challenges Submissions

Submission 3402

Submission3402
Competingyes
Challengeaido2-LFV-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22338
Next
User labelRL-TH-shi
Admin priority50
Blessingn/a
User priority50

22338

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22338step1-simulationsuccessyes0:31:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0656256711545056
survival_time_median14.950000000000076
deviation-center-line_median1.067962415499822
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.17157697677612305
agent_compute-ego_mean0.1661475680247456
agent_compute-ego_median0.16582575379585734
agent_compute-ego_min0.1575186038017273
deviation-center-line_max1.3050316432676294
deviation-center-line_mean0.939056391191476
deviation-center-line_min0.2352082649629227
deviation-heading_max8.476768494662194
deviation-heading_mean4.140557172545289
deviation-heading_median3.0429296736689047
deviation-heading_min1.500030541342493
driven_any_max3.794125700053806
driven_any_mean2.4869055410177014
driven_any_median2.612878294174509
driven_any_min1.4086570521625874
driven_lanedir_consec_max3.742087276869941
driven_lanedir_consec_mean2.2992516928522773
driven_lanedir_consec_min1.254594619368286
driven_lanedir_max3.742087276869941
driven_lanedir_mean2.3843231188552685
driven_lanedir_median2.4306487193687563
driven_lanedir_min1.3149287011689903
in-drivable-lane_max4.099999999999985
in-drivable-lane_mean1.1700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7094953140588514, "sim_physics": 0.1594630495707194, "survival_time": 14.950000000000076, "driven_lanedir": 2.6525567712103726, "sim_render-ego": 0.05655939896901448, "in-drivable-lane": 0, "agent_compute-ego": 0.1575186038017273, "deviation-heading": 3.0429296736689047, "set_robot_commands": 0.08654730717341105, "deviation-center-line": 1.3050316432676294, "driven_lanedir_consec": 2.6525567712103726, "sim_compute_sim_state": 0.03513382434844971, "sim_compute_performance-ego": 0.06142990112304687, "sim_compute_robot_state-ego": 0.0656575067838033, "sim_compute_robot_state-npc0": 0.06254857540130615, "sim_compute_robot_state-npc1": 0.061590179602305097, "sim_compute_robot_state-npc2": 0.061166305541992184, "sim_compute_robot_state-npc3": 0.06215750296910604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.794125700053806, "sim_physics": 0.17906782229741414, "survival_time": 14.950000000000076, "driven_lanedir": 3.742087276869941, "sim_render-ego": 0.05846297740936279, "in-drivable-lane": 0, "agent_compute-ego": 0.17134380181630451, "deviation-heading": 2.262240256023796, "set_robot_commands": 0.09059075196584064, "deviation-center-line": 1.067962415499822, "driven_lanedir_consec": 3.742087276869941, "sim_compute_sim_state": 0.03646530866622925, "sim_compute_performance-ego": 0.06677495479583741, "sim_compute_robot_state-ego": 0.0705595866839091, "sim_compute_robot_state-npc0": 0.06733516216278077, "sim_compute_robot_state-npc1": 0.06486596584320069, "sim_compute_robot_state-npc2": 0.06476866642634074, "sim_compute_robot_state-npc3": 0.0646024481455485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.612878294174509, "sim_physics": 0.16263309790163624, "survival_time": 14.700000000000074, "driven_lanedir": 2.4306487193687563, "sim_render-ego": 0.05863287578634664, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.16582575379585734, "deviation-heading": 5.420816897029061, "set_robot_commands": 0.09164221676028504, "deviation-center-line": 1.197885946037198, "driven_lanedir_consec": 2.0656256711545056, "sim_compute_sim_state": 0.03645126998019056, "sim_compute_performance-ego": 0.06632480410491529, "sim_compute_robot_state-ego": 0.06964137278446535, "sim_compute_robot_state-npc0": 0.06554411138807024, "sim_compute_robot_state-npc1": 0.06411471577728686, "sim_compute_robot_state-npc2": 0.06464217876901432, "sim_compute_robot_state-npc3": 0.06445423194340297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4086570521625874, "sim_physics": 0.15182961225509645, "survival_time": 14.950000000000076, "driven_lanedir": 1.3149287011689903, "sim_render-ego": 0.05691541751225789, "in-drivable-lane": 4.099999999999985, "agent_compute-ego": 0.16447270393371582, "deviation-heading": 8.476768494662194, "set_robot_commands": 0.09010095755259195, "deviation-center-line": 0.8891936861898081, "driven_lanedir_consec": 1.254594619368286, "sim_compute_sim_state": 0.03670051495234171, "sim_compute_performance-ego": 0.06298758029937744, "sim_compute_robot_state-ego": 0.06820156415303548, "sim_compute_robot_state-npc0": 0.06556615670522054, "sim_compute_robot_state-npc1": 0.06560276110967, "sim_compute_robot_state-npc2": 0.06421844482421875, "sim_compute_robot_state-npc3": 0.06594360669453939}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9093713446387544, "sim_physics": 0.15730951513562882, "survival_time": 6.999999999999983, "driven_lanedir": 1.7813941256582806, "sim_render-ego": 0.061457674843924386, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.17157697677612305, "deviation-heading": 1.500030541342493, "set_robot_commands": 0.09291960852486748, "deviation-center-line": 0.2352082649629227, "driven_lanedir_consec": 1.7813941256582806, "sim_compute_sim_state": 0.03777547223227365, "sim_compute_performance-ego": 0.06616788932255337, "sim_compute_robot_state-ego": 0.07253009080886841, "sim_compute_robot_state-npc0": 0.06814404726028442, "sim_compute_robot_state-npc1": 0.06711064577102661, "sim_compute_robot_state-npc2": 0.06574511698314121, "sim_compute_robot_state-npc3": 0.06774926696504865}}
set_robot_commands_max0.09291960852486748
set_robot_commands_mean0.09036016839539925
set_robot_commands_median0.09059075196584064
set_robot_commands_min0.08654730717341105
sim_compute_performance-ego_max0.06677495479583741
sim_compute_performance-ego_mean0.06473702592914607
sim_compute_performance-ego_median0.06616788932255337
sim_compute_performance-ego_min0.06142990112304687
sim_compute_robot_state-ego_max0.07253009080886841
sim_compute_robot_state-ego_mean0.06931802424281633
sim_compute_robot_state-ego_median0.06964137278446535
sim_compute_robot_state-ego_min0.0656575067838033
sim_compute_robot_state-npc0_max0.06814404726028442
sim_compute_robot_state-npc0_mean0.06582761058353241
sim_compute_robot_state-npc0_median0.06556615670522054
sim_compute_robot_state-npc0_min0.06254857540130615
sim_compute_robot_state-npc1_max0.06711064577102661
sim_compute_robot_state-npc1_mean0.06465685362069785
sim_compute_robot_state-npc1_median0.06486596584320069
sim_compute_robot_state-npc1_min0.061590179602305097
sim_compute_robot_state-npc2_max0.06574511698314121
sim_compute_robot_state-npc2_mean0.06410814250894145
sim_compute_robot_state-npc2_median0.06464217876901432
sim_compute_robot_state-npc2_min0.061166305541992184
sim_compute_robot_state-npc3_max0.06774926696504865
sim_compute_robot_state-npc3_mean0.06498141134352911
sim_compute_robot_state-npc3_median0.0646024481455485
sim_compute_robot_state-npc3_min0.06215750296910604
sim_compute_sim_state_max0.03777547223227365
sim_compute_sim_state_mean0.036505278035896975
sim_compute_sim_state_median0.03646530866622925
sim_compute_sim_state_min0.03513382434844971
sim_physics_max0.17906782229741414
sim_physics_mean0.162060619432099
sim_physics_median0.1594630495707194
sim_physics_min0.15182961225509645
sim_render-ego_max0.061457674843924386
sim_render-ego_mean0.05840566890418124
sim_render-ego_median0.05846297740936279
sim_render-ego_min0.05655939896901448
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.31000000000006
survival_time_min6.999999999999983
No reset possible
22042step1-simulationsuccessno0:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
22041step1-simulationhost-errorno0:06:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22041-812164', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22041-812164', 'down']:

   >  Command '['docker-compose', '-p', 'job22041-812164', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible