Duckietown Challenges Home Challenges Submissions

Submission 3384

Submission3384
Competingyes
Challengeaido2-LFV-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22359
Next
User labelRL-TH-shi
Admin priority50
Blessingn/a
User priority50

22359

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22359step1-simulationsuccessyes0:29:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.014963426083584
survival_time_median14.950000000000076
deviation-center-line_median0.7835435398988666
in-drivable-lane_median1.2500000000000018


other stats
agent_compute-ego_max0.17468318382898967
agent_compute-ego_mean0.16892855939625537
agent_compute-ego_median0.16805754820505778
agent_compute-ego_min0.16395220705257949
deviation-center-line_max1.1420799755697089
deviation-center-line_mean0.6905197721352371
deviation-center-line_min0.11120974714089606
deviation-heading_max5.288306496665341
deviation-heading_mean2.354684133490915
deviation-heading_median2.316078363499446
deviation-heading_min0.4761406434174122
driven_any_max3.589118018203941
driven_any_mean2.278782555309843
driven_any_median2.3571086635878236
driven_any_min0.7866079095386854
driven_lanedir_consec_max3.3597020570676293
driven_lanedir_consec_mean1.9481957680427784
driven_lanedir_consec_min0.6807447403868805
driven_lanedir_max3.3597020570676293
driven_lanedir_mean1.9553465332756064
driven_lanedir_median2.0507172522477246
driven_lanedir_min0.6807447403868805
in-drivable-lane_max13.100000000000076
in-drivable-lane_mean3.720000000000023
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7866079095386854, "sim_physics": 0.15188687721888225, "survival_time": 14.950000000000076, "driven_lanedir": 0.6807447403868805, "sim_render-ego": 0.05911167621612549, "in-drivable-lane": 13.100000000000076, "agent_compute-ego": 0.16408493836720783, "deviation-heading": 0.4761406434174122, "set_robot_commands": 0.09264017422993978, "deviation-center-line": 0.11120974714089606, "driven_lanedir_consec": 0.6807447403868805, "sim_compute_sim_state": 0.03724752426147461, "sim_compute_performance-ego": 0.0665476409594218, "sim_compute_robot_state-ego": 0.07028584718704224, "sim_compute_robot_state-npc0": 0.06644086519877115, "sim_compute_robot_state-npc1": 0.06515290180842082, "sim_compute_robot_state-npc2": 0.06672252337137859, "sim_compute_robot_state-npc3": 0.06597165822982788}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.589118018203941, "sim_physics": 0.200612850189209, "survival_time": 14.950000000000076, "driven_lanedir": 3.3597020570676293, "sim_render-ego": 0.0583255664507548, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.16805754820505778, "deviation-heading": 2.979443906575837, "set_robot_commands": 0.0901508871714274, "deviation-center-line": 1.1398250402165415, "driven_lanedir_consec": 3.3597020570676293, "sim_compute_sim_state": 0.037813059488932294, "sim_compute_performance-ego": 0.06568450927734375, "sim_compute_robot_state-ego": 0.07163995901743571, "sim_compute_robot_state-npc0": 0.06618937412897746, "sim_compute_robot_state-npc1": 0.06750948985417683, "sim_compute_robot_state-npc2": 0.06385759830474853, "sim_compute_robot_state-npc3": 0.06501540104548137}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6176315741315754, "sim_physics": 0.16855825147321146, "survival_time": 4.6499999999999915, "driven_lanedir": 1.2379019004726923, "sim_render-ego": 0.05730776632985761, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.16395220705257949, "deviation-heading": 0.7134512572965398, "set_robot_commands": 0.086898926765688, "deviation-center-line": 0.27594055785017235, "driven_lanedir_consec": 1.2379019004726923, "sim_compute_sim_state": 0.035206525556502805, "sim_compute_performance-ego": 0.06328994997086064, "sim_compute_robot_state-ego": 0.06590979073637275, "sim_compute_robot_state-npc0": 0.06359380547718335, "sim_compute_robot_state-npc1": 0.062002017933835266, "sim_compute_robot_state-npc2": 0.06060944064970939, "sim_compute_robot_state-npc3": 0.06308477155623897}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3571086635878236, "sim_physics": 0.16992889006932577, "survival_time": 14.950000000000076, "driven_lanedir": 2.0507172522477246, "sim_render-ego": 0.06156554460525512, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.17468318382898967, "deviation-heading": 5.288306496665341, "set_robot_commands": 0.09102298418680826, "deviation-center-line": 1.1420799755697089, "driven_lanedir_consec": 2.014963426083584, "sim_compute_sim_state": 0.04204496224721273, "sim_compute_performance-ego": 0.0675730315844218, "sim_compute_robot_state-ego": 0.07232025067011515, "sim_compute_robot_state-npc0": 0.06788545449574789, "sim_compute_robot_state-npc1": 0.06832826852798463, "sim_compute_robot_state-npc2": 0.06820342381795247, "sim_compute_robot_state-npc3": 0.06831830978393555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0434466110871914, "sim_physics": 0.16900892595274258, "survival_time": 11.300000000000026, "driven_lanedir": 2.4476667162031065, "sim_render-ego": 0.060848805756695504, "in-drivable-lane": 1.2500000000000018, "agent_compute-ego": 0.17386491952744204, "deviation-heading": 2.316078363499446, "set_robot_commands": 0.09639366643618694, "deviation-center-line": 0.7835435398988666, "driven_lanedir_consec": 2.4476667162031065, "sim_compute_sim_state": 0.03841309104345541, "sim_compute_performance-ego": 0.07094153260762713, "sim_compute_robot_state-ego": 0.07593006264846937, "sim_compute_robot_state-npc0": 0.07030968433987778, "sim_compute_robot_state-npc1": 0.06892363265552352, "sim_compute_robot_state-npc2": 0.06802891313502218, "sim_compute_robot_state-npc3": 0.06817817266008495}}
set_robot_commands_max0.09639366643618694
set_robot_commands_mean0.09142132775801008
set_robot_commands_median0.09102298418680826
set_robot_commands_min0.086898926765688
sim_compute_performance-ego_max0.07094153260762713
sim_compute_performance-ego_mean0.06680733287993502
sim_compute_performance-ego_median0.0665476409594218
sim_compute_performance-ego_min0.06328994997086064
sim_compute_robot_state-ego_max0.07593006264846937
sim_compute_robot_state-ego_mean0.07121718205188704
sim_compute_robot_state-ego_median0.07163995901743571
sim_compute_robot_state-ego_min0.06590979073637275
sim_compute_robot_state-npc0_max0.07030968433987778
sim_compute_robot_state-npc0_mean0.06688383672811152
sim_compute_robot_state-npc0_median0.06644086519877115
sim_compute_robot_state-npc0_min0.06359380547718335
sim_compute_robot_state-npc1_max0.06892363265552352
sim_compute_robot_state-npc1_mean0.0663832621559882
sim_compute_robot_state-npc1_median0.06750948985417683
sim_compute_robot_state-npc1_min0.062002017933835266
sim_compute_robot_state-npc2_max0.06820342381795247
sim_compute_robot_state-npc2_mean0.06548437985576223
sim_compute_robot_state-npc2_median0.06672252337137859
sim_compute_robot_state-npc2_min0.06060944064970939
sim_compute_robot_state-npc3_max0.06831830978393555
sim_compute_robot_state-npc3_mean0.06611366265511374
sim_compute_robot_state-npc3_median0.06597165822982788
sim_compute_robot_state-npc3_min0.06308477155623897
sim_compute_sim_state_max0.04204496224721273
sim_compute_sim_state_mean0.03814503251951557
sim_compute_sim_state_median0.037813059488932294
sim_compute_sim_state_min0.035206525556502805
sim_physics_max0.200612850189209
sim_physics_mean0.1719991589806742
sim_physics_median0.16900892595274258
sim_physics_min0.15188687721888225
sim_render-ego_max0.06156554460525512
sim_render-ego_mean0.05943187187173771
sim_render-ego_median0.05911167621612549
sim_render-ego_min0.05730776632985761
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.16000000000005
survival_time_min4.6499999999999915
No reset possible
22009step1-simulationsuccessno0:26:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
22003step1-simulationhost-errorno0:16:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22003-387464', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22003-387464', 'down']:

   >  Command '['docker-compose', '-p', 'job22003-387464', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible