Duckietown Challenges Home Challenges Submissions

Submission 788

Submission788
Competingyes
Challengeaido1_LF1_r3-v3
UserAoming Liu
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11886 step2-scoring: 11896 step3-videos: 11901 step4-viz: 11905
Next
User labelRandom execution
Admin priority50
Blessingn/a
User priority50

11905

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11901

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11905step4-vizsuccessyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.544461043280575
deviation-center-line_median0.10637336618235804
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.21473729915245723
deviation-center-line_mean0.11663117079720953
deviation-center-line_min0.05686042963902838
deviation-heading_max0.8003630117852052
deviation-heading_mean0.4140430142741591
deviation-heading_median0.32047851147425255
deviation-heading_min0.11132957903462216
driven_any_max1.1536794901544232
driven_any_mean0.8062409476375254
driven_any_median0.8019703109905375
driven_any_min0.421007800991154
driven_lanedir_max1.1093797361886004
driven_lanedir_mean0.5605927249364113
driven_lanedir_min0.03520414000116201
in-drivable-lane_max2.1333333333333355
in-drivable-lane_mean0.44666666666666704
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.108071633318775, "driven_lanedir": 0.03520414000116201, "in-drivable-lane": 2.1333333333333355, "deviation-heading": 0.8003630117852052, "deviation-center-line": 0.05686042963902838}, "ep001": {"driven_any": 0.421007800991154, "driven_lanedir": 0.41729046767284306, "in-drivable-lane": 0, "deviation-heading": 0.132775651379343, "deviation-center-line": 0.08589595065660494}, "ep002": {"driven_any": 0.8019703109905375, "driven_lanedir": 0.6966282375388764, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.7052683176973726, "deviation-center-line": 0.10637336618235804}, "ep003": {"driven_any": 0.5464755027327376, "driven_lanedir": 0.544461043280575, "in-drivable-lane": 0, "deviation-heading": 0.11132957903462216, "deviation-center-line": 0.11928880835559905}, "ep004": {"driven_any": 1.1536794901544232, "driven_lanedir": 1.1093797361886004, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 0.32047851147425255, "deviation-center-line": 0.21473729915245723}}
No reset possible
11901step3-videossuccessyes0:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11896step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.0000000000000027


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.322899239160485, "good_angle": 1.745366384328998, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.0666666666666649}, "ep001": {"nsteps": 32, "reward": -30.884442741051316, "good_angle": 0.019124835566901043, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 60, "reward": -15.996370818764747, "good_angle": 0.30464878482478586, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.6333333333333351}, "ep003": {"nsteps": 41, "reward": -24.05383611325084, "good_angle": 0.01010275078873688, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 85, "reward": -11.66355313760338, "good_angle": 0.3674392763506761, "survival_time": 2.833333333333333, "traveled_tiles": 3, "valid_direction": 0.899999999999997}}
good_angle_max1.745366384328998
good_angle_mean0.4893364063720197
good_angle_median0.30464878482478586
good_angle_min0.01010275078873688
reward_max-11.66355313760338
reward_mean-19.18422040996615
reward_median-15.996370818764747
reward_min-30.884442741051316
survival_time_max2.833333333333333
survival_time_mean2.000000000000001
survival_time_min1.0666666666666669
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0666666666666649
valid_direction_mean0.5199999999999994
valid_direction_median0.6333333333333351
valid_direction_min0
No reset possible
11886step1-simulationsuccessyes0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6819step4-vizsuccessyes0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6817step3-videossuccessyes0:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6815step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6808step1-simulationsuccessno0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6570step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission788/step1-simulation-nutonomy-P50-2210-job6570'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6334step1-simulationabortedno0:00:14
Error while running [...]

Pulling evaluator ... done
stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob174930597: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob174930597: no space left on device
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5871step4-vizsuccessno0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5870step3-videossuccessno0:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5869step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5868step2-scoringsuccessno0:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5867step1-simulationsuccessno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible