Duckietown Challenges Home Challenges Submissions

Submission 787

Submission787
Competingyes
Challengeaido1_LF1_r3-v3
UserCliff Li
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11873 step2-scoring: 11883 step3-videos: 11888 step4-viz: 11894
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
Blessingn/a
User priority50

11894

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11888

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11894step4-vizsuccessyes0:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7583624342945385
deviation-center-line_median0.05856940306194948
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.0848318451919554
deviation-center-line_mean0.046692309596965104
deviation-center-line_min0.00493459316827017
deviation-heading_max0.17871954277822616
deviation-heading_mean0.12290238968183878
deviation-heading_median0.1404921816205833
deviation-heading_min0.043767648089746966
driven_any_max1.12
driven_any_mean0.9520000000000014
driven_any_median1.0400000000000025
driven_any_min0.7599999999999976
driven_lanedir_max1.0891907711875215
driven_lanedir_mean0.7157737741226108
driven_lanedir_min0.00431907202387416
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.1733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0400000000000025, "driven_lanedir": 0.00431907202387416, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.1516782451032673, "deviation-center-line": 0.00493459316827017}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 0.7599999999999976, "driven_lanedir": 0.6711343097180644, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17871954277822616, "deviation-center-line": 0.02298492709392346}, "ep003": {"driven_any": 1.0800000000000007, "driven_lanedir": 1.0558622833890554, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09985433081737012, "deviation-center-line": 0.0848318451919554}, "ep004": {"driven_any": 1.12, "driven_lanedir": 1.0891907711875215, "in-drivable-lane": 0, "deviation-heading": 0.1404921816205833, "deviation-center-line": 0.062140779468727016}}
No reset possible
11888step3-videossuccessyes0:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11883step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}}
good_angle_max0.5231223188267838
good_angle_mean0.18979987683516303
good_angle_median0.13484239023230782
good_angle_min0.0030213493876724944
reward_max-33.12740348378817
reward_mean-39.758097890022654
reward_median-36.6421162430197
reward_min-47.27952035410063
survival_time_max1
survival_time_mean0.86
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.3666666666666666
valid_direction_mean0.2399999999999999
valid_direction_median0.26666666666666666
valid_direction_min0
No reset possible
11873step1-simulationsuccessyes0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6812step1-simulationerrorno0:12:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6571step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission787/step1-simulation-nutonomy-P50-2110-job6571'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6337step1-simulationabortedno0:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6336step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission787/step1-simulation-nutonomy-P50-2110-job6336'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5856step1-simulationerrorno0:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible