Duckietown Challenges Home Challenges Submissions

Submission 785

Submission785
Competingyes
Challengeaido1_LF1_r3-v3
UserFrancesco Milano
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 11849 step2-scoring: 6826 step3-videos: 6828 step4-viz: 6832
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
Blessingn/a
User priority50

6832

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

6828

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11849step1-simulationerroryes0:03:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6832step4-vizsuccessyes0:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1457656061451469
deviation-center-line_median0.07346075850793322
in-drivable-lane_median0


other stats
deviation-center-line_max0.08063070759446563
deviation-center-line_mean0.06525960383834356
deviation-center-line_min0.03414125009254369
deviation-heading_max0.4004931717127147
deviation-heading_mean0.30729853033532556
deviation-heading_median0.314017142924901
deviation-heading_min0.24832242064753093
driven_any_max0.3658462447019392
driven_any_mean0.2015887470806599
driven_any_median0.1717237475131552
driven_any_min0.12692624816189793
driven_lanedir_max0.15419106879424893
driven_lanedir_mean0.11408044672409308
driven_lanedir_min0.002331408876295904
in-drivable-lane_max1.500000000000002
in-drivable-lane_mean0.3000000000000004
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3658462447019392, "driven_lanedir": 0.002331408876295904, "in-drivable-lane": 1.500000000000002, "deviation-heading": 0.24832242064753093, "deviation-center-line": 0.03414125009254369}, "ep001": {"driven_any": 0.12692624816189793, "driven_lanedir": 0.11427240428925912, "in-drivable-lane": 0, "deviation-heading": 0.24924170622426584, "deviation-center-line": 0.07346075850793322}, "ep002": {"driven_any": 0.16425749762127798, "driven_lanedir": 0.1457656061451469, "in-drivable-lane": 0, "deviation-heading": 0.3244182101672154, "deviation-center-line": 0.07493942418307827}, "ep003": {"driven_any": 0.17918999740502944, "driven_lanedir": 0.15384174551551455, "in-drivable-lane": 0, "deviation-heading": 0.4004931717127147, "deviation-center-line": 0.06312587881369701}, "ep004": {"driven_any": 0.1717237475131552, "driven_lanedir": 0.15419106879424893, "in-drivable-lane": 0, "deviation-heading": 0.314017142924901, "deviation-center-line": 0.08063070759446563}}
No reset possible
6831step4-vizsuccessyes0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6828step3-videossuccessyes0:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6826step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8333333333333333


other stats
episodes
details{"ep000": {"nsteps": 51, "reward": -21.1743085034849, "good_angle": 3.884118181265496, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 1.5666666666666684}, "ep001": {"nsteps": 19, "reward": -53.28756666026617, "good_angle": 0.14422009081761158, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 24, "reward": -42.191059398154415, "good_angle": 0.20724530639980177, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep003": {"nsteps": 26, "reward": -38.8698256078821, "good_angle": 0.2809590101358145, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 25, "reward": -40.539133900403975, "good_angle": 0.19690358841402775, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max3.884118181265496
good_angle_mean0.9426892354065504
good_angle_median0.20724530639980177
good_angle_min0.14422009081761158
reward_max-21.1743085034849
reward_mean-39.21237881403831
reward_median-40.539133900403975
reward_min-53.28756666026617
survival_time_max1.700000000000002
survival_time_mean0.966666666666667
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.5666666666666684
valid_direction_mean0.7000000000000003
valid_direction_median0.49999999999999994
valid_direction_min0.4
No reset possible
6821step1-simulationsuccessno0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6573step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission785/step1-simulation-nutonomy-P50-2210-job6573'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6340step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission785/step1-simulation-nutonomy-P50-2110-job6340'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5875step4-vizsuccessno0:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5874step3-videossuccessno0:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5873step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5872step2-scoringsuccessno0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5854step2-scoringtimeoutno0:31:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5847step1-simulationsuccessno0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible