Duckietown Challenges Home Challenges Submissions

Submission 705

Submission705
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13546 step2-scoring: 13556 step3-videos: 13559 step4-viz: 13562
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

13562

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13559

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13562step4-vizsuccessyes0:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0711773643771023
deviation-center-line_median0.05772229232644795
in-drivable-lane_median0


other stats
deviation-center-line_max0.0709747363269976
deviation-center-line_mean0.04681021951786836
deviation-center-line_min0.018599462582285224
deviation-heading_max0.2722165588357286
deviation-heading_mean0.18534345729761423
deviation-heading_median0.15599479328360444
deviation-heading_min0.1237847430311322
driven_any_max1.327980007785431
driven_any_mean1.0749868801091875
driven_any_median1.0999875048658898
driven_any_min0.7519950019463577
driven_lanedir_max1.2818869545033411
driven_lanedir_mean0.8403601946710945
driven_lanedir_min0.09265588584703988
in-drivable-lane_max0.7333333333333333
in-drivable-lane_mean0.15333333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0939837563256614, "driven_lanedir": 0.09265588584703988, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 0.2722165588357286, "deviation-center-line": 0.025413824564785067}, "ep001": {"driven_any": 1.327980007785431, "driven_lanedir": 1.2818869545033411, "in-drivable-lane": 0, "deviation-heading": 0.2208949060038085, "deviation-center-line": 0.0709747363269976}, "ep002": {"driven_any": 0.7519950019463577, "driven_lanedir": 0.6740746128764495, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.15599479328360444, "deviation-center-line": 0.018599462582285224}, "ep003": {"driven_any": 1.1009881296225992, "driven_lanedir": 1.0711773643771023, "in-drivable-lane": 0, "deviation-heading": 0.15382628533379752, "deviation-center-line": 0.05772229232644795}, "ep004": {"driven_any": 1.0999875048658898, "driven_lanedir": 1.0820061557515392, "in-drivable-lane": 0, "deviation-heading": 0.1237847430311322, "deviation-center-line": 0.06134078178882596}}
No reset possible
13559step3-videossuccessyes0:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13556step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1


other stats
episodes
details{"ep000": {"nsteps": 30, "reward": -34.24811281661193, "good_angle": 0.4864396444634765, "survival_time": 1, "traveled_tiles": 3, "valid_direction": 0.3999999999999999}, "ep001": {"nsteps": 36, "reward": -27.441358898248936, "good_angle": 0.08812782782302836, "survival_time": 1.2000000000000004, "traveled_tiles": 3, "valid_direction": 0.23333333333333384}, "ep002": {"nsteps": 21, "reward": -47.238859063369176, "good_angle": 0.12476231588068598, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 30, "reward": -33.10199307277799, "good_angle": 0.10751511249113754, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}, "ep004": {"nsteps": 30, "reward": -33.0861985348165, "good_angle": 0.08097513785746031, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}}
good_angle_max0.4864396444634765
good_angle_mean0.17756400770315775
good_angle_median0.10751511249113754
good_angle_min0.08097513785746031
reward_max-27.441358898248936
reward_mean-35.023304477164906
reward_median-33.10199307277799
reward_min-47.238859063369176
survival_time_max1.2000000000000004
survival_time_mean0.98
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.3999999999999999
valid_direction_mean0.2800000000000001
valid_direction_median0.2666666666666666
valid_direction_min0.23333333333333328
No reset possible
13546step1-simulationsuccessyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7063step1-simulationfailedno0:01:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 70, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6657step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission705/step1-simulation-nutonomy-P50-2570-job6657'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6452step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission705/step1-simulation-nutonomy-P50-2110-job6452'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5474step4-vizsuccessno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5473step3-videossuccessno0:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5472step2-scoringsuccessno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5471step1-simulationsuccessno0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible