Duckietown Challenges Home Challenges Submissions

Submission 746

Submission746
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14000 step2-scoring: 14015 step3-videos: 14019 step4-viz: 14026
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

14026

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

14019

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
14026step4-vizsuccessyes0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3463523629807135
deviation-center-line_median0.09581653293486486
in-drivable-lane_median0


other stats
deviation-center-line_max2.3065268755134656
deviation-center-line_mean0.9051169662638584
deviation-center-line_min0.039824516332313126
deviation-heading_max1.2377390771929364
deviation-heading_mean0.5918868729212153
deviation-heading_median0.1946778205556924
deviation-heading_min0.13656966799543427
driven_any_max5.3356565570777095
driven_any_mean2.260502293561827
driven_any_median0.353368752472601
driven_any_min0.1284178607242687
driven_lanedir_max4.031871811302736
driven_lanedir_mean1.5975635555991443
driven_lanedir_min0.12116910547297954
in-drivable-lane_max5.966666666666649
in-drivable-lane_mean1.973333333333328
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335248290578934, "driven_lanedir": 3.352460839267476, "in-drivable-lane": 5.966666666666649, "deviation-heading": 1.2377390771929364, "deviation-center-line": 2.037428841538106}, "ep001": {"driven_any": 0.353368752472601, "driven_lanedir": 0.3463523629807135, "in-drivable-lane": 0, "deviation-heading": 0.1946778205556924, "deviation-center-line": 0.09581653293486486}, "ep002": {"driven_any": 5.3356565570777095, "driven_lanedir": 4.031871811302736, "in-drivable-lane": 3.8999999999999906, "deviation-heading": 1.209756277939214, "deviation-center-line": 2.3065268755134656}, "ep003": {"driven_any": 0.14982000695562264, "driven_lanedir": 0.13596365897181828, "in-drivable-lane": 0, "deviation-heading": 0.1806915209228, "deviation-center-line": 0.039824516332313126}, "ep004": {"driven_any": 0.1284178607242687, "driven_lanedir": 0.12116910547297954, "in-drivable-lane": 0, "deviation-heading": 0.13656966799543427, "deviation-center-line": 0.04598806500054215}}
No reset possible
14019step3-videossuccessyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
14015step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.166666666666667


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.06683571355347522, "good_angle": 1.2746931919540363, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.766666666666689}, "ep001": {"nsteps": 35, "reward": -28.229087582257176, "good_angle": 0.05192200835770649, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0.16666666666666685}, "ep002": {"nsteps": 500, "reward": 0.19289504570607097, "good_angle": 0.6910098552034001, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.7666666666666666}, "ep003": {"nsteps": 16, "reward": -62.24102240492357, "good_angle": 0.1925927780764332, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666667}, "ep004": {"nsteps": 14, "reward": -71.27738340358648, "good_angle": 0.10578136669170986, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0.19999999999999996}}
good_angle_max1.2746931919540363
good_angle_mean0.4631998400566572
good_angle_median0.1925927780764332
good_angle_min0.05192200835770649
reward_max0.19289504570607097
reward_mean-32.29755252630154
reward_median-28.229087582257176
reward_min-71.27738340358648
survival_time_max16.666666666666654
survival_time_mean7.099999999999994
survival_time_min0.4666666666666666
traveled_tiles_max10
traveled_tiles_mean5
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666689
valid_direction_mean1.033333333333338
valid_direction_median0.2666666666666667
valid_direction_min0.16666666666666685
No reset possible
14000step1-simulationsuccessyes0:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6980step4-vizsuccessyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6977step3-videossuccessyes0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6976step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6969step1-simulationsuccessno0:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6613step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission746/step1-simulation-nutonomy-P50-2210-job6613'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6387step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission746/step1-simulation-nutonomy-P50-2210-job6387'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5665step4-vizsuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5664step4-vizsuccessno0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5663step3-videossuccessno0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5662step3-videossuccessno0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5661step3-videossuccessno0:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5660step3-videoserrorno0:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5660-4616', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5660-4616', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5659step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5658step1-simulationsuccessno0:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5657step1-simulationfailedno0:08:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5656step1-simulationfailedno0:07:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5655step1-simulationsuccessno0:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5654step1-simulationsuccessno0:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible