Duckietown Challenges Home Challenges Submissions

Submission 709

Submission709
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13587 step2-scoring: 13608 step3-videos: 13610 step4-viz: 13615
Next
User labelJP pipeline
Admin priority74
Blessingn/a
User priority74

13615

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13610

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13615step4-vizsuccessyes0:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median15.188012674967652
deviation-center-line_median0.9873977066194278
in-drivable-lane_median3.099999999999989


other stats
deviation-center-line_max1.034629298733854
deviation-center-line_mean0.9754386007554764
deviation-center-line_min0.8981031065611349
deviation-heading_max2.3853268628651394
deviation-heading_mean2.233066432800677
deviation-heading_median2.2396969876721093
deviation-heading_min2.089373408559456
driven_any_max19.061687764503596
driven_any_mean18.968070409795036
driven_any_median18.96990808335345
driven_any_min18.838613531725183
driven_lanedir_max16.19277825872027
driven_lanedir_mean15.06133680572034
driven_lanedir_min13.277050153308757
in-drivable-lane_max4.766666666666666
in-drivable-lane_mean3.179999999999997
in-drivable-lane_min2.200000000000006
per-episodes
details{"ep000": {"driven_any": 18.838613531725183, "driven_lanedir": 13.277050153308757, "in-drivable-lane": 4.766666666666666, "deviation-heading": 2.1687473943856985, "deviation-center-line": 0.8981031065611349}, "ep001": {"driven_any": 19.061687764503596, "driven_lanedir": 15.771213246143402, "in-drivable-lane": 2.633333333333331, "deviation-heading": 2.282187510520981, "deviation-center-line": 0.9873977066194278}, "ep002": {"driven_any": 19.049089629336247, "driven_lanedir": 16.19277825872027, "in-drivable-lane": 2.200000000000006, "deviation-heading": 2.2396969876721093, "deviation-center-line": 0.9876552921755644}, "ep003": {"driven_any": 18.921053040056705, "driven_lanedir": 15.188012674967652, "in-drivable-lane": 3.099999999999989, "deviation-heading": 2.089373408559456, "deviation-center-line": 0.9694075996874004}, "ep004": {"driven_any": 18.96990808335345, "driven_lanedir": 14.87762969546162, "in-drivable-lane": 3.1999999999999913, "deviation-heading": 2.3853268628651394, "deviation-center-line": 1.034629298733854}}
No reset possible
13610step3-videossuccessyes0:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13608step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.3760608980022371, "good_angle": 1.3993681359402834, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.933333333333324}, "ep001": {"nsteps": 500, "reward": 0.5755687124319374, "good_angle": 1.087956023710125, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.733333333333334}, "ep002": {"nsteps": 500, "reward": 0.5731831927709281, "good_angle": 0.9565638553895884, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.1666666666666594}, "ep003": {"nsteps": 500, "reward": 0.482005890559405, "good_angle": 0.9054896641768444, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4666666666666583}, "ep004": {"nsteps": 500, "reward": 0.4805345337111503, "good_angle": 1.4048006677158351, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2999999999999936}}
good_angle_max1.4048006677158351
good_angle_mean1.1508356693865354
good_angle_median1.087956023710125
good_angle_min0.9054896641768444
reward_max0.5755687124319374
reward_mean0.4974706454951316
reward_median0.482005890559405
reward_min0.3760608980022371
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max3.2999999999999936
valid_direction_mean2.7199999999999935
valid_direction_median2.733333333333334
valid_direction_min2.1666666666666594
No reset possible
13587step1-simulationsuccessyes0:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7084step4-vizsuccessyes0:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7074step3-videossuccessyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7071step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7052step1-simulationsuccessno0:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6653step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission709/step1-simulation-nutonomy-P50-2110-job6653'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6447step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission709/step1-simulation-nutonomy-P50-2570-job6447'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5488step4-vizsuccessno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5487step4-vizsuccessno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5486step3-videossuccessno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5485step3-videossuccessno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5484step2-scoringsuccessno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5483step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5482step1-simulationsuccessno0:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible