Duckietown Challenges Home Challenges Submissions

Submission 726

Submission726
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13784 step2-scoring: 13786 step3-videos: 13788 step4-viz: 13793
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

13793

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13788

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13793step4-vizsuccessyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5619117837235694
deviation-center-line_median0.10251863117452434
in-drivable-lane_median0.09999999999999998


other stats
deviation-center-line_max0.2118463495176564
deviation-center-line_mean0.11603928494954382
deviation-center-line_min0.05856940306194948
deviation-heading_max0.7507644468675223
deviation-heading_mean0.31894237256449764
deviation-heading_median0.2712192676940383
deviation-heading_min0.043767648089746966
driven_any_max3.807282123935704
driven_any_mean2.090465884685675
driven_any_median1.9216998386165616
driven_any_min0.760000000000006
driven_lanedir_max2.602700914383715
driven_lanedir_mean1.607456431681617
driven_lanedir_min0.7583624342945385
in-drivable-lane_max0.8999999999999996
in-drivable-lane_mean0.3733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2056829569488636, "driven_lanedir": 1.2449016864057645, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.19395089221437212, "deviation-center-line": 0.09588613820460816}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 1.7576645039272405, "driven_lanedir": 1.5619117837235694, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.33500960795680856, "deviation-center-line": 0.10251863117452434}, "ep003": {"driven_any": 1.9216998386165616, "driven_lanedir": 1.869405339600497, "in-drivable-lane": 0, "deviation-heading": 0.2712192676940383, "deviation-center-line": 0.11137590278898073}, "ep004": {"driven_any": 3.807282123935704, "driven_lanedir": 2.602700914383715, "in-drivable-lane": 0.8999999999999996, "deviation-heading": 0.7507644468675223, "deviation-center-line": 0.2118463495176564}}
No reset possible
13788step3-videossuccessyes0:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13786step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -16.812896430368223, "good_angle": 0.16725092791193047, "survival_time": 2.0000000000000027, "traveled_tiles": 5, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -20.090162189211696, "good_angle": 0.05127530661354473, "survival_time": 1.6000000000000016, "traveled_tiles": 4, "valid_direction": 0.10000000000000003}, "ep003": {"nsteps": 52, "reward": -18.76694420678541, "good_angle": 0.05594291817927141, "survival_time": 1.7333333333333354, "traveled_tiles": 3, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 103, "reward": -9.498041331302376, "good_angle": 0.5151282818834407, "survival_time": 3.433333333333331, "traveled_tiles": 8, "valid_direction": 0.9000000000000006}}
good_angle_max0.5151282818834407
good_angle_mean0.15852375679517197
good_angle_median0.05594291817927141
good_angle_min0.0030213493876724944
reward_max-9.498041331302376
reward_mean-22.489512902353667
reward_median-18.76694420678541
reward_min-47.27952035410063
survival_time_max3.433333333333331
survival_time_mean1.893333333333334
survival_time_min0.7
traveled_tiles_max8
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.9000000000000006
valid_direction_mean0.28000000000000014
valid_direction_median0.1333333333333333
valid_direction_min0
No reset possible
13784step1-simulationsuccessyes0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6990step1-simulationfailedno0:02:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6637step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission726/step1-simulation-nutonomy-P50-2210-job6637'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6403step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission726/step1-simulation-nutonomy-P50-2210-job6403'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5583step4-vizsuccessno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5582step4-vizsuccessno0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5581step4-vizsuccessno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5580step4-vizsuccessno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5579step4-vizerrorno0:00:49
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5579-5673', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5579-5673', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5578step3-videossuccessno0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5577step3-videossuccessno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5576step2-scoringsuccessno0:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5575step1-simulationsuccessno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible