Duckietown Challenges Home Challenges Submissions

Submission 570

Submission570
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12211 step2-scoring: 12223 step3-videos: 12226 step4-viz: 12231
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

12231

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12226

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12231step4-vizsuccessyes0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5549316000371993
deviation-center-line_median0.10851656512874833
in-drivable-lane_median0.8666666666666666


other stats
deviation-center-line_max0.5571463132164043
deviation-center-line_mean0.2343432542081735
deviation-center-line_min0.009312279635657847
deviation-heading_max2.278240732445088
deviation-heading_mean1.0767683499795977
deviation-heading_median0.5800003265972268
deviation-heading_min0.08034838911007319
driven_any_max5.8726763831947375
driven_any_mean2.297150366860248
driven_any_median0.9187714112970216
driven_any_min0.4830706091146239
driven_lanedir_max2.624800359510078
driven_lanedir_mean1.1251524730087958
driven_lanedir_min0.005667026202823777
in-drivable-lane_max4.933333333333318
in-drivable-lane_mean1.7799999999999965
in-drivable-lane_min0.5666666666666684
per-episodes
details{"ep000": {"driven_any": 0.4830706091146239, "driven_lanedir": 0.005667026202823777, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.08034838911007319, "deviation-center-line": 0.009312279635657847}, "ep001": {"driven_any": 0.9187714112970216, "driven_lanedir": 0.5549316000371993, "in-drivable-lane": 0.5666666666666684, "deviation-heading": 0.5800003265972268, "deviation-center-line": 0.10851656512874833}, "ep002": {"driven_any": 3.447797339474484, "driven_lanedir": 2.026817145112328, "in-drivable-lane": 1.933333333333328, "deviation-heading": 2.278240732445088, "deviation-center-line": 0.4181686881999281}, "ep003": {"driven_any": 5.8726763831947375, "driven_lanedir": 2.624800359510078, "in-drivable-lane": 4.933333333333318, "deviation-heading": 1.9509094198655512, "deviation-center-line": 0.5571463132164043}, "ep004": {"driven_any": 0.7634360912203738, "driven_lanedir": 0.4135462341815501, "in-drivable-lane": 0.6000000000000018, "deviation-heading": 0.4943428818800482, "deviation-center-line": 0.07857242486012887}}
No reset possible
12226step3-videossuccessyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12223step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8333333333333357


other stats
episodes
details{"ep000": {"nsteps": 29, "reward": -35.992743588727095, "good_angle": 0.3129217352844281, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep001": {"nsteps": 55, "reward": -18.163696935772897, "good_angle": 0.8612256063205401, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 1.1333333333333355}, "ep002": {"nsteps": 193, "reward": -5.278291659024327, "good_angle": 7.317213420014861, "survival_time": 6.43333333333332, "traveled_tiles": 4, "valid_direction": 4.166666666666656}, "ep003": {"nsteps": 302, "reward": -3.6263221074743752, "good_angle": 12.794809407740924, "survival_time": 10.066666666666642, "traveled_tiles": 9, "valid_direction": 4.499999999999991}, "ep004": {"nsteps": 48, "reward": -21.064588163775625, "good_angle": 0.948685279009423, "survival_time": 1.6000000000000016, "traveled_tiles": 1, "valid_direction": 1.233333333333335}}
good_angle_max12.794809407740924
good_angle_mean4.446971089674035
good_angle_median0.948685279009423
good_angle_min0.3129217352844281
reward_max-3.6263221074743752
reward_mean-16.825128490954864
reward_median-18.163696935772897
reward_min-35.992743588727095
survival_time_max10.066666666666642
survival_time_mean4.1799999999999935
survival_time_min0.9666666666666666
traveled_tiles_max9
traveled_tiles_mean3.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.499999999999991
valid_direction_mean2.2933333333333303
valid_direction_median1.233333333333335
valid_direction_min0.4333333333333333
No reset possible
12211step1-simulationsuccessyes0:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9938step1-simulationfailedno0:03:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9937step1-simulationfailedno0:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9936step1-simulationabortedno0:00:16
Error while running [...]

Creating job9936-3847_solution_1  ... error
stderr | ERROR: for job9936-3847_solution_1  Cannot start service solution: network job9936-3847_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9936-3847_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9936-3847_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4803step4-vizsuccessno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4802step4-vizsuccessno0:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4801step3-videossuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4800step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4792step1-simulationsuccessno0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible