Duckietown Challenges Home Challenges Submissions

Submission 517

Submission517
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11857 step2-scoring: 11865 step3-videos: 11868 step4-viz: 11880
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

11880

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11868

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11880step4-vizsuccessyes0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3917662776160642
deviation-center-line_median0.07655203696339263
in-drivable-lane_median4.599999999999993


other stats
deviation-center-line_max0.12926452244313627
deviation-center-line_mean0.07395301677842392
deviation-center-line_min0
deviation-heading_max0.48443919591232226
deviation-heading_mean0.33802258211589326
deviation-heading_median0.40091933916848527
deviation-heading_min0
driven_any_max2.544613364104022
driven_any_mean1.1037372630936837
driven_any_median0.885264556649182
driven_any_min0.21806952950719857
driven_lanedir_max0.5216893445336988
driven_lanedir_mean0.31041626356194474
driven_lanedir_min0
in-drivable-lane_max12.49999999999996
in-drivable-lane_mean5.966666666666653
in-drivable-lane_min1.1333333333333355
per-episodes
details{"ep000": {"driven_any": 0.21806952950719857, "driven_lanedir": 0, "in-drivable-lane": 4.599999999999993, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.015160431977597, "driven_lanedir": 0.5216893445336988, "in-drivable-lane": 1.2000000000000004, "deviation-heading": 0.40091933916848527, "deviation-center-line": 0.12926452244313627}, "ep002": {"driven_any": 2.544613364104022, "driven_lanedir": 0.1986898524633487, "in-drivable-lane": 10.399999999999972, "deviation-heading": 0.4110037989531076, "deviation-center-line": 0.057809888214198885}, "ep003": {"driven_any": 0.8555784332304173, "driven_lanedir": 0.3917662776160642, "in-drivable-lane": 1.1333333333333355, "deviation-heading": 0.39375057654555146, "deviation-center-line": 0.07655203696339263}, "ep004": {"driven_any": 0.885264556649182, "driven_lanedir": 0.43993584319661205, "in-drivable-lane": 12.49999999999996, "deviation-heading": 0.48443919591232226, "deviation-center-line": 0.1061386362713918}}
No reset possible
11868step3-videossuccessyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11865step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.633333333333327


other stats
episodes
details{"ep000": {"nsteps": 139, "reward": -10.069596947954713, "good_angle": 8.608940267566906, "survival_time": 4.633333333333327, "traveled_tiles": 1, "valid_direction": 3.86666666666666}, "ep001": {"nsteps": 74, "reward": -13.925507610210696, "good_angle": 0.802367411807925, "survival_time": 2.4666666666666677, "traveled_tiles": 3, "valid_direction": 1.6333333333333342}, "ep002": {"nsteps": 330, "reward": -5.023177665505897, "good_angle": 8.307246707219269, "survival_time": 10.999999999999972, "traveled_tiles": 6, "valid_direction": 6.766666666666649}, "ep003": {"nsteps": 63, "reward": -16.47722815237348, "good_angle": 0.9763179194391848, "survival_time": 2.1000000000000023, "traveled_tiles": 3, "valid_direction": 1.633333333333336}, "ep004": {"nsteps": 409, "reward": -5.349814069997018, "good_angle": 20.712055652002327, "survival_time": 13.633333333333296, "traveled_tiles": 4, "valid_direction": 11.066666666666636}}
good_angle_max20.712055652002327
good_angle_mean7.881385591607122
good_angle_median8.307246707219269
good_angle_min0.802367411807925
reward_max-5.023177665505897
reward_mean-10.16906488920836
reward_median-10.069596947954713
reward_min-16.47722815237348
survival_time_max13.633333333333296
survival_time_mean6.766666666666653
survival_time_min2.1000000000000023
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max11.066666666666636
valid_direction_mean4.993333333333323
valid_direction_median3.86666666666666
valid_direction_min1.6333333333333342
No reset possible
11857step1-simulationsuccessyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10098step1-simulationfailedno0:06:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10097step1-simulationsuccessno0:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4478step4-vizsuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4476step3-videossuccessno0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4475step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4468step1-simulationsuccessno0:06:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible