Duckietown Challenges Home Challenges Submissions

Submission 725

Submission725
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11629 step2-scoring: 7012 step3-videos: 7013 step4-viz: 7022
Next
User labelJP pipeline
Admin priority63
Blessingn/a
User priority63

7022

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

7013

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11629step1-simulationfailedyes0:04:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7022step4-vizsuccessyes0:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.530928914494076
deviation-center-line_median0.9024867744431432
in-drivable-lane_median3.9666666666666535


other stats
deviation-center-line_max0.9987147398595346
deviation-center-line_mean0.6170623132836557
deviation-center-line_min0.09790842455205594
deviation-heading_max3.0266278074635378
deviation-heading_mean1.6720243988478942
deviation-heading_median2.453904503491593
deviation-heading_min0.05656408439086616
driven_any_max7.915896197689495
driven_any_mean4.963399247864707
driven_any_median7.639887293488561
driven_any_min0.4093315581414513
driven_lanedir_max6.063825442305101
driven_lanedir_mean3.796681908494361
driven_lanedir_min0.4083926740883401
in-drivable-lane_max4.96666666666665
in-drivable-lane_mean2.5999999999999917
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 7.915896197689495, "driven_lanedir": 6.063825442305101, "in-drivable-lane": 4.066666666666654, "deviation-heading": 2.7034747881275947, "deviation-center-line": 0.926574720495412}, "ep001": {"driven_any": 0.4093315581414513, "driven_lanedir": 0.4083926740883401, "in-drivable-lane": 0, "deviation-heading": 0.05656408439086616, "deviation-center-line": 0.09790842455205594}, "ep002": {"driven_any": 7.840550301117218, "driven_lanedir": 5.97128422859293, "in-drivable-lane": 3.9666666666666535, "deviation-heading": 3.0266278074635378, "deviation-center-line": 0.9987147398595346}, "ep003": {"driven_any": 7.639887293488561, "driven_lanedir": 5.530928914494076, "in-drivable-lane": 4.96666666666665, "deviation-heading": 2.453904503491593, "deviation-center-line": 0.9024867744431432}, "ep004": {"driven_any": 1.011330888886809, "driven_lanedir": 1.008978282991359, "in-drivable-lane": 0, "deviation-heading": 0.11955081076587964, "deviation-center-line": 0.15962690706813307}}
No reset possible
7013step3-videossuccessyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7012step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.34021338050160554, "good_angle": 2.107156783957668, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 4.633333333333318}, "ep001": {"nsteps": 28, "reward": -36.26356498045581, "good_angle": 0.004931803717651561, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.3379425484823296, "good_angle": 2.228819455600586, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.333333333333316}, "ep003": {"nsteps": 500, "reward": -0.3543990011010319, "good_angle": 2.2097806819694967, "survival_time": 16.666666666666654, "traveled_tiles": 14, "valid_direction": 4.999999999999983}, "ep004": {"nsteps": 60, "reward": -17.061365912854672, "good_angle": 0.013200051116812444, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.228819455600586
good_angle_mean1.312777755272443
good_angle_median2.107156783957668
good_angle_min0.004931803717651561
reward_max-0.3379425484823296
reward_mean-10.871497164679088
reward_median-0.3543990011010319
reward_min-36.26356498045581
survival_time_max16.666666666666654
survival_time_mean10.58666666666666
survival_time_min0.9333333333333332
traveled_tiles_max15
traveled_tiles_mean9.4
traveled_tiles_median14
traveled_tiles_min1
valid_direction_max5.333333333333316
valid_direction_mean2.993333333333323
valid_direction_median4.633333333333318
valid_direction_min0
No reset possible