Duckietown Challenges Home Challenges Submissions

Submission 1144

Submission1144
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12819 step2-scoring: 8997 step3-videos: 8998 step4-viz: 9008
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

9008

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8998

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12819step1-simulationfailedyes0:06:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9008step4-vizsuccessyes0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.766216887792637
deviation-center-line_median1.0065939529985208
in-drivable-lane_median10.633333333333338


other stats
deviation-center-line_max2.060886647250259
deviation-center-line_mean1.3034017297130225
deviation-center-line_min0.7714244124291091
deviation-heading_max2.982981578967821
deviation-heading_mean1.6395480530831417
deviation-heading_median1.0447813802358168
deviation-heading_min0.9376552661037968
driven_any_max10.66903208544648
driven_any_mean10.668291646868228
driven_any_median10.668456758913718
driven_any_min10.666703621213706
driven_lanedir_max7.77956515729205
driven_lanedir_mean4.935970434534815
driven_lanedir_min2.8485590756121373
in-drivable-lane_max11.96666666666663
in-drivable-lane_mean8.593333333333328
in-drivable-lane_min3.766666666666689
per-episodes
details{"ep000": {"driven_any": 10.66903208544648, "driven_lanedir": 3.766216887792637, "in-drivable-lane": 10.633333333333338, "deviation-heading": 0.995428157851232, "deviation-center-line": 1.0065939529985208}, "ep001": {"driven_any": 10.666703621213706, "driven_lanedir": 7.77956515729205, "in-drivable-lane": 3.766666666666689, "deviation-heading": 2.982981578967821, "deviation-center-line": 2.060886647250259}, "ep002": {"driven_any": 10.66887253738005, "driven_lanedir": 3.7160019132437294, "in-drivable-lane": 10.699999999999974, "deviation-heading": 1.0447813802358168, "deviation-center-line": 0.963660002847558}, "ep003": {"driven_any": 10.66839323138717, "driven_lanedir": 2.8485590756121373, "in-drivable-lane": 11.96666666666663, "deviation-heading": 0.9376552661037968, "deviation-center-line": 0.7714244124291091}, "ep004": {"driven_any": 10.668456758913718, "driven_lanedir": 6.5695091387335225, "in-drivable-lane": 5.900000000000009, "deviation-heading": 2.2368938822570423, "deviation-center-line": 1.714443633039665}}
No reset possible
9007step4-vizsuccessyes0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8998step3-videossuccessyes0:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8997step2-scoringsuccessyes0:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.790566131234169, "good_angle": 1.2903118912353084, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.166666666666656}, "ep001": {"nsteps": 500, "reward": -0.5960932991057635, "good_angle": 24.443253885152547, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.699999999999984}, "ep002": {"nsteps": 500, "reward": -0.7611904352903366, "good_angle": 1.258449643740138, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.699999999999995}, "ep003": {"nsteps": 500, "reward": -0.8476087856493104, "good_angle": 1.2553266018277809, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.7666666666666577}, "ep004": {"nsteps": 500, "reward": -0.6190339300409542, "good_angle": 9.26235383088953, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.099999999999988}}
good_angle_max24.443253885152547
good_angle_mean7.501939170569061
good_angle_median1.2903118912353084
good_angle_min1.2553266018277809
reward_max-0.5960932991057635
reward_mean-0.7228985162641068
reward_median-0.7611904352903366
reward_min-0.8476087856493104
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16
traveled_tiles_median18
traveled_tiles_min13
valid_direction_max5.699999999999984
valid_direction_mean3.686666666666656
valid_direction_median3.166666666666656
valid_direction_min2.699999999999995
No reset possible