Duckietown Challenges Home Challenges Submissions

Submission 1120

Submission1120
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12578 step2-scoring: 12596 step3-videos: 12597 step4-viz: 12599
Next
User labelROS-based Lane Following
Admin priority55
Blessingn/a
User priority55

12599

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12597

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12599step4-vizsuccessyes0:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.795839354558863
deviation-center-line_median1.5863594452661496
in-drivable-lane_median7.09999999999998


other stats
deviation-center-line_max1.8918971331659948
deviation-center-line_mean1.6603684395309066
deviation-center-line_min1.5191380339168452
deviation-heading_max2.8760598919608285
deviation-heading_mean1.9810007795711695
deviation-heading_median1.9557959412517576
deviation-heading_min1.2788533452545583
driven_any_max18.430388662204372
driven_any_mean17.446425020264705
driven_any_median17.350010157134182
driven_any_min16.256396072249238
driven_lanedir_max11.796299580531436
driven_lanedir_mean9.746030081536087
driven_lanedir_min8.438666604759856
in-drivable-lane_max8.200000000000012
in-drivable-lane_mean7.159999999999997
in-drivable-lane_min6.033333333333328
per-episodes
details{"ep000": {"driven_any": 17.21051110939161, "driven_lanedir": 8.78560445291983, "in-drivable-lane": 8.133333333333326, "deviation-heading": 1.7555117800477118, "deviation-center-line": 1.5863594452661496}, "ep001": {"driven_any": 17.350010157134182, "driven_lanedir": 8.438666604759856, "in-drivable-lane": 8.200000000000012, "deviation-heading": 2.0387829393409893, "deviation-center-line": 1.5191380339168452}, "ep002": {"driven_any": 16.256396072249238, "driven_lanedir": 8.795839354558863, "in-drivable-lane": 7.09999999999998, "deviation-heading": 2.8760598919608285, "deviation-center-line": 1.5702422392864337}, "ep003": {"driven_any": 17.984819100344133, "driven_lanedir": 10.91374041491044, "in-drivable-lane": 6.333333333333334, "deviation-heading": 1.9557959412517576, "deviation-center-line": 1.7342053460191098}, "ep004": {"driven_any": 18.430388662204372, "driven_lanedir": 11.796299580531436, "in-drivable-lane": 6.033333333333328, "deviation-heading": 1.2788533452545583, "deviation-center-line": 1.8918971331659948}}
No reset possible
12597step3-videossuccessyes0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12596step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.30134082720839067, "good_angle": 19.431770519727216, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.166666666666682}, "ep001": {"nsteps": 500, "reward": -0.3672306838813238, "good_angle": 22.737983334857244, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 5.899999999999983}, "ep002": {"nsteps": 500, "reward": -0.32895604429976083, "good_angle": 27.72669236171956, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 7.000000000000011}, "ep003": {"nsteps": 500, "reward": 0.1046211402787594, "good_angle": 4.438486952089856, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.3333333333333437}, "ep004": {"nsteps": 500, "reward": 0.14009621169813907, "good_angle": 1.0823577523076109, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2666666666666617}}
good_angle_max27.72669236171956
good_angle_mean15.083458184140298
good_angle_median19.431770519727216
good_angle_min1.0823577523076109
reward_max0.14009621169813907
reward_mean-0.1505620406825154
reward_median-0.30134082720839067
reward_min-0.3672306838813238
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16.2
traveled_tiles_median18
traveled_tiles_min12
valid_direction_max7.000000000000011
valid_direction_mean4.733333333333336
valid_direction_median5.166666666666682
valid_direction_min2.2666666666666617
No reset possible
12578step1-simulationsuccessyes0:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8822step1-simulationfailedno0:05:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible