AI Driving Olympics Home Challenges Submissions Jobs

Submission 1033

Submission1033
Competingyes
Challengeaido1_LF1_r3-v3
UserVincentMai
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 11747 step2-scoring: 11760 step3-videos: 11763 step4-viz: 11768
Next
User labelROS-based Lane Following
Admin priority75
User priority75

11768

Click the images to see detailed statistics about the episode.

11763

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
117681033VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:04:38(hidden)
driven_lanedir_median14.276242890902438
deviation-center-line_median1.8522828302788
in-drivable-lane_median1.7333333333333294


other stats
deviation-center-line_max2.0595368253089297
deviation-center-line_mean1.6034667984067958
deviation-center-line_min0.7765440063396913
deviation-heading_max3.1625729631358137
deviation-heading_mean2.214165071890971
deviation-heading_median2.202955935092595
deviation-heading_min1.1161983217025762
driven_any_max18.286595308041782
driven_any_mean16.003587180710596
driven_any_median18.19814379983282
driven_any_min10.44183366172243
driven_lanedir_max15.704660873568384
driven_lanedir_mean13.276777340821289
driven_lanedir_min9.422347459270457
in-drivable-lane_max3.366666666666656
in-drivable-lane_mean2.186666666666662
in-drivable-lane_min0.7999999999999978
per-episodes
details{"ep000": {"driven_any": 18.286595308041782, "driven_lanedir": 15.704660873568384, "in-drivable-lane": 1.7333333333333294, "deviation-heading": 3.1625729631358137, "deviation-center-line": 2.0595368253089297}, "ep001": {"driven_any": 14.831208870130332, "driven_lanedir": 12.455563195301082, "in-drivable-lane": 1.7333333333333294, "deviation-heading": 2.202955935092595, "deviation-center-line": 1.4320736130677143}, "ep002": {"driven_any": 18.260154263825612, "driven_lanedir": 14.276242890902438, "in-drivable-lane": 3.299999999999998, "deviation-heading": 2.463307539001523, "deviation-center-line": 1.8522828302788}, "ep003": {"driven_any": 18.19814379983282, "driven_lanedir": 14.52507228506407, "in-drivable-lane": 3.366666666666656, "deviation-heading": 2.125790600522346, "deviation-center-line": 1.896896717038844}, "ep004": {"driven_any": 10.44183366172243, "driven_lanedir": 9.422347459270457, "in-drivable-lane": 0.7999999999999978, "deviation-heading": 1.1161983217025762, "deviation-center-line": 0.7765440063396913}}
117631033VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:02:47(hidden)
other stats
videos1
117601033VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.05541074035828933, "good_angle": 26.431173739179957, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 5.066666666666667}, "ep001": {"nsteps": 401, "reward": -2.450109859728754, "good_angle": 20.351031843093068, "survival_time": 13.36666666666663, "traveled_tiles": 18, "valid_direction": 3.8333333333333224}, "ep002": {"nsteps": 500, "reward": 0.18878666829830035, "good_angle": 16.969249957081086, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.89999999999999}, "ep003": {"nsteps": 500, "reward": 0.3674318769532256, "good_angle": 2.729981768447491, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.899999999999996}, "ep004": {"nsteps": 282, "reward": -3.0035165039829064, "good_angle": 2.108800527341819, "survival_time": 9.399999999999975, "traveled_tiles": 13, "valid_direction": 1.199999999999997}}
good_angle_max26.431173739179957
good_angle_mean13.718047567028682
good_angle_median16.969249957081086
good_angle_min2.108800527341819
reward_max0.3674318769532256
reward_mean-0.968399415620369
reward_median0.05541074035828933
reward_min-3.0035165039829064
survival_time_max16.666666666666654
survival_time_mean14.553333333333311
survival_time_min9.399999999999975
traveled_tiles_max18
traveled_tiles_mean17
traveled_tiles_median18
traveled_tiles_min13
valid_direction_max5.066666666666667
valid_direction_mean3.379999999999994
valid_direction_median3.8333333333333224
valid_direction_min1.199999999999997
117471033VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:09:38(hidden)
other stats
simulation-passed1
83001033VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:05:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)