Duckietown Challenges Home Challenges Submissions

Submission 1027

Submission1027
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11696 step2-scoring: 8289 step3-videos: 8291 step4-viz: 8292
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

8292

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8291

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11696step1-simulationfailedyes0:07:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8292step4-vizsuccessyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.8161513026876515
deviation-center-line_median0.7771981944006463
in-drivable-lane_median0.9666666666666632


other stats
deviation-center-line_max1.9666084990321744
deviation-center-line_mean0.9489287400316164
deviation-center-line_min0.09897289157693905
deviation-heading_max1.7124447566030414
deviation-heading_mean1.108797268534521
deviation-heading_median1.3114511045610224
deviation-heading_min0.06092138286581164
driven_any_max6.264894104031473
driven_any_mean3.73784226954849
driven_any_median2.9412927432041545
driven_any_min0.34666666666667245
driven_lanedir_max4.811093744004362
driven_lanedir_mean2.938931838045414
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.33333333333335
in-drivable-lane_mean2.0333333333333337
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.253399978101632, "driven_lanedir": 4.811093744004362, "in-drivable-lane": 3.8666666666666543, "deviation-heading": 1.6114894674892213, "deviation-center-line": 1.9666084990321744}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.264894104031473, "driven_lanedir": 4.152722112129075, "in-drivable-lane": 5.33333333333335, "deviation-heading": 1.7124447566030414, "deviation-center-line": 1.528817036044358}, "ep003": {"driven_any": 2.8829578557385176, "driven_lanedir": 2.8161513026876515, "in-drivable-lane": 0, "deviation-heading": 0.847679631153509, "deviation-center-line": 0.37304707910396506}, "ep004": {"driven_any": 2.9412927432041545, "driven_lanedir": 2.5688201539635105, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 1.3114511045610224, "deviation-center-line": 0.7771981944006463}}
No reset possible
8291step3-videossuccessyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8290step3-videossuccessyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8289step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.933333333333315


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3701488013258204, "good_angle": 0.6058817932506364, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.2333333333333292}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.4321476400345564, "good_angle": 0.6623218333699774, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1333333333333293}, "ep003": {"nsteps": 224, "reward": -4.642331055026651, "good_angle": 0.1130436329615555, "survival_time": 7.46666666666665, "traveled_tiles": 5, "valid_direction": 0.16666666666666607}, "ep004": {"nsteps": 238, "reward": -4.661016504452446, "good_angle": 10.885551075653066, "survival_time": 7.933333333333315, "traveled_tiles": 6, "valid_direction": 2.1333333333333258}}
good_angle_max10.885551075653066
good_angle_mean2.454184425911554
good_angle_median0.6058817932506364
good_angle_min0.004123794322536422
reward_max-0.3701488013258204
reward_mean-9.275212682227265
reward_median-4.642331055026651
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean9.93333333333332
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.2
traveled_tiles_median6
traveled_tiles_min1
valid_direction_max2.1333333333333258
valid_direction_mean0.93333333333333
valid_direction_median1.1333333333333293
valid_direction_min0
No reset possible
8288step2-scoringsuccessyes0:20:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8287step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible