Duckietown Challenges Home Challenges Submissions

Submission 989

Submission989
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11652 step2-scoring: 8071 step3-videos: 8073 step4-viz: 8094
Next
User labelROS-based Lane Following
Admin priority59
Blessingn/a
User priority59

8094

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8073

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11652step1-simulationfailedyes0:09:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8094step4-vizsuccessyes0:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.134341320879944
deviation-center-line_median1.9231104123180216
in-drivable-lane_median2.6666666666666785


other stats
deviation-center-line_max2.4672838847978604
deviation-center-line_mean1.8802017935178892
deviation-center-line_min1.1510608107169331
deviation-heading_max2.122160942008872
deviation-heading_mean1.8617177696464784
deviation-heading_median1.9368236681807245
deviation-heading_min1.4598171163237277
driven_any_max6.296294432793152
driven_any_mean6.268011031189323
driven_any_median6.283075427615398
driven_any_min6.20626247640538
driven_lanedir_max5.590448107063559
driven_lanedir_mean5.034148207982884
driven_lanedir_min4.486003737617959
in-drivable-lane_max4.633333333333319
in-drivable-lane_mean3.026666666666661
in-drivable-lane_min1.4666666666666617
per-episodes
details{"ep000": {"driven_any": 6.295741885769301, "driven_lanedir": 4.486003737617959, "in-drivable-lane": 4.633333333333319, "deviation-heading": 1.836166422163057, "deviation-center-line": 1.546790168179425}, "ep001": {"driven_any": 6.20626247640538, "driven_lanedir": 5.36376955621475, "in-drivable-lane": 2.033333333333327, "deviation-heading": 2.122160942008872, "deviation-center-line": 2.312763691577205}, "ep002": {"driven_any": 6.283075427615398, "driven_lanedir": 4.59617831813821, "in-drivable-lane": 4.333333333333319, "deviation-heading": 1.4598171163237277, "deviation-center-line": 1.9231104123180216}, "ep003": {"driven_any": 6.296294432793152, "driven_lanedir": 5.134341320879944, "in-drivable-lane": 2.6666666666666785, "deviation-heading": 1.953620699556012, "deviation-center-line": 1.1510608107169331}, "ep004": {"driven_any": 6.258680933363384, "driven_lanedir": 5.590448107063559, "in-drivable-lane": 1.4666666666666617, "deviation-heading": 1.9368236681807245, "deviation-center-line": 2.4672838847978604}}
No reset possible
8093step4-vizsuccessyes0:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8073step3-videossuccessyes0:13:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8072step3-videossuccessyes0:13:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8071step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5431600785318297, "good_angle": 0.9067805821867386, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.9333333333333265}, "ep001": {"nsteps": 500, "reward": -0.616796643519774, "good_angle": 31.053615074944535, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.866666666666654}, "ep002": {"nsteps": 500, "reward": -0.6115267089046538, "good_angle": 0.82679593498224, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.2333333333333254}, "ep003": {"nsteps": 500, "reward": -0.3262829188723117, "good_angle": 0.811202341751506, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.0666666666666593}, "ep004": {"nsteps": 500, "reward": -0.5283348486777395, "good_angle": 22.3351322728827, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.2333333333333583}}
good_angle_max31.053615074944535
good_angle_mean11.186705241349545
good_angle_median0.9067805821867386
good_angle_min0.811202341751506
reward_max-0.3262829188723117
reward_mean-0.5252202397012617
reward_median-0.5431600785318297
reward_min-0.616796643519774
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.2
traveled_tiles_median12
traveled_tiles_min11
valid_direction_max4.866666666666654
valid_direction_mean2.866666666666665
valid_direction_median2.2333333333333254
valid_direction_min1.9333333333333265
No reset possible
8070step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8069step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible