Duckietown Challenges Home Challenges Submissions

Submission 1040

Submission1040
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11841 step2-scoring: 8347 step3-videos: 8349 step4-viz: 8350
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

8350

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8349

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11841step1-simulationfailedyes0:10:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8350step4-vizsuccessyes0:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.7569371888673837
deviation-center-line_median0.3769476526336325
in-drivable-lane_median0.6


other stats
deviation-center-line_max1.0090441183592271
deviation-center-line_mean0.46237402879014977
deviation-center-line_min0.09897289157693905
deviation-heading_max2.3238937706010443
deviation-heading_mean1.069367522485255
deviation-heading_median0.9186495598787852
deviation-heading_min0.06092138286581164
driven_any_max3.638251335819073
driven_any_mean2.2447402974292596
driven_any_median2.8816370980721
driven_any_min0.34666666666667245
driven_lanedir_max3.2000135218648933
driven_lanedir_mean2.002860821062266
driven_lanedir_min0.3458718774424743
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.493333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.937676836066722, "driven_lanedir": 0.7030731007387803, "in-drivable-lane": 0.6, "deviation-heading": 0.3993437901058893, "deviation-center-line": 0.13641028708115116}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 3.419469550521731, "driven_lanedir": 3.0084084163977964, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 1.644029108974744, "deviation-center-line": 0.6904951942997992}, "ep003": {"driven_any": 2.8816370980721, "driven_lanedir": 2.7569371888673837, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.9186495598787852, "deviation-center-line": 0.3769476526336325}, "ep004": {"driven_any": 3.638251335819073, "driven_lanedir": 3.2000135218648933, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 2.3238937706010443, "deviation-center-line": 1.0090441183592271}}
No reset possible
8349step3-videossuccessyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8348step3-videosabortedyes0:00:11
Error while running [...]

Creating job8348-5546_videos_1 ... error
stderr | ERROR: for job8348-5546_videos_1  Cannot start service videos: network job8348-5546_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8348-5546_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8347step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.46666666666665


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.368606731862345, "good_angle": 0.12579438509513446, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 277, "reward": -3.839482358106688, "good_angle": 0.4756246841482495, "survival_time": 9.233333333333311, "traveled_tiles": 7, "valid_direction": 0.8666666666666636}, "ep003": {"nsteps": 224, "reward": -4.596634012518085, "good_angle": 0.14758094880083045, "survival_time": 7.46666666666665, "traveled_tiles": 5, "valid_direction": 0.29999999999999893}, "ep004": {"nsteps": 302, "reward": -3.629076436019559, "good_angle": 9.480099014909849, "survival_time": 10.066666666666642, "traveled_tiles": 4, "valid_direction": 3.0333333333333248}}
good_angle_max9.480099014909849
good_angle_mean2.0466445654553196
good_angle_median0.14758094880083045
good_angle_min0.004123794322536422
reward_max-3.629076436019559
reward_mean-12.340843789760704
reward_median-4.596634012518085
reward_min-36.270419410296846
survival_time_max10.066666666666642
survival_time_mean6.046666666666654
survival_time_min0.9333333333333332
traveled_tiles_max7
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max3.0333333333333248
valid_direction_mean0.8733333333333307
valid_direction_median0.29999999999999893
valid_direction_min0
No reset possible
8346step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible