Duckietown Challenges Home Challenges Submissions

Submission 1118

Submission1118
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12558 step2-scoring: 8830 step3-videos: 8833 step4-viz: 8837
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

8837

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8833

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12558step1-simulationfailedyes0:10:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8837step4-vizsuccessyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.0800191384151985
deviation-center-line_median1.4537620998520973
in-drivable-lane_median5.69999999999998


other stats
deviation-center-line_max1.7204669087765312
deviation-center-line_mean1.1874341263981512
deviation-center-line_min0.08414725295459423
deviation-heading_max1.7831337144331194
deviation-heading_mean1.1771825303886414
deviation-heading_median1.4718526205875515
deviation-heading_min0.06090207335592236
driven_any_max6.32998801859085
driven_any_mean5.07141095797302
driven_any_median6.268505372753538
driven_any_min0.29270692151363087
driven_lanedir_max4.772752515201063
driven_lanedir_mean3.340705977205901
driven_lanedir_min0.29177575401793865
in-drivable-lane_max7.56666666666667
in-drivable-lane_mean4.586666666666663
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.268505372753538, "driven_lanedir": 3.4774979430591326, "in-drivable-lane": 7.56666666666667, "deviation-heading": 0.911682657700122, "deviation-center-line": 1.657779837791391}, "ep001": {"driven_any": 0.29270692151363087, "driven_lanedir": 0.29177575401793865, "in-drivable-lane": 0, "deviation-heading": 0.06090207335592236, "deviation-center-line": 0.08414725295459423}, "ep002": {"driven_any": 6.322367338240872, "driven_lanedir": 4.0814845353361715, "in-drivable-lane": 5.700000000000015, "deviation-heading": 1.7831337144331194, "deviation-center-line": 1.4537620998520973}, "ep003": {"driven_any": 6.32998801859085, "driven_lanedir": 4.772752515201063, "in-drivable-lane": 3.966666666666653, "deviation-heading": 1.6583415858664925, "deviation-center-line": 1.0210145326161415}, "ep004": {"driven_any": 6.143487138766211, "driven_lanedir": 4.0800191384151985, "in-drivable-lane": 5.69999999999998, "deviation-heading": 1.4718526205875515, "deviation-center-line": 1.7204669087765312}}
No reset possible
8836step4-vizsuccessyes0:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8835step4-vizsuccessyes0:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8834step4-vizsuccessyes0:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8833step3-videossuccessyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8832step3-videossuccessyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8831step3-videossuccessyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8830step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6716831328887493, "good_angle": 0.5418643666748314, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.9999999999999968}, "ep001": {"nsteps": 24, "reward": -42.21845681592822, "good_angle": 0.004903164463036015, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.534391786611639, "good_angle": 0.653873420892181, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.1333333333333293}, "ep003": {"nsteps": 500, "reward": -0.34749589752446625, "good_angle": 0.5094799271642615, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1333333333333293}, "ep004": {"nsteps": 500, "reward": -0.6268078962262953, "good_angle": 9.587389930780583, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.299999999999992}}
good_angle_max9.587389930780583
good_angle_mean2.2595021619949787
good_angle_median0.5418643666748314
good_angle_min0.004903164463036015
reward_max-0.34749589752446625
reward_mean-8.879767105835874
reward_median-0.6268078962262953
reward_min-42.21845681592822
survival_time_max16.666666666666654
survival_time_mean13.493333333333323
survival_time_min0.7999999999999999
traveled_tiles_max13
traveled_tiles_mean9.6
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max2.299999999999992
valid_direction_mean1.1133333333333293
valid_direction_median1.1333333333333293
valid_direction_min0
No reset possible
8829step2-scoringabortedyes0:00:11
Error while running [...]

Creating job8829-9177_scorer_1 ... error
stderr | ERROR: for job8829-9177_scorer_1  Cannot start service scorer: network job8829-9177_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8829-9177_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8828step2-scoringabortedyes0:00:11
Error while running [...]

Creating job8828-3992_scorer_1 ... error
stderr | ERROR: for job8828-3992_scorer_1  Cannot start service scorer: network job8828-3992_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8828-3992_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8827step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible