Duckietown Challenges Home Challenges Submissions

Submission 1128

Submission1128
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12678 step2-scoring: 8900 step3-videos: 8905 step4-viz: 8911
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

8911

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8905

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12678step1-simulationfailedyes0:08:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8911step4-vizsuccessyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1712941515220547
deviation-center-line_median0.27899688603984235
in-drivable-lane_median2.0666666666666664


other stats
deviation-center-line_max0.7689411168935266
deviation-center-line_mean0.4277846978542722
deviation-center-line_min0.1774300522257357
deviation-heading_max4.199505556750244
deviation-heading_mean2.2651397587817628
deviation-heading_median1.5093532121986049
deviation-heading_min1.0628363723804486
driven_any_max13.741216422834915
driven_any_mean6.238866454941861
driven_any_median3.52111640228564
driven_any_min2.384892536867285
driven_lanedir_max3.879106940033293
driven_lanedir_mean1.971570328292364
driven_lanedir_min0.854453165695908
in-drivable-lane_max7.53333333333331
in-drivable-lane_mean3.04666666666666
in-drivable-lane_min0.533333333333333
per-episodes
details{"ep000": {"driven_any": 3.491126840302257, "driven_lanedir": 0.854453165695908, "in-drivable-lane": 2.0666666666666664, "deviation-heading": 1.0628363723804486, "deviation-center-line": 0.1774300522257357}, "ep001": {"driven_any": 13.741216422834915, "driven_lanedir": 3.879106940033293, "in-drivable-lane": 7.53333333333331, "deviation-heading": 4.199505556750244, "deviation-center-line": 0.7689411168935266}, "ep002": {"driven_any": 2.384892536867285, "driven_lanedir": 1.1712941515220547, "in-drivable-lane": 0.533333333333333, "deviation-heading": 1.354939488134754, "deviation-center-line": 0.2729623793593397}, "ep003": {"driven_any": 8.05598007241921, "driven_lanedir": 2.871538129002206, "in-drivable-lane": 3.4999999999999902, "deviation-heading": 3.1990641644447626, "deviation-center-line": 0.6405930547529166}, "ep004": {"driven_any": 3.52111640228564, "driven_lanedir": 1.0814592552083582, "in-drivable-lane": 1.5999999999999988, "deviation-heading": 1.5093532121986049, "deviation-center-line": 0.27899688603984235}}
No reset possible
8910step4-vizabortedyes0:00:12
Error while running [...]

Creating job8910-6439_visualization_1 ... error
stderr | ERROR: for job8910-6439_visualization_1  Cannot start service visualization: network job8910-6439_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8910-6439_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8909step4-vizabortedyes0:00:13
Error while running [...]

Creating job8909-7581_visualization_1 ... error
stderr | ERROR: for job8909-7581_visualization_1  Cannot start service visualization: network job8909-7581_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8909-7581_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8908step4-vizsuccessyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8907step4-vizsuccessyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8906step4-vizsuccessyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8905step3-videossuccessyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8904step3-videossuccessyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8903step3-videossuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8902step3-videossuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8901step3-videosabortedyes0:00:12
Error while running [...]

Creating job8901-6727_videos_1 ... error
stderr | ERROR: for job8901-6727_videos_1  Cannot start service videos: network job8901-6727_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8901-6727_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8900step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.433333333333331


other stats
episodes
details{"ep000": {"nsteps": 103, "reward": -10.738487651906183, "good_angle": 6.623001189913441, "survival_time": 3.433333333333331, "traveled_tiles": 3, "valid_direction": 2.899999999999998}, "ep001": {"nsteps": 398, "reward": -3.573834209098602, "good_angle": 22.17096518362927, "survival_time": 13.26666666666663, "traveled_tiles": 5, "valid_direction": 10.399999999999972}, "ep002": {"nsteps": 70, "reward": -14.945861303220902, "good_angle": 2.0756036777075386, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.800000000000001}, "ep003": {"nsteps": 235, "reward": -5.1351538396351275, "good_angle": 6.174899015840222, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 5.999999999999986}, "ep004": {"nsteps": 103, "reward": -10.579931350063209, "good_angle": 3.1213364923864, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.766666666666665}}
good_angle_max22.17096518362927
good_angle_mean8.033161111895375
good_angle_median6.174899015840222
good_angle_min2.0756036777075386
reward_max-3.573834209098602
reward_mean-8.994653670784803
reward_median-10.579931350063209
reward_min-14.945861303220902
survival_time_max13.26666666666663
survival_time_mean6.059999999999988
survival_time_min2.333333333333335
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max10.399999999999972
valid_direction_mean4.7733333333333245
valid_direction_median2.899999999999998
valid_direction_min1.800000000000001
No reset possible
8899step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8898step2-scoringsuccessyes0:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8897step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8896step2-scoringabortedyes0:00:12
Error while running [...]

Creating job8896-8932_scorer_1 ... error
stderr | ERROR: for job8896-8932_scorer_1  Cannot start service scorer: network job8896-8932_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8896-8932_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible