Duckietown Challenges Home Challenges Submissions

Submission 553

Submission553
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12077 step2-scoring: 12090 step3-videos: 12094 step4-viz: 12096
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

12096

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12094

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12096step4-vizsuccessyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5434859718501883
deviation-center-line_median0.05407787116861011
in-drivable-lane_median0.2000000000000003


other stats
deviation-center-line_max0.6948264580306274
deviation-center-line_mean0.17119321389764453
deviation-center-line_min0
deviation-heading_max1.8602380469117077
deviation-heading_mean0.6311269221208408
deviation-heading_median0.41649670978633285
deviation-heading_min0
driven_any_max10.05007881047974
driven_any_mean2.5724751386709253
driven_any_median0.843053326824309
driven_any_min0.4932616926944604
driven_lanedir_max3.5445116710249103
driven_lanedir_mean1.0027374748628763
driven_lanedir_min0
in-drivable-lane_max7.33333333333331
in-drivable-lane_mean1.7133333333333287
in-drivable-lane_min0.16666666666666669
per-episodes
details{"ep000": {"driven_any": 0.4932616926944604, "driven_lanedir": 0, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.9609735357931516, "driven_lanedir": 0.6904291401331002, "in-drivable-lane": 0.2000000000000003, "deviation-heading": 0.41429785916235856, "deviation-center-line": 0.06654478146805873}, "ep002": {"driven_any": 0.5150083275629633, "driven_lanedir": 0.23526059130618335, "in-drivable-lane": 0.16666666666666669, "deviation-heading": 0.41649670978633285, "deviation-center-line": 0.04051695882092643}, "ep003": {"driven_any": 0.843053326824309, "driven_lanedir": 0.5434859718501883, "in-drivable-lane": 0.19999999999999996, "deviation-heading": 0.4646019947438048, "deviation-center-line": 0.05407787116861011}, "ep004": {"driven_any": 10.05007881047974, "driven_lanedir": 3.5445116710249103, "in-drivable-lane": 7.33333333333331, "deviation-heading": 1.8602380469117077, "deviation-center-line": 0.6948264580306274}}
No reset possible
12094step3-videossuccessyes0:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12090step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.1333333333333335


other stats
episodes
details{"ep000": {"nsteps": 21, "reward": -49.079299256915135, "good_angle": 0.15273066838314237, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}, "ep001": {"nsteps": 38, "reward": -26.085897090893827, "good_angle": 0.645734265825173, "survival_time": 1.2666666666666673, "traveled_tiles": 2, "valid_direction": 0.6000000000000006}, "ep002": {"nsteps": 22, "reward": -45.59602353167297, "good_angle": 0.7030642796310155, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0.7}, "ep003": {"nsteps": 34, "reward": -29.353512226001303, "good_angle": 0.8445543716572845, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.6666666666666669}, "ep004": {"nsteps": 380, "reward": -3.3823620116803794, "good_angle": 20.843271182366507, "survival_time": 12.666666666666632, "traveled_tiles": 16, "valid_direction": 4.366666666666654}}
good_angle_max20.843271182366507
good_angle_mean4.637870953572625
good_angle_median0.7030642796310155
good_angle_min0.15273066838314237
reward_max-3.3823620116803794
reward_mean-30.699418823432723
reward_median-29.353512226001303
reward_min-49.079299256915135
survival_time_max12.666666666666632
survival_time_mean3.2999999999999927
survival_time_min0.7
traveled_tiles_max16
traveled_tiles_mean4.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max4.366666666666654
valid_direction_mean1.3066666666666642
valid_direction_median0.6666666666666669
valid_direction_min0.19999999999999996
No reset possible
12077step1-simulationsuccessyes0:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9978step4-vizsuccessyes0:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9977step4-vizsuccessyes0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9971step3-videossuccessyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9970step3-videosabortedyes0:00:12
Error while running [...]

Creating job9970-4056_videos_1 ... error
stderr | ERROR: for job9970-4056_videos_1  Cannot start service videos: network job9970-4056_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9970-4056_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9969step3-videossuccessyes0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9966step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible