Duckietown Challenges Home Challenges Submissions

Submission 909

Submission909
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13042 step2-scoring: 13050 step3-videos: 13052 step4-viz: 13059
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

13059

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13052

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13059step4-vizsuccessyes0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.146522243519182
deviation-center-line_median0.1891888601671544
in-drivable-lane_median0.33333333333333237


other stats
deviation-center-line_max1.1225745608366913
deviation-center-line_mean0.3520104275653818
deviation-center-line_min0
deviation-heading_max2.658087168579981
deviation-heading_mean0.8776642948271114
deviation-heading_median0.3594499575862384
deviation-heading_min0
driven_any_max19.07937152425053
driven_any_mean6.495695906380179
driven_any_median3.295192792501811
driven_any_min1.466493608985395
driven_lanedir_max16.876113006113272
driven_lanedir_mean5.319439988493145
driven_lanedir_min0
in-drivable-lane_max2.366666666666668
in-drivable-lane_mean0.8399999999999992
in-drivable-lane_min0.03333333333333344
per-episodes
details{"ep000": {"driven_any": 2.642296370739315, "driven_lanedir": 0, "in-drivable-lane": 2.366666666666668, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 19.07937152425053, "driven_lanedir": 16.876113006113272, "in-drivable-lane": 1.399999999999996, "deviation-heading": 2.658087168579981, "deviation-center-line": 1.1225745608366913}, "ep002": {"driven_any": 3.295192792501811, "driven_lanedir": 3.146522243519182, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.33104695865252526, "deviation-center-line": 0.1891888601671544}, "ep003": {"driven_any": 5.995125235423849, "driven_lanedir": 5.257657811814299, "in-drivable-lane": 0.33333333333333237, "deviation-heading": 1.0397373893168125, "deviation-center-line": 0.33984268643167226}, "ep004": {"driven_any": 1.466493608985395, "driven_lanedir": 1.3169068810189688, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.3594499575862384, "deviation-center-line": 0.10844603039139132}}
No reset possible
13052step3-videossuccessyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13050step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.8999999999999995


other stats
episodes
details{"ep000": {"nsteps": 72, "reward": -15.224518820643423, "good_angle": 0.27789189219423827, "survival_time": 2.4000000000000012, "traveled_tiles": 7, "valid_direction": 0.5666666666666658}, "ep001": {"nsteps": 500, "reward": 0.662351571790874, "good_angle": 0.6516180326657329, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.699999999999996}, "ep002": {"nsteps": 87, "reward": -10.857532508328728, "good_angle": 0.04680390202743956, "survival_time": 2.8999999999999995, "traveled_tiles": 6, "valid_direction": 0.06666666666666671}, "ep003": {"nsteps": 160, "reward": -5.683951257634908, "good_angle": 0.4197091732649837, "survival_time": 5.333333333333324, "traveled_tiles": 11, "valid_direction": 0.8999999999999974}, "ep004": {"nsteps": 42, "reward": -23.33175783387075, "good_angle": 0.13898032044249595, "survival_time": 1.400000000000001, "traveled_tiles": 3, "valid_direction": 0.3666666666666675}}
good_angle_max0.6516180326657329
good_angle_mean0.3070006641189781
good_angle_median0.27789189219423827
good_angle_min0.04680390202743956
reward_max0.662351571790874
reward_mean-10.887081769737389
reward_median-10.857532508328728
reward_min-23.33175783387075
survival_time_max16.666666666666654
survival_time_mean5.739999999999997
survival_time_min1.400000000000001
traveled_tiles_max18
traveled_tiles_mean9
traveled_tiles_median7
traveled_tiles_min3
valid_direction_max1.699999999999996
valid_direction_mean0.7199999999999986
valid_direction_median0.5666666666666658
valid_direction_min0.06666666666666671
No reset possible
13042step1-simulationsuccessyes0:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7576step4-vizsuccessyes0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7575step3-videossuccessyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7574step3-videossuccessyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7573step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7572step2-scoringabortedyes0:00:12
Error while running [...]

Creating job7572-3130_scorer_1 ... error
stderr | ERROR: for job7572-3130_scorer_1  Cannot start service scorer: network job7572-3130_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7572-3130_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7571step2-scoringsuccessyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible