Duckietown Challenges Home Challenges Submissions

Submission 1012

Submission1012
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid Abraham
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14100 step2-scoring: 14109 step3-videos: 14112 step4-viz: 14118
Next
User labelPytorch IL
Admin priority50
Blessingn/a
User priority50

14118

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

14112

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
14118step4-vizsuccessyes0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.698483872000147
deviation-center-line_median0.1141705820433344
in-drivable-lane_median0.09999999999999988


other stats
deviation-center-line_max0.2746417194998002
deviation-center-line_mean0.15867932379677854
deviation-center-line_min0.06264226358418436
deviation-heading_max1.237071973429899
deviation-heading_mean0.6928635446867579
deviation-heading_median0.7270644762155613
deviation-heading_min0.25554791073930605
driven_any_max6.67258745930385
driven_any_mean4.036291644438568
driven_any_median3.729364788911458
driven_any_min1.4387120515518923
driven_lanedir_max6.422034032605247
driven_lanedir_mean3.564472827295842
driven_lanedir_min1.3545319446031665
in-drivable-lane_max0.8666666666666666
in-drivable-lane_mean0.24666666666666667
in-drivable-lane_min0.033333333333333326
per-episodes
details{"ep000": {"driven_any": 3.729364788911458, "driven_lanedir": 2.698483872000147, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.4444425066343305, "deviation-center-line": 0.09417733573056712}, "ep001": {"driven_any": 1.4387120515518923, "driven_lanedir": 1.3545319446031665, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.25554791073930605, "deviation-center-line": 0.06264226358418436}, "ep002": {"driven_any": 6.67258745930385, "driven_lanedir": 6.422034032605247, "in-drivable-lane": 0.09999999999999988, "deviation-heading": 0.7270644762155613, "deviation-center-line": 0.24776471812600656}, "ep003": {"driven_any": 6.438878588574458, "driven_lanedir": 5.911383048849606, "in-drivable-lane": 0.09999999999999976, "deviation-heading": 1.237071973429899, "deviation-center-line": 0.2746417194998002}, "ep004": {"driven_any": 1.9019153338511805, "driven_lanedir": 1.435931238421042, "in-drivable-lane": 0.13333333333333364, "deviation-heading": 0.8001908564146925, "deviation-center-line": 0.1141705820433344}}
No reset possible
14112step3-videossuccessyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
14109step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.3666666666666645


other stats
episodes
details{"ep000": {"nsteps": 101, "reward": -9.51644176429156, "good_angle": 0.1786445516274026, "survival_time": 3.3666666666666645, "traveled_tiles": 6, "valid_direction": 0.566666666666666}, "ep001": {"nsteps": 41, "reward": -23.707647001756943, "good_angle": 0.04579691577208957, "survival_time": 1.3666666666666676, "traveled_tiles": 3, "valid_direction": 0.06666666666666687}, "ep002": {"nsteps": 174, "reward": -4.994314238723453, "good_angle": 0.07054867910858756, "survival_time": 5.799999999999989, "traveled_tiles": 11, "valid_direction": 0.06666666666666643}, "ep003": {"nsteps": 170, "reward": -5.276598060631317, "good_angle": 1.1137454422165698, "survival_time": 5.666666666666656, "traveled_tiles": 11, "valid_direction": 0.5333333333333314}, "ep004": {"nsteps": 52, "reward": -18.770169389102826, "good_angle": 0.9017961787199076, "survival_time": 1.7333333333333354, "traveled_tiles": 4, "valid_direction": 0.6000000000000019}}
good_angle_max1.1137454422165698
good_angle_mean0.4621063534889115
good_angle_median0.1786445516274026
good_angle_min0.04579691577208957
reward_max-4.994314238723453
reward_mean-12.45303409090122
reward_median-9.51644176429156
reward_min-23.707647001756943
survival_time_max5.799999999999989
survival_time_mean3.5866666666666625
survival_time_min1.3666666666666676
traveled_tiles_max11
traveled_tiles_mean7
traveled_tiles_median6
traveled_tiles_min3
valid_direction_max0.6000000000000019
valid_direction_mean0.3666666666666666
valid_direction_median0.5333333333333314
valid_direction_min0.06666666666666643
No reset possible
14100step1-simulationsuccessyes0:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8211step4-vizsuccessyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8210step4-vizsuccessyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8209step4-vizsuccessyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8208step3-videossuccessyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8207step3-videossuccessyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8206step3-videosabortedyes0:00:12
Error while running [...]

Creating job8206-6457_videos_1 ... error
stderr | ERROR: for job8206-6457_videos_1  Cannot start service videos: network job8206-6457_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8206-6457_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8202step2-scoringsuccessyes0:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8201step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible