Duckietown Challenges Home Challenges Submissions

Submission 1146

Submission1146
Competingyes
Challengeaido1_LF1_r3-v3
UserMartin Weiss 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12830 step2-scoring: 12837 step3-videos: 12838 step4-viz: 12841
Next
User labelPyTorch template
Admin priority50
Blessingn/a
User priority50

12841

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12838

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12841step4-vizsuccessyes0:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7583624342945385
deviation-center-line_median0.05856940306194948
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.0848318451919554
deviation-center-line_mean0.046692309596965104
deviation-center-line_min0.00493459316827017
deviation-heading_max0.17871954277822616
deviation-heading_mean0.12290238968183878
deviation-heading_median0.1404921816205833
deviation-heading_min0.043767648089746966
driven_any_max1.12
driven_any_mean0.9520000000000014
driven_any_median1.0400000000000025
driven_any_min0.7599999999999976
driven_lanedir_max1.0891907711875215
driven_lanedir_mean0.7157737741226108
driven_lanedir_min0.00431907202387416
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.1733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0400000000000025, "driven_lanedir": 0.00431907202387416, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.1516782451032673, "deviation-center-line": 0.00493459316827017}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 0.7599999999999976, "driven_lanedir": 0.6711343097180644, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17871954277822616, "deviation-center-line": 0.02298492709392346}, "ep003": {"driven_any": 1.0800000000000007, "driven_lanedir": 1.0558622833890554, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09985433081737012, "deviation-center-line": 0.0848318451919554}, "ep004": {"driven_any": 1.12, "driven_lanedir": 1.0891907711875215, "in-drivable-lane": 0, "deviation-heading": 0.1404921816205833, "deviation-center-line": 0.062140779468727016}}
No reset possible
12838step3-videossuccessyes0:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12837step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}}
good_angle_max0.5231223188267838
good_angle_mean0.18979987683516303
good_angle_median0.13484239023230782
good_angle_min0.0030213493876724944
reward_max-33.12740348378817
reward_mean-39.758097890022654
reward_median-36.6421162430197
reward_min-47.27952035410063
survival_time_max1
survival_time_mean0.86
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.3666666666666666
valid_direction_mean0.2399999999999999
valid_direction_median0.26666666666666666
valid_direction_min0
No reset possible
12830step1-simulationsuccessyes0:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10754step4-vizsuccessyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10753step4-vizsuccessyes0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9006step4-vizabortedyes0:03:38
Error while running [...]

Pulling visualization ... error
stderr | ERROR: for visualization  Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
stderr | Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9005step4-vizsuccessyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9004step4-vizabortedyes0:00:13
Error while running [...]

Creating job9004-1385_visualization_1 ... error
stderr | ERROR: for job9004-1385_visualization_1  Cannot start service visualization: network job9004-1385_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9004-1385_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9003step3-videossuccessyes0:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9002step3-videossuccessyes0:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9001step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9000step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8999step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible