Duckietown Challenges Home Challenges Submissions

Submission 1044

Submission1044
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid Abraham
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11890 step2-scoring: 11897 step3-videos: 11900 step4-viz: 11904
Next
User labelPytorch IL
Admin priority50
Blessingn/a
User priority50

11904

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11900

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11904step4-vizsuccessyes0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.41155985068160095
deviation-center-line_median0.04576515611971445
in-drivable-lane_median0


other stats
deviation-center-line_max0.6790097643666503
deviation-center-line_mean0.1846591185353737
deviation-center-line_min0.03215910280249246
deviation-heading_max1.258902919083825
deviation-heading_mean0.4029877685811404
deviation-heading_median0.09634271500801804
deviation-heading_min0.05936511896651107
driven_any_max8.273541857320206
driven_any_mean2.085127190657187
driven_any_median0.4192622334126492
driven_any_min0.279490292587599
driven_lanedir_max7.496864198250639
driven_lanedir_mean1.81244926008893
driven_lanedir_min0.2735596540447722
in-drivable-lane_max0.5999999999999985
in-drivable-lane_mean0.213333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1459221374552668, "driven_lanedir": 0.5861867421707377, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.5184528633009765, "deviation-center-line": 0.130202581208337}, "ep001": {"driven_any": 0.30741943251021414, "driven_lanedir": 0.2940758552969003, "in-drivable-lane": 0, "deviation-heading": 0.09634271500801804, "deviation-center-line": 0.03215910280249246}, "ep002": {"driven_any": 8.273541857320206, "driven_lanedir": 7.496864198250639, "in-drivable-lane": 0.5999999999999985, "deviation-heading": 1.258902919083825, "deviation-center-line": 0.6790097643666503}, "ep003": {"driven_any": 0.4192622334126492, "driven_lanedir": 0.41155985068160095, "in-drivable-lane": 0, "deviation-heading": 0.08187522654637128, "deviation-center-line": 0.04576515611971445}, "ep004": {"driven_any": 0.279490292587599, "driven_lanedir": 0.2735596540447722, "in-drivable-lane": 0, "deviation-heading": 0.05936511896651107, "deviation-center-line": 0.036158988179674466}}
No reset possible
11900step3-videossuccessyes0:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11897step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.5666666666666667


other stats
episodes
details{"ep000": {"nsteps": 43, "reward": -23.07705678669519, "good_angle": 0.3181420612423621, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.6333333333333342}, "ep001": {"nsteps": 13, "reward": -76.60292469824736, "good_angle": 0.05238933160329326, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep002": {"nsteps": 298, "reward": -2.3073978608711654, "good_angle": 0.2443975809004328, "survival_time": 9.933333333333309, "traveled_tiles": 14, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 17, "reward": -58.49703047928565, "good_angle": 0.02981684033343196, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.10000000000000003}, "ep004": {"nsteps": 12, "reward": -83.09124115838979, "good_angle": 0.026786598291278465, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.09999999999999998}}
good_angle_max0.3181420612423621
good_angle_mean0.13430648247415972
good_angle_median0.05238933160329326
good_angle_min0.026786598291278465
reward_max-2.3073978608711654
reward_mean-48.71513019669783
reward_median-58.49703047928565
reward_min-83.09124115838979
survival_time_max9.933333333333309
survival_time_mean2.5533333333333283
survival_time_min0.4
traveled_tiles_max14
traveled_tiles_mean4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.6333333333333342
valid_direction_mean0.24666666666666667
valid_direction_median0.1333333333333333
valid_direction_min0.09999999999999998
No reset possible
11890step1-simulationsuccessyes0:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8378step4-vizsuccessyes0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8377step3-videossuccessyes0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8376step3-videosabortedyes0:00:12
Error while running [...]

Creating job8376-8907_videos_1 ... error
stderr | ERROR: for job8376-8907_videos_1  Cannot start service videos: network job8376-8907_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8376-8907_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8373step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8372step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible