Duckietown Challenges Home Challenges Submissions

Submission 1163

Submission1163
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 13013 step2-scoring: 9135 step3-videos: 9141 step4-viz: 9144
Next
User labelMy ROS solution
Admin priority50
Blessingn/a
User priority50

9144

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

9141

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13013step1-simulationerroryes0:03:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9144step4-vizsuccessyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3070283213499705
deviation-center-line_median0.09702116052130282
in-drivable-lane_median0


other stats
deviation-center-line_max0.1334524996958888
deviation-center-line_mean0.09749151407689988
deviation-center-line_min0.055815900522894105
deviation-heading_max0.7110042756209249
deviation-heading_mean0.296793112575123
deviation-heading_median0.2182953031992732
deviation-heading_min0.06818726091822697
driven_any_max0.4940570536094428
driven_any_mean0.36368335909081895
driven_any_median0.3449494516498846
driven_any_min0.17765045729553103
driven_lanedir_max0.4823056849554743
driven_lanedir_mean0.3165662687498885
driven_lanedir_min0.13982312596231128
in-drivable-lane_max0.2
in-drivable-lane_mean0.039999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3449494516498846, "driven_lanedir": 0.13982312596231128, "in-drivable-lane": 0.2, "deviation-heading": 0.7110042756209249, "deviation-center-line": 0.07077433954496597}, "ep001": {"driven_any": 0.17765045729553103, "driven_lanedir": 0.17595983449900254, "in-drivable-lane": 0, "deviation-heading": 0.06818726091822697, "deviation-center-line": 0.055815900522894105}, "ep002": {"driven_any": 0.4856599583480304, "driven_lanedir": 0.47771437698268393, "in-drivable-lane": 0, "deviation-heading": 0.2182953031992732, "deviation-center-line": 0.13039367009944774}, "ep003": {"driven_any": 0.4940570536094428, "driven_lanedir": 0.4823056849554743, "in-drivable-lane": 0, "deviation-heading": 0.2790574156926786, "deviation-center-line": 0.1334524996958888}, "ep004": {"driven_any": 0.3160998745512058, "driven_lanedir": 0.3070283213499705, "in-drivable-lane": 0, "deviation-heading": 0.20742130744451104, "deviation-center-line": 0.09702116052130282}}
No reset possible
9141step3-videossuccessyes0:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9140step3-videosabortedyes0:00:11
Error while running [...]

Creating job9140-9975_videos_1 ... error
stderr | ERROR: for job9140-9975_videos_1  Cannot start service videos: network job9140-9975_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9140-9975_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9139step3-videosabortedyes0:00:11
Error while running [...]

Creating job9139-7125_videos_1 ... error
stderr | ERROR: for job9139-7125_videos_1  Cannot start service videos: network job9139-7125_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9139-7125_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9135step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95931072273691, "good_angle": 0.4607011578049614, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 16, "reward": -63.05295382626355, "good_angle": 0.009460817280403743, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 42, "reward": -24.293739820520084, "good_angle": 0.08335812933400061, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.16666666666666718}, "ep003": {"nsteps": 44, "reward": -23.202110031450335, "good_angle": 0.12142468689602476, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.20000000000000065}, "ep004": {"nsteps": 29, "reward": -35.01854748150398, "good_angle": 0.10026262007949992, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}}
good_angle_max0.4607011578049614
good_angle_mean0.15504148227897813
good_angle_median0.10026262007949992
good_angle_min0.009460817280403743
reward_max-23.202110031450335
reward_mean-36.305332376494974
reward_median-35.01854748150398
reward_min-63.05295382626355
survival_time_max1.466666666666668
survival_time_mean1.0600000000000005
survival_time_min0.5333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.7999999999999998
valid_direction_mean0.27333333333333354
valid_direction_median0.19999999999999996
valid_direction_min0
No reset possible
9134step2-scoringabortedyes0:00:13
Error while running [...]

Creating job9134-2322_scorer_1 ... error
stderr | ERROR: for job9134-2322_scorer_1  Cannot start service scorer: network job9134-2322_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9134-2322_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible