Duckietown Challenges Home Challenges Submissions

Submission 1035

Submission1035
Competingyes
Challengeaido1_LF1_r3-v3
UserLaurent Mandrile
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 11780 step2-scoring: 8314 step3-videos: 8320 step4-viz: 8321
Next
User labelSim Il Tflow hype
Admin priority50
Blessingn/a
User priority50

8321

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8320

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11780step1-simulationerroryes0:03:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8321step4-vizsuccessyes0:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.10331574596562688
deviation-center-line_median0.05244593062932587
in-drivable-lane_median0


other stats
deviation-center-line_max0.06578370034473885
deviation-center-line_mean0.04518778107444964
deviation-center-line_min0
deviation-heading_max0.3686251299873819
deviation-heading_mean0.23148631655125265
deviation-heading_median0.27013205533439005
deviation-heading_min0
driven_any_max0.4658305023419053
driven_any_mean0.19564555356369256
driven_any_median0.1319747280469859
driven_any_min0.11645892831692588
driven_lanedir_max0.12289313585708062
driven_lanedir_mean0.08714163911977364
driven_lanedir_min0
in-drivable-lane_max2.033333333333336
in-drivable-lane_mean0.4066666666666672
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.4658305023419053, "driven_lanedir": 0, "in-drivable-lane": 2.033333333333336, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.11645892831692588, "driven_lanedir": 0.10331574596562688, "in-drivable-lane": 0, "deviation-heading": 0.23931054874527796, "deviation-center-line": 0.06578370034473885}, "ep002": {"driven_any": 0.12421489379037376, "driven_lanedir": 0.10686655994365736, "in-drivable-lane": 0, "deviation-heading": 0.27013205533439005, "deviation-center-line": 0.05244593062932587}, "ep003": {"driven_any": 0.1319747280469859, "driven_lanedir": 0.10263275383250337, "in-drivable-lane": 0, "deviation-heading": 0.3686251299873819, "deviation-center-line": 0.043900178720998786}, "ep004": {"driven_any": 0.1397487153222717, "driven_lanedir": 0.12289313585708062, "in-drivable-lane": 0, "deviation-heading": 0.2793638486892131, "deviation-center-line": 0.06380909567718467}}
No reset possible
8320step3-videossuccessyes0:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8314step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6333333333333333


other stats
episodes
details{"ep000": {"nsteps": 62, "reward": -18.74995160461854, "good_angle": 7.287449371287515, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.966666666666669}, "ep001": {"nsteps": 17, "reward": -59.485464104834726, "good_angle": 0.1460733136162632, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 18, "reward": -56.05330875681506, "good_angle": 0.20255283961350373, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0.4333333333333333}, "ep003": {"nsteps": 19, "reward": -53.0501162821525, "good_angle": 0.33679541117258294, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep004": {"nsteps": 20, "reward": -50.540405513346194, "good_angle": 0.187055372739996, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}}
good_angle_max7.287449371287515
good_angle_mean1.631985261685972
good_angle_median0.20255283961350373
good_angle_min0.1460733136162632
reward_max-18.74995160461854
reward_mean-47.5758492523534
reward_median-53.0501162821525
reward_min-59.485464104834726
survival_time_max2.066666666666669
survival_time_mean0.9066666666666672
survival_time_min0.5666666666666667
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.966666666666669
valid_direction_mean0.7400000000000004
valid_direction_median0.4333333333333333
valid_direction_min0.4
No reset possible