Duckietown Challenges Home Challenges Submissions

Submission 2072

Submission2072
Competingyes
Challengeaido1_LF1_r4-v3
UserWei GaoΒ πŸ‡ΈπŸ‡¬
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
ResultπŸ’š
Jobsstep1-simulation: 16115 step2-scoring: 16118 step3-videos: 16120 step4-viz: 16582
Next
User labelCopy of #1: sub 1633 by WEIGAO (First trial)
Admin priority75
Blessingn/a
User priority75

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
16582step4-vizsuccessyes0:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.410990082676825
deviation-center-line_median0.28490831546479445
in-drivable-lane_median0


other stats
deviation-center-line_max0.5935736021140995
deviation-center-line_mean0.3445022302413157
deviation-center-line_min0.021604559012538285
deviation-heading_max1.781383298075152
deviation-heading_mean1.0656565769150546
deviation-heading_median1.2035530552725715
deviation-heading_min0.02138418203915921
driven_any_max18.64769387247215
driven_any_mean12.066834442408393
driven_any_median18.469829251563716
driven_any_min0.382129615111452
driven_lanedir_consec_max18.436466512723463
driven_lanedir_consec_mean11.742110278319
driven_lanedir_consec_min0.3547016332420685
driven_lanedir_max18.436466512723463
driven_lanedir_mean11.742110278319
driven_lanedir_median17.410990082676825
driven_lanedir_min0.3547016332420685
in-drivable-lane_max0.966666666666668
in-drivable-lane_mean0.18571428571428591
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 18.469829251563716, "driven_lanedir": 17.932156968092315, "in-drivable-lane": 0.3, "deviation-heading": 1.781383298075152, "deviation-center-line": 0.5935736021140995, "driven_lanedir_consec": 17.932156968092315}, "ep001": {"driven_any": 9.41747442788139, "driven_lanedir": 9.285332031639747, "in-drivable-lane": 0, "deviation-heading": 0.9235736621180932, "deviation-center-line": 0.28490831546479445, "driven_lanedir_consec": 9.285332031639747}, "ep002": {"driven_any": 0.4212510600489533, "driven_lanedir": 0.3547016332420685, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.1155025046280199, "deviation-center-line": 0.021604559012538285, "driven_lanedir_consec": 0.3547016332420685}, "ep003": {"driven_any": 18.64769387247215, "driven_lanedir": 18.436466512723463, "in-drivable-lane": 0, "deviation-heading": 1.7185142230766497, "deviation-center-line": 0.5852705211347878, "driven_lanedir_consec": 18.436466512723463}, "ep004": {"driven_any": 18.58700631773924, "driven_lanedir": 18.39389491150657, "in-drivable-lane": 0, "deviation-heading": 1.6956851131957364, "deviation-center-line": 0.5934770337610016, "driven_lanedir_consec": 18.39389491150657}, "ep005": {"driven_any": 18.54245655204185, "driven_lanedir": 17.410990082676825, "in-drivable-lane": 0.966666666666668, "deviation-heading": 1.2035530552725715, "deviation-center-line": 0.28474265658290643, "driven_lanedir_consec": 17.410990082676825}, "ep006": {"driven_any": 0.382129615111452, "driven_lanedir": 0.381229808352022, "in-drivable-lane": 0, "deviation-heading": 0.02138418203915921, "deviation-center-line": 0.04793892361908171, "driven_lanedir_consec": 0.381229808352022}}
No reset possible
16121step4-vizsuccessno0:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16120step3-videossuccessyes0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
16118step2-scoringsuccessyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9299884500801564, "good_angle": 0.38806267850275367, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5999999999999991}, "ep001": {"nsteps": 255, "reward": -2.9658761950100168, "good_angle": 0.2082762203305908, "survival_time": 8.49999999999998, "traveled_tiles": 16, "valid_direction": 0.3333333333333327}, "ep002": {"nsteps": 13, "reward": -76.37894345590702, "good_angle": 0.06860686224361136, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.2}, "ep003": {"nsteps": 500, "reward": 1.0049873070120812, "good_angle": 0.2711702842296921, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.4999999999999992}, "ep004": {"nsteps": 500, "reward": 0.9595290693640708, "good_angle": 0.25082748300591223, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.19999999999999996}, "ep005": {"nsteps": 500, "reward": 0.4785167848914862, "good_angle": 24.63362467883735, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.3333333333333415}, "ep006": {"nsteps": 11, "reward": -90.72955027561297, "good_angle": 0.0016043104460826373, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max24.63362467883735
good_angle_mean3.688881788227999
good_angle_median0.25082748300591223
good_angle_min0.0016043104460826373
reward_max1.0049873070120812
reward_mean-23.814478330740315
reward_median0.4785167848914862
reward_min-90.72955027561297
survival_time_max16.666666666666654
survival_time_mean10.852380952380942
survival_time_min0.36666666666666664
traveled_tiles_max18
traveled_tiles_mean13
traveled_tiles_median18
traveled_tiles_min1
valid_direction_max3.3333333333333415
valid_direction_mean0.7380952380952389
valid_direction_median0.3333333333333327
valid_direction_min0
No reset possible
16115step1-simulationsuccessyes0:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
16113step1-simulationfailedno0:11:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16112step4-vizsuccessno0:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16111step3-videossuccessyes0:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16110step2-scoringsuccessyes0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16108step1-simulationsuccessno0:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible