AI Driving Olympics Home Challenges Submissions Jobs

Submission 2072

Submission2072
Competingyes
Challengeaido1_LF1_r4-v3
UserWEIGAO
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 16115 step2-scoring: 16118 step3-videos: 16120 step4-viz: 16582
Next
User labelCopy of #1: sub 1633 by WEIGAO (First trial)
Admin priority75
User priority75

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
165822072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step4-vizsuccessyes-0:05:28(hidden)
driven_lanedir_consec_median17.410990082676825
deviation-center-line_median0.28490831546479445
in-drivable-lane_median0


other stats
deviation-center-line_max0.5935736021140995
deviation-center-line_mean0.3445022302413157
deviation-center-line_min0.021604559012538285
deviation-heading_max1.781383298075152
deviation-heading_mean1.0656565769150546
deviation-heading_median1.2035530552725715
deviation-heading_min0.02138418203915921
driven_any_max18.64769387247215
driven_any_mean12.066834442408393
driven_any_median18.469829251563716
driven_any_min0.382129615111452
driven_lanedir_consec_max18.436466512723463
driven_lanedir_consec_mean11.742110278319
driven_lanedir_consec_min0.3547016332420685
driven_lanedir_max18.436466512723463
driven_lanedir_mean11.742110278319
driven_lanedir_median17.410990082676825
driven_lanedir_min0.3547016332420685
in-drivable-lane_max0.966666666666668
in-drivable-lane_mean0.18571428571428591
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 18.469829251563716, "driven_lanedir": 17.932156968092315, "in-drivable-lane": 0.3, "deviation-heading": 1.781383298075152, "deviation-center-line": 0.5935736021140995, "driven_lanedir_consec": 17.932156968092315}, "ep001": {"driven_any": 9.41747442788139, "driven_lanedir": 9.285332031639747, "in-drivable-lane": 0, "deviation-heading": 0.9235736621180932, "deviation-center-line": 0.28490831546479445, "driven_lanedir_consec": 9.285332031639747}, "ep002": {"driven_any": 0.4212510600489533, "driven_lanedir": 0.3547016332420685, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.1155025046280199, "deviation-center-line": 0.021604559012538285, "driven_lanedir_consec": 0.3547016332420685}, "ep003": {"driven_any": 18.64769387247215, "driven_lanedir": 18.436466512723463, "in-drivable-lane": 0, "deviation-heading": 1.7185142230766497, "deviation-center-line": 0.5852705211347878, "driven_lanedir_consec": 18.436466512723463}, "ep004": {"driven_any": 18.58700631773924, "driven_lanedir": 18.39389491150657, "in-drivable-lane": 0, "deviation-heading": 1.6956851131957364, "deviation-center-line": 0.5934770337610016, "driven_lanedir_consec": 18.39389491150657}, "ep005": {"driven_any": 18.54245655204185, "driven_lanedir": 17.410990082676825, "in-drivable-lane": 0.966666666666668, "deviation-heading": 1.2035530552725715, "deviation-center-line": 0.28474265658290643, "driven_lanedir_consec": 17.410990082676825}, "ep006": {"driven_any": 0.382129615111452, "driven_lanedir": 0.381229808352022, "in-drivable-lane": 0, "deviation-heading": 0.02138418203915921, "deviation-center-line": 0.04793892361908171, "driven_lanedir_consec": 0.381229808352022}}
161212072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step4-vizsuccessno-0:04:43(hidden)
driven_lanedir_consec_median0.5790479408749499
deviation-center-line_median0.28490831546479445
in-drivable-lane_median0


other stats
deviation-center-line_max0.5935736021140995
deviation-center-line_mean0.3445022302413157
deviation-center-line_min0.021604559012538285
deviation-heading_max1.781383298075152
deviation-heading_mean1.0656565769150546
deviation-heading_median1.2035530552725715
deviation-heading_min0.02138418203915921
driven_any_max0.6202572847758401
driven_any_mean0.4009539081324668
driven_any_median0.6144355524703826
driven_any_min0.011482324710404926
driven_lanedir_consec_max0.6132163704015805
driven_lanedir_consec_mean0.3903564639003343
driven_lanedir_consec_min0.011456998089206244
driven_lanedir_max0.6132163704015805
driven_lanedir_mean0.3903564639003343
driven_lanedir_median0.5790479408749499
driven_lanedir_min0.011456998089206244
in-drivable-lane_max0.966666666666668
in-drivable-lane_mean0.18571428571428591
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6144355524703826, "driven_lanedir": 0.5965253956036033, "in-drivable-lane": 0.3, "deviation-heading": 1.781383298075152, "deviation-center-line": 0.5935736021140995, "driven_lanedir_consec": 0.5965253956036033}, "ep001": {"driven_any": 0.3126693631610157, "driven_lanedir": 0.3086092139075046, "in-drivable-lane": 0, "deviation-heading": 0.9235736621180932, "deviation-center-line": 0.28490831546479445, "driven_lanedir_consec": 0.3086092139075046}, "ep002": {"driven_any": 0.012817058653472137, "driven_lanedir": 0.011823387774735615, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.1155025046280199, "deviation-center-line": 0.021604559012538285, "driven_lanedir_consec": 0.011823387774735615}, "ep003": {"driven_any": 0.6202572847758401, "driven_lanedir": 0.6132163704015805, "in-drivable-lane": 0, "deviation-heading": 1.7185142230766497, "deviation-center-line": 0.5852705211347878, "driven_lanedir_consec": 0.6132163704015805}, "ep004": {"driven_any": 0.6182523895747947, "driven_lanedir": 0.6118159406507603, "in-drivable-lane": 0, "deviation-heading": 1.6956851131957364, "deviation-center-line": 0.5934770337610016, "driven_lanedir_consec": 0.6118159406507603}, "ep005": {"driven_any": 0.6167633835813575, "driven_lanedir": 0.5790479408749499, "in-drivable-lane": 0.966666666666668, "deviation-heading": 1.2035530552725715, "deviation-center-line": 0.28474265658290643, "driven_lanedir_consec": 0.5790479408749499}, "ep006": {"driven_any": 0.011482324710404926, "driven_lanedir": 0.011456998089206244, "in-drivable-lane": 0, "deviation-heading": 0.02138418203915921, "deviation-center-line": 0.04793892361908171, "driven_lanedir_consec": 0.011456998089206244}}
161202072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step3-videossuccessyes-0:02:33(hidden)
other stats
videos1
161182072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step2-scoringsuccessyes-0:01:23(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9299884500801564, "good_angle": 0.38806267850275367, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5999999999999991}, "ep001": {"nsteps": 255, "reward": -2.9658761950100168, "good_angle": 0.2082762203305908, "survival_time": 8.49999999999998, "traveled_tiles": 16, "valid_direction": 0.3333333333333327}, "ep002": {"nsteps": 13, "reward": -76.37894345590702, "good_angle": 0.06860686224361136, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.2}, "ep003": {"nsteps": 500, "reward": 1.0049873070120812, "good_angle": 0.2711702842296921, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.4999999999999992}, "ep004": {"nsteps": 500, "reward": 0.9595290693640708, "good_angle": 0.25082748300591223, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.19999999999999996}, "ep005": {"nsteps": 500, "reward": 0.4785167848914862, "good_angle": 24.63362467883735, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.3333333333333415}, "ep006": {"nsteps": 11, "reward": -90.72955027561297, "good_angle": 0.0016043104460826373, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max24.63362467883735
good_angle_mean3.688881788227999
good_angle_median0.25082748300591223
good_angle_min0.0016043104460826373
reward_max1.0049873070120812
reward_mean-23.814478330740315
reward_median0.4785167848914862
reward_min-90.72955027561297
survival_time_max16.666666666666654
survival_time_mean10.852380952380942
survival_time_min0.36666666666666664
traveled_tiles_max18
traveled_tiles_mean13
traveled_tiles_median18
traveled_tiles_min1
valid_direction_max3.3333333333333415
valid_direction_mean0.7380952380952389
valid_direction_median0.3333333333333327
valid_direction_min0
161152072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step1-simulationsuccessyes-0:07:11(hidden)
other stats
simulation-passed1
161132072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step1-simulationfailedno-0:11:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
161122072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step4-vizsuccessno-0:04:25(hidden)
driven_lanedir_consec_median0.60898370889724
deviation-center-line_median0.5678532577342792
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.6549139155936597
deviation-center-line_mean0.4804987742512533
deviation-center-line_min0.03675033175696908
deviation-heading_max1.7706056898140432
deviation-heading_mean1.3919398605297455
deviation-heading_median1.6748654726114642
deviation-heading_min0.179741884722262
driven_any_max0.6227937710628106
driven_any_mean0.5005106912855024
driven_any_median0.6173688743190228
driven_any_min0.027405471276430653
driven_lanedir_consec_max0.616115332674357
driven_lanedir_consec_mean0.49244430766774905
driven_lanedir_consec_min0.02435251987962312
driven_lanedir_max0.616115332674357
driven_lanedir_mean0.49244430766774905
driven_lanedir_median0.60898370889724
driven_lanedir_min0.02435251987962312
in-drivable-lane_max0.3
in-drivable-lane_mean0.08666666666666664
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6173688743190228, "driven_lanedir": 0.599877501099977, "in-drivable-lane": 0.3, "deviation-heading": 1.7318463091106986, "deviation-center-line": 0.6026235790533131, "driven_lanedir_consec": 0.599877501099977}, "ep001": {"driven_any": 0.6183341314141273, "driven_lanedir": 0.6128924757875481, "in-drivable-lane": 0, "deviation-heading": 1.6026399463902614, "deviation-center-line": 0.5403527871180454, "driven_lanedir_consec": 0.6128924757875481}, "ep002": {"driven_any": 0.027405471276430653, "driven_lanedir": 0.02435251987962312, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.179741884722262, "deviation-center-line": 0.03675033175696908, "driven_lanedir_consec": 0.02435251987962312}, "ep003": {"driven_any": 0.6227937710628106, "driven_lanedir": 0.616115332674357, "in-drivable-lane": 0, "deviation-heading": 1.6748654726114642, "deviation-center-line": 0.5678532577342792, "driven_lanedir_consec": 0.616115332674357}, "ep004": {"driven_any": 0.6166512083551207, "driven_lanedir": 0.60898370889724, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.7706056898140432, "deviation-center-line": 0.6549139155936597, "driven_lanedir_consec": 0.60898370889724}}
161112072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step3-videossuccessyes-0:03:47(hidden)
other stats
videos1
161102072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step2-scoringsuccessyes-0:01:55(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9243867295086384, "good_angle": 0.3735488574469558, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.6333333333333323}, "ep001": {"nsteps": 500, "reward": 0.9680272319316864, "good_angle": 0.18388811290812856, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.1333333333333331}, "ep002": {"nsteps": 25, "reward": -39.286394599378106, "good_angle": 0.13506469239273372, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.3333333333333333}, "ep003": {"nsteps": 500, "reward": 1.007110200405121, "good_angle": 0.25957128380319955, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.33333333333333315}, "ep004": {"nsteps": 500, "reward": 0.9467283459305764, "good_angle": 0.30535075676277035, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.43333333333333246}}
good_angle_max0.3735488574469558
good_angle_mean0.25148474066275756
good_angle_median0.25957128380319955
good_angle_min0.13506469239273372
reward_max1.007110200405121
reward_mean-7.088028418320417
reward_median0.9467283459305764
reward_min-39.286394599378106
survival_time_max16.666666666666654
survival_time_mean13.499999999999991
survival_time_min0.8333333333333333
traveled_tiles_max18
traveled_tiles_mean14.8
traveled_tiles_median18
traveled_tiles_min2
valid_direction_max0.6333333333333323
valid_direction_mean0.3733333333333329
valid_direction_median0.3333333333333333
valid_direction_min0.1333333333333331
161082072WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LF1_r4-v3step1-simulationsuccessno-0:06:11(hidden)
other stats
simulation-passed1