AI Driving Olympics Home Challenges Submissions Jobs

Submission 712

Submission712
Competingyes
Challengeaido1_LF1_r3-v3
UserLiam Paull
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13629 step2-scoring: 13642 step3-videos: 13645 step4-viz: 13650
Next
User labelROS-based Lane Following
Admin priority50
Blessing50
User priority

13650

Click the images to see detailed statistics about the episode.

13645

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13650712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:02:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1374889235448205
deviation-center-line_median0.2520393826581857
in-drivable-lane_median0


other stats
deviation-center-line_max2.03255640822436
deviation-center-line_mean0.894261041262226
deviation-center-line_min0.04685026574068999
deviation-heading_max1.9648959938482315
deviation-heading_mean0.990957686580287
deviation-heading_median1.1853642404885243
deviation-heading_min0.1373106535319752
driven_any_max5.335405555710802
driven_any_mean2.5240196399485333
driven_any_median1.2208212777141358
driven_any_min0.149884451234161
driven_lanedir_max3.460325074454387
driven_lanedir_mean1.7110849863588768
driven_lanedir_min0.13984549915618238
in-drivable-lane_max6.033333333333314
in-drivable-lane_mean2.259999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335405555710802, "driven_lanedir": 3.2423342570895275, "in-drivable-lane": 6.033333333333314, "deviation-heading": 1.5034850227712455, "deviation-center-line": 2.03255640822436}, "ep001": {"driven_any": 0.5785992351871089, "driven_lanedir": 0.5754311775494676, "in-drivable-lane": 0, "deviation-heading": 0.163732522261458, "deviation-center-line": 0.17774150813757067}, "ep002": {"driven_any": 1.2208212777141358, "driven_lanedir": 1.1374889235448205, "in-drivable-lane": 0, "deviation-heading": 1.1853642404885243, "deviation-center-line": 0.2520393826581857}, "ep003": {"driven_any": 5.33538767989646, "driven_lanedir": 3.460325074454387, "in-drivable-lane": 5.266666666666648, "deviation-heading": 1.9648959938482315, "deviation-center-line": 1.9621176415503232}, "ep004": {"driven_any": 0.149884451234161, "driven_lanedir": 0.13984549915618238, "in-drivable-lane": 0, "deviation-heading": 0.1373106535319752, "deviation-center-line": 0.04685026574068999}}
13645712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13642712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.03399783622240648, "good_angle": 2.5879587635967822, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.500000000000016}, "ep001": {"nsteps": 56, "reward": -17.565453245969756, "good_angle": 0.0200453150176543, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 116, "reward": -8.149260365895943, "good_angle": 0.2606366121500726, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.533333333333332}, "ep003": {"nsteps": 500, "reward": 0.10452219875674928, "good_angle": 2.1889535769206447, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.96666666666669}, "ep004": {"nsteps": 16, "reward": -62.290221896604635, "good_angle": 0.1469362066838789, "survival_time": 0.5333333333333333, "traveled_tiles": 2, "valid_direction": 0.13333333333333336}}
good_angle_max2.5879587635967822
good_angle_mean1.0409060948738067
good_angle_median0.2606366121500726
good_angle_min0.0200453150176543
reward_max0.10452219875674928
reward_mean-17.5868822291872
reward_median-8.149260365895943
reward_min-62.290221896604635
survival_time_max16.666666666666654
survival_time_mean7.919999999999995
survival_time_min0.5333333333333333
traveled_tiles_max10
traveled_tiles_mean5.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.500000000000016
valid_direction_mean1.4266666666666743
valid_direction_median0.533333333333332
valid_direction_min0
13629712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:04:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7039712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:09:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
6650712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission712/step1-simulation-nutonomy-P50-2110-job6650'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6444712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission712/step1-simulation-nutonomy-P50-2570-job6444'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5500712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5499712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:05:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5498712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5497712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5496712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5549307504342869, "good_angle": 28.906573263742025, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.200000000000011}, "ep001": {"nsteps": 500, "reward": -0.3181587567869574, "good_angle": 18.281628973374907, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.133333333333322}, "ep002": {"nsteps": 500, "reward": -0.38564417546987534, "good_angle": 0.0488346134607125, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.35650141959125176, "good_angle": 18.778318378546786, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.266666666666656}, "ep004": {"nsteps": 87, "reward": -14.048405466408566, "good_angle": 0.7437346447797271, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 1.533333333333332}}
good_angle_max28.906573263742025
good_angle_mean13.351817974780827
good_angle_median18.281628973374907
good_angle_min0.0488346134607125
reward_max-0.3181587567869574
reward_mean-3.1327281137381875
reward_median-0.38564417546987534
reward_min-14.048405466408566
survival_time_max16.666666666666654
survival_time_mean13.913333333333323
survival_time_min2.8999999999999995
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max7.200000000000011
valid_direction_mean3.0266666666666637
valid_direction_median3.133333333333322
valid_direction_min0
5495712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5549307504342869, "good_angle": 28.906573263742025, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.200000000000011}, "ep001": {"nsteps": 500, "reward": -0.3181587567869574, "good_angle": 18.281628973374907, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.133333333333322}, "ep002": {"nsteps": 500, "reward": -0.38564417546987534, "good_angle": 0.0488346134607125, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.35650141959125176, "good_angle": 18.778318378546786, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.266666666666656}, "ep004": {"nsteps": 87, "reward": -14.048405466408566, "good_angle": 0.7437346447797271, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 1.533333333333332}}
good_angle_max28.906573263742025
good_angle_mean13.351817974780827
good_angle_median18.281628973374907
good_angle_min0.0488346134607125
reward_max-0.3181587567869574
reward_mean-3.1327281137381875
reward_median-0.38564417546987534
reward_min-14.048405466408566
survival_time_max16.666666666666654
survival_time_mean13.913333333333323
survival_time_min2.8999999999999995
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max7.200000000000011
valid_direction_mean3.0266666666666637
valid_direction_median3.133333333333322
valid_direction_min0
5493712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:06:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1