AI Driving Olympics Home Challenges Submissions Jobs

Submission 672

Submission672
Competingyes
Challengeaido1_LF1_r3-v3
UserLiam Paull
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13199 step2-scoring: 13206 step3-videos: 13211 step4-viz: 13214
Next
User labelRandom execution
Admin priority50
Blessing50
User priority

13214

Click the images to see detailed statistics about the episode.

13211

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13214672Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.04803616187779
deviation-center-line_median0.11325970999188652
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.1743725065545202
deviation-center-line_mean0.10540015414631763
deviation-center-line_min0
deviation-heading_max0.7850289638469695
deviation-heading_mean0.4588838229478058
deviation-heading_median0.5238724823517287
deviation-heading_min0
driven_any_max1.3272549629407648
driven_any_mean1.0993609720875308
driven_any_median1.114145733156471
driven_any_min0.7835608520829895
driven_lanedir_max1.2600289784351182
driven_lanedir_mean0.8176504826822738
driven_lanedir_min0
in-drivable-lane_max2.666666666666667
in-drivable-lane_mean0.56
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1021718176134454, "driven_lanedir": 0, "in-drivable-lane": 2.666666666666667, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3272549629407648, "driven_lanedir": 1.2600289784351182, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.5238724823517287, "deviation-center-line": 0.11325970999188652}, "ep002": {"driven_any": 0.7835608520829895, "driven_lanedir": 0.703905584597947, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.5756696723732959, "deviation-center-line": 0.0808740150214356}, "ep003": {"driven_any": 1.114145733156471, "driven_lanedir": 1.0762816885005138, "in-drivable-lane": 0, "deviation-heading": 0.4098479961670348, "deviation-center-line": 0.1743725065545202}, "ep004": {"driven_any": 1.169671494643984, "driven_lanedir": 1.04803616187779, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.7850289638469695, "deviation-center-line": 0.1584945391637459}}
13211672Liam PaullRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13206672Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7333333333333334


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -13.497841651091512, "good_angle": 1.8722389687360697, "survival_time": 2.7, "traveled_tiles": 2, "valid_direction": 1.0333333333333317}, "ep001": {"nsteps": 98, "reward": -9.664967268439275, "good_angle": 0.3635260790161622, "survival_time": 3.266666666666665, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep002": {"nsteps": 59, "reward": -16.431182975947888, "good_angle": 0.3934499419624224, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.7333333333333356}, "ep003": {"nsteps": 82, "reward": -11.98355710955632, "good_angle": 0.3180063569674276, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 85, "reward": -11.09486048927202, "good_angle": 0.3142317108471362, "survival_time": 2.833333333333333, "traveled_tiles": 3, "valid_direction": 0.6333333333333311}}
good_angle_max1.8722389687360697
good_angle_mean0.6522906115058436
good_angle_median0.3635260790161622
good_angle_min0.3142317108471362
reward_max-9.664967268439275
reward_mean-12.534481898861404
reward_median-11.98355710955632
reward_min-16.431182975947888
survival_time_max3.266666666666665
survival_time_mean2.7
survival_time_min1.9666666666666697
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.0333333333333317
valid_direction_mean0.7599999999999987
valid_direction_median0.7333333333333307
valid_direction_min0.6333333333333311
13199672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7190672Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1205241909238974
deviation-center-line_median0.32567948605211444
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.5366660543204965
deviation-center-line_mean0.3716597587511169
deviation-center-line_min0.21359671850110856
deviation-heading_max3.033660826268806
deviation-heading_mean1.462361372299732
deviation-heading_median1.5624822860565988
deviation-heading_min0.17569105310644478
driven_any_max1.599119272892101
driven_any_mean0.9587422436148698
driven_any_median1.1876802939792177
driven_any_min0.34864371902573427
driven_lanedir_max1.28645210127883
driven_lanedir_mean0.8360086532585941
driven_lanedir_min0.15610689205667572
in-drivable-lane_max0.9666666666666632
in-drivable-lane_mean0.32666666666666594
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3692710679452628, "driven_lanedir": 0.15610689205667572, "in-drivable-lane": 0.6, "deviation-heading": 2.0795008864147806, "deviation-center-line": 0.21359671850110856}, "ep001": {"driven_any": 0.34864371902573427, "driven_lanedir": 0.3477532770867158, "in-drivable-lane": 0, "deviation-heading": 0.17569105310644478, "deviation-center-line": 0.28189892971893604}, "ep002": {"driven_any": 1.1876802939792177, "driven_lanedir": 1.1205241909238974, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.5624822860565988, "deviation-center-line": 0.32567948605211444}, "ep003": {"driven_any": 1.2889968642320333, "driven_lanedir": 1.28645210127883, "in-drivable-lane": 0, "deviation-heading": 0.4604718096520287, "deviation-center-line": 0.5366660543204965}, "ep004": {"driven_any": 1.599119272892101, "driven_lanedir": 1.2692068049468517, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 3.033660826268806, "deviation-center-line": 0.500457605162929}}
7187672Liam PaullRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7185672Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.456679522764029, "good_angle": 1.2444061727245357, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333333}, "ep001": {"nsteps": 77, "reward": -13.56421662731604, "good_angle": 0.012883256037206005, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 256, "reward": -4.184217490405899, "good_angle": 0.8002735122115757, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.6999999999999948}, "ep003": {"nsteps": 279, "reward": -3.842369125361511, "good_angle": 0.03726928837545495, "survival_time": 9.299999999999978, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 344, "reward": -3.574730662805154, "good_angle": 18.38033312184743, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max18.38033312184743
good_angle_mean4.09503307023924
good_angle_median0.8002735122115757
good_angle_min0.012883256037206005
reward_max-3.574730662805154
reward_mean-7.524442685730525
reward_median-4.184217490405899
reward_min-13.56421662731604
survival_time_max11.466666666666637
survival_time_mean6.919999999999985
survival_time_min2.5666666666666673
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean1.5933333333333295
valid_direction_median1.6999999999999948
valid_direction_min0
7176672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6692672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission672/step1-simulation-nutonomy-P50-2210-job6692'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6691672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission672/step1-simulation-nutonomy-P50-2110-job6691'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6490672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6490-6702', 'pull']:

   >  Command '['docker-compose', '-p', 'job6490-6702', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling evaluator ... done

stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob211870072: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob211870072: no space left on device
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5317672Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5316672Liam PaullRandom executionaido1_LF1_r3-v3step3-videossuccessno-0:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5315672Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.59999999999998


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.811692823792062, "good_angle": 24.28812986601777, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 378, "reward": -3.695406492109652, "good_angle": 22.76586970690279, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 241, "reward": -4.152174594516468, "good_angle": 0.20136059001702675, "survival_time": 8.033333333333315, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.3602991353633795, "good_angle": 26.00621789271218, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.601168967155671, "good_angle": 5.172273166308113, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.00621789271218
good_angle_mean15.686770244391576
good_angle_median22.76586970690279
good_angle_min0.20136059001702675
reward_max-3.695406492109652
reward_mean-5.524148402587447
reward_median-5.601168967155671
reward_min-7.811692823792062
survival_time_max12.599999999999966
survival_time_mean8.786666666666646
survival_time_min5.6999999999999895
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666544
valid_direction_mean2.9733333333333234
valid_direction_median3.93333333333332
valid_direction_min0
5314672Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.59999999999998


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.811692823792062, "good_angle": 24.28812986601777, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 378, "reward": -3.695406492109652, "good_angle": 22.76586970690279, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 241, "reward": -4.152174594516468, "good_angle": 0.20136059001702675, "survival_time": 8.033333333333315, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.3602991353633795, "good_angle": 26.00621789271218, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.601168967155671, "good_angle": 5.172273166308113, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.00621789271218
good_angle_mean15.686770244391576
good_angle_median22.76586970690279
good_angle_min0.20136059001702675
reward_max-3.695406492109652
reward_mean-5.524148402587447
reward_median-5.601168967155671
reward_min-7.811692823792062
survival_time_max12.599999999999966
survival_time_mean8.786666666666646
survival_time_min5.6999999999999895
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666544
valid_direction_mean2.9733333333333234
valid_direction_median3.93333333333332
valid_direction_min0
5313672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1