AI Driving Olympics Home Challenges Submissions Jobs

Submission 745

Submission745
Competingyes
Challengeaido1_LF1_r3-v3
Userheyt0ny
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13992 step2-scoring: 14003 step3-videos: 14006 step4-viz: 14010
Next
User labelAI DL RL MML XXXL 2k18 yoo
Admin priority50
Blessing50
User priority

14010

Click the images to see detailed statistics about the episode.

14006

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14010745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes-0:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.786550593794506
deviation-center-line_median0.28404222493894965
in-drivable-lane_median0.10000000000000007


other stats
deviation-center-line_max0.507717046310039
deviation-center-line_mean0.3324638806081811
deviation-center-line_min0.13837419446280794
deviation-heading_max1.3807878977781234
deviation-heading_mean1.0403851584282833
deviation-heading_median1.014705794765345
deviation-heading_min0.7267362721664988
driven_any_max5.456843632682162
driven_any_mean3.694340421977538
driven_any_median4.344556621469376
driven_any_min1.296523482621127
driven_lanedir_max5.012754736743167
driven_lanedir_mean3.174687908348678
driven_lanedir_min1.1324075168078194
in-drivable-lane_max1.8666666666666687
in-drivable-lane_mean0.4866666666666673
in-drivable-lane_min0.03333333333333344
per-episodes
details{"ep000": {"driven_any": 4.344556621469376, "driven_lanedir": 2.786550593794506, "in-drivable-lane": 1.8666666666666687, "deviation-heading": 0.8892441782679916, "deviation-center-line": 0.28404222493894965}, "ep001": {"driven_any": 2.456695880389858, "driven_lanedir": 2.3205439269201458, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.7267362721664988, "deviation-center-line": 0.24295124092895337}, "ep002": {"driven_any": 5.456843632682162, "driven_lanedir": 5.012754736743167, "in-drivable-lane": 0.3666666666666673, "deviation-heading": 1.1904516491634574, "deviation-center-line": 0.507717046310039}, "ep003": {"driven_any": 4.9170824927251715, "driven_lanedir": 4.6211827674777535, "in-drivable-lane": 0.10000000000000007, "deviation-heading": 1.3807878977781234, "deviation-center-line": 0.4892346964001559}, "ep004": {"driven_any": 1.296523482621127, "driven_lanedir": 1.1324075168078194, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 1.014705794765345, "deviation-center-line": 0.13837419446280794}}
14006745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes-0:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
14003745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.266666666666658


other stats
episodes
details{"ep000": {"nsteps": 158, "reward": -6.443896666687878, "good_angle": 0.5558670749976514, "survival_time": 5.266666666666658, "traveled_tiles": 8, "valid_direction": 1.733333333333335}, "ep001": {"nsteps": 89, "reward": -10.729929503095285, "good_angle": 0.10515861578190572, "survival_time": 2.966666666666666, "traveled_tiles": 5, "valid_direction": 0.30000000000000093}, "ep002": {"nsteps": 186, "reward": -4.875641627297286, "good_angle": 0.22887121095168503, "survival_time": 6.199999999999988, "traveled_tiles": 10, "valid_direction": 0.7333333333333318}, "ep003": {"nsteps": 173, "reward": -5.27640387682901, "good_angle": 0.21153864216163695, "survival_time": 5.766666666666656, "traveled_tiles": 8, "valid_direction": 0.6666666666666664}, "ep004": {"nsteps": 64, "reward": -15.04919581123977, "good_angle": 0.5091537933886537, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 0.7666666666666679}}
good_angle_max0.5558670749976514
good_angle_mean0.3221178674563066
good_angle_median0.22887121095168503
good_angle_min0.10515861578190572
reward_max-4.875641627297286
reward_mean-8.475013497029845
reward_median-6.443896666687878
reward_min-15.04919581123977
survival_time_max6.199999999999988
survival_time_mean4.466666666666661
survival_time_min2.1333333333333355
traveled_tiles_max10
traveled_tiles_mean6.6
traveled_tiles_median8
traveled_tiles_min2
valid_direction_max1.733333333333335
valid_direction_mean0.8400000000000004
valid_direction_median0.7333333333333318
valid_direction_min0.30000000000000093
13992745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessyes-0:06:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10712745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno-0:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6614745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno-0:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6614-6431', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job6614-6431', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job6614-6431_evaluation" with the default driver
stderr | Creating job6614-6431_evaluator_1 ...
stderr | Creating job6614-6431_solution_1  ...
stderr | 
Creating job6614-6431_evaluator_1 ... error

stderr | ERROR: for job6614-6431_evaluator_1  Cannot start service evaluator: network job6614-6431_evaluation not found
stderr | 
Creating job6614-6431_solution_1  ... error

stderr | ERROR: for job6614-6431_solution_1  Cannot start service solution: network job6614-6431_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job6614-6431_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job6614-6431_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6388745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission745/step1-simulation-nutonomy-P50-2570-job6388'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5653745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno-0:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5652745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno-0:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5651745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno-0:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5650745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno-0:01:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.133333333333318


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.493504843804476, "good_angle": 10.80054552018425, "survival_time": 10.66666666666664, "traveled_tiles": 4, "valid_direction": 4.833333333333322}, "ep001": {"nsteps": 167, "reward": -6.300075401846197, "good_angle": 5.697903143655912, "survival_time": 5.566666666666657, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep002": {"nsteps": 342, "reward": -3.0983721763705727, "good_angle": 0.4467618172119696, "survival_time": 11.39999999999997, "traveled_tiles": 7, "valid_direction": 1.233333333333329}, "ep003": {"nsteps": 204, "reward": -5.827742832913702, "good_angle": 13.094108382975016, "survival_time": 6.799999999999986, "traveled_tiles": 4, "valid_direction": 3.4999999999999876}, "ep004": {"nsteps": 214, "reward": -6.383901206254262, "good_angle": 5.496909782358589, "survival_time": 7.133333333333318, "traveled_tiles": 5, "valid_direction": 4.333333333333318}}
good_angle_max13.094108382975016
good_angle_mean7.107245729277148
good_angle_median5.697903143655912
good_angle_min0.4467618172119696
reward_max-3.0983721763705727
reward_mean-5.020719292237842
reward_median-5.827742832913702
reward_min-6.383901206254262
survival_time_max11.39999999999997
survival_time_mean8.313333333333315
survival_time_min5.566666666666657
traveled_tiles_max7
traveled_tiles_mean4.8
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max4.833333333333322
valid_direction_mean3.2199999999999904
valid_direction_median3.4999999999999876
valid_direction_min1.233333333333329
5649745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno-0:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.133333333333318


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.493504843804476, "good_angle": 10.80054552018425, "survival_time": 10.66666666666664, "traveled_tiles": 4, "valid_direction": 4.833333333333322}, "ep001": {"nsteps": 167, "reward": -6.300075401846197, "good_angle": 5.697903143655912, "survival_time": 5.566666666666657, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep002": {"nsteps": 342, "reward": -3.0983721763705727, "good_angle": 0.4467618172119696, "survival_time": 11.39999999999997, "traveled_tiles": 7, "valid_direction": 1.233333333333329}, "ep003": {"nsteps": 204, "reward": -5.827742832913702, "good_angle": 13.094108382975016, "survival_time": 6.799999999999986, "traveled_tiles": 4, "valid_direction": 3.4999999999999876}, "ep004": {"nsteps": 214, "reward": -6.383901206254262, "good_angle": 5.496909782358589, "survival_time": 7.133333333333318, "traveled_tiles": 5, "valid_direction": 4.333333333333318}}
good_angle_max13.094108382975016
good_angle_mean7.107245729277148
good_angle_median5.697903143655912
good_angle_min0.4467618172119696
reward_max-3.0983721763705727
reward_mean-5.020719292237842
reward_median-5.827742832913702
reward_min-6.383901206254262
survival_time_max11.39999999999997
survival_time_mean8.313333333333315
survival_time_min5.566666666666657
traveled_tiles_max7
traveled_tiles_mean4.8
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max4.833333333333322
valid_direction_mean3.2199999999999904
valid_direction_median3.4999999999999876
valid_direction_min1.233333333333329
5648745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno-0:09:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1