AI Driving Olympics Home Challenges Submissions Jobs

Submission 726

Submission726
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13784 step2-scoring: 13786 step3-videos: 13788 step4-viz: 13793
Next
User labelJP pipeline
Admin priority50
Blessing50
User priority

13793

Click the images to see detailed statistics about the episode.

13788

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13793726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5619117837235694
deviation-center-line_median0.10251863117452434
in-drivable-lane_median0.09999999999999998


other stats
deviation-center-line_max0.2118463495176564
deviation-center-line_mean0.11603928494954382
deviation-center-line_min0.05856940306194948
deviation-heading_max0.7507644468675223
deviation-heading_mean0.31894237256449764
deviation-heading_median0.2712192676940383
deviation-heading_min0.043767648089746966
driven_any_max3.807282123935704
driven_any_mean2.090465884685675
driven_any_median1.9216998386165616
driven_any_min0.760000000000006
driven_lanedir_max2.602700914383715
driven_lanedir_mean1.607456431681617
driven_lanedir_min0.7583624342945385
in-drivable-lane_max0.8999999999999996
in-drivable-lane_mean0.3733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2056829569488636, "driven_lanedir": 1.2449016864057645, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.19395089221437212, "deviation-center-line": 0.09588613820460816}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 1.7576645039272405, "driven_lanedir": 1.5619117837235694, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.33500960795680856, "deviation-center-line": 0.10251863117452434}, "ep003": {"driven_any": 1.9216998386165616, "driven_lanedir": 1.869405339600497, "in-drivable-lane": 0, "deviation-heading": 0.2712192676940383, "deviation-center-line": 0.11137590278898073}, "ep004": {"driven_any": 3.807282123935704, "driven_lanedir": 2.602700914383715, "in-drivable-lane": 0.8999999999999996, "deviation-heading": 0.7507644468675223, "deviation-center-line": 0.2118463495176564}}
13788726JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13786726JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -16.812896430368223, "good_angle": 0.16725092791193047, "survival_time": 2.0000000000000027, "traveled_tiles": 5, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -20.090162189211696, "good_angle": 0.05127530661354473, "survival_time": 1.6000000000000016, "traveled_tiles": 4, "valid_direction": 0.10000000000000003}, "ep003": {"nsteps": 52, "reward": -18.76694420678541, "good_angle": 0.05594291817927141, "survival_time": 1.7333333333333354, "traveled_tiles": 3, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 103, "reward": -9.498041331302376, "good_angle": 0.5151282818834407, "survival_time": 3.433333333333331, "traveled_tiles": 8, "valid_direction": 0.9000000000000006}}
good_angle_max0.5151282818834407
good_angle_mean0.15852375679517197
good_angle_median0.05594291817927141
good_angle_min0.0030213493876724944
reward_max-9.498041331302376
reward_mean-22.489512902353667
reward_median-18.76694420678541
reward_min-47.27952035410063
survival_time_max3.433333333333331
survival_time_mean1.893333333333334
survival_time_min0.7
traveled_tiles_max8
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.9000000000000006
valid_direction_mean0.28000000000000014
valid_direction_median0.1333333333333333
valid_direction_min0
13784726JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes-0:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6990726JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno-0:02:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
6637726JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission726/step1-simulation-nutonomy-P50-2210-job6637'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6403726JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission726/step1-simulation-nutonomy-P50-2210-job6403'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5583726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5582726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:06:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5581726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5580726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5579726JonJP pipelineaido1_LF1_r3-v3step4-vizerrorno-0:00:49
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5579-5673', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5579-5673', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5578726JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5577726JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5576726JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:01:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.5482772109312937, "good_angle": 45.85291574377827, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.233333333333313}, "ep001": {"nsteps": 500, "reward": -1.3214039908000268, "good_angle": 39.45868151088105, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.933333333333345}, "ep002": {"nsteps": 218, "reward": -4.578549463967146, "good_angle": 0.698688621525974, "survival_time": 7.266666666666651, "traveled_tiles": 9, "valid_direction": 1.3666666666666618}, "ep003": {"nsteps": 500, "reward": -1.5141833693385125, "good_angle": 46.938958097691355, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.266666666666648}, "ep004": {"nsteps": 42, "reward": -26.426783873921348, "good_angle": 0.040033951121231176, "survival_time": 1.400000000000001, "traveled_tiles": 3, "valid_direction": 0}}
good_angle_max46.938958097691355
good_angle_mean26.597855584999586
good_angle_median39.45868151088105
good_angle_min0.040033951121231176
reward_max-1.3214039908000268
reward_mean-7.077839581791665
reward_median-1.5482772109312937
reward_min-26.426783873921348
survival_time_max16.666666666666654
survival_time_mean11.733333333333322
survival_time_min1.400000000000001
traveled_tiles_max18
traveled_tiles_mean13.2
traveled_tiles_median18
traveled_tiles_min3
valid_direction_max7.933333333333345
valid_direction_mean4.759999999999993
valid_direction_median7.233333333333313
valid_direction_min0
5575726JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:05:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1