AI Driving Olympics Home Challenges Submissions Jobs

Submission 725

Submission725
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11629 step2-scoring: 7012 step3-videos: 7013 step4-viz: 7022
Next
User labelJP pipeline
Admin priority63
Blessing63
User priority

7022

Click the images to see detailed statistics about the episode.

7013

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11629725JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedyes-0:04:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
7022725JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:03:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.530928914494076
deviation-center-line_median0.9024867744431432
in-drivable-lane_median3.9666666666666535


other stats
deviation-center-line_max0.9987147398595346
deviation-center-line_mean0.6170623132836557
deviation-center-line_min0.09790842455205594
deviation-heading_max3.0266278074635378
deviation-heading_mean1.6720243988478942
deviation-heading_median2.453904503491593
deviation-heading_min0.05656408439086616
driven_any_max7.915896197689495
driven_any_mean4.963399247864707
driven_any_median7.639887293488561
driven_any_min0.4093315581414513
driven_lanedir_max6.063825442305101
driven_lanedir_mean3.796681908494361
driven_lanedir_min0.4083926740883401
in-drivable-lane_max4.96666666666665
in-drivable-lane_mean2.5999999999999917
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 7.915896197689495, "driven_lanedir": 6.063825442305101, "in-drivable-lane": 4.066666666666654, "deviation-heading": 2.7034747881275947, "deviation-center-line": 0.926574720495412}, "ep001": {"driven_any": 0.4093315581414513, "driven_lanedir": 0.4083926740883401, "in-drivable-lane": 0, "deviation-heading": 0.05656408439086616, "deviation-center-line": 0.09790842455205594}, "ep002": {"driven_any": 7.840550301117218, "driven_lanedir": 5.97128422859293, "in-drivable-lane": 3.9666666666666535, "deviation-heading": 3.0266278074635378, "deviation-center-line": 0.9987147398595346}, "ep003": {"driven_any": 7.639887293488561, "driven_lanedir": 5.530928914494076, "in-drivable-lane": 4.96666666666665, "deviation-heading": 2.453904503491593, "deviation-center-line": 0.9024867744431432}, "ep004": {"driven_any": 1.011330888886809, "driven_lanedir": 1.008978282991359, "in-drivable-lane": 0, "deviation-heading": 0.11955081076587964, "deviation-center-line": 0.15962690706813307}}
7013725JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7012725JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.34021338050160554, "good_angle": 2.107156783957668, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 4.633333333333318}, "ep001": {"nsteps": 28, "reward": -36.26356498045581, "good_angle": 0.004931803717651561, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.3379425484823296, "good_angle": 2.228819455600586, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.333333333333316}, "ep003": {"nsteps": 500, "reward": -0.3543990011010319, "good_angle": 2.2097806819694967, "survival_time": 16.666666666666654, "traveled_tiles": 14, "valid_direction": 4.999999999999983}, "ep004": {"nsteps": 60, "reward": -17.061365912854672, "good_angle": 0.013200051116812444, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.228819455600586
good_angle_mean1.312777755272443
good_angle_median2.107156783957668
good_angle_min0.004931803717651561
reward_max-0.3379425484823296
reward_mean-10.871497164679088
reward_median-0.3543990011010319
reward_min-36.26356498045581
survival_time_max16.666666666666654
survival_time_mean10.58666666666666
survival_time_min0.9333333333333332
traveled_tiles_max15
traveled_tiles_mean9.4
traveled_tiles_median14
traveled_tiles_min1
valid_direction_max5.333333333333316
valid_direction_mean2.993333333333323
valid_direction_median4.633333333333318
valid_direction_min0
6992725JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:06:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6638725JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission725'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6404725JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission725'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5574725JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5573725JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5572725JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4406520579289646, "good_angle": 40.96600144619954, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 6.766666666666651}, "ep001": {"nsteps": 500, "reward": -1.199175238309428, "good_angle": 40.123178141166946, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.9666666666666455}, "ep002": {"nsteps": 500, "reward": -0.1594446971627185, "good_angle": 1.63454841808679, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 2.9999999999999893}, "ep003": {"nsteps": 274, "reward": -5.511251442569451, "good_angle": 31.406782331891332, "survival_time": 9.133333333333312, "traveled_tiles": 10, "valid_direction": 4.099999999999991}, "ep004": {"nsteps": 88, "reward": -13.374755779302426, "good_angle": 1.7719252236731329, "survival_time": 2.9333333333333327, "traveled_tiles": 5, "valid_direction": 1.1333333333333315}}
good_angle_max40.96600144619954
good_angle_mean23.18048711220355
good_angle_median31.406782331891332
good_angle_min1.63454841808679
reward_max-0.1594446971627185
reward_mean-4.337055843054598
reward_median-1.4406520579289646
reward_min-13.374755779302426
survival_time_max16.666666666666654
survival_time_mean12.41333333333332
survival_time_min2.9333333333333327
traveled_tiles_max16
traveled_tiles_mean12.2
traveled_tiles_median15
traveled_tiles_min5
valid_direction_max6.766666666666651
valid_direction_mean4.193333333333322
valid_direction_median4.099999999999991
valid_direction_min1.1333333333333315
5571725JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:05:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1