AI Driving Olympics Home Challenges Submissions Jobs

Submission 769

Submission769
Competingyes
Challengeaido1_LF1_r3-v3
Userkbenson
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 11740 step2-scoring: 11742 step3-videos: 11744 step4-viz: 11746
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
User priority50

11746

Click the images to see detailed statistics about the episode.

11744

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11746769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:28(hidden)
driven_lanedir_median0.7583624342945385
deviation-center-line_median0.05856940306194948
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.0848318451919554
deviation-center-line_mean0.046692309596965104
deviation-center-line_min0.00493459316827017
deviation-heading_max0.17871954277822616
deviation-heading_mean0.12290238968183878
deviation-heading_median0.1404921816205833
deviation-heading_min0.043767648089746966
driven_any_max1.12
driven_any_mean0.9520000000000014
driven_any_median1.0400000000000025
driven_any_min0.7599999999999976
driven_lanedir_max1.0891907711875215
driven_lanedir_mean0.7157737741226108
driven_lanedir_min0.00431907202387416
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.1733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0400000000000025, "driven_lanedir": 0.00431907202387416, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.1516782451032673, "deviation-center-line": 0.00493459316827017}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 0.7599999999999976, "driven_lanedir": 0.6711343097180644, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17871954277822616, "deviation-center-line": 0.02298492709392346}, "ep003": {"driven_any": 1.0800000000000007, "driven_lanedir": 1.0558622833890554, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09985433081737012, "deviation-center-line": 0.0848318451919554}, "ep004": {"driven_any": 1.12, "driven_lanedir": 1.0891907711875215, "in-drivable-lane": 0, "deviation-heading": 0.1404921816205833, "deviation-center-line": 0.062140779468727016}}
11744769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:32(hidden)
other stats
videos1
11742769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:38(hidden)
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}}
good_angle_max0.5231223188267838
good_angle_mean0.18979987683516303
good_angle_median0.13484239023230782
good_angle_min0.0030213493876724944
reward_max-33.12740348378817
reward_mean-39.758097890022654
reward_median-36.6421162430197
reward_min-47.27952035410063
survival_time_max1
survival_time_mean0.86
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.3666666666666666
valid_direction_mean0.2399999999999999
valid_direction_median0.26666666666666666
valid_direction_min0
11740769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:01:12(hidden)
other stats
simulation-passed1
6894769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationerrorno-0:00:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
(hidden)
6593769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission769'
(hidden)
6592769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission769'
(hidden)
6364769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission769'
(hidden)
5773769kbensonAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationerrorno-0:00:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
(hidden)