AI Driving Olympics Home Challenges Submissions Jobs

Submission 729

Submission729
Competingyes
Challengeaido1_LF1_r3-v3
Userheyt0ny
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13816 step2-scoring: 13820 step3-videos: 13825 step4-viz: 13835
Next
User labelAI DL RL MML XXXL 2k18 yoo
Admin priority50
Blessing50
User priority

13835

Click the images to see detailed statistics about the episode.

13825

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13835729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes-0:03:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.9719025309559286
deviation-center-line_median1.2828172855158575
in-drivable-lane_median0.6999999999999982


other stats
deviation-center-line_max1.3268156399619444
deviation-center-line_mean0.8158175883315473
deviation-center-line_min0
deviation-heading_max12.30286214726098
deviation-heading_mean7.492911373676364
deviation-heading_median11.791788515571948
deviation-heading_min0
driven_any_max4.639692202041085
driven_any_mean2.9515150393707104
driven_any_median4.639692202041062
driven_any_min0.232916275202866
driven_lanedir_max2.97366098162551
driven_lanedir_mean1.8585194438277488
driven_lanedir_min0
in-drivable-lane_max0.8666666666666666
in-drivable-lane_mean0.5799999999999993
in-drivable-lane_min0.16666666666666685
per-episodes
details{"ep000": {"driven_any": 0.232916275202866, "driven_lanedir": 0, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 4.639692202041062, "driven_lanedir": 2.973359424269386, "in-drivable-lane": 0.7333333333333325, "deviation-heading": 11.791788515571948, "deviation-center-line": 1.299074331276045}, "ep002": {"driven_any": 0.6055823155274532, "driven_lanedir": 0.3736742822879182, "in-drivable-lane": 0.16666666666666685, "deviation-heading": 1.5163173734972024, "deviation-center-line": 0.17038068490388883}, "ep003": {"driven_any": 4.6396922020410845, "driven_lanedir": 2.97366098162551, "in-drivable-lane": 0.6999999999999982, "deviation-heading": 11.853588832051686, "deviation-center-line": 1.2828172855158575}, "ep004": {"driven_any": 4.639692202041085, "driven_lanedir": 2.9719025309559286, "in-drivable-lane": 0.43333333333333224, "deviation-heading": 12.30286214726098, "deviation-center-line": 1.3268156399619444}}
13825729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes-0:04:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13820729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 27, "reward": -38.80096993181441, "good_angle": 0.5670615028987019, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.6999999999999998}, "ep001": {"nsteps": 500, "reward": 0.21128437551110985, "good_angle": 13.418610029853284, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.9}, "ep002": {"nsteps": 67, "reward": -14.764856543113936, "good_angle": 1.8488018607767789, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep003": {"nsteps": 500, "reward": 0.21980279483040796, "good_angle": 13.45476251240043, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.9}, "ep004": {"nsteps": 500, "reward": 0.23003951618261637, "good_angle": 13.540210786108863, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666663}}
good_angle_max13.540210786108863
good_angle_mean8.565889338407612
good_angle_median13.418610029853284
good_angle_min0.5670615028987019
reward_max0.23003951618261637
reward_mean-10.580939957680842
reward_median0.21128437551110985
reward_min-38.80096993181441
survival_time_max16.666666666666654
survival_time_mean10.62666666666666
survival_time_min0.8999999999999999
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.966666666666663
valid_direction_mean8.246666666666666
valid_direction_median12.9
valid_direction_min0.6999999999999998
13816729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessyes-0:06:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6632729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno-0:06:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 116, in run
    solve(params, cis)
  File "solution.py", line 81, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
6631729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno-0:07:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6400729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission729'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5594729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno-0:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5593729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno-0:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5592729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno-0:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5591729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno-0:03:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5590729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno-0:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.066666666666662


other stats
episodes
details{"ep000": {"nsteps": 122, "reward": -9.584048272156323, "good_angle": 4.15024539593361, "survival_time": 4.066666666666662, "traveled_tiles": 1, "valid_direction": 3.2999999999999954}, "ep001": {"nsteps": 125, "reward": -9.326586581707, "good_angle": 4.253873169300722, "survival_time": 4.166666666666662, "traveled_tiles": 1, "valid_direction": 3.366666666666662}, "ep002": {"nsteps": 150, "reward": -7.492702591568231, "good_angle": 5.0505519054772465, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 4.0999999999999925}, "ep003": {"nsteps": 97, "reward": -12.444948281209491, "good_angle": 2.6592831813146716, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.5666666666666647}, "ep004": {"nsteps": 70, "reward": -16.90499336378915, "good_angle": 1.0227292718412762, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.666666666666668}}
good_angle_max5.0505519054772465
good_angle_mean3.427336584773505
good_angle_median4.15024539593361
good_angle_min1.0227292718412762
reward_max-7.492702591568231
reward_mean-11.15065581808604
reward_median-9.584048272156323
reward_min-16.90499336378915
survival_time_max4.999999999999992
survival_time_mean3.7599999999999967
survival_time_min2.333333333333335
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.0999999999999925
valid_direction_mean2.9999999999999964
valid_direction_median3.2999999999999954
valid_direction_min1.666666666666668
5589729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno-0:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1