AI Driving Olympics Home Challenges Submissions Jobs

Submission 895

Submission895
Competingyes
Challengeaido1_LFV_r1-v3
Userdaredevil
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 12873 step2-scoring: 12880 step3-videos: 12884 step4-viz: 15518
Next
User labelPyTorch template
Admin priority51
User priority51

15518

Click the images to see detailed statistics about the episode.

12884

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
15518895daredevilPyTorch templateaido1_LFV_r1-v3step4-vizsuccessyes-0:07:12(hidden)
driven_lanedir_consec_median-0.10248977287952452
deviation-center-line_median0.4519810165398645
in-drivable-lane_median8.29999999999999


other stats
deviation-center-line_max0.6182595548551001
deviation-center-line_mean0.4174195244484103
deviation-center-line_min0.22503598450246703
deviation-heading_max6.5753077607462105
deviation-heading_mean6.5321772183416416
deviation-heading_median6.520677872432119
deviation-heading_min6.483660130719006
driven_any_max0.3298766989117038
driven_any_mean0.3298766989117035
driven_any_median0.32987669891170346
driven_any_min0.3298766989117031
driven_lanedir_consec_max-0.10239136695692158
driven_lanedir_consec_mean-0.10302446486550484
driven_lanedir_consec_min-0.10451226683521056
driven_lanedir_max-0.10239136695692158
driven_lanedir_mean-0.10302446486550484
driven_lanedir_median-0.10248977287952452
driven_lanedir_min-0.10451226683521056
in-drivable-lane_max8.366666666666664
in-drivable-lane_mean8.299999999999992
in-drivable-lane_min8.266666666666657
per-episodes
details{"ep000": {"driven_any": 0.3298766989117036, "driven_lanedir": -0.1032856979782874, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.483660130719006, "deviation-center-line": 0.5103265639409208, "driven_lanedir_consec": -0.1032856979782874}, "ep001": {"driven_any": 0.32987669891170346, "driven_lanedir": -0.10239136695692158, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.5201516759806815, "deviation-center-line": 0.28149450240369933, "driven_lanedir_consec": -0.10239136695692158}, "ep002": {"driven_any": 0.3298766989117038, "driven_lanedir": -0.10244321967758004, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.520677872432119, "deviation-center-line": 0.22503598450246703, "driven_lanedir_consec": -0.10244321967758004}, "ep003": {"driven_any": 0.3298766989117034, "driven_lanedir": -0.10451226683521056, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.56108865183019, "deviation-center-line": 0.4519810165398645, "driven_lanedir_consec": -0.10451226683521056}, "ep004": {"driven_any": 0.3298766989117031, "driven_lanedir": -0.10248977287952452, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.5753077607462105, "deviation-center-line": 0.6182595548551001, "driven_lanedir_consec": -0.10248977287952452}}
12891895daredevilPyTorch templateaido1_LFV_r1-v3step4-vizsuccessno-0:04:21(hidden)
deviation-center-line_median0.2562563998383896
in-drivable-lane_median8.29999999999999


other stats
deviation-center-line_max0.37464385838227393
deviation-center-line_mean0.2580649928589977
deviation-center-line_min0.18483439220798464
deviation-heading_max6.5753077607462105
deviation-heading_mean6.5321772183416416
deviation-heading_median6.520677872432119
deviation-heading_min6.483660130719006
driven_any_max9.896300967351106
driven_any_mean9.8963009673511
driven_any_median9.896300967351102
driven_any_min9.896300967351095
driven_lanedir_max-3.071741008707646
driven_lanedir_mean-3.090733945965145
driven_lanedir_median-3.074693186385737
driven_lanedir_min-3.1353680050563155
in-drivable-lane_max8.366666666666664
in-drivable-lane_mean8.299999999999992
in-drivable-lane_min8.266666666666657
per-episodes
details{"ep000": {"driven_any": 9.896300967351106, "driven_lanedir": -3.0985709393486247, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.483660130719006, "deviation-center-line": 0.2874062538642671}, "ep001": {"driven_any": 9.896300967351095, "driven_lanedir": -3.071741008707646, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.5201516759806815, "deviation-center-line": 0.18483439220798464}, "ep002": {"driven_any": 9.896300967351106, "driven_lanedir": -3.073296590327401, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.520677872432119, "deviation-center-line": 0.1871840600020732}, "ep003": {"driven_any": 9.896300967351102, "driven_lanedir": -3.1353680050563155, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.56108865183019, "deviation-center-line": 0.2562563998383896}, "ep004": {"driven_any": 9.8963009673511, "driven_lanedir": -3.074693186385737, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.5753077607462105, "deviation-center-line": 0.37464385838227393}}
12884895daredevilPyTorch templateaido1_LFV_r1-v3step3-videossuccessyes-0:02:35(hidden)
other stats
videos1
12880895daredevilPyTorch templateaido1_LFV_r1-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6330975580978566, "good_angle": 13.583277703186145, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.49999999999999}, "ep001": {"nsteps": 500, "reward": -0.42959495505323864, "good_angle": 13.69785972367098, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666656}, "ep002": {"nsteps": 500, "reward": -0.35807455437723545, "good_angle": 13.71235392407289, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.033333333333324}, "ep003": {"nsteps": 500, "reward": -0.5717144658076577, "good_angle": 13.601307293223426, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.66666666666666}, "ep004": {"nsteps": 500, "reward": -0.6983834902492817, "good_angle": 13.764056550944453, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666655}}
good_angle_max13.764056550944453
good_angle_mean13.671771039019578
good_angle_median13.69785972367098
good_angle_min13.583277703186145
reward_max-0.35807455437723545
reward_mean-0.5381730047170541
reward_median-0.5717144658076577
reward_min-0.6983834902492817
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.166666666666655
valid_direction_mean12.866666666666656
valid_direction_median12.966666666666656
valid_direction_min12.49999999999999
12873895daredevilPyTorch templateaido1_LFV_r1-v3step1-simulationsuccessyes-0:07:26(hidden)
other stats
simulation-passed1
7496895daredevilPyTorch templateaido1_LFV_r1-v3step1-simulationfailedno-0:03:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 106, in run
    solve(params, cis)
  File "solution.py", line 72, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
7495895daredevilPyTorch templateaido1_LFV_r1-v3step1-simulationfailedno-0:03:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 106, in run
    solve(params, cis)
  File "solution.py", line 72, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)