Duckietown Challenges Home Challenges Submissions

Submission 732

Submission732
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13861 step2-scoring: 13871 step3-videos: 13876 step4-viz: 13884
Next
User labelAI DL RL MML XXXL 2k18 yoo
Admin priority50
Blessingn/a
User priority50

13884

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13876

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13884step4-vizsuccessyes0:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5829770577558191
deviation-center-line_median0.14993212565362363
in-drivable-lane_median7.833333333333308


other stats
deviation-center-line_max0.4035387690525949
deviation-center-line_mean0.1866597021898769
deviation-center-line_min0
deviation-heading_max0.864736145138095
deviation-heading_mean0.4673261643985856
deviation-heading_median0.5111042462687017
deviation-heading_min0
driven_any_max6.149143225631854
driven_any_mean3.6969146107091624
driven_any_median3.642897751243212
driven_any_min0.5124195970580631
driven_lanedir_max1.451765387560334
driven_lanedir_mean0.644074813273646
driven_lanedir_min0
in-drivable-lane_max15.73333333333332
in-drivable-lane_mean9.259999999999987
in-drivable-lane_min1.7333333333333354
per-episodes
details{"ep000": {"driven_any": 0.5124195970580631, "driven_lanedir": 0, "in-drivable-lane": 1.7333333333333354, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.149143225631854, "driven_lanedir": 0.8695825727556461, "in-drivable-lane": 14.166666666666654, "deviation-heading": 0.5497200340779129, "deviation-center-line": 0.30090631686329666}, "ep002": {"driven_any": 5.385100114925407, "driven_lanedir": 0.3160490482964309, "in-drivable-lane": 15.73333333333332, "deviation-heading": 0.41107039650821825, "deviation-center-line": 0.0789212993798694}, "ep003": {"driven_any": 2.7950123646872775, "driven_lanedir": 0.5829770577558191, "in-drivable-lane": 7.833333333333308, "deviation-heading": 0.5111042462687017, "deviation-center-line": 0.14993212565362363}, "ep004": {"driven_any": 3.642897751243212, "driven_lanedir": 1.451765387560334, "in-drivable-lane": 6.833333333333312, "deviation-heading": 0.864736145138095, "deviation-center-line": 0.4035387690525949}}
No reset possible
13876step3-videossuccessyes0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13871step2-scoringsuccessyes0:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.033333333333308


other stats
episodes
details{"ep000": {"nsteps": 53, "reward": -20.47226224305495, "good_angle": 0.31339965646471213, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep001": {"nsteps": 500, "reward": -0.3185310780971777, "good_angle": 1.3147281275892655, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.600000000000012}, "ep002": {"nsteps": 500, "reward": -0.7173953298926353, "good_angle": 1.4309758714751228, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.466666666666687}, "ep003": {"nsteps": 284, "reward": -4.330997165515494, "good_angle": 1.1445495758287336, "survival_time": 9.466666666666644, "traveled_tiles": 5, "valid_direction": 2.099999999999997}, "ep004": {"nsteps": 301, "reward": -3.9489842650257794, "good_angle": 1.585917504628602, "survival_time": 10.033333333333308, "traveled_tiles": 8, "valid_direction": 3.433333333333326}}
good_angle_max1.585917504628602
good_angle_mean1.1579141471972874
good_angle_median1.3147281275892655
good_angle_min0.31339965646471213
reward_max-0.3185310780971777
reward_mean-5.957634016317207
reward_median-3.9489842650257794
reward_min-20.47226224305495
survival_time_max16.666666666666654
survival_time_mean10.919999999999986
survival_time_min1.7666666666666688
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median8
traveled_tiles_min1
valid_direction_max3.433333333333326
valid_direction_mean2.2533333333333383
valid_direction_median2.466666666666687
valid_direction_min0.6666666666666687
No reset possible
13861step1-simulationsuccessyes0:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7018step4-vizsuccessyes0:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7017step4-vizabortedyes0:00:12
Error while running [...]

Creating job7017-2905_visualization_1 ... error
stderr | ERROR: for job7017-2905_visualization_1  Cannot start service visualization: network job7017-2905_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7017-2905_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7016step4-vizsuccessyes0:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7005step3-videossuccessyes0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7004step3-videossuccessyes0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7002step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6983step1-simulationsuccessno0:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6626step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission732/step1-simulation-nutonomy-P50-2210-job6626'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6397step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission732/step1-simulation-nutonomy-P50-2210-job6397'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5609step1-simulationfailedno0:03:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 82, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5608step1-simulationfailedno0:02:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 82, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible