Duckietown Challenges Home Challenges Submissions

Submission 1297

Submission1297
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11556 step2-scoring: 11100 step3-videos: 11103 step4-viz: 11113
Next
User labelSAIC MOSCOW MML
Admin priority50
Blessingn/a
User priority50

11113

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11103

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11556step1-simulationfailedyes0:06:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 130, in run
    solve(params, cis)
  File "solution.py", line 98, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 378, in step
    obs, reward, done, info = self.env.step(actions)
  File "/workspace/wrappers.py", line 359, in step
    obs, reward, done, info = self.env.step(actions)
  File "/workspace/wrappers.py", line 317, in step
    ob, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 288, in step
    obs, reward, done, info = self.env.step(actions)
  File "/workspace/wrappers.py", line 338, in step
    obs, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11113step4-vizsuccessyes0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.051829096858754
deviation-center-line_median0.92971426400998
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.942361718872175
deviation-center-line_mean0.8572808146222097
deviation-center-line_min0.6352737923652181
deviation-heading_max4.154968182851831
deviation-heading_mean3.0043615237383805
deviation-heading_median3.2100480227248354
deviation-heading_min1.448995458537678
driven_any_max4.685052912313802
driven_any_mean4.268651858623994
driven_any_median4.270000785139785
driven_any_min3.6056512932929903
driven_lanedir_max4.666314634594814
driven_lanedir_mean4.092641922881887
driven_lanedir_min3.3140298965753785
in-drivable-lane_max1.2666666666666664
in-drivable-lane_mean0.3999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible
11112step4-vizsuccessyes0:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11111step4-vizsuccessyes0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11110step4-vizsuccessyes0:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11109step4-vizsuccessyes0:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11108step4-vizsuccessyes0:08:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11107step4-vizsuccessyes0:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11106step4-vizsuccessyes0:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11105step4-vizsuccessyes0:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11104step4-vizsuccessyes0:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11103step3-videossuccessyes0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11102step3-videossuccessyes0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11101step3-videossuccessyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11100step2-scoringsuccessyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.12872719888342543, "good_angle": 0.9576191171400944, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.299999999999994}, "ep001": {"nsteps": 500, "reward": -0.32568414630950426, "good_angle": 31.885946853786997, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.8000000000000025}, "ep002": {"nsteps": 500, "reward": -0.026519747545942662, "good_angle": 0.7382874364771269, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.8999999999999932}, "ep003": {"nsteps": 500, "reward": -0.14358187809749506, "good_angle": 0.736805346290642, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.9000000000000057}, "ep004": {"nsteps": 500, "reward": -0.3258316019057529, "good_angle": 37.830552116191214, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.66666666666665}}
good_angle_max37.830552116191214
good_angle_mean14.429842173977216
good_angle_median0.9576191171400944
good_angle_min0.736805346290642
reward_max-0.026519747545942662
reward_mean-0.1900689145484241
reward_median-0.14358187809749506
reward_min-0.3258316019057529
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max10
traveled_tiles_mean8.8
traveled_tiles_median9
traveled_tiles_min8
valid_direction_max5.8000000000000025
valid_direction_mean3.313333333333329
valid_direction_median2.299999999999994
valid_direction_min1.8999999999999932
No reset possible
11099step2-scoringsuccessyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible