AI Driving Olympics Home Challenges Submissions Jobs

Submission 1153

Submission1153
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 12893 step2-scoring: 12899 step3-videos: 12902 step4-viz: 12906
Next
User labelPytorch IL
Admin priority50
User priority50

12906

Click the images to see detailed statistics about the episode.

12902

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
129061153DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes-0:01:31(hidden)
driven_lanedir_median0.49529213669591154
deviation-center-line_median0.06857041696365888
in-drivable-lane_median3.433333333333329


other stats
deviation-center-line_max0.0986899238643206
deviation-center-line_mean0.0547429901144381
deviation-center-line_min0
deviation-heading_max0.2402888648973172
deviation-heading_mean0.17078661069979623
deviation-heading_median0.20834084446154705
deviation-heading_min0
driven_any_max5.866916240200962
driven_any_mean3.5427434167305663
driven_any_median3.1582875295137183
driven_any_min0.6148119782705214
driven_lanedir_max0.6949744499048753
driven_lanedir_mean0.3983151211218025
driven_lanedir_min0
in-drivable-lane_max6.399999999999984
in-drivable-lane_mean3.74666666666666
in-drivable-lane_min0.7666666666666666
per-episodes
details{"ep000": {"driven_any": 0.6148119782705214, "driven_lanedir": 0, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 5.72614470465888, "driven_lanedir": 0.6949744499048753, "in-drivable-lane": 5.999999999999986, "deviation-heading": 0.20834084446154705, "deviation-center-line": 0.0986899238643206}, "ep002": {"driven_any": 3.1582875295137183, "driven_lanedir": 0.2547785793917039, "in-drivable-lane": 3.433333333333329, "deviation-heading": 0.19173869315610612, "deviation-center-line": 0.028628166150210257}, "ep003": {"driven_any": 5.866916240200962, "driven_lanedir": 0.49529213669591154, "in-drivable-lane": 6.399999999999984, "deviation-heading": 0.2135646509840108, "deviation-center-line": 0.06857041696365888}, "ep004": {"driven_any": 2.347556631008751, "driven_lanedir": 0.5465304396165214, "in-drivable-lane": 2.133333333333333, "deviation-heading": 0.2402888648973172, "deviation-center-line": 0.07782644359400077}}
129021153DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes-0:00:53(hidden)
other stats
videos1
128991153DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23(hidden)
survival_time_median3.8333333333333295


other stats
episodes
details{"ep000": {"nsteps": 24, "reward": -43.22636259098848, "good_angle": 0.11909781384202343, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 207, "reward": -5.578869480572209, "good_angle": 0.6931582952803249, "survival_time": 6.899999999999985, "traveled_tiles": 12, "valid_direction": 1.199999999999998}, "ep002": {"nsteps": 115, "reward": -9.903928011785382, "good_angle": 0.4548320851196959, "survival_time": 3.8333333333333295, "traveled_tiles": 7, "valid_direction": 0.8333333333333323}, "ep003": {"nsteps": 212, "reward": -5.727167320806744, "good_angle": 0.7391999191635701, "survival_time": 7.066666666666651, "traveled_tiles": 12, "valid_direction": 1.6999999999999962}, "ep004": {"nsteps": 86, "reward": -12.658520396582263, "good_angle": 0.511095828828641, "survival_time": 2.8666666666666663, "traveled_tiles": 5, "valid_direction": 0.9666666666666656}}
good_angle_max0.7391999191635701
good_angle_mean0.5034767884468511
good_angle_median0.511095828828641
good_angle_min0.11909781384202343
reward_max-5.578869480572209
reward_mean-15.418969560147016
reward_median-9.903928011785382
reward_min-43.22636259098848
survival_time_max7.066666666666651
survival_time_mean4.293333333333327
survival_time_min0.7999999999999999
traveled_tiles_max12
traveled_tiles_mean7.6
traveled_tiles_median7
traveled_tiles_min2
valid_direction_max1.6999999999999962
valid_direction_mean0.9933333333333316
valid_direction_median0.9666666666666656
valid_direction_min0.2666666666666666
128931153DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessyes-0:01:59(hidden)
other stats
simulation-passed1
90581153DavidPytorch ILaido1_LF1_r3-v3step1-simulationfailedno-0:03:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 51, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
90571153DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno-0:08:34(hidden)
other stats
simulation-passed1