AI Driving Olympics Home Challenges Submissions Jobs

Submission 1246

Submission1246
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 13886 step2-scoring: 13894 step3-videos: 13899 step4-viz: 13903
Next
User labelPytorch IL
Admin priority50
User priority50

13903

Click the images to see detailed statistics about the episode.

13899

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
139031246DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes-0:02:58(hidden)
driven_lanedir_median0.4912857968290054
deviation-center-line_median0.41125712551993504
in-drivable-lane_median11.299999999999995


other stats
deviation-center-line_max0.5617068006291867
deviation-center-line_mean0.3255529353342984
deviation-center-line_min0.02826459707050564
deviation-heading_max1.4155312886012552
deviation-heading_mean1.0886469355173798
deviation-heading_median1.2905855973497309
deviation-heading_min0.1993453441835165
driven_any_max2.319982130414997
driven_any_mean1.6872768914345564
driven_any_median2.3198066186351345
driven_any_min0.5543006589774145
driven_lanedir_max0.7123884370059654
driven_lanedir_mean0.39857201575435386
driven_lanedir_min0.017606791565141888
in-drivable-lane_max14.53333333333332
in-drivable-lane_mean8.999999999999993
in-drivable-lane_min2.5333333333333243
per-episodes
details{"ep000": {"driven_any": 0.5543006589774145, "driven_lanedir": 0.017606791565141888, "in-drivable-lane": 3.766666666666663, "deviation-heading": 0.1993453441835165, "deviation-center-line": 0.02826459707050564}, "ep001": {"driven_any": 2.3198066186351345, "driven_lanedir": 0.7123884370059654, "in-drivable-lane": 11.299999999999995, "deviation-heading": 1.2905855973497309, "deviation-center-line": 0.5617068006291867}, "ep002": {"driven_any": 2.319982130414997, "driven_lanedir": 0.2367319626373554, "in-drivable-lane": 14.53333333333332, "deviation-heading": 1.2413856671348222, "deviation-center-line": 0.18293111842797177}, "ep003": {"driven_any": 2.3199425843737203, "driven_lanedir": 0.4912857968290054, "in-drivable-lane": 12.866666666666658, "deviation-heading": 1.296386780317574, "deviation-center-line": 0.41125712551993504}, "ep004": {"driven_any": 0.9223524647715164, "driven_lanedir": 0.534847090734301, "in-drivable-lane": 2.5333333333333243, "deviation-heading": 1.4155312886012552, "deviation-center-line": 0.4436050350238931}}
138991246DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes-0:01:31(hidden)
other stats
videos1
138941246DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 121, "reward": -9.604604649388286, "good_angle": 0.6286364625186772, "survival_time": 4.033333333333329, "traveled_tiles": 1, "valid_direction": 0.8333333333333304}, "ep001": {"nsteps": 500, "reward": -0.6849114918122068, "good_angle": 2.129438810548207, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.6999999999999904}, "ep002": {"nsteps": 500, "reward": -1.1647364023327826, "good_angle": 2.4313537358847865, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.7333333333333294}, "ep003": {"nsteps": 500, "reward": -0.8955752215329558, "good_angle": 2.108816067942779, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.166666666666659}, "ep004": {"nsteps": 200, "reward": -5.346285532177426, "good_angle": 3.082431708941487, "survival_time": 6.666666666666653, "traveled_tiles": 4, "valid_direction": 4.16666666666666}}
good_angle_max3.082431708941487
good_angle_mean2.0761353571671877
good_angle_median2.129438810548207
good_angle_min0.6286364625186772
reward_max-0.6849114918122068
reward_mean-3.5392226594487313
reward_median-1.1647364023327826
reward_min-9.604604649388286
survival_time_max16.666666666666654
survival_time_mean12.139999999999988
survival_time_min4.033333333333329
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max4.16666666666666
valid_direction_mean3.319999999999994
valid_direction_median3.7333333333333294
valid_direction_min0.8333333333333304
138861246DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:42(hidden)
other stats
simulation-passed1
96581246DavidPytorch ILaido1_LF1_r3-v3step1-simulationfailedno-0:06:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 51, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)