AI Driving Olympics Home Challenges Submissions Jobs

Submission 436

Submission436
Competingyes
Challengeaido1_LF1_r3-v3
Userorlando.m.bol@gmail.com
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13391 step2-scoring: 13399 step3-videos: 13402 step4-viz: 13406
Next
User labelPyTorch DDPG template
Admin priority57
Blessing57
User priority

13406

Click the images to see detailed statistics about the episode.

13402

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13406436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes-0:05:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median9.311616118207551
deviation-center-line_median1.3745504270569049
in-drivable-lane_median1.333333333333331


other stats
deviation-center-line_max1.4011942005038411
deviation-center-line_mean1.3772210504550673
deviation-center-line_min1.3611208237516923
deviation-heading_max11.74707094717592
deviation-heading_mean11.108784947195296
deviation-heading_median11.099677050076671
deviation-heading_min10.351507705045384
driven_any_max14.916078396590851
driven_any_mean14.91589944723149
driven_any_median14.915912413296308
driven_any_min14.915674103930964
driven_lanedir_max9.394942130563432
driven_lanedir_mean9.296269275478387
driven_lanedir_min9.122690663301016
in-drivable-lane_max1.9333333333333311
in-drivable-lane_mean1.3399999999999983
in-drivable-lane_min0.866666666666666
per-episodes
details{"ep000": {"driven_any": 14.916078396590851, "driven_lanedir": 9.356934605061218, "in-drivable-lane": 1.166666666666665, "deviation-heading": 11.325398647950186, "deviation-center-line": 1.369370369314258}, "ep001": {"driven_any": 14.915753925748524, "driven_lanedir": 9.394942130563432, "in-drivable-lane": 0.866666666666666, "deviation-heading": 11.74707094717592, "deviation-center-line": 1.37986943164864}, "ep002": {"driven_any": 14.915912413296308, "driven_lanedir": 9.295162860258728, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 11.020270385728312, "deviation-center-line": 1.3745504270569049}, "ep003": {"driven_any": 14.915674103930964, "driven_lanedir": 9.122690663301016, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 10.351507705045384, "deviation-center-line": 1.4011942005038411}, "ep004": {"driven_any": 14.916078396590809, "driven_lanedir": 9.311616118207551, "in-drivable-lane": 1.333333333333331, "deviation-heading": 11.099677050076671, "deviation-center-line": 1.3611208237516923}}
13402436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes-0:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13399436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.306630763130961, "good_angle": 13.625583836466248, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.83333333333332}, "ep001": {"nsteps": 500, "reward": 0.33102615126920865, "good_angle": 13.66984956822564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.199999999999983}, "ep002": {"nsteps": 500, "reward": 0.2721846809310373, "good_angle": 13.606712335197498, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.666666666666655}, "ep003": {"nsteps": 500, "reward": 0.17541598234581762, "good_angle": 13.661231358784333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.13333333333332}, "ep004": {"nsteps": 500, "reward": 0.2897547553096665, "good_angle": 13.640331732151727, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}}
good_angle_max13.66984956822564
good_angle_mean13.640741766165087
good_angle_median13.640331732151727
good_angle_min13.606712335197498
reward_max0.33102615126920865
reward_mean0.2750024665973382
reward_median0.2897547553096665
reward_min0.17541598234581762
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.199999999999983
valid_direction_mean12.966666666666654
valid_direction_median12.999999999999988
valid_direction_min12.666666666666655
13391436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessyes-0:05:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10323436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedno-0:09:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 104, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4047436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno-0:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4046436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno-0:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4045436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno-0:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4044436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.66025702655315, "good_angle": 1.2893309412281913, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900491462083045
good_angle_median1.2893309412281913
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.20577226519031
reward_median-26.66025702655315
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4041436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno-0:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1