AI Driving Olympics Home Challenges Submissions Jobs

Submission 834

Submission834
Competingyes
Challengeaido1_LF1_r3-v3
Userlavoiems
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12297 step2-scoring: 6259 step3-videos: 6262 step4-viz: 6421
Next
User labelYoung Duke
Admin priority50
Blessing50
User priority

6421

Click the images to see detailed statistics about the episode.

6262

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12297834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationfailedyes-0:04:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 75, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 75, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python3.6/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
6421834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyes-0:04:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.007174640650131
deviation-center-line_median0.7470490299516872
in-drivable-lane_median10.96666666666663


other stats
deviation-center-line_max1.2882373660159392
deviation-center-line_mean0.6562525500331089
deviation-center-line_min0
deviation-heading_max2.3062969492956733
deviation-heading_mean1.2751324529310195
deviation-heading_median1.2324123415856356
deviation-heading_min0
driven_any_max6.370932198627862
driven_any_mean6.286530397440294
driven_any_median6.33989131858102
driven_any_min6.120627628089538
driven_lanedir_max4.038876905070678
driven_lanedir_mean2.148530641897353
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.726666666666649
in-drivable-lane_min5.566666666666647
per-episodes
details{"ep000": {"driven_any": 6.232326621558599, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.120627628089538, "driven_lanedir": 2.007174640650131, "in-drivable-lane": 10.96666666666663, "deviation-heading": 1.2324123415856356, "deviation-center-line": 0.7470490299516872}, "ep002": {"driven_any": 6.368874220344451, "driven_lanedir": 4.038876905070678, "in-drivable-lane": 5.566666666666647, "deviation-heading": 2.3062969492956733, "deviation-center-line": 1.1050416948852386}, "ep003": {"driven_any": 6.33989131858102, "driven_lanedir": 3.5174523047355586, "in-drivable-lane": 7.000000000000002, "deviation-heading": 2.290768452385038, "deviation-center-line": 1.2882373660159392}, "ep004": {"driven_any": 6.370932198627862, "driven_lanedir": 1.1791493590303976, "in-drivable-lane": 13.466666666666656, "deviation-heading": 0.5461845213887516, "deviation-center-line": 0.14093465931267904}}
6420834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission834/step4-viz-nutonomy-P50-2210-job6420'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6265834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessno-0:03:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.007174640650131
deviation-center-line_median0.7470490299516872
in-drivable-lane_median10.96666666666663


other stats
deviation-center-line_max1.2882373660159392
deviation-center-line_mean0.6562525500331089
deviation-center-line_min0
deviation-heading_max2.3062969492956733
deviation-heading_mean1.2751324529310195
deviation-heading_median1.2324123415856356
deviation-heading_min0
driven_any_max6.370932198627862
driven_any_mean6.286530397440294
driven_any_median6.33989131858102
driven_any_min6.120627628089538
driven_lanedir_max4.038876905070678
driven_lanedir_mean2.148530641897353
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.726666666666649
in-drivable-lane_min5.566666666666647
per-episodes
details{"ep000": {"driven_any": 6.232326621558599, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.120627628089538, "driven_lanedir": 2.007174640650131, "in-drivable-lane": 10.96666666666663, "deviation-heading": 1.2324123415856356, "deviation-center-line": 0.7470490299516872}, "ep002": {"driven_any": 6.368874220344451, "driven_lanedir": 4.038876905070678, "in-drivable-lane": 5.566666666666647, "deviation-heading": 2.3062969492956733, "deviation-center-line": 1.1050416948852386}, "ep003": {"driven_any": 6.33989131858102, "driven_lanedir": 3.5174523047355586, "in-drivable-lane": 7.000000000000002, "deviation-heading": 2.290768452385038, "deviation-center-line": 1.2882373660159392}, "ep004": {"driven_any": 6.370932198627862, "driven_lanedir": 1.1791493590303976, "in-drivable-lane": 13.466666666666656, "deviation-heading": 0.5461845213887516, "deviation-center-line": 0.14093465931267904}}
6262834lavoiemsYoung Dukeaido1_LF1_r3-v3step3-videossuccessyes-0:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6259834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -2.485302177786827, "good_angle": 44.70155231345539, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 5.533333333333351}, "ep001": {"nsteps": 500, "reward": -1.4064829516261816, "good_angle": 16.665641929545327, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 6.0333333333333155}, "ep002": {"nsteps": 500, "reward": -0.5573239942416549, "good_angle": 2.385354831913217, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.166666666666648}, "ep003": {"nsteps": 500, "reward": -0.78558545652451, "good_angle": 2.7125707063362507, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.833333333333345}, "ep004": {"nsteps": 500, "reward": -2.124756822562427, "good_angle": 32.37004984167209, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.9333333333333194}}
good_angle_max44.70155231345539
good_angle_mean19.767033924584457
good_angle_median16.665641929545327
good_angle_min2.385354831913217
reward_max-0.5573239942416549
reward_mean-1.47189028054832
reward_median-1.4064829516261816
reward_min-2.485302177786827
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean11.2
traveled_tiles_median11
traveled_tiles_min8
valid_direction_max6.833333333333345
valid_direction_mean5.699999999999995
valid_direction_median6.0333333333333155
valid_direction_min3.9333333333333194
6253834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationsuccessno-0:02:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6218834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno-0:31:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
6217834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationtimeoutno-0:31:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
6197834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno-0:43:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
6196834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationtimeoutno-0:45:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
6177834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno-0:33:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
6176834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationsuccessno-0:02:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6175834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationtimeoutno-0:34:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
6131834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessno-0:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6130834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessno-0:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6129834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizabortedno-0:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6128834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizabortedno-0:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6127834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessno-0:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6126834lavoiemsYoung Dukeaido1_LF1_r3-v3step3-videossuccessno-0:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6125834lavoiemsYoung Dukeaido1_LF1_r3-v3step3-videossuccessno-0:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6124834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessno-0:09:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
6123834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringabortedno-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
6122834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessno-0:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
6121834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessno-0:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
6120834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno-0:05:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1