AI Driving Olympics Home Challenges Submissions Jobs

Submission 689

Submission689
Competingyes
Challengeaido1_LF1_r3-v3
UserMandanaSamiei
Date submitted
Completecomplete
Resultfailed
Jobsstep1-simulation: 13370 step2-scoring: 7132 step3-videos: 7134 step4-viz: 7138
Next
User labelROS-based Lane Following
Admin priority50
User priority50

7138

Click the images to see detailed statistics about the episode.

7134

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13370689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedyes-0:08:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)
7138689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:23(hidden)
driven_lanedir_median0.163587505423334
deviation-center-line_median0.14090614756679057
in-drivable-lane_median0


other stats
deviation-center-line_max0.361985590230278
deviation-center-line_mean0.18275758894104777
deviation-center-line_min0.0730502489089567
deviation-heading_max1.7721669502942847
deviation-heading_mean0.8405589602830114
deviation-heading_median0.6095677373580766
deviation-heading_min0.395649211909228
driven_any_max0.7857352523890606
driven_any_mean0.2950026166379576
driven_any_median0.19285406594748625
driven_any_min0.06784959615308007
driven_lanedir_max0.5485313658051105
driven_lanedir_mean0.23069338720056196
driven_lanedir_min0.0524430454333471
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857352523890606, "driven_lanedir": 0.5485313658051105, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7721669502942847, "deviation-center-line": 0.361985590230278}, "ep001": {"driven_any": 0.06784959615308007, "driven_lanedir": 0.0524430454333471, "in-drivable-lane": 0, "deviation-heading": 0.395649211909228, "deviation-center-line": 0.0730502489089567}, "ep002": {"driven_any": 0.1785716907122184, "driven_lanedir": 0.1564801120218069, "in-drivable-lane": 0, "deviation-heading": 0.6095677373580766, "deviation-center-line": 0.14090614756679057}, "ep003": {"driven_any": 0.19285406594748625, "driven_lanedir": 0.163587505423334, "in-drivable-lane": 0, "deviation-heading": 0.8219507291376054, "deviation-center-line": 0.1232526807136534}, "ep004": {"driven_any": 0.2500024779879429, "driven_lanedir": 0.23242490731921128, "in-drivable-lane": 0, "deviation-heading": 0.6034601727158618, "deviation-center-line": 0.2145932772855602}}
7134689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:47(hidden)
other stats
videos1
7132689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20(hidden)
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.6725652776417315, "good_angle": 0.7619739059953089, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.3666666666666618}, "ep001": {"nsteps": 21, "reward": -48.25360845384144, "good_angle": 0.38521134577333366, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 52, "reward": -19.68344509372344, "good_angle": 0.5169259604290245, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.5666666666666684}, "ep003": {"nsteps": 56, "reward": -18.227136365803226, "good_angle": 0.6489835124272907, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.7333333333333356}, "ep004": {"nsteps": 72, "reward": -14.369265000439352, "good_angle": 0.39804197168283767, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.7619739059953089
good_angle_mean0.5422273392615591
good_angle_median0.5169259604290245
good_angle_min0.38521134577333366
reward_max-4.6725652776417315
reward_mean-21.04120403828984
reward_median-18.227136365803226
reward_min-48.25360845384144
survival_time_max7.399999999999984
survival_time_mean2.819999999999998
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666618
valid_direction_mean0.7399999999999997
valid_direction_median0.599999999999999
valid_direction_min0.4333333333333333
7120689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:02:24(hidden)
other stats
simulation-passed1
6674689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission689/step1-simulation-nutonomy-P50-2110-job6674'
(hidden)
6475689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission689/step1-simulation-nutonomy-P50-2210-job6475'
(hidden)
5399689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:06:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)