AI Driving Olympics Home Challenges Submissions Jobs

Submission 687

Submission687
Competingyes
Challengeaido1_LF1_r3-v3
UserMandanaSamiei
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 13351 step2-scoring: 13364 step3-videos: 13367 step4-viz: 13371
Next
User labelROS-based Lane Following
Admin priority50
User priority50

13371

Click the images to see detailed statistics about the episode.

13367

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13371687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:03:01(hidden)
driven_lanedir_median1.2714336594329
deviation-center-line_median0.5569188104981396
in-drivable-lane_median1.2666666666666622


other stats
deviation-center-line_max2.4630939170863377
deviation-center-line_mean1.149232047247004
deviation-center-line_min0.1307973252154854
deviation-heading_max1.5039038366024164
deviation-heading_mean1.0775100190062783
deviation-heading_median1.183763485773499
deviation-heading_min0.23411158561902337
driven_any_max5.335645546434336
driven_any_mean2.922600067214783
driven_any_median1.8532320531846775
driven_any_min0.4283472526665047
driven_lanedir_max4.610460048696211
driven_lanedir_mean2.317034588210382
driven_lanedir_min0.4187765336892091
in-drivable-lane_max3.9333333333333194
in-drivable-lane_mean1.6466666666666612
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6601825818562577, "driven_lanedir": 1.24631845600737, "in-drivable-lane": 0.9666666666666662, "deviation-heading": 1.4279116339883189, "deviation-center-line": 0.38010402198937093}, "ep001": {"driven_any": 5.335645546434336, "driven_lanedir": 4.0381842432262225, "in-drivable-lane": 3.9333333333333194, "deviation-heading": 1.0378595530481345, "deviation-center-line": 2.215246161445687}, "ep002": {"driven_any": 5.335592901932138, "driven_lanedir": 4.610460048696211, "in-drivable-lane": 2.0666666666666593, "deviation-heading": 1.183763485773499, "deviation-center-line": 2.4630939170863377}, "ep003": {"driven_any": 0.4283472526665047, "driven_lanedir": 0.4187765336892091, "in-drivable-lane": 0, "deviation-heading": 0.23411158561902337, "deviation-center-line": 0.1307973252154854}, "ep004": {"driven_any": 1.8532320531846775, "driven_lanedir": 1.2714336594329, "in-drivable-lane": 1.2666666666666622, "deviation-heading": 1.5039038366024164, "deviation-center-line": 0.5569188104981396}}
13367687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:40(hidden)
other stats
videos1
13364687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 157, "reward": -5.853171486758248, "good_angle": 0.5706102847226819, "survival_time": 5.2333333333333245, "traveled_tiles": 3, "valid_direction": 1.7333333333333327}, "ep001": {"nsteps": 500, "reward": 0.22853902287059463, "good_angle": 0.5831963801408289, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4333333333333291}, "ep002": {"nsteps": 500, "reward": 0.29473067964054644, "good_angle": 0.545817470332487, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.03333333333333}, "ep003": {"nsteps": 42, "reward": -23.5382668101007, "good_angle": 0.12195921403314522, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0.16666666666666696}, "ep004": {"nsteps": 175, "reward": -5.4731847972529275, "good_angle": 1.797869249021679, "survival_time": 5.833333333333322, "traveled_tiles": 5, "valid_direction": 2.033333333333327}}
good_angle_max1.797869249021679
good_angle_mean0.7238905196501644
good_angle_median0.5706102847226819
good_angle_min0.12195921403314522
reward_max0.29473067964054644
reward_mean-6.868270678320147
reward_median-5.4731847972529275
reward_min-23.5382668101007
survival_time_max16.666666666666654
survival_time_mean9.159999999999991
survival_time_min1.400000000000001
traveled_tiles_max10
traveled_tiles_mean5.8
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max2.033333333333327
valid_direction_mean1.2799999999999971
valid_direction_median1.4333333333333291
valid_direction_min0.16666666666666696
13351687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:05:32(hidden)
other stats
simulation-passed1
7127687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:08:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)
6676687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission687/step1-simulation-nutonomy-P50-2210-job6676'
(hidden)
6477687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission687/step1-simulation-nutonomy-P50-2570-job6477'
(hidden)
5390687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)