AI Driving Olympics Home Challenges Submissions Jobs

Submission 699

Submission699
Competingyes
Challengeaido1_LF1_r3-v3
UserMandanaSamiei
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 13478 step2-scoring: 13496 step3-videos: 13498 step4-viz: 13501
Next
User labelROS-based Lane Following
Admin priority50
User priority50

13501

Click the images to see detailed statistics about the episode.

13498

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13501699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:02:24(hidden)
driven_lanedir_median0.8795230585068441
deviation-center-line_median0.2996626535537166
in-drivable-lane_median0.36666666666666714


other stats
deviation-center-line_max1.7186869679158427
deviation-center-line_mean0.6923967567945983
deviation-center-line_min0.07337729864062047
deviation-heading_max1.8605278053514036
deviation-heading_mean1.0599800406177189
deviation-heading_median1.4221542128343794
deviation-heading_min0.1979521882222297
driven_any_max5.335599085890078
driven_any_mean2.2176288951029757
driven_any_median1.1245190887600518
driven_any_min0.2784709660570083
driven_lanedir_max3.5045446274401355
driven_lanedir_mean1.5605505540355658
driven_lanedir_min0.26492415380042367
in-drivable-lane_max5.3666666666666485
in-drivable-lane_mean1.819999999999995
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.7817606241420902, "driven_lanedir": 2.591089910299913, "in-drivable-lane": 3.3666666666666587, "deviation-heading": 1.6000443496123804, "deviation-center-line": 1.1978822393083133}, "ep001": {"driven_any": 0.2784709660570083, "driven_lanedir": 0.26492415380042367, "in-drivable-lane": 0, "deviation-heading": 0.21922164706820127, "deviation-center-line": 0.07337729864062047}, "ep002": {"driven_any": 1.1245190887600518, "driven_lanedir": 0.8795230585068441, "in-drivable-lane": 0.36666666666666714, "deviation-heading": 1.4221542128343794, "deviation-center-line": 0.2996626535537166}, "ep003": {"driven_any": 0.5677947106656492, "driven_lanedir": 0.5626710201305127, "in-drivable-lane": 0, "deviation-heading": 0.1979521882222297, "deviation-center-line": 0.17237462455449842}, "ep004": {"driven_any": 5.335599085890078, "driven_lanedir": 3.5045446274401355, "in-drivable-lane": 5.3666666666666485, "deviation-heading": 1.8605278053514036, "deviation-center-line": 1.7186869679158427}}
13498699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:21(hidden)
other stats
videos1
13497699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:22(hidden)
other stats
videos1
13496699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median3.566666666666664


other stats
episodes
details{"ep000": {"nsteps": 355, "reward": -2.599589042345875, "good_angle": 0.9629593279790922, "survival_time": 11.833333333333302, "traveled_tiles": 7, "valid_direction": 1.8666666666666616}, "ep001": {"nsteps": 28, "reward": -35.390901141201276, "good_angle": 0.10072020662173144, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 107, "reward": -8.599052025196709, "good_angle": 0.7396904052796556, "survival_time": 3.566666666666664, "traveled_tiles": 3, "valid_direction": 1.333333333333333}, "ep003": {"nsteps": 55, "reward": -17.888060603714123, "good_angle": 0.035307523010520016, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.03333333333333344}, "ep004": {"nsteps": 500, "reward": 0.1773753482126631, "good_angle": 1.5080454366201037, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.2999999999999896}}
good_angle_max1.5080454366201037
good_angle_mean0.6693445799022205
good_angle_median0.7396904052796556
good_angle_min0.035307523010520016
reward_max0.1773753482126631
reward_mean-12.860045492849064
reward_median-8.599052025196709
reward_min-35.390901141201276
survival_time_max16.666666666666654
survival_time_mean6.966666666666657
survival_time_min0.9333333333333332
traveled_tiles_max11
traveled_tiles_mean4.8
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.2999999999999896
valid_direction_mean1.3533333333333304
valid_direction_median1.333333333333333
valid_direction_min0.03333333333333344
13478699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:04:27(hidden)
other stats
simulation-passed1
7083699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
6663699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission699/step1-simulation-nutonomy-P50-2570-job6663'
(hidden)
6461699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission699/step1-simulation-nutonomy-P50-2210-job6461'
(hidden)
6460699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:02:39(hidden)
other stats
simulation-passed1
5440699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:34(hidden)
other stats
videos1
5439699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:02:08(hidden)
other stats
videos1
5438699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:02:08(hidden)
other stats
videos1
5437699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.520073588193627, "good_angle": 28.372258145821053, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.56666666666668}, "ep001": {"nsteps": 500, "reward": -0.31609241442009806, "good_angle": 18.20454025902395, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.133333333333322}, "ep002": {"nsteps": 500, "reward": -0.3679287188500166, "good_angle": 0.035575018106605565, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3605381392007512, "good_angle": 18.65611139600455, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.9999999999999902}, "ep004": {"nsteps": 500, "reward": -0.7963048856555252, "good_angle": 2.526092621414395, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.999999999999987}}
good_angle_max28.372258145821053
good_angle_mean13.558915488074112
good_angle_median18.20454025902395
good_angle_min0.035575018106605565
reward_max-0.31609241442009806
reward_mean-0.4721875492640037
reward_median-0.3679287188500166
reward_min-0.7963048856555252
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max6.56666666666668
valid_direction_mean3.739999999999996
valid_direction_median3.133333333333322
valid_direction_min0
5433699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:08:19(hidden)
other stats
simulation-passed1
5432699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:07:20(hidden)
other stats
simulation-passed1