AI Driving Olympics Home Challenges Submissions Jobs

Submission 685

Submission685
Competingyes
Challengeaido1_LF1_r3-v3
Useranna.tsalapova
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13332 step2-scoring: 13350 step3-videos: 13354 step4-viz: 13358
Next
User labelROS-based Lane Following
Admin priority50
Blessing50
User priority

13358

Click the images to see detailed statistics about the episode.

13354

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13358685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.34778476493997657
deviation-center-line_median0.11354952186212536
in-drivable-lane_median0


other stats
deviation-center-line_max2.364571173702163
deviation-center-line_mean0.5587585150771412
deviation-center-line_min0.06200939630214739
deviation-heading_max1.2726251644529332
deviation-heading_mean0.5393445676834353
deviation-heading_median0.27148619217474185
deviation-heading_min0.1018767710642505
driven_any_max5.3350805775971715
driven_any_mean1.4032566087189815
driven_any_median0.36399987632225983
driven_any_min0.23559950141442185
driven_lanedir_max4.277956298112677
driven_lanedir_mean1.1389774487674411
driven_lanedir_min0.21650344881616945
in-drivable-lane_max3.133333333333322
in-drivable-lane_mean0.7199999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7709088607928699, "driven_lanedir": 0.5448938681963629, "in-drivable-lane": 0.4666666666666667, "deviation-heading": 0.8236438814777899, "deviation-center-line": 0.15489680598212113}, "ep001": {"driven_any": 5.3350805775971715, "driven_lanedir": 4.277956298112677, "in-drivable-lane": 3.133333333333322, "deviation-heading": 1.2726251644529332, "deviation-center-line": 2.364571173702163}, "ep002": {"driven_any": 0.36399987632225983, "driven_lanedir": 0.34778476493997657, "in-drivable-lane": 0, "deviation-heading": 0.27148619217474185, "deviation-center-line": 0.09876567753714924}, "ep003": {"driven_any": 0.3106942274681856, "driven_lanedir": 0.3077488637720196, "in-drivable-lane": 0, "deviation-heading": 0.1018767710642505, "deviation-center-line": 0.11354952186212536}, "ep004": {"driven_any": 0.23559950141442185, "driven_lanedir": 0.21650344881616945, "in-drivable-lane": 0, "deviation-heading": 0.227090829247461, "deviation-center-line": 0.06200939630214739}}
13354685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13350685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2000000000000004


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -13.352707633937433, "good_angle": 0.8877015831353215, "survival_time": 2.4666666666666677, "traveled_tiles": 2, "valid_direction": 1.3333333333333333}, "ep001": {"nsteps": 500, "reward": 0.23956387668848036, "good_angle": 0.979875708337114, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.7666666666666615}, "ep002": {"nsteps": 36, "reward": -27.625363662425016, "good_angle": 0.2289567787701174, "survival_time": 1.2000000000000004, "traveled_tiles": 2, "valid_direction": 0.3333333333333338}, "ep003": {"nsteps": 31, "reward": -32.07356548093019, "good_angle": 0.01948683850809805, "survival_time": 1.0333333333333332, "traveled_tiles": 2, "valid_direction": 0.033333333333333326}, "ep004": {"nsteps": 24, "reward": -41.38919739813233, "good_angle": 0.2016489087430064, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}}
good_angle_max0.979875708337114
good_angle_mean0.46353396349873144
good_angle_median0.2289567787701174
good_angle_min0.01948683850809805
reward_max0.23956387668848036
reward_mean-22.8402540597473
reward_median-27.625363662425016
reward_min-41.38919739813233
survival_time_max16.666666666666654
survival_time_mean4.433333333333331
survival_time_min0.7999999999999999
traveled_tiles_max10
traveled_tiles_mean3.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7666666666666615
valid_direction_mean0.7333333333333325
valid_direction_median0.3333333333333338
valid_direction_min0.033333333333333326
13332685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:05:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7149685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22209094376713656
deviation-center-line_median0.20246095331595268
in-drivable-lane_median0


other stats
deviation-center-line_max0.30168878333512433
deviation-center-line_mean0.19548067373584185
deviation-center-line_min0.12302038102308972
deviation-heading_max1.834003606005921
deviation-heading_mean0.8394426455087283
deviation-heading_median0.6444174952344611
deviation-heading_min0.33000713745724486
driven_any_max0.5464472271487393
driven_any_mean0.28786004034431517
driven_any_median0.2428624910475559
driven_any_min0.15713873927101343
driven_lanedir_max0.28180618199899854
driven_lanedir_mean0.22010122620050213
driven_lanedir_min0.13526246201468006
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5464472271487393, "driven_lanedir": 0.2772630491130057, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.834003606005921, "deviation-center-line": 0.212833855154674}, "ep001": {"driven_any": 0.2857225358668876, "driven_lanedir": 0.28180618199899854, "in-drivable-lane": 0, "deviation-heading": 0.33000713745724486, "deviation-center-line": 0.30168878333512433}, "ep002": {"driven_any": 0.15713873927101343, "driven_lanedir": 0.13526246201468006, "in-drivable-lane": 0, "deviation-heading": 0.619266515803785, "deviation-center-line": 0.12302038102308972}, "ep003": {"driven_any": 0.2071292083873798, "driven_lanedir": 0.18408349410868977, "in-drivable-lane": 0, "deviation-heading": 0.769518473042229, "deviation-center-line": 0.13739939585036856}, "ep004": {"driven_any": 0.2428624910475559, "driven_lanedir": 0.22209094376713656, "in-drivable-lane": 0, "deviation-heading": 0.6444174952344611, "deviation-center-line": 0.20246095331595268}}
7145685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7143685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -6.582495219678047, "good_angle": 1.397675751928089, "survival_time": 5.166666666666658, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 82, "reward": -12.780102875174546, "good_angle": 0.07893720372985005, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 46, "reward": -22.191317722849224, "good_angle": 0.49699080504771087, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.6666666666666682}, "ep003": {"nsteps": 60, "reward": -17.037552816669145, "good_angle": 0.5307481795458672, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.700000000000002}, "ep004": {"nsteps": 70, "reward": -14.755798952920095, "good_angle": 0.45785588849117737, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.6666666666666663}}
good_angle_max1.397675751928089
good_angle_mean0.5924415657485389
good_angle_median0.49699080504771087
good_angle_min0.07893720372985005
reward_max-6.582495219678047
reward_mean-14.669453517458214
reward_median-14.755798952920095
reward_min-22.191317722849224
survival_time_max5.166666666666658
survival_time_mean2.753333333333333
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7399999999999995
valid_direction_median0.6666666666666682
valid_direction_min0.1999999999999993
7133685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:02:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6678685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission685/step1-simulation-nutonomy-P50-2570-job6678'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6479685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission685/step1-simulation-nutonomy-P50-2110-job6479'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5385685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:07:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5384685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:08:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.