AI Driving Olympics Home Challenges Submissions Jobs

Submission 678

Submission678
Competingyes
Challengeaido1_LF1_r3-v3
UserMandanaSamiei
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 13258 step2-scoring: 13274 step3-videos: 13278 step4-viz: 13282
Next
User labelROS-based Lane Following
Admin priority50
User priority50

13282

Click the images to see detailed statistics about the episode.

13278

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13282678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:45(hidden)
driven_lanedir_median0.4022578037243032
deviation-center-line_median0.10877836016255832
in-drivable-lane_median0


other stats
deviation-center-line_max1.9344878771384524
deviation-center-line_mean0.4643566168946663
deviation-center-line_min0.027823697374179324
deviation-heading_max1.1611990908821046
deviation-heading_mean0.40326319611171835
deviation-heading_median0.237054513022317
deviation-heading_min0.16432364187677945
driven_any_max5.335257019138864
driven_any_mean1.3433968491699697
driven_any_median0.4071063034450065
driven_any_min0.11762980122743429
driven_lanedir_max3.2282499430469027
driven_lanedir_mean0.9101122954352172
driven_lanedir_min0.08204562830747886
in-drivable-lane_max6.366666666666648
in-drivable-lane_mean1.2733333333333294
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335257019138864, "driven_lanedir": 3.2282499430469027, "in-drivable-lane": 6.366666666666648, "deviation-heading": 1.1611990908821046, "deviation-center-line": 1.9344878771384524}, "ep001": {"driven_any": 0.5250241833709441, "driven_lanedir": 0.5216598658497964, "in-drivable-lane": 0, "deviation-heading": 0.16432364187677945, "deviation-center-line": 0.16090590838897567}, "ep002": {"driven_any": 0.11762980122743429, "driven_lanedir": 0.08204562830747886, "in-drivable-lane": 0, "deviation-heading": 0.28533444910870565, "deviation-center-line": 0.027823697374179324}, "ep003": {"driven_any": 0.3319669386675993, "driven_lanedir": 0.31634823624760333, "in-drivable-lane": 0, "deviation-heading": 0.237054513022317, "deviation-center-line": 0.08978724140916541}, "ep004": {"driven_any": 0.4071063034450065, "driven_lanedir": 0.4022578037243032, "in-drivable-lane": 0, "deviation-heading": 0.16840428566868498, "deviation-center-line": 0.10877836016255832}}
13278678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:03(hidden)
other stats
videos1
13274678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23(hidden)
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.011770717273815534, "good_angle": 1.536626590694179, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.2000000000000117}, "ep001": {"nsteps": 51, "reward": -19.315485576350316, "good_angle": 0.02096696579269912, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 13, "reward": -76.83653521537781, "good_angle": 0.3368062603190747, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep003": {"nsteps": 33, "reward": -29.992794328115203, "good_angle": 0.12240629289681026, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0.26666666666666683}, "ep004": {"nsteps": 40, "reward": -24.640102692320944, "good_angle": 0.03061805400210516, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.10000000000000032}}
good_angle_max1.536626590694179
good_angle_mean0.4094848327409736
good_angle_median0.12240629289681026
good_angle_min0.02096696579269912
reward_max0.011770717273815534
reward_mean-30.15462941897809
reward_median-24.640102692320944
reward_min-76.83653521537781
survival_time_max16.666666666666654
survival_time_mean4.246666666666665
survival_time_min0.4333333333333333
traveled_tiles_max10
traveled_tiles_mean3.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.2000000000000117
valid_direction_mean0.7800000000000024
valid_direction_median0.26666666666666683
valid_direction_min0
13258678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:05:11(hidden)
other stats
simulation-passed1
7180678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:22(hidden)
driven_lanedir_median0.277265991745407
deviation-center-line_median0.2936260994934386
in-drivable-lane_median0


other stats
deviation-center-line_max0.3691403305480279
deviation-center-line_mean0.273356271487626
deviation-center-line_min0.13598130745242462
deviation-heading_max1.7603371492658582
deviation-heading_mean0.7498470982047403
deviation-heading_median0.5811950134637281
deviation-heading_min0.24310937205908192
driven_any_max0.7857427245351707
driven_any_mean0.3800095980346498
driven_any_median0.27859073929303557
driven_any_min0.16427680300617853
driven_lanedir_max0.5424843212358612
driven_lanedir_mean0.3229705737844261
driven_lanedir_min0.14764726762286462
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857427245351707, "driven_lanedir": 0.5424843212358612, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7603371492658582, "deviation-center-line": 0.34894908319999995}, "ep001": {"driven_any": 0.27859073929303557, "driven_lanedir": 0.277265991745407, "in-drivable-lane": 0, "deviation-heading": 0.24310937205908192, "deviation-center-line": 0.2936260994934386}, "ep002": {"driven_any": 0.16427680300617853, "driven_lanedir": 0.14764726762286462, "in-drivable-lane": 0, "deviation-heading": 0.5697573102082113, "deviation-center-line": 0.13598130745242462}, "ep003": {"driven_any": 0.41429775627852866, "driven_lanedir": 0.4049519753762154, "in-drivable-lane": 0, "deviation-heading": 0.5811950134637281, "deviation-center-line": 0.3691403305480279}, "ep004": {"driven_any": 0.25713996706033526, "driven_lanedir": 0.2425033129417824, "in-drivable-lane": 0, "deviation-heading": 0.5948366460268221, "deviation-center-line": 0.21908453674423892}}
7174678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:52(hidden)
other stats
videos1
7173678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20(hidden)
survival_time_median2.666666666666667


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.664083582342697, "good_angle": 0.8285740888753486, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.0333333333333297}, "ep001": {"nsteps": 80, "reward": -13.079728885740042, "good_angle": 0.025090575460954348, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -21.300049481292564, "good_angle": 0.3948034748547388, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.633333333333335}, "ep003": {"nsteps": 118, "reward": -8.961789391619169, "good_angle": 0.17935710075172995, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 0.4333333333333336}, "ep004": {"nsteps": 74, "reward": -13.984935660619993, "good_angle": 0.3311466220015881, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 0.6666666666666654}}
good_angle_max0.8285740888753486
good_angle_mean0.351794372388872
good_angle_median0.3311466220015881
good_angle_min0.025090575460954348
reward_max-4.664083582342697
reward_mean-12.398117400322894
reward_median-13.079728885740042
reward_min-21.300049481292564
survival_time_max7.399999999999984
survival_time_mean3.6133333333333297
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0333333333333297
valid_direction_mean0.5533333333333328
valid_direction_median0.633333333333335
valid_direction_min0
7158678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:02:55(hidden)
other stats
simulation-passed1
6687678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission678/step1-simulation-nutonomy-P50-2570-job6687'
(hidden)
6486678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission678/step1-simulation-nutonomy-P50-2570-job6486'
(hidden)
5341678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno-0:06:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)