AI Driving Olympics Home Challenges Submissions Jobs

Submission 773

Submission773
Competingyes
Challengeaido1_LF1_r3-v3
UserAmaurX
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 11704 step2-scoring: 11707 step3-videos: 11709 step4-viz: 11711
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
User priority50

11711

Click the images to see detailed statistics about the episode.

11709

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11711773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:29(hidden)
driven_lanedir_median0.4894326591386844
deviation-center-line_median0.10159491874534542
in-drivable-lane_median0.2666666666666667


other stats
deviation-center-line_max0.11559937270810716
deviation-center-line_mean0.08282191850267559
deviation-center-line_min0.02743801479716522
deviation-heading_max0.770108248316512
deviation-heading_mean0.4503493147067932
deviation-heading_median0.41209290450046726
deviation-heading_min0.0948856061765822
driven_any_max1.1983820471401816
driven_any_mean0.7767767072516831
driven_any_median0.846413340904546
driven_any_min0.16272225453819997
driven_lanedir_max0.7220398668396617
driven_lanedir_mean0.5091146229978228
driven_lanedir_min0.1532558876545953
in-drivable-lane_max0.6666666666666666
in-drivable-lane_mean0.28666666666666696
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.9499640131782666, "driven_lanedir": 0.47091672106597704, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.41209290450046726, "deviation-center-line": 0.10159491874534542}, "ep001": {"driven_any": 0.16272225453819997, "driven_lanedir": 0.1532558876545953, "in-drivable-lane": 0, "deviation-heading": 0.0948856061765822, "deviation-center-line": 0.02743801479716522}, "ep002": {"driven_any": 0.846413340904546, "driven_lanedir": 0.4894326591386844, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.7386266900232743, "deviation-center-line": 0.1048251255779308}, "ep003": {"driven_any": 1.1983820471401816, "driven_lanedir": 0.7220398668396617, "in-drivable-lane": 0.5000000000000013, "deviation-heading": 0.770108248316512, "deviation-center-line": 0.11559937270810716}, "ep004": {"driven_any": 0.726401880497221, "driven_lanedir": 0.7099279802901961, "in-drivable-lane": 0, "deviation-heading": 0.23603312451712977, "deviation-center-line": 0.0646521606848293}}
11709773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:33(hidden)
other stats
videos1
11707773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 49, "reward": -20.629765765104747, "good_angle": 0.4483085155065757, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 1.133333333333335}, "ep001": {"nsteps": 10, "reward": -99.75981116220356, "good_angle": 0.03589697696020486, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.1}, "ep002": {"nsteps": 44, "reward": -22.20786445858804, "good_angle": 0.4891297095591765, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}, "ep003": {"nsteps": 64, "reward": -15.322045463937684, "good_angle": 0.8550957756948183, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.0333333333333352}, "ep004": {"nsteps": 40, "reward": -24.44970727339387, "good_angle": 0.06481757410176862, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0.16666666666666674}}
good_angle_max0.8550957756948183
good_angle_mean0.3786497103645088
good_angle_median0.4483085155065757
good_angle_min0.03589697696020486
reward_max-15.322045463937684
reward_mean-36.473838824645576
reward_median-22.20786445858804
reward_min-99.75981116220356
survival_time_max2.1333333333333355
survival_time_mean1.3800000000000012
survival_time_min0.3333333333333333
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.133333333333335
valid_direction_mean0.6333333333333344
valid_direction_median0.7333333333333347
valid_direction_min0.1
11704773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:26(hidden)
other stats
simulation-passed1
6891773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:47(hidden)
driven_lanedir_median0.7334287330346738
deviation-center-line_median0.25529786063730087
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max0.4423386350164731
deviation-center-line_mean0.2812291949572165
deviation-center-line_min0.1221537899955525
deviation-heading_max3.012962151746203
deviation-heading_mean1.5334440686844406
deviation-heading_median1.3921026549013094
deviation-heading_min0.8068940684601202
driven_any_max1.532573125810874
driven_any_mean1.068876109701163
driven_any_median1.1561062463240606
driven_any_min0.34662198582828657
driven_lanedir_max1.114284977940725
driven_lanedir_mean0.7178143275356028
driven_lanedir_min0.10262459723782036
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean1.1933333333333294
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.34662198582828657, "driven_lanedir": 0.10262459723782036, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.3921026549013094, "deviation-center-line": 0.1221537899955525}, "ep001": {"driven_any": 1.1561062463240606, "driven_lanedir": 0.7334287330346738, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 3.012962151746203, "deviation-center-line": 0.4423386350164731}, "ep002": {"driven_any": 1.1802907448635878, "driven_lanedir": 1.08948401237682, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.4934247398378606, "deviation-center-line": 0.3386314750440172}, "ep003": {"driven_any": 1.1287884456790065, "driven_lanedir": 1.114284977940725, "in-drivable-lane": 0, "deviation-heading": 0.8068940684601202, "deviation-center-line": 0.24772421409273884}, "ep004": {"driven_any": 1.532573125810874, "driven_lanedir": 0.5492493170879753, "in-drivable-lane": 4.699999999999983, "deviation-heading": 0.9618367284767102, "deviation-center-line": 0.25529786063730087}}
6888773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:42(hidden)
other stats
videos1
6885773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19(hidden)
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 54, "reward": -18.823495253506636, "good_angle": 1.0113227424237254, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.366666666666669}, "ep001": {"nsteps": 170, "reward": -7.281124632235835, "good_angle": 12.298049812198876, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.066666666666656}, "ep002": {"nsteps": 183, "reward": -5.568044029769126, "good_angle": 1.1140481897696386, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 1.7333333333333272}, "ep003": {"nsteps": 167, "reward": -6.008025793368443, "good_angle": 0.14583727448031963, "survival_time": 5.566666666666657, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 232, "reward": -5.856484064204088, "good_angle": 13.70984710258984, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 4.1999999999999895}}
good_angle_max13.70984710258984
good_angle_mean5.6558210242924805
good_angle_median1.1140481897696386
good_angle_min0.14583727448031963
reward_max-5.568044029769126
reward_mean-8.707434754616825
reward_median-6.008025793368443
reward_min-18.823495253506636
survival_time_max7.733333333333316
survival_time_mean5.373333333333324
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.1999999999999895
valid_direction_mean2.0733333333333284
valid_direction_median1.7333333333333272
valid_direction_min0
6877773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:35(hidden)
other stats
simulation-passed1
6588773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission773/step1-simulation-nutonomy-P50-2570-job6588'
(hidden)
6359773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission773/step1-simulation-nutonomy-P50-2210-job6359'
(hidden)
5796773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizabortedno-0:00:52
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5796-6102', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5796-6102', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job5796-6102_evaluation" with the default driver
stderr | Creating job5796-6102_videos_1 ...
stderr | 
Creating job5796-6102_videos_1 ... error

stderr | ERROR: for job5796-6102_videos_1  Cannot start service videos: network job5796-6102_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job5796-6102_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
5795773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:00:47(hidden)
other stats
videos1
5787773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:02:35(hidden)
survival_time_median4.166666666666662


other stats
episodes
details{"ep000": {"nsteps": 125, "reward": -10.275045363903043, "good_angle": 19.028327950707173, "survival_time": 4.166666666666662, "traveled_tiles": 2, "valid_direction": 3.0999999999999943}, "ep001": {"nsteps": 94, "reward": -10.949103168954954, "good_angle": 0.6273082138140861, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 1.733333333333331}, "ep002": {"nsteps": 179, "reward": -6.57558033108814, "good_angle": 0.8388841699109951, "survival_time": 5.966666666666655, "traveled_tiles": 3, "valid_direction": 3.0333333333333226}, "ep003": {"nsteps": 185, "reward": -7.416382503509522, "good_angle": 19.876774516690535, "survival_time": 6.1666666666666545, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 66, "reward": -17.69188007441434, "good_angle": 0.1784253969051379, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 0.4666666666666665}}
good_angle_max19.876774516690535
good_angle_mean8.109944049605584
good_angle_median0.8388841699109951
good_angle_min0.1784253969051379
reward_max-6.57558033108814
reward_mean-10.581598288374
reward_median-10.275045363903043
reward_min-17.69188007441434
survival_time_max6.1666666666666545
survival_time_mean4.326666666666661
survival_time_min2.200000000000002
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.0999999999999943
valid_direction_mean2.2199999999999944
valid_direction_median2.766666666666657
valid_direction_min0.4666666666666665
5783773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:31(hidden)
other stats
simulation-passed1