AI Driving Olympics Home Challenges Submissions Jobs

Submission 786

Submission786
Competingyes
Challengeaido1_LF1_r3-v3
Usermartatintore
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 11859 step2-scoring: 11867 step3-videos: 11869 step4-viz: 11876
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
User priority50

11876

Click the images to see detailed statistics about the episode.

11869

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11876786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:17(hidden)
driven_lanedir_median0.7126529183789587
deviation-center-line_median0.1347203030847702
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.19459272469554612
deviation-center-line_mean0.1216956683446694
deviation-center-line_min0.05466685858615235
deviation-heading_max0.9628595286899624
deviation-heading_mean0.5413439411636931
deviation-heading_median0.5469863749986666
deviation-heading_min0.126740562568969
driven_any_max1.1769694591887163
driven_any_mean0.9786303099441632
driven_any_median1.118265182532307
driven_any_min0.6867562874800863
driven_lanedir_max1.0815534547388053
driven_lanedir_mean0.7088579638102485
driven_lanedir_min0.07910847982864144
in-drivable-lane_max2.1333333333333355
in-drivable-lane_mean0.4600000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.123768222599454, "driven_lanedir": 0.07910847982864144, "in-drivable-lane": 2.1333333333333355, "deviation-heading": 0.6878734119493095, "deviation-center-line": 0.05466685858615235}, "ep001": {"driven_any": 0.6867562874800863, "driven_lanedir": 0.6846442660719139, "in-drivable-lane": 0, "deviation-heading": 0.126740562568969, "deviation-center-line": 0.15105767391839162}, "ep002": {"driven_any": 0.7873923979202525, "driven_lanedir": 0.7126529183789587, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.5469863749986666, "deviation-center-line": 0.07344078143848667}, "ep003": {"driven_any": 1.118265182532307, "driven_lanedir": 1.0815534547388053, "in-drivable-lane": 0, "deviation-heading": 0.3822598276115577, "deviation-center-line": 0.1347203030847702}, "ep004": {"driven_any": 1.1769694591887163, "driven_lanedir": 0.9863307000329232, "in-drivable-lane": 0.13333333333333375, "deviation-heading": 0.9628595286899624, "deviation-center-line": 0.19459272469554612}}
11869786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:40(hidden)
other stats
videos1
11867786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23(hidden)
survival_time_median2.7


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.326478562113351, "good_angle": 1.5577814919274129, "survival_time": 2.7333333333333334, "traveled_tiles": 3, "valid_direction": 1.0999999999999983}, "ep001": {"nsteps": 51, "reward": -19.276078093577834, "good_angle": 0.010282873887382443, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 58, "reward": -16.716050449437624, "good_angle": 0.32380672135248884, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 0.6666666666666687}, "ep003": {"nsteps": 81, "reward": -12.04488823865684, "good_angle": 0.2822049233514216, "survival_time": 2.7, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 86, "reward": -10.927798965339395, "good_angle": 0.37857558356521426, "survival_time": 2.8666666666666663, "traveled_tiles": 3, "valid_direction": 0.6666666666666643}}
good_angle_max1.5577814919274129
good_angle_mean0.510530318816784
good_angle_median0.32380672135248884
good_angle_min0.010282873887382443
reward_max-10.927798965339395
reward_mean-14.45825886182501
reward_median-13.326478562113351
reward_min-19.276078093577834
survival_time_max2.8666666666666663
survival_time_mean2.3866666666666676
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.0999999999999983
valid_direction_mean0.6199999999999991
valid_direction_median0.6666666666666643
valid_direction_min0
11859786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:16(hidden)
other stats
simulation-passed1
6827786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:02:36(hidden)
driven_lanedir_median1.1432382119502291
deviation-center-line_median0.5204103554475212
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max0.7854477695802368
deviation-center-line_mean0.4630712168897032
deviation-center-line_min0.20926369490742272
deviation-heading_max3.927054728939466
deviation-heading_mean1.8043750965554088
deviation-heading_median1.846973201593595
deviation-heading_min0.18003545892847353
driven_any_max2.117078772274096
driven_any_mean1.1118203579613968
driven_any_median1.1806627796143985
driven_any_min0.28267661010001705
driven_lanedir_max2.0211536131148073
driven_lanedir_mean0.9601557980935757
driven_lanedir_min0.1505773556271348
in-drivable-lane_max1.233333333333329
in-drivable-lane_mean0.3933333333333324
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.361433367014794, "driven_lanedir": 0.1505773556271348, "in-drivable-lane": 0.6, "deviation-heading": 2.0726370365592395, "deviation-center-line": 0.20926369490742272}, "ep001": {"driven_any": 0.28267661010001705, "driven_lanedir": 0.2815729002244498, "in-drivable-lane": 0, "deviation-heading": 0.18003545892847353, "deviation-center-line": 0.225023555751891}, "ep002": {"driven_any": 1.1806627796143985, "driven_lanedir": 1.1432382119502291, "in-drivable-lane": 0, "deviation-heading": 0.9951750567562708, "deviation-center-line": 0.5752107087614442}, "ep003": {"driven_any": 2.117078772274096, "driven_lanedir": 2.0211536131148073, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.846973201593595, "deviation-center-line": 0.5204103554475212}, "ep004": {"driven_any": 1.6172502608036787, "driven_lanedir": 1.204236909551256, "in-drivable-lane": 1.233333333333329, "deviation-heading": 3.927054728939466, "deviation-center-line": 0.7854477695802368}}
6824786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:47(hidden)
other stats
videos1
6820786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19(hidden)
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.597587918348172, "good_angle": 1.236407449549888, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.3}, "ep001": {"nsteps": 63, "reward": -16.434686097833847, "good_angle": 0.01613172104834008, "survival_time": 2.1000000000000023, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.471395843987372, "good_angle": 0.8419214451119427, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 455, "reward": -2.1757505042721506, "good_angle": 1.2668875667987856, "survival_time": 15.166666666666623, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep004": {"nsteps": 348, "reward": -3.716289642093728, "good_angle": 21.774254046429576, "survival_time": 11.59999999999997, "traveled_tiles": 3, "valid_direction": 3.9999999999999862}}
good_angle_max21.774254046429576
good_angle_mean5.027120445787706
good_angle_median1.236407449549888
good_angle_min0.01613172104834008
reward_max-2.1757505042721506
reward_mean-7.879142001307055
reward_median-4.471395843987372
reward_min-16.434686097833847
survival_time_max15.166666666666623
survival_time_mean8.013333333333316
survival_time_min2.1000000000000023
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9999999999999862
valid_direction_mean2.1199999999999948
valid_direction_median2.199999999999992
valid_direction_min0
6813786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:48(hidden)
other stats
simulation-passed1
6572786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission786/step1-simulation-nutonomy-P50-2570-job6572'
(hidden)
6339786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission786/step1-simulation-nutonomy-P50-2210-job6339'
(hidden)
6338786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission786/step1-simulation-nutonomy-P50-2570-job6338'
(hidden)
5941786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:09(hidden)
other stats
videos1
5940786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:00:46(hidden)
other stats
videos1
5939786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:00:47(hidden)
other stats
videos1
5938786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:05:07(hidden)
other stats
videos1
5937786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:05:08(hidden)
other stats
videos1
5936786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17(hidden)
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.790757534083198, "good_angle": 24.085888249464556, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 376, "reward": -3.5683142356970845, "good_angle": 22.87213440078576, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 318, "reward": -3.1791894810119388, "good_angle": 0.13315919092022602, "survival_time": 10.599999999999971, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.154849209064661, "good_angle": 26.1922502546216, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.561203524712611, "good_angle": 5.142374861417086, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}
good_angle_max26.1922502546216
good_angle_mean15.685161391441843
good_angle_median22.87213440078576
good_angle_min0.13315919092022602
reward_max-3.1791894810119388
reward_mean-5.250862796913898
reward_median-5.561203524712611
reward_min-7.790757534083198
survival_time_max12.5333333333333
survival_time_mean9.286666666666644
survival_time_min5.666666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.93333333333332
valid_direction_mean2.953333333333324
valid_direction_median3.899999999999986
valid_direction_min0
5935786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17(hidden)
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.790757534083198, "good_angle": 24.085888249464556, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 376, "reward": -3.5683142356970845, "good_angle": 22.87213440078576, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 318, "reward": -3.1791894810119388, "good_angle": 0.13315919092022602, "survival_time": 10.599999999999971, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.154849209064661, "good_angle": 26.1922502546216, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.561203524712611, "good_angle": 5.142374861417086, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}
good_angle_max26.1922502546216
good_angle_mean15.685161391441843
good_angle_median22.87213440078576
good_angle_min0.13315919092022602
reward_max-3.1791894810119388
reward_mean-5.250862796913898
reward_median-5.561203524712611
reward_min-7.790757534083198
survival_time_max12.5333333333333
survival_time_mean9.286666666666644
survival_time_min5.666666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.93333333333332
valid_direction_mean2.953333333333324
valid_direction_median3.899999999999986
valid_direction_min0
5934786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:18(hidden)
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.790757534083198, "good_angle": 24.085888249464556, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 376, "reward": -3.5683142356970845, "good_angle": 22.87213440078576, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 318, "reward": -3.1791894810119388, "good_angle": 0.13315919092022602, "survival_time": 10.599999999999971, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.154849209064661, "good_angle": 26.1922502546216, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.561203524712611, "good_angle": 5.142374861417086, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}
good_angle_max26.1922502546216
good_angle_mean15.685161391441843
good_angle_median22.87213440078576
good_angle_min0.13315919092022602
reward_max-3.1791894810119388
reward_mean-5.250862796913898
reward_median-5.561203524712611
reward_min-7.790757534083198
survival_time_max12.5333333333333
survival_time_mean9.286666666666644
survival_time_min5.666666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.93333333333332
valid_direction_mean2.953333333333324
valid_direction_median3.899999999999986
valid_direction_min0
5933786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:58(hidden)
other stats
simulation-passed1
5865786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizabortedno-0:01:13(hidden)
other stats
videos1
5859786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videosabortedno-0:00:50(hidden)
other stats
videos1
5858786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringabortedno-0:00:18(hidden)
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.788953623350928, "good_angle": 24.91796765809418, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 377, "reward": -3.5404039369970164, "good_angle": 23.284883625908556, "survival_time": 12.566666666666633, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 500, "reward": 0.06837520753254649, "good_angle": 0.5794104329079299, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.5333333333333634}, "ep003": {"nsteps": 258, "reward": -6.081126526344654, "good_angle": 26.256722859299472, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.62272922676469, "good_angle": 5.3133982514159195, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.0666666666666567}}
good_angle_max26.256722859299472
good_angle_mean16.07047656552521
good_angle_median23.284883625908556
good_angle_min0.5794104329079299
reward_max0.06837520753254649
reward_mean-4.592967621184949
reward_median-5.62272922676469
reward_min-7.788953623350928
survival_time_max16.666666666666654
survival_time_mean10.506666666666646
survival_time_min5.666666666666656
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.933333333333321
valid_direction_mean3.2799999999999963
valid_direction_median3.9333333333333194
valid_direction_min1.5333333333333634
5853786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:01:56(hidden)
other stats
simulation-passed1
5852786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5852-8789', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5852-8789', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job5852-8789_evaluation" with the default driver
stderr | Creating job5852-8789_solution_1 ...
stderr | Creating job5852-8789_evaluator_1 ...
stderr | 
Creating job5852-8789_evaluator_1 ... error

stderr | ERROR: for job5852-8789_evaluator_1  Cannot start service evaluator: network job5852-8789_evaluation not found
stderr | 
Creating job5852-8789_solution_1  ... error

stderr | ERROR: for job5852-8789_solution_1  Cannot start service solution: network job5852-8789_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job5852-8789_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job5852-8789_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
5851786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:03:34(hidden)
other stats
simulation-passed1
5850786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:01:55(hidden)
other stats
simulation-passed1
5849786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:02:07(hidden)
other stats
simulation-passed1