AI Driving Olympics Home Challenges Submissions Jobs

Submission 812

Submission812
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12112 step2-scoring: 12124 step3-videos: 12128 step4-viz: 12136
Next
User labelMy modified ROS-based Lane Following
Admin priority50
Blessing50
User priority

12136

Click the images to see detailed statistics about the episode.

12128

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12136812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:04:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.293894886345015e-06
deviation-center-line_median0.35427651431850266
in-drivable-lane_median8.333333333333325


other stats
deviation-center-line_max0.7166999847809707
deviation-center-line_mean0.4021814778868882
deviation-center-line_min0.11255032169353904
deviation-heading_max6.559847755542228
deviation-heading_mean6.516205339884881
deviation-heading_median6.511992303973169
deviation-heading_min6.468692922982471
driven_any_max0.137332931121333
driven_any_mean0.05295064547398628
driven_any_median0.02937691534376773
driven_any_min1.9997630964596442e-13
driven_lanedir_max2.432825033160668e-05
driven_lanedir_mean-0.0005646267102803915
driven_lanedir_min-0.0028197111415342313
in-drivable-lane_max8.366666666666658
in-drivable-lane_mean8.333333333333325
in-drivable-lane_min8.29999999999999
per-episodes
details{"ep000": {"driven_any": 0.137332931121333, "driven_lanedir": -1.293894886345015e-06, "in-drivable-lane": 8.366666666666658, "deviation-heading": 6.483660130719008, "deviation-center-line": 0.11255032169353904}, "ep001": {"driven_any": 1.9997630964596442e-13, "driven_lanedir": 2.432825033160668e-05, "in-drivable-lane": 8.333333333333325, "deviation-heading": 6.511992303973169, "deviation-center-line": 0.35427651431850266}, "ep002": {"driven_any": 0.028666465560799805, "driven_lanedir": -3.811898571637329e-05, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.556833586207534, "deviation-center-line": 0.32283094857906275}, "ep003": {"driven_any": 0.06937691534383089, "driven_lanedir": 1.1662220403385604e-05, "in-drivable-lane": 8.366666666666658, "deviation-heading": 6.468692922982471, "deviation-center-line": 0.5045496200623655}, "ep004": {"driven_any": 0.02937691534376773, "driven_lanedir": -0.0028197111415342313, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.559847755542228, "deviation-center-line": 0.7166999847809707}}
12128812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
12124812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8070502380006946, "good_angle": 13.363300617665956, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.133333333333322}, "ep001": {"nsteps": 500, "reward": -1.0276108434740454, "good_angle": 13.733489302556302, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.9874393634081352, "good_angle": 13.225138900404856, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.53333333333333}, "ep003": {"nsteps": 500, "reward": -1.1264446720592678, "good_angle": 13.145087132021226, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.166666666666654}, "ep004": {"nsteps": 500, "reward": -1.2755269907958573, "good_angle": 13.185696883992287, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.333333333333329}}
good_angle_max13.733489302556302
good_angle_mean13.330542567328129
good_angle_median13.225138900404856
good_angle_min13.145087132021226
reward_max-0.8070502380006946
reward_mean-1.0448144215476
reward_median-1.0276108434740454
reward_min-1.2755269907958573
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.53333333333333
valid_direction_mean13.266666666666657
valid_direction_median13.166666666666655
valid_direction_min13.133333333333322
12112812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:10:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6792812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:02:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1083133999257062
deviation-center-line_median0.26193177690187186
in-drivable-lane_median6.566666666666663


other stats
deviation-center-line_max1.459563558232137
deviation-center-line_mean0.477031735520102
deviation-center-line_min0.00689353744255581
deviation-heading_max7.3529798435663425
deviation-heading_mean3.30482660895136
deviation-heading_median2.481734038738831
deviation-heading_min0.07844071682584033
driven_any_max22.991451579322693
driven_any_mean13.323045616860176
driven_any_median21.013749597224955
driven_any_min0.41387808387579816
driven_lanedir_max1.449453095242103
driven_lanedir_mean0.5461968394991965
driven_lanedir_min0.0236675100560082
in-drivable-lane_max12.999999999999975
in-drivable-lane_mean5.753333333333324
in-drivable-lane_min0.5666666666666667
per-episodes
details{"ep000": {"driven_any": 22.991451579322693, "driven_lanedir": 1.055645172238337, "in-drivable-lane": 12.999999999999975, "deviation-heading": 2.481734038738831, "deviation-center-line": 0.26193177690187186}, "ep001": {"driven_any": 1.1634291533411067, "driven_lanedir": 0.1083133999257062, "in-drivable-lane": 0.6333333333333335, "deviation-heading": 0.3473745052130815, "deviation-center-line": 0.03912260355067344}, "ep002": {"driven_any": 21.03271967053632, "driven_lanedir": 1.449453095242103, "in-drivable-lane": 7.999999999999984, "deviation-heading": 6.263603940412701, "deviation-center-line": 0.6176472014732722}, "ep003": {"driven_any": 21.013749597224955, "driven_lanedir": 0.09390502003382784, "in-drivable-lane": 6.566666666666663, "deviation-heading": 7.3529798435663425, "deviation-center-line": 1.459563558232137}, "ep004": {"driven_any": 0.41387808387579816, "driven_lanedir": 0.0236675100560082, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.07844071682584033, "deviation-center-line": 0.00689353744255581}}
6786812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6785812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes-0:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6785-1181', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job6785-1181', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job6785-1181_evaluation" with the default driver
stderr | Creating job6785-1181_videos_1 ...
stderr | 
Creating job6785-1181_videos_1 ... error

stderr | ERROR: for job6785-1181_videos_1  Cannot start service videos: network job6785-1181_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job6785-1181_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6781812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2442880286555738, "good_angle": 49.27850673721177, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.899999999999991}, "ep001": {"nsteps": 35, "reward": -30.17108565824373, "good_angle": 0.9524494896916972, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep002": {"nsteps": 500, "reward": -0.844765876989637, "good_angle": 12.509740325592723, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666666}, "ep003": {"nsteps": 500, "reward": -0.7657762226680643, "good_angle": 13.3664816792467, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}, "ep004": {"nsteps": 20, "reward": -52.504125183820726, "good_angle": 0.5956607844272193, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666667}}
good_angle_max49.27850673721177
good_angle_mean15.340567803234023
good_angle_median12.509740325592723
good_angle_min0.5956607844272193
reward_max-0.7657762226680643
reward_mean-17.106008194075546
reward_median-1.2442880286555738
reward_min-52.504125183820726
survival_time_max16.666666666666654
survival_time_mean10.366666666666658
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.899999999999991
valid_direction_mean8.259999999999994
valid_direction_median12.96666666666666
valid_direction_min0.4666666666666667
6556812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission812/step2-scoring-nutonomy-P50-2570-job6556'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6555812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2442880286555738, "good_angle": 49.27850673721177, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.899999999999991}, "ep001": {"nsteps": 35, "reward": -30.17108565824373, "good_angle": 0.9524494896916972, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep002": {"nsteps": 500, "reward": -0.844765876989637, "good_angle": 12.509740325592723, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666666}, "ep003": {"nsteps": 500, "reward": -0.7657762226680643, "good_angle": 13.3664816792467, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}, "ep004": {"nsteps": 20, "reward": -52.504125183820726, "good_angle": 0.5956607844272193, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666667}}
good_angle_max49.27850673721177
good_angle_mean15.340567803234023
good_angle_median12.509740325592723
good_angle_min0.5956607844272193
reward_max-0.7657762226680643
reward_mean-17.106008194075546
reward_median-1.2442880286555738
reward_min-52.504125183820726
survival_time_max16.666666666666654
survival_time_mean10.366666666666658
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.899999999999991
valid_direction_mean8.259999999999994
valid_direction_median12.96666666666666
valid_direction_min0.4666666666666667
6289812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6289-6703', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job6289-6703', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job6289-6703_evaluation" with the default driver
stderr | Creating job6289-6703_scorer_1 ...
stderr | 
Creating job6289-6703_scorer_1 ... error

stderr | ERROR: for job6289-6703_scorer_1  Cannot start service scorer: network job6289-6703_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job6289-6703_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6269812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:05:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6040812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6035812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6030812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7747792674911907, "good_angle": 13.70950418488412, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.799999999999992}, "ep001": {"nsteps": 500, "reward": -0.8456194863413693, "good_angle": 13.837077786562803, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666653}, "ep002": {"nsteps": 500, "reward": -0.8973875654921867, "good_angle": 20.009250521667163, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.133333333333324}, "ep003": {"nsteps": 500, "reward": -1.1176309097209014, "good_angle": 13.752742985792336, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.733333333333324}, "ep004": {"nsteps": 11, "reward": -92.5487169785933, "good_angle": 0.3003884263205863, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.23333333333333336}}
good_angle_max20.009250521667163
good_angle_mean12.3217927810454
good_angle_median13.752742985792336
good_angle_min0.3003884263205863
reward_max-0.7747792674911907
reward_mean-19.23682684152779
reward_median-0.8973875654921867
reward_min-92.5487169785933
survival_time_max16.666666666666654
survival_time_mean13.406666666666656
survival_time_min0.36666666666666664
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.133333333333324
valid_direction_mean10.373333333333326
valid_direction_median12.799999999999992
valid_direction_min0.23333333333333336
6024812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:06:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6023812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6023-3588', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job6023-3588', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job6023-3588_evaluation" with the default driver
stderr | Creating job6023-3588_solution_1 ...
stderr | Creating job6023-3588_evaluator_1 ...
stderr | 
Creating job6023-3588_evaluator_1 ... error

stderr | ERROR: for job6023-3588_evaluator_1  Cannot start service evaluator: network job6023-3588_evaluation not found
stderr | 
Creating job6023-3588_solution_1  ... error

stderr | ERROR: for job6023-3588_solution_1  Cannot start service solution: network job6023-3588_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job6023-3588_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job6023-3588_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6022812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:13:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6021812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:13:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1