AI Driving Olympics Home Challenges Submissions Jobs

Submission 1002

Submission1002
Competingyes
Challengeaido1_LF1_r3-v3
Userlmandrile
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14001 step2-scoring: 14011 step3-videos: 14014 step4-viz: 14020
Next
User labelTensorflow template
Admin priority50
Blessing50
User priority

14020

Click the images to see detailed statistics about the episode.

14014

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
140201002lmandrileTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes-0:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1425257472173178
deviation-center-line_median0.03770648650464713
in-drivable-lane_median0.5333333333333337


other stats
deviation-center-line_max0.06562208899707554
deviation-center-line_mean0.035374830248696934
deviation-center-line_min0
deviation-heading_max0.3388724938784655
deviation-heading_mean0.23283257865497475
deviation-heading_median0.2868160289210462
deviation-heading_min0
driven_any_max0.8335179254552931
driven_any_mean0.6920588253553465
driven_any_median0.7432966489027525
driven_any_min0.48887927842206014
driven_lanedir_max0.32094154686017173
driven_lanedir_mean0.17973377192291137
driven_lanedir_min0
in-drivable-lane_max1.2000000000000004
in-drivable-lane_mean0.6600000000000003
in-drivable-lane_min0.4666666666666666
per-episodes
details{"ep000": {"driven_any": 0.8335179254552931, "driven_lanedir": 0, "in-drivable-lane": 1.2000000000000004, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.6195224587507607, "driven_lanedir": 0.1425257472173178, "in-drivable-lane": 0.5333333333333332, "deviation-heading": 0.2868160289210462, "deviation-center-line": 0.03770648650464713}, "ep002": {"driven_any": 0.7750778152458664, "driven_lanedir": 0.32094154686017173, "in-drivable-lane": 0.566666666666667, "deviation-heading": 0.31412602224688074, "deviation-center-line": 0.047820848899404265}, "ep003": {"driven_any": 0.7432966489027525, "driven_lanedir": 0.30934324911406597, "in-drivable-lane": 0.5333333333333337, "deviation-heading": 0.3388724938784655, "deviation-center-line": 0.06562208899707554}, "ep004": {"driven_any": 0.48887927842206014, "driven_lanedir": 0.12585831642300116, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.22434834822848143, "deviation-center-line": 0.025724726842357715}}
140141002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
140111002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.166666666666667


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -28.33219768872132, "good_angle": 0.4841211643615117, "survival_time": 1.2333333333333338, "traveled_tiles": 3, "valid_direction": 0.5000000000000002}, "ep001": {"nsteps": 27, "reward": -38.29449649210329, "good_angle": 1.0248311898624871, "survival_time": 0.8999999999999999, "traveled_tiles": 3, "valid_direction": 0.7999999999999999}, "ep002": {"nsteps": 35, "reward": -29.095297619806868, "good_angle": 0.7352453722231659, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9333333333333336}, "ep003": {"nsteps": 35, "reward": -29.02805897699935, "good_angle": 0.6327953431255243, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep004": {"nsteps": 23, "reward": -44.56027106228082, "good_angle": 0.9851564314367316, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.7333333333333333}}
good_angle_max1.0248311898624871
good_angle_mean0.7724299002018842
good_angle_median0.7352453722231659
good_angle_min0.4841211643615117
reward_max-28.33219768872132
reward_mean-33.86206436798233
reward_median-29.095297619806868
reward_min-44.56027106228082
survival_time_max1.2333333333333338
survival_time_mean1.0466666666666669
survival_time_min0.7666666666666666
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.9666666666666668
valid_direction_mean0.7866666666666668
valid_direction_median0.7999999999999999
valid_direction_min0.5000000000000002
140011002lmandrileTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
107111002lmandrileTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes-0:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.0958908069543778
deviation-center-line_median0.17962751025510462
in-drivable-lane_median3.3333333333333233


other stats
deviation-center-line_max0.8439804300523625
deviation-center-line_mean0.26553448463337254
deviation-center-line_min0.041641315532446536
deviation-heading_max7.713631633240814
deviation-heading_mean2.439015326562819
deviation-heading_median1.1814767516542048
deviation-heading_min0.3747283471553756
driven_any_max3.343731442526935
driven_any_mean1.2511177462517495
driven_any_median1.2140094739554237
driven_any_min0.15264807230455107
driven_lanedir_max1.1513825364526962
driven_lanedir_mean0.33867295619196625
driven_lanedir_min0.035517354683261004
in-drivable-lane_max5.499999999999986
in-drivable-lane_mean2.92666666666666
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ep000": {"driven_any": 1.284994355509164, "driven_lanedir": 0.3375407056887837, "in-drivable-lane": 4.699999999999992, "deviation-heading": 1.1814767516542048, "deviation-center-line": 0.1915641769361276}, "ep001": {"driven_any": 1.2140094739554237, "driven_lanedir": 0.0958908069543778, "in-drivable-lane": 3.3333333333333233, "deviation-heading": 2.449274801322821, "deviation-center-line": 0.17962751025510462}, "ep002": {"driven_any": 0.26020538696267453, "driven_lanedir": 0.035517354683261004, "in-drivable-lane": 0.9000000000000011, "deviation-heading": 0.3747283471553756, "deviation-center-line": 0.041641315532446536}, "ep003": {"driven_any": 3.343731442526935, "driven_lanedir": 1.1513825364526962, "in-drivable-lane": 5.499999999999986, "deviation-heading": 7.713631633240814, "deviation-center-line": 0.8439804300523625}, "ep004": {"driven_any": 0.15264807230455107, "driven_lanedir": 0.07303337718071257, "in-drivable-lane": 0.20000000000000007, "deviation-heading": 0.47596509944087984, "deviation-center-line": 0.07085899039082134}}
107101002lmandrileTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes-0:02:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.0958908069543778
deviation-center-line_median0.17962751025510462
in-drivable-lane_median3.3333333333333233


other stats
deviation-center-line_max0.8439804300523625
deviation-center-line_mean0.26553448463337254
deviation-center-line_min0.041641315532446536
deviation-heading_max7.713631633240814
deviation-heading_mean2.439015326562819
deviation-heading_median1.1814767516542048
deviation-heading_min0.3747283471553756
driven_any_max3.343731442526935
driven_any_mean1.2511177462517495
driven_any_median1.2140094739554237
driven_any_min0.15264807230455107
driven_lanedir_max1.1513825364526962
driven_lanedir_mean0.33867295619196625
driven_lanedir_min0.035517354683261004
in-drivable-lane_max5.499999999999986
in-drivable-lane_mean2.92666666666666
in-drivable-lane_min0.20000000000000007
per-episodes
details{"ep000": {"driven_any": 1.284994355509164, "driven_lanedir": 0.3375407056887837, "in-drivable-lane": 4.699999999999992, "deviation-heading": 1.1814767516542048, "deviation-center-line": 0.1915641769361276}, "ep001": {"driven_any": 1.2140094739554237, "driven_lanedir": 0.0958908069543778, "in-drivable-lane": 3.3333333333333233, "deviation-heading": 2.449274801322821, "deviation-center-line": 0.17962751025510462}, "ep002": {"driven_any": 0.26020538696267453, "driven_lanedir": 0.035517354683261004, "in-drivable-lane": 0.9000000000000011, "deviation-heading": 0.3747283471553756, "deviation-center-line": 0.041641315532446536}, "ep003": {"driven_any": 3.343731442526935, "driven_lanedir": 1.1513825364526962, "in-drivable-lane": 5.499999999999986, "deviation-heading": 7.713631633240814, "deviation-center-line": 0.8439804300523625}, "ep004": {"driven_any": 0.15264807230455107, "driven_lanedir": 0.07303337718071257, "in-drivable-lane": 0.20000000000000007, "deviation-heading": 0.47596509944087984, "deviation-center-line": 0.07085899039082134}}
107071002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
107061002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
81531002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videosabortedyes-0:00:26
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8153-6043', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8153-6043', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8153-6043_evaluation" with the default driver
stderr | Creating job8153-6043_videos_1 ...
stderr | 
Creating job8153-6043_videos_1 ... error

stderr | ERROR: for job8153-6043_videos_1  Cannot start service videos: network job8153-6043_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8153-6043_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
81521002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
81511002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:01:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
81501002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videosabortedyes-0:00:32
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8150-2724', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8150-2724', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8150-2724_evaluation" with the default driver
stderr | Creating job8150-2724_videos_1 ...
stderr | 
Creating job8150-2724_videos_1 ... error

stderr | ERROR: for job8150-2724_videos_1  Cannot start service videos: network job8150-2724_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8150-2724_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
81491002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes-0:02:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
81481002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:03:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 216, "reward": -6.392362615874003, "good_angle": 22.74045157653506, "survival_time": 7.199999999999984, "traveled_tiles": 2, "valid_direction": 5.499999999999989}, "ep001": {"nsteps": 202, "reward": -6.445137121382695, "good_angle": 4.28775818782871, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 5.233333333333322}, "ep002": {"nsteps": 43, "reward": -25.32363423219947, "good_angle": 0.6317146216669308, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 1.2666666666666673}, "ep003": {"nsteps": 500, "reward": -1.0371820561804344, "good_angle": 9.409300943573458, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 12.533333333333331}, "ep004": {"nsteps": 32, "reward": -32.28967246040702, "good_angle": 0.848158727035083, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0.6666666666666666}}
good_angle_max22.74045157653506
good_angle_mean7.583476811327849
good_angle_median4.28775818782871
good_angle_min0.6317146216669308
reward_max-1.0371820561804344
reward_mean-14.297597697208724
reward_median-6.445137121382695
reward_min-32.28967246040702
survival_time_max16.666666666666654
survival_time_mean6.619999999999992
survival_time_min1.0666666666666669
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.533333333333331
valid_direction_mean5.039999999999996
valid_direction_median5.233333333333322
valid_direction_min0.6666666666666666
81471002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 216, "reward": -6.392362615874003, "good_angle": 22.74045157653506, "survival_time": 7.199999999999984, "traveled_tiles": 2, "valid_direction": 5.499999999999989}, "ep001": {"nsteps": 202, "reward": -6.445137121382695, "good_angle": 4.28775818782871, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 5.233333333333322}, "ep002": {"nsteps": 43, "reward": -25.32363423219947, "good_angle": 0.6317146216669308, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 1.2666666666666673}, "ep003": {"nsteps": 500, "reward": -1.0371820561804344, "good_angle": 9.409300943573458, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 12.533333333333331}, "ep004": {"nsteps": 32, "reward": -32.28967246040702, "good_angle": 0.848158727035083, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0.6666666666666666}}
good_angle_max22.74045157653506
good_angle_mean7.583476811327849
good_angle_median4.28775818782871
good_angle_min0.6317146216669308
reward_max-1.0371820561804344
reward_mean-14.297597697208724
reward_median-6.445137121382695
reward_min-32.28967246040702
survival_time_max16.666666666666654
survival_time_mean6.619999999999992
survival_time_min1.0666666666666669
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.533333333333331
valid_direction_mean5.039999999999996
valid_direction_median5.233333333333322
valid_direction_min0.6666666666666666
81461002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringabortedyes-0:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8146-3831', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8146-3831', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8146-3831_evaluation" with the default driver
stderr | Creating job8146-3831_scorer_1 ...
stderr | 
Creating job8146-3831_scorer_1 ... error

stderr | ERROR: for job8146-3831_scorer_1  Cannot start service scorer: network job8146-3831_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8146-3831_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
81451002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 216, "reward": -6.392362615874003, "good_angle": 22.74045157653506, "survival_time": 7.199999999999984, "traveled_tiles": 2, "valid_direction": 5.499999999999989}, "ep001": {"nsteps": 202, "reward": -6.445137121382695, "good_angle": 4.28775818782871, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 5.233333333333322}, "ep002": {"nsteps": 43, "reward": -25.32363423219947, "good_angle": 0.6317146216669308, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 1.2666666666666673}, "ep003": {"nsteps": 500, "reward": -1.0371820561804344, "good_angle": 9.409300943573458, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 12.533333333333331}, "ep004": {"nsteps": 32, "reward": -32.28967246040702, "good_angle": 0.848158727035083, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0.6666666666666666}}
good_angle_max22.74045157653506
good_angle_mean7.583476811327849
good_angle_median4.28775818782871
good_angle_min0.6317146216669308
reward_max-1.0371820561804344
reward_mean-14.297597697208724
reward_median-6.445137121382695
reward_min-32.28967246040702
survival_time_max16.666666666666654
survival_time_mean6.619999999999992
survival_time_min1.0666666666666669
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.533333333333331
valid_direction_mean5.039999999999996
valid_direction_median5.233333333333322
valid_direction_min0.6666666666666666
81441002lmandrileTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1