AI Driving Olympics Home Challenges Submissions Jobs

Submission 878

Submission878
Competingyes
Challengeaido1_LF1_r3-v3
UserMandanaSamiei
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 12710 step2-scoring: 12724 step3-videos: 12727 step4-viz: 12731
Next
User labelPyTorch DDPG template
Admin priority50
User priority50

12731

Click the images to see detailed statistics about the episode.

12727

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12731878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes-0:01:01(hidden)
driven_lanedir_median0.44017109085015216
deviation-center-line_median0.03693775853645397
in-drivable-lane_median0.3666666666666666


other stats
deviation-center-line_max0.05878435404338575
deviation-center-line_mean0.03414645078850969
deviation-center-line_min0
deviation-heading_max0.2938855670096093
deviation-heading_mean0.1885916742823144
deviation-heading_median0.2122209160707328
deviation-heading_min0
driven_any_max0.8588583230617277
driven_any_mean0.7202659722064104
driven_any_median0.7470555893742069
driven_any_min0.480607972878184
driven_lanedir_max0.7041722777352769
driven_lanedir_mean0.391543212807542
driven_lanedir_min0
in-drivable-lane_max0.7666666666666666
in-drivable-lane_mean0.38666666666666666
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.480607972878184, "driven_lanedir": 0, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.6706424888154348, "driven_lanedir": 0.3683954841921251, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.16423021234081836, "deviation-center-line": 0.02844247604314933}, "ep002": {"driven_any": 0.7470555893742069, "driven_lanedir": 0.7041722777352769, "in-drivable-lane": 0, "deviation-heading": 0.2938855670096093, "deviation-center-line": 0.04656766531955941}, "ep003": {"driven_any": 0.8441654869024985, "driven_lanedir": 0.44017109085015216, "in-drivable-lane": 0.3666666666666666, "deviation-heading": 0.2122209160707328, "deviation-center-line": 0.03693775853645397}, "ep004": {"driven_any": 0.8588583230617277, "driven_lanedir": 0.444977211260156, "in-drivable-lane": 0.466666666666667, "deviation-heading": 0.2726216759904114, "deviation-center-line": 0.05878435404338575}}
12727878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:40(hidden)
other stats
videos1
12724878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median1


other stats
episodes
details{"ep000": {"nsteps": 24, "reward": -43.290506387750305, "good_angle": 0.13777320991716416, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep001": {"nsteps": 23, "reward": -43.9207489464594, "good_angle": 0.5671328699928305, "survival_time": 0.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.5999999999999999}, "ep002": {"nsteps": 60, "reward": -16.275390857815122, "good_angle": 0.3076098269339417, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.700000000000002}, "ep003": {"nsteps": 30, "reward": -33.756056149552265, "good_angle": 0.550720538329567, "survival_time": 1, "traveled_tiles": 3, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 35, "reward": -28.904929783940315, "good_angle": 0.5276022963213172, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 0.8666666666666667}}
good_angle_max0.5671328699928305
good_angle_mean0.4181677482989642
good_angle_median0.5276022963213172
good_angle_min0.13777320991716416
reward_max-16.275390857815122
reward_mean-33.22952642510349
reward_median-33.756056149552265
reward_min-43.9207489464594
survival_time_max2.0000000000000027
survival_time_mean1.1466666666666672
survival_time_min0.7666666666666666
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.8666666666666667
valid_direction_mean0.6400000000000003
valid_direction_median0.5999999999999999
valid_direction_min0.4666666666666666
12710878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:29(hidden)
other stats
simulation-passed1
7422878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes-0:04:13(hidden)
driven_lanedir_median0.42583954081123343
deviation-center-line_median0.17320688210284996
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.2228829251353732
deviation-center-line_mean0.16434571981296003
deviation-center-line_min0.09093832662212982
deviation-heading_max1.4075803299755223
deviation-heading_mean0.9176843383697352
deviation-heading_median0.8078204297304372
deviation-heading_min0.5613042426861848
driven_any_max0.9219548432356148
driven_any_mean0.7299005046004915
driven_any_median0.793164018584243
driven_any_min0.4054401413209636
driven_lanedir_max0.5721425621400456
driven_lanedir_mean0.39567261648125274
driven_lanedir_min0.19465232407579425
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.0266666666666644
in-drivable-lane_min0.7333333333333356
per-episodes
details{"ep000": {"driven_any": 0.4054401413209636, "driven_lanedir": 0.19465232407579425, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 1.4075803299755223, "deviation-center-line": 0.17320688210284996}, "ep001": {"driven_any": 0.9219548432356148, "driven_lanedir": 0.5721425621400456, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 1.0430727836679292, "deviation-center-line": 0.2228829251353732}, "ep002": {"driven_any": 0.8734300505158462, "driven_lanedir": 0.42583954081123343, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.7686439057886024, "deviation-center-line": 0.14653797754600437}, "ep003": {"driven_any": 0.793164018584243, "driven_lanedir": 0.4434648915398909, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 0.8078204297304372, "deviation-center-line": 0.18816248765844276}, "ep004": {"driven_any": 0.6555134693457899, "driven_lanedir": 0.3422637638392996, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5613042426861848, "deviation-center-line": 0.09093832662212982}}
7421878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes-0:04:14(hidden)
driven_lanedir_median0.42583954081123343
deviation-center-line_median0.17320688210284996
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.2228829251353732
deviation-center-line_mean0.16434571981296003
deviation-center-line_min0.09093832662212982
deviation-heading_max1.4075803299755223
deviation-heading_mean0.9176843383697352
deviation-heading_median0.8078204297304372
deviation-heading_min0.5613042426861848
driven_any_max0.9219548432356148
driven_any_mean0.7299005046004915
driven_any_median0.793164018584243
driven_any_min0.4054401413209636
driven_lanedir_max0.5721425621400456
driven_lanedir_mean0.39567261648125274
driven_lanedir_min0.19465232407579425
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.0266666666666644
in-drivable-lane_min0.7333333333333356
per-episodes
details{"ep000": {"driven_any": 0.4054401413209636, "driven_lanedir": 0.19465232407579425, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 1.4075803299755223, "deviation-center-line": 0.17320688210284996}, "ep001": {"driven_any": 0.9219548432356148, "driven_lanedir": 0.5721425621400456, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 1.0430727836679292, "deviation-center-line": 0.2228829251353732}, "ep002": {"driven_any": 0.8734300505158462, "driven_lanedir": 0.42583954081123343, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.7686439057886024, "deviation-center-line": 0.14653797754600437}, "ep003": {"driven_any": 0.793164018584243, "driven_lanedir": 0.4434648915398909, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 0.8078204297304372, "deviation-center-line": 0.18816248765844276}, "ep004": {"driven_any": 0.6555134693457899, "driven_lanedir": 0.3422637638392996, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5613042426861848, "deviation-center-line": 0.09093832662212982}}
7420878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:46(hidden)
other stats
videos1
7419878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21(hidden)
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
7418878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyes-0:01:26
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7418-773', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7418-773', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7418-773_evaluation" with the default driver
stderr | Creating job7418-773_scorer_1 ...
stderr | 
Creating job7418-773_scorer_1 ... error

stderr | ERROR: for job7418-773_scorer_1  Cannot start service scorer: network job7418-773_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7418-773_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
7417878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:38(hidden)
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
7416878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:38(hidden)
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
7415878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:38(hidden)
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
7414878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:41(hidden)
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
7413878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyes-0:01:31
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7413-6664', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7413-6664', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7413-6664_evaluation" with the default driver
stderr | Creating job7413-6664_scorer_1 ...
stderr | 
Creating job7413-6664_scorer_1 ... error

stderr | ERROR: for job7413-6664_scorer_1  Cannot start service scorer: network job7413-6664_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7413-6664_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
7412878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno-0:05:11(hidden)
other stats
simulation-passed1
7411878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno-0:05:16(hidden)
other stats
simulation-passed1
7410878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno-0:01:54(hidden)
other stats
simulation-passed1