AI Driving Olympics Home Challenges Submissions Jobs

Submission 798

Submission798
Competingyes
Challengeaido1_LF1_r3-v3
UserCpPI
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11993 step2-scoring: 12000 step3-videos: 12002 step4-viz: 12006
Next
User labelRandom execution
Admin priority50
Blessing50
User priority

12006

Click the images to see detailed statistics about the episode.

12002

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12006798CpPIRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4703023706806073
deviation-center-line_median0.06989830778990293
in-drivable-lane_median0


other stats
deviation-center-line_max0.16060550091159348
deviation-center-line_mean0.0889109375681704
deviation-center-line_min0.051073590533058
deviation-heading_max0.7189595564358684
deviation-heading_mean0.37489958082345415
deviation-heading_median0.4283820363478741
deviation-heading_min0.12620206186322305
driven_any_max1.16322644559171
driven_any_mean0.7715049089936922
driven_any_median0.7807725540198728
driven_any_min0.3353739457760075
driven_lanedir_max1.118421865191824
driven_lanedir_mean0.536916758694839
driven_lanedir_min0.04774253889636837
in-drivable-lane_max2.1333333333333355
in-drivable-lane_mean0.43333333333333374
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.104317037923746, "driven_lanedir": 0.04774253889636837, "in-drivable-lane": 2.1333333333333355, "deviation-heading": 0.7189595564358684, "deviation-center-line": 0.051073590533058}, "ep001": {"driven_any": 0.3353739457760075, "driven_lanedir": 0.32980637265972623, "in-drivable-lane": 0, "deviation-heading": 0.14503020224491547, "deviation-center-line": 0.06989830778990293}, "ep002": {"driven_any": 0.7807725540198728, "driven_lanedir": 0.7183106460456692, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.4283820363478741, "deviation-center-line": 0.061915626643968213}, "ep003": {"driven_any": 0.4738345616571246, "driven_lanedir": 0.4703023706806073, "in-drivable-lane": 0, "deviation-heading": 0.12620206186322305, "deviation-center-line": 0.1010616619623294}, "ep004": {"driven_any": 1.16322644559171, "driven_lanedir": 1.118421865191824, "in-drivable-lane": 0, "deviation-heading": 0.4559240472253898, "deviation-center-line": 0.16060550091159348}}
12002798CpPIRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
12000798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -13.322318376421377, "good_angle": 1.4198928824648014, "survival_time": 2.7, "traveled_tiles": 2, "valid_direction": 0.9999999999999982}, "ep001": {"nsteps": 26, "reward": -38.11213367569368, "good_angle": 0.030332013141684395, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 58, "reward": -16.955989942468445, "good_angle": 0.4088313252605393, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 0.766666666666669}, "ep003": {"nsteps": 36, "reward": -27.430401153448557, "good_angle": 0.01970714901929458, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 86, "reward": -11.35537640232766, "good_angle": 0.2875737622166194, "survival_time": 2.8666666666666663, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}}
good_angle_max1.4198928824648014
good_angle_mean0.43326742642058785
good_angle_median0.2875737622166194
good_angle_min0.01970714901929458
reward_max-11.35537640232766
reward_mean-21.435243910071943
reward_median-16.955989942468445
reward_min-38.11213367569368
survival_time_max2.8666666666666663
survival_time_mean1.913333333333334
survival_time_min0.8666666666666666
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.9999999999999982
valid_direction_mean0.4666666666666665
valid_direction_median0.5666666666666647
valid_direction_min0
11993798CpPIRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6797798CpPIRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:05:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9654873254053034
deviation-center-line_median0.41289189532906545
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.6135569189582012
deviation-center-line_mean0.4056492664483418
deviation-center-line_min0.2061794883302597
deviation-heading_max2.90974275700166
deviation-heading_mean1.315832326018135
deviation-heading_median0.9626486735309404
deviation-heading_min0.16870163130240173
driven_any_max1.596777574949506
driven_any_mean0.9233582566609092
driven_any_median0.9686290551073296
driven_any_min0.35859851566372447
driven_lanedir_max1.260193031629722
driven_lanedir_mean0.8021399053746914
driven_lanedir_min0.13956835691080005
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.3533333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35859851566372447, "driven_lanedir": 0.13956835691080005, "in-drivable-lane": 0.6, "deviation-heading": 2.077502532796642, "deviation-center-line": 0.2061794883302597}, "ep001": {"driven_any": 0.5134500013124798, "driven_lanedir": 0.5127504927612125, "in-drivable-lane": 0, "deviation-heading": 0.16870163130240173, "deviation-center-line": 0.41289189532906545}, "ep002": {"driven_any": 1.1793361362715051, "driven_lanedir": 1.1327003201664188, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.9626486735309404, "deviation-center-line": 0.6135569189582012}, "ep003": {"driven_any": 0.9686290551073296, "driven_lanedir": 0.9654873254053034, "in-drivable-lane": 0, "deviation-heading": 0.4605660354590315, "deviation-center-line": 0.4281874376946226}, "ep004": {"driven_any": 1.596777574949506, "driven_lanedir": 1.260193031629722, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 2.90974275700166, "deviation-center-line": 0.36743059192956007}}
6565798CpPIRandom executionaido1_LF1_r3-v3step4-vizabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission798/step4-viz-nutonomy-P50-2110-job6565'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6439798CpPIRandom executionaido1_LF1_r3-v3step4-vizabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission798/step4-viz-nutonomy-P50-2110-job6439'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6327798CpPIRandom executionaido1_LF1_r3-v3step4-vizsuccessno-0:02:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9654873254053034
deviation-center-line_median0.41289189532906545
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.6135569189582012
deviation-center-line_mean0.4056492664483418
deviation-center-line_min0.2061794883302597
deviation-heading_max2.90974275700166
deviation-heading_mean1.315832326018135
deviation-heading_median0.9626486735309404
deviation-heading_min0.16870163130240173
driven_any_max1.596777574949506
driven_any_mean0.9233582566609092
driven_any_median0.9686290551073296
driven_any_min0.35859851566372447
driven_lanedir_max1.260193031629722
driven_lanedir_mean0.8021399053746914
driven_lanedir_min0.13956835691080005
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.3533333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35859851566372447, "driven_lanedir": 0.13956835691080005, "in-drivable-lane": 0.6, "deviation-heading": 2.077502532796642, "deviation-center-line": 0.2061794883302597}, "ep001": {"driven_any": 0.5134500013124798, "driven_lanedir": 0.5127504927612125, "in-drivable-lane": 0, "deviation-heading": 0.16870163130240173, "deviation-center-line": 0.41289189532906545}, "ep002": {"driven_any": 1.1793361362715051, "driven_lanedir": 1.1327003201664188, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.9626486735309404, "deviation-center-line": 0.6135569189582012}, "ep003": {"driven_any": 0.9686290551073296, "driven_lanedir": 0.9654873254053034, "in-drivable-lane": 0, "deviation-heading": 0.4605660354590315, "deviation-center-line": 0.4281874376946226}, "ep004": {"driven_any": 1.596777574949506, "driven_lanedir": 1.260193031629722, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 2.90974275700166, "deviation-center-line": 0.36743059192956007}}
6322798CpPIRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6321798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.966666666666652


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.923029431277484, "good_angle": 1.3158804276306024, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 111, "reward": -9.596115778963846, "good_angle": 0.009812665592739704, "survival_time": 3.6999999999999966, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.519026840317483, "good_angle": 0.9939452414914156, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.199999999999993}, "ep003": {"nsteps": 209, "reward": -5.066346031876557, "good_angle": 0.04524398387971608, "survival_time": 6.966666666666652, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 343, "reward": -3.5039374469770945, "good_angle": 18.831470875777747, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max18.831470875777747
good_angle_mean4.239270638874444
good_angle_median0.9939452414914156
good_angle_min0.009812665592739704
reward_max-3.5039374469770945
reward_mean-7.121691105882493
reward_median-5.066346031876557
reward_min-12.923029431277484
survival_time_max11.433333333333303
survival_time_mean6.646666666666652
survival_time_min2.6333333333333337
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean1.6533333333333295
valid_direction_median2.166666666666667
valid_direction_min0
6313798CpPIRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5921798CpPIRandom executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5920798CpPIRandom executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5919798CpPIRandom executionaido1_LF1_r3-v3step3-videossuccessno-0:02:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5918798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999979


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max27.571145449058
good_angle_mean16.355745883456553
good_angle_median24.218758506416364
good_angle_min0.1268074882377727
reward_max-3.039140198254471
reward_mean-5.362412869085995
reward_median-5.542087158836701
reward_min-7.729742120232499
survival_time_max12.7333333333333
survival_time_mean9.459999999999976
survival_time_min5.6999999999999895
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.066666666666652
valid_direction_mean2.9866666666666566
valid_direction_median3.93333333333332
valid_direction_min0
5917798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999979


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max27.571145449058
good_angle_mean16.355745883456553
good_angle_median24.218758506416364
good_angle_min0.1268074882377727
reward_max-3.039140198254471
reward_mean-5.362412869085995
reward_median-5.542087158836701
reward_min-7.729742120232499
survival_time_max12.7333333333333
survival_time_mean9.459999999999976
survival_time_min5.6999999999999895
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.066666666666652
valid_direction_mean2.9866666666666566
valid_direction_median3.93333333333332
valid_direction_min0
5916798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999979


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max27.571145449058
good_angle_mean16.355745883456553
good_angle_median24.218758506416364
good_angle_min0.1268074882377727
reward_max-3.039140198254471
reward_mean-5.362412869085995
reward_median-5.542087158836701
reward_min-7.729742120232499
survival_time_max12.7333333333333
survival_time_mean9.459999999999976
survival_time_min5.6999999999999895
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.066666666666652
valid_direction_mean2.9866666666666566
valid_direction_median3.93333333333332
valid_direction_min0
5915798CpPIRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999979


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max27.571145449058
good_angle_mean16.355745883456553
good_angle_median24.218758506416364
good_angle_min0.1268074882377727
reward_max-3.039140198254471
reward_mean-5.362412869085995
reward_median-5.542087158836701
reward_min-7.729742120232499
survival_time_max12.7333333333333
survival_time_mean9.459999999999976
survival_time_min5.6999999999999895
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.066666666666652
valid_direction_mean2.9866666666666566
valid_direction_median3.93333333333332
valid_direction_min0
5914798CpPIRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1