AI Driving Olympics Home Challenges Submissions Jobs

Submission 781

Submission781
Competingyes
Challengeaido1_LF1_r3-v3
Useramuni
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11798 step2-scoring: 11802 step3-videos: 11807 step4-viz: 11812
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
Blessing50
User priority

11812

Click the images to see detailed statistics about the episode.

11807

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11812781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.33309559522709353
deviation-center-line_median0.07417965972590783
in-drivable-lane_median0.16666666666666718


other stats
deviation-center-line_max0.1917488363492015
deviation-center-line_mean0.07575952008311362
deviation-center-line_min0
deviation-heading_max0.8960655303827447
deviation-heading_mean0.36735394614772143
deviation-heading_median0.3689437957598077
deviation-heading_min0
driven_any_max1.1671339393013722
driven_any_mean0.6472240643528748
driven_any_median0.6837562046751159
driven_any_min0.2619835475757828
driven_lanedir_max0.9426844085431824
driven_lanedir_mean0.43743447053110673
driven_lanedir_min0
in-drivable-lane_max0.966666666666669
in-drivable-lane_mean0.3533333333333339
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.2780519772471777, "driven_lanedir": 0, "in-drivable-lane": 0.6333333333333333, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.2619835475757828, "driven_lanedir": 0.2506700898091503, "in-drivable-lane": 0, "deviation-heading": 0.13076158168656138, "deviation-center-line": 0.03833659955845817}, "ep002": {"driven_any": 0.8451946529649257, "driven_lanedir": 0.33309559522709353, "in-drivable-lane": 0.966666666666669, "deviation-heading": 0.4409988229094936, "deviation-center-line": 0.0745325047820006}, "ep003": {"driven_any": 0.6837562046751159, "driven_lanedir": 0.6607222590761073, "in-drivable-lane": 0, "deviation-heading": 0.3689437957598077, "deviation-center-line": 0.07417965972590783}, "ep004": {"driven_any": 1.1671339393013722, "driven_lanedir": 0.9426844085431824, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.8960655303827447, "deviation-center-line": 0.1917488363492015}}
11807781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
11802781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.5333333333333348


other stats
episodes
details{"ep000": {"nsteps": 20, "reward": -51.837019389867784, "good_angle": 0.2609639857522934, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5999999999999999}, "ep001": {"nsteps": 17, "reward": -58.44422381458914, "good_angle": 0.05317625877336557, "survival_time": 0.5666666666666667, "traveled_tiles": 2, "valid_direction": 0.23333333333333336}, "ep002": {"nsteps": 56, "reward": -17.688429258397914, "good_angle": 1.129642023838684, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 1.3666666666666687}, "ep003": {"nsteps": 46, "reward": -21.15205667777311, "good_angle": 0.1262859667507404, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.33333333333333426}, "ep004": {"nsteps": 75, "reward": -12.778340691526733, "good_angle": 0.5722502176050555, "survival_time": 2.500000000000001, "traveled_tiles": 3, "valid_direction": 0.7333333333333321}}
good_angle_max1.129642023838684
good_angle_mean0.4284636905440277
good_angle_median0.2609639857522934
good_angle_min0.05317625877336557
reward_max-12.778340691526733
reward_mean-32.38001396643094
reward_median-21.15205667777311
reward_min-58.44422381458914
survival_time_max2.500000000000001
survival_time_mean1.4266666666666676
survival_time_min0.5666666666666667
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.3666666666666687
valid_direction_mean0.6533333333333337
valid_direction_median0.5999999999999999
valid_direction_min0.23333333333333336
11798781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6850781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6563528361539146
deviation-center-line_median0.2953971598388384
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max0.6647032776516654
deviation-center-line_mean0.3725370031291633
deviation-center-line_min0.15844274308335793
deviation-heading_max3.5770000783727793
deviation-heading_mean2.0132571220501334
deviation-heading_median1.87793503883297
deviation-heading_min0.3275083836010684
driven_any_max1.6103720212868673
driven_any_mean0.9681277352122944
driven_any_median1.0935520511365866
driven_any_min0.3327271210224425
driven_lanedir_max1.2429579850638162
driven_lanedir_mean0.6158989768051985
driven_lanedir_min0.09515152751007494
in-drivable-lane_max4.999999999999983
in-drivable-lane_mean1.3599999999999957
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3327271210224425, "driven_lanedir": 0.09515152751007494, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.87793503883297, "deviation-center-line": 0.15844274308335793}, "ep001": {"driven_any": 1.0935520511365866, "driven_lanedir": 0.7563867063502803, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 3.5770000783727793, "deviation-center-line": 0.5476508542770249}, "ep002": {"driven_any": 0.3331003527683718, "driven_lanedir": 0.32864582894790617, "in-drivable-lane": 0, "deviation-heading": 0.3275083836010684, "deviation-center-line": 0.19649098079493005}, "ep003": {"driven_any": 1.4708871298472035, "driven_lanedir": 0.6563528361539146, "in-drivable-lane": 4.999999999999983, "deviation-heading": 1.0476944878622192, "deviation-center-line": 0.2953971598388384}, "ep004": {"driven_any": 1.6103720212868673, "driven_lanedir": 1.2429579850638162, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.2361476215816305, "deviation-center-line": 0.6647032776516654}}
6849781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6563528361539146
deviation-center-line_median0.2953971598388384
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max0.6647032776516654
deviation-center-line_mean0.3725370031291633
deviation-center-line_min0.15844274308335793
deviation-heading_max3.5770000783727793
deviation-heading_mean2.0132571220501334
deviation-heading_median1.87793503883297
deviation-heading_min0.3275083836010684
driven_any_max1.6103720212868673
driven_any_mean0.9681277352122944
driven_any_median1.0935520511365866
driven_any_min0.3327271210224425
driven_lanedir_max1.2429579850638162
driven_lanedir_mean0.6158989768051985
driven_lanedir_min0.09515152751007494
in-drivable-lane_max4.999999999999983
in-drivable-lane_mean1.3599999999999957
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3327271210224425, "driven_lanedir": 0.09515152751007494, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.87793503883297, "deviation-center-line": 0.15844274308335793}, "ep001": {"driven_any": 1.0935520511365866, "driven_lanedir": 0.7563867063502803, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 3.5770000783727793, "deviation-center-line": 0.5476508542770249}, "ep002": {"driven_any": 0.3331003527683718, "driven_lanedir": 0.32864582894790617, "in-drivable-lane": 0, "deviation-heading": 0.3275083836010684, "deviation-center-line": 0.19649098079493005}, "ep003": {"driven_any": 1.4708871298472035, "driven_lanedir": 0.6563528361539146, "in-drivable-lane": 4.999999999999983, "deviation-heading": 1.0476944878622192, "deviation-center-line": 0.2953971598388384}, "ep004": {"driven_any": 1.6103720212868673, "driven_lanedir": 1.2429579850638162, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.2361476215816305, "deviation-center-line": 0.6647032776516654}}
6844781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6842781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999985


other stats
episodes
details{"ep000": {"nsteps": 65, "reward": -15.678465802996204, "good_angle": 1.3310843843395357, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 1.7666666666666686}, "ep001": {"nsteps": 210, "reward": -5.957237409410022, "good_angle": 15.64719412897302, "survival_time": 6.999999999999985, "traveled_tiles": 2, "valid_direction": 3.6666666666666536}, "ep002": {"nsteps": 68, "reward": -15.146394089302596, "good_angle": 0.06255009894966714, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 282, "reward": -4.599610430261856, "good_angle": 0.9904623541935248, "survival_time": 9.399999999999975, "traveled_tiles": 3, "valid_direction": 4.03333333333332}, "ep004": {"nsteps": 298, "reward": -4.134139246388569, "good_angle": 13.23555278266835, "survival_time": 9.933333333333309, "traveled_tiles": 3, "valid_direction": 3.3333333333333224}}
good_angle_max15.64719412897302
good_angle_mean6.25336874982482
good_angle_median1.3310843843395357
good_angle_min0.06255009894966714
reward_max-4.134139246388569
reward_mean-9.10316939567185
reward_median-5.957237409410022
reward_min-15.678465802996204
survival_time_max9.933333333333309
survival_time_mean6.153333333333322
survival_time_min2.1666666666666687
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.03333333333332
valid_direction_mean2.559999999999993
valid_direction_median3.3333333333333224
valid_direction_min0
6839781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6838781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6578781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission781/step1-simulation-nutonomy-P50-2110-job6578'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6348781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission781/step1-simulation-nutonomy-P50-2570-job6348'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5846781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5845781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessno-0:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5844781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessno-0:04:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5842781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5841781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 144, "reward": -9.06813865651687, "good_angle": 20.52817005800521, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 3.3666666666666583}, "ep001": {"nsteps": 175, "reward": -7.296941792624337, "good_angle": 0.7101056477194247, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 2.299999999999992}, "ep002": {"nsteps": 475, "reward": -2.0803148428691354, "good_angle": 1.457937384196954, "survival_time": 15.833333333333288, "traveled_tiles": 5, "valid_direction": 1.86666666666666}, "ep003": {"nsteps": 231, "reward": -6.718039963152502, "good_angle": 24.418321537832004, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 3.533333333333321}, "ep004": {"nsteps": 123, "reward": -10.564881026260252, "good_angle": 0.2059180554482576, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.93333333333333}}
good_angle_max24.418321537832004
good_angle_mean9.464090536640368
good_angle_median1.457937384196954
good_angle_min0.2059180554482576
reward_max-2.0803148428691354
reward_mean-7.145663256284619
reward_median-7.296941792624337
reward_min-10.564881026260252
survival_time_max15.833333333333288
survival_time_mean7.6533333333333164
survival_time_min4.099999999999995
traveled_tiles_max5
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.533333333333321
valid_direction_mean2.3999999999999924
valid_direction_median2.299999999999992
valid_direction_min0.93333333333333
5840781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 144, "reward": -9.06813865651687, "good_angle": 20.52817005800521, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 3.3666666666666583}, "ep001": {"nsteps": 175, "reward": -7.296941792624337, "good_angle": 0.7101056477194247, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 2.299999999999992}, "ep002": {"nsteps": 475, "reward": -2.0803148428691354, "good_angle": 1.457937384196954, "survival_time": 15.833333333333288, "traveled_tiles": 5, "valid_direction": 1.86666666666666}, "ep003": {"nsteps": 231, "reward": -6.718039963152502, "good_angle": 24.418321537832004, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 3.533333333333321}, "ep004": {"nsteps": 123, "reward": -10.564881026260252, "good_angle": 0.2059180554482576, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.93333333333333}}
good_angle_max24.418321537832004
good_angle_mean9.464090536640368
good_angle_median1.457937384196954
good_angle_min0.2059180554482576
reward_max-2.0803148428691354
reward_mean-7.145663256284619
reward_median-7.296941792624337
reward_min-10.564881026260252
survival_time_max15.833333333333288
survival_time_mean7.6533333333333164
survival_time_min4.099999999999995
traveled_tiles_max5
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.533333333333321
valid_direction_mean2.3999999999999924
valid_direction_median2.299999999999992
valid_direction_min0.93333333333333
5839781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 144, "reward": -9.06813865651687, "good_angle": 20.52817005800521, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 3.3666666666666583}, "ep001": {"nsteps": 175, "reward": -7.296941792624337, "good_angle": 0.7101056477194247, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 2.299999999999992}, "ep002": {"nsteps": 475, "reward": -2.0803148428691354, "good_angle": 1.457937384196954, "survival_time": 15.833333333333288, "traveled_tiles": 5, "valid_direction": 1.86666666666666}, "ep003": {"nsteps": 231, "reward": -6.718039963152502, "good_angle": 24.418321537832004, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 3.533333333333321}, "ep004": {"nsteps": 123, "reward": -10.564881026260252, "good_angle": 0.2059180554482576, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.93333333333333}}
good_angle_max24.418321537832004
good_angle_mean9.464090536640368
good_angle_median1.457937384196954
good_angle_min0.2059180554482576
reward_max-2.0803148428691354
reward_mean-7.145663256284619
reward_median-7.296941792624337
reward_min-10.564881026260252
survival_time_max15.833333333333288
survival_time_mean7.6533333333333164
survival_time_min4.099999999999995
traveled_tiles_max5
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.533333333333321
valid_direction_mean2.3999999999999924
valid_direction_median2.299999999999992
valid_direction_min0.93333333333333
5833781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1