AI Driving Olympics Home Challenges Submissions Jobs

Submission 709

Submission709
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13587 step2-scoring: 13608 step3-videos: 13610 step4-viz: 13615
Next
User labelJP pipeline
Admin priority74
Blessing74
User priority

13615

Click the images to see detailed statistics about the episode.

13610

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13615709JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:05:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median15.188012674967652
deviation-center-line_median0.9873977066194278
in-drivable-lane_median3.099999999999989


other stats
deviation-center-line_max1.034629298733854
deviation-center-line_mean0.9754386007554764
deviation-center-line_min0.8981031065611349
deviation-heading_max2.3853268628651394
deviation-heading_mean2.233066432800677
deviation-heading_median2.2396969876721093
deviation-heading_min2.089373408559456
driven_any_max19.061687764503596
driven_any_mean18.968070409795036
driven_any_median18.96990808335345
driven_any_min18.838613531725183
driven_lanedir_max16.19277825872027
driven_lanedir_mean15.06133680572034
driven_lanedir_min13.277050153308757
in-drivable-lane_max4.766666666666666
in-drivable-lane_mean3.179999999999997
in-drivable-lane_min2.200000000000006
per-episodes
details{"ep000": {"driven_any": 18.838613531725183, "driven_lanedir": 13.277050153308757, "in-drivable-lane": 4.766666666666666, "deviation-heading": 2.1687473943856985, "deviation-center-line": 0.8981031065611349}, "ep001": {"driven_any": 19.061687764503596, "driven_lanedir": 15.771213246143402, "in-drivable-lane": 2.633333333333331, "deviation-heading": 2.282187510520981, "deviation-center-line": 0.9873977066194278}, "ep002": {"driven_any": 19.049089629336247, "driven_lanedir": 16.19277825872027, "in-drivable-lane": 2.200000000000006, "deviation-heading": 2.2396969876721093, "deviation-center-line": 0.9876552921755644}, "ep003": {"driven_any": 18.921053040056705, "driven_lanedir": 15.188012674967652, "in-drivable-lane": 3.099999999999989, "deviation-heading": 2.089373408559456, "deviation-center-line": 0.9694075996874004}, "ep004": {"driven_any": 18.96990808335345, "driven_lanedir": 14.87762969546162, "in-drivable-lane": 3.1999999999999913, "deviation-heading": 2.3853268628651394, "deviation-center-line": 1.034629298733854}}
13610709JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:03:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13608709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.3760608980022371, "good_angle": 1.3993681359402834, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.933333333333324}, "ep001": {"nsteps": 500, "reward": 0.5755687124319374, "good_angle": 1.087956023710125, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.733333333333334}, "ep002": {"nsteps": 500, "reward": 0.5731831927709281, "good_angle": 0.9565638553895884, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.1666666666666594}, "ep003": {"nsteps": 500, "reward": 0.482005890559405, "good_angle": 0.9054896641768444, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4666666666666583}, "ep004": {"nsteps": 500, "reward": 0.4805345337111503, "good_angle": 1.4048006677158351, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2999999999999936}}
good_angle_max1.4048006677158351
good_angle_mean1.1508356693865354
good_angle_median1.087956023710125
good_angle_min0.9054896641768444
reward_max0.5755687124319374
reward_mean0.4974706454951316
reward_median0.482005890559405
reward_min0.3760608980022371
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max3.2999999999999936
valid_direction_mean2.7199999999999935
valid_direction_median2.733333333333334
valid_direction_min2.1666666666666594
13587709JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes-0:10:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7084709JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:03:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.280330090117705
deviation-center-line_median0.8277406461082766
in-drivable-lane_median4.2666666666666515


other stats
deviation-center-line_max0.9234218283333382
deviation-center-line_mean0.6156942792197058
deviation-center-line_min0.146205314831042
deviation-heading_max2.750055474455623
deviation-heading_mean1.7771086722599088
deviation-heading_median2.5146386159075425
deviation-heading_min0.06275934716503707
driven_any_max6.3990590465774755
driven_any_mean5.1593723682899135
driven_any_median6.3156577146642725
driven_any_min0.4975324649295448
driven_lanedir_max4.7759959538156345
driven_lanedir_mean3.0877244685744554
driven_lanedir_min0.49692298640615307
in-drivable-lane_max12.833333333333323
in-drivable-lane_mean5.106666666666657
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.258763762671904, "driven_lanedir": 4.280330090117705, "in-drivable-lane": 4.866666666666653, "deviation-heading": 2.750055474455623, "deviation-center-line": 0.8835975104771246}, "ep001": {"driven_any": 0.4975324649295448, "driven_lanedir": 0.49692298640615307, "in-drivable-lane": 0, "deviation-heading": 0.06275934716503707, "deviation-center-line": 0.146205314831042}, "ep002": {"driven_any": 6.325848852606372, "driven_lanedir": 4.7759959538156345, "in-drivable-lane": 3.566666666666654, "deviation-heading": 2.6472172807883676, "deviation-center-line": 0.9234218283333382}, "ep003": {"driven_any": 6.3156577146642725, "driven_lanedir": 4.556617529936929, "in-drivable-lane": 4.2666666666666515, "deviation-heading": 2.5146386159075425, "deviation-center-line": 0.8277406461082766}, "ep004": {"driven_any": 6.3990590465774755, "driven_lanedir": 1.3287557825958558, "in-drivable-lane": 12.833333333333323, "deviation-heading": 0.9108726429829732, "deviation-center-line": 0.2975060963487476}}
7074709JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7071709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3662249705931754, "good_angle": 2.2361184668345566, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 5.199999999999982}, "ep001": {"nsteps": 41, "reward": -24.9506225404216, "good_angle": 0.003257666006859974, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.39198204246954993, "good_angle": 2.1100592083271015, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.933333333333318}, "ep003": {"nsteps": 500, "reward": -0.36458317884752617, "good_angle": 2.118889254776054, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.999999999999982}, "ep004": {"nsteps": 500, "reward": -1.8135781616568565, "good_angle": 24.949273793660616, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.4666666666666845}}
good_angle_max24.949273793660616
good_angle_mean6.283519677921038
good_angle_median2.118889254776054
good_angle_min0.003257666006859974
reward_max-0.36458317884752617
reward_mean-5.577398178797742
reward_median-0.39198204246954993
reward_min-24.9506225404216
survival_time_max16.666666666666654
survival_time_mean13.606666666666658
survival_time_min1.3666666666666676
traveled_tiles_max13
traveled_tiles_mean10
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max5.199999999999982
valid_direction_mean3.719999999999993
valid_direction_median4.933333333333318
valid_direction_min0
7052709JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:05:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6653709JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission709/step1-simulation-nutonomy-P50-2110-job6653'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6447709JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission709/step1-simulation-nutonomy-P50-2570-job6447'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5488709JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5487709JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5486709JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5485709JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5484709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.577728519514203, "good_angle": 48.26358421644558, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.633333333333341}, "ep001": {"nsteps": 500, "reward": -1.0854666557144377, "good_angle": 21.89444445470377, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.666666666666664}, "ep002": {"nsteps": 500, "reward": -0.3708411160647374, "good_angle": 2.230681428334207, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.233333333333315}, "ep003": {"nsteps": 500, "reward": -1.4293122868076895, "good_angle": 42.44376119691759, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 7.066666666666647}, "ep004": {"nsteps": 108, "reward": -11.174042657397136, "good_angle": 1.9677892234531176, "survival_time": 3.599999999999997, "traveled_tiles": 5, "valid_direction": 1.2999999999999954}}
good_angle_max48.26358421644558
good_angle_mean23.360052103970855
good_angle_median21.89444445470377
good_angle_min1.9677892234531176
reward_max-0.3708411160647374
reward_mean-3.1274782470996407
reward_median-1.4293122868076895
reward_min-11.174042657397136
survival_time_max16.666666666666654
survival_time_mean14.053333333333322
survival_time_min3.599999999999997
traveled_tiles_max13
traveled_tiles_mean11.4
traveled_tiles_median13
traveled_tiles_min5
valid_direction_max7.066666666666647
valid_direction_mean5.379999999999993
valid_direction_median6.633333333333341
valid_direction_min1.2999999999999954
5483709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.577728519514203, "good_angle": 48.26358421644558, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.633333333333341}, "ep001": {"nsteps": 500, "reward": -1.0854666557144377, "good_angle": 21.89444445470377, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.666666666666664}, "ep002": {"nsteps": 500, "reward": -0.3708411160647374, "good_angle": 2.230681428334207, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.233333333333315}, "ep003": {"nsteps": 500, "reward": -1.4293122868076895, "good_angle": 42.44376119691759, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 7.066666666666647}, "ep004": {"nsteps": 108, "reward": -11.174042657397136, "good_angle": 1.9677892234531176, "survival_time": 3.599999999999997, "traveled_tiles": 5, "valid_direction": 1.2999999999999954}}
good_angle_max48.26358421644558
good_angle_mean23.360052103970855
good_angle_median21.89444445470377
good_angle_min1.9677892234531176
reward_max-0.3708411160647374
reward_mean-3.1274782470996407
reward_median-1.4293122868076895
reward_min-11.174042657397136
survival_time_max16.666666666666654
survival_time_mean14.053333333333322
survival_time_min3.599999999999997
traveled_tiles_max13
traveled_tiles_mean11.4
traveled_tiles_median13
traveled_tiles_min5
valid_direction_max7.066666666666647
valid_direction_mean5.379999999999993
valid_direction_median6.633333333333341
valid_direction_min1.2999999999999954
5482709JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:05:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1