AI Driving Olympics Home Challenges Submissions Jobs

Submission 708

Submission708
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11673 step2-scoring: 11675 step3-videos: 11676 step4-viz: 11677
Next
User labelJP pipeline
Admin priority63
Blessing63
User priority

11677

Click the images to see detailed statistics about the episode.

11676

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11677708JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:03:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.649988991193347
deviation-center-line_median0.25885925674725396
in-drivable-lane_median0.6


other stats
deviation-center-line_max1.175794641886225
deviation-center-line_mean0.5230699865225239
deviation-center-line_min0
deviation-heading_max2.489380928085302
deviation-heading_mean1.178186429740027
deviation-heading_median0.7754795488782122
deviation-heading_min0
driven_any_max18.921651398145855
driven_any_mean8.63105437776872
driven_any_median4.040599427269344
driven_any_min0.6217772310150077
driven_lanedir_max16.12492677856342
driven_lanedir_mean7.435370408745679
driven_lanedir_min0
in-drivable-lane_max1.9999999999999931
in-drivable-lane_mean0.8266666666666644
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 0.6217772310150077, "driven_lanedir": 0, "in-drivable-lane": 0.6, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 16.279061300915988, "driven_lanedir": 14.258794058475912, "in-drivable-lane": 1.2999999999999965, "deviation-heading": 2.2930639287703705, "deviation-center-line": 0.9911332338990656}, "ep002": {"driven_any": 3.2921825314974056, "driven_lanedir": 3.1431422154957183, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.33300774296625085, "deviation-center-line": 0.18956280008007445}, "ep003": {"driven_any": 18.921651398145855, "driven_lanedir": 16.12492677856342, "in-drivable-lane": 1.9999999999999931, "deviation-heading": 2.489380928085302, "deviation-center-line": 1.175794641886225}, "ep004": {"driven_any": 4.040599427269344, "driven_lanedir": 3.649988991193347, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 0.7754795488782122, "deviation-center-line": 0.25885925674725396}}
11676708JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
11675708JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 19, "reward": -54.16429551965312, "good_angle": 0.11800398015075755, "survival_time": 0.6333333333333333, "traveled_tiles": 3, "valid_direction": 0.23333333333333336}, "ep001": {"nsteps": 428, "reward": -1.7122301900689707, "good_angle": 0.6424104013051718, "survival_time": 14.266666666666628, "traveled_tiles": 18, "valid_direction": 1.699999999999996}, "ep002": {"nsteps": 87, "reward": -10.858472139178508, "good_angle": 0.04742749797514355, "survival_time": 2.8999999999999995, "traveled_tiles": 6, "valid_direction": 0.06666666666666671}, "ep003": {"nsteps": 500, "reward": 0.5446357050433289, "good_angle": 0.9721534581785936, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4999999999999916}, "ep004": {"nsteps": 110, "reward": -8.4004887890621, "good_angle": 0.21131172421336805, "survival_time": 3.6666666666666634, "traveled_tiles": 8, "valid_direction": 0.5666666666666672}}
good_angle_max0.9721534581785936
good_angle_mean0.3982614123646069
good_angle_median0.21131172421336805
good_angle_min0.04742749797514355
reward_max0.5446357050433289
reward_mean-14.91817018658387
reward_median-8.4004887890621
reward_min-54.16429551965312
survival_time_max16.666666666666654
survival_time_mean7.626666666666655
survival_time_min0.6333333333333333
traveled_tiles_max18
traveled_tiles_mean10.6
traveled_tiles_median8
traveled_tiles_min3
valid_direction_max2.4999999999999916
valid_direction_mean1.013333333333331
valid_direction_median0.5666666666666672
valid_direction_min0.06666666666666671
11673708JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes-0:06:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7085708JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:03:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.951199566048288
deviation-center-line_median1.0894585203856173
in-drivable-lane_median2.166666666666659


other stats
deviation-center-line_max1.1758201897522276
deviation-center-line_mean0.7441698510511787
deviation-center-line_min0.11728302102959842
deviation-heading_max2.722069331262558
deviation-heading_mean1.5935172104060755
deviation-heading_median2.2724266992306936
deviation-heading_min0.06145004089386224
driven_any_max6.35685444100951
driven_any_mean4.077004970027146
driven_any_median6.298493252647102
driven_any_min0.37766101434568056
driven_lanedir_max5.333388927436764
driven_lanedir_mean3.358545139662863
driven_lanedir_min0.3766482521395565
in-drivable-lane_max3.266666666666657
in-drivable-lane_mean1.6733333333333278
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.298493252647102, "driven_lanedir": 4.951199566048288, "in-drivable-lane": 3.266666666666657, "deviation-heading": 2.722069331262558, "deviation-center-line": 1.0894585203856173}, "ep001": {"driven_any": 0.37766101434568056, "driven_lanedir": 0.3766482521395565, "in-drivable-lane": 0, "deviation-heading": 0.06145004089386224, "deviation-center-line": 0.11728302102959842}, "ep002": {"driven_any": 6.328164883343014, "driven_lanedir": 5.333388927436764, "in-drivable-lane": 2.166666666666659, "deviation-heading": 2.612073961245019, "deviation-center-line": 1.1758201897522276}, "ep003": {"driven_any": 6.35685444100951, "driven_lanedir": 5.1247220476482855, "in-drivable-lane": 2.933333333333323, "deviation-heading": 2.2724266992306936, "deviation-center-line": 1.150690064596101}, "ep004": {"driven_any": 1.0238512587904254, "driven_lanedir": 1.006766905041418, "in-drivable-lane": 0, "deviation-heading": 0.2995660193982453, "deviation-center-line": 0.1875974594923498}}
7077708JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7075708JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.1307723607895896, "good_angle": 1.063664835828663, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.5999999999999908}, "ep001": {"nsteps": 32, "reward": -31.829736437648535, "good_angle": 0.00551830494081773, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.17794758645206457, "good_angle": 1.032617828300907, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.7666666666666573}, "ep003": {"nsteps": 500, "reward": -0.17718939224781935, "good_angle": 1.1539966198762297, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.3333333333333215}, "ep004": {"nsteps": 82, "reward": -12.528270207163764, "good_angle": 0.1381696419437306, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 0.33333333333333215}}
good_angle_max1.1539966198762297
good_angle_mean0.6787934461780696
good_angle_median1.032617828300907
good_angle_min0.00551830494081773
reward_max-0.1307723607895896
reward_mean-8.968783196860354
reward_median-0.17794758645206457
reward_min-31.829736437648535
survival_time_max16.666666666666654
survival_time_mean10.759999999999994
survival_time_min1.0666666666666669
traveled_tiles_max12
traveled_tiles_mean7.8
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.3333333333333215
valid_direction_mean1.80666666666666
valid_direction_median2.5999999999999908
valid_direction_min0
7059708JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:04:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6654708JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission708/step1-simulation-nutonomy-P50-2570-job6654'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6449708JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission708/step1-simulation-nutonomy-P50-2110-job6449'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6448708JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission708/step1-simulation-nutonomy-P50-2210-job6448'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5481708JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5480708JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5479708JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.933333333333309


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.7767751636505127, "good_angle": 50.854512115381254, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 6.20000000000002}, "ep001": {"nsteps": 104, "reward": -9.9869894286743, "good_angle": 1.4741682590518028, "survival_time": 3.466666666666664, "traveled_tiles": 3, "valid_direction": 0.8999999999999968}, "ep002": {"nsteps": 500, "reward": -0.4454572081409861, "good_angle": 1.8392847063280993, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.466666666666651}, "ep003": {"nsteps": 298, "reward": -5.310037099675045, "good_angle": 30.541267599331825, "survival_time": 9.933333333333309, "traveled_tiles": 8, "valid_direction": 3.9333333333333225}, "ep004": {"nsteps": 63, "reward": -18.33765479496547, "good_angle": 0.25978028756452276, "survival_time": 2.1000000000000023, "traveled_tiles": 3, "valid_direction": 0.5000000000000007}}
good_angle_max50.854512115381254
good_angle_mean16.993802593531502
good_angle_median1.8392847063280993
good_angle_min0.25978028756452276
reward_max-0.4454572081409861
reward_mean-7.171382739021263
reward_median-5.310037099675045
reward_min-18.33765479496547
survival_time_max16.666666666666654
survival_time_mean9.766666666666657
survival_time_min2.1000000000000023
traveled_tiles_max13
traveled_tiles_mean7.8
traveled_tiles_median8
traveled_tiles_min3
valid_direction_max6.20000000000002
valid_direction_mean3.199999999999998
valid_direction_median3.9333333333333225
valid_direction_min0.5000000000000007
5478708JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.933333333333309


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.7767751636505127, "good_angle": 50.854512115381254, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 6.20000000000002}, "ep001": {"nsteps": 104, "reward": -9.9869894286743, "good_angle": 1.4741682590518028, "survival_time": 3.466666666666664, "traveled_tiles": 3, "valid_direction": 0.8999999999999968}, "ep002": {"nsteps": 500, "reward": -0.4454572081409861, "good_angle": 1.8392847063280993, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.466666666666651}, "ep003": {"nsteps": 298, "reward": -5.310037099675045, "good_angle": 30.541267599331825, "survival_time": 9.933333333333309, "traveled_tiles": 8, "valid_direction": 3.9333333333333225}, "ep004": {"nsteps": 63, "reward": -18.33765479496547, "good_angle": 0.25978028756452276, "survival_time": 2.1000000000000023, "traveled_tiles": 3, "valid_direction": 0.5000000000000007}}
good_angle_max50.854512115381254
good_angle_mean16.993802593531502
good_angle_median1.8392847063280993
good_angle_min0.25978028756452276
reward_max-0.4454572081409861
reward_mean-7.171382739021263
reward_median-5.310037099675045
reward_min-18.33765479496547
survival_time_max16.666666666666654
survival_time_mean9.766666666666657
survival_time_min2.1000000000000023
traveled_tiles_max13
traveled_tiles_mean7.8
traveled_tiles_median8
traveled_tiles_min3
valid_direction_max6.20000000000002
valid_direction_mean3.199999999999998
valid_direction_median3.9333333333333225
valid_direction_min0.5000000000000007
5477708JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:04:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1