AI Driving Olympics Home Challenges Submissions Jobs

Submission 721

Submission721
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13724 step2-scoring: 13734 step3-videos: 13737 step4-viz: 13743
Next
User labelMy modified ROS-based Lane Following
Admin priority50
Blessing50
User priority

13743

Click the images to see detailed statistics about the episode.

13737

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13743721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.416850587850048
deviation-center-line_median0.12363831551549798
in-drivable-lane_median0


other stats
deviation-center-line_max0.14755162672461591
deviation-center-line_mean0.108290654424995
deviation-center-line_min0.05856940306194948
deviation-heading_max0.6359708224001126
deviation-heading_mean0.3796824473495947
deviation-heading_median0.3240248060376518
deviation-heading_min0.043767648089746966
driven_any_max1.8026439130307697
driven_any_mean1.424444089502617
driven_any_median1.494119767234939
driven_any_min0.760000000000006
driven_lanedir_max1.663688415878798
driven_lanedir_mean1.3295760686059468
driven_lanedir_min0.7583624342945385
in-drivable-lane_max0.3333333333333333
in-drivable-lane_mean0.06666666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.8026439130307697, "driven_lanedir": 1.4960315576497871, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.6359708224001126, "deviation-center-line": 0.14755162672461591}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 1.3599289064879432, "driven_lanedir": 1.3129473473565625, "in-drivable-lane": 0, "deviation-heading": 0.3012492573994738, "deviation-center-line": 0.08283522294022015}, "ep003": {"driven_any": 1.705527860759427, "driven_lanedir": 1.663688415878798, "in-drivable-lane": 0, "deviation-heading": 0.3240248060376518, "deviation-center-line": 0.12885870388269144}, "ep004": {"driven_any": 1.494119767234939, "driven_lanedir": 1.416850587850048, "in-drivable-lane": 0, "deviation-heading": 0.5933997028209885, "deviation-center-line": 0.12363831551549798}}
13737721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13734721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.415154420528305, "good_angle": 0.3147043198739996, "survival_time": 2.4333333333333345, "traveled_tiles": 3, "valid_direction": 0.7000000000000006}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -20.81093230098486, "good_angle": 0.05133578734780305, "survival_time": 1.5666666666666682, "traveled_tiles": 3, "valid_direction": 0.09999999999999998}, "ep003": {"nsteps": 58, "reward": -16.97874402054681, "good_angle": 0.1079669872452238, "survival_time": 1.933333333333336, "traveled_tiles": 3, "valid_direction": 0.3000000000000005}, "ep004": {"nsteps": 59, "reward": -16.696578025439027, "good_angle": 0.5824379166124307, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.5333333333333344}}
good_angle_max0.5824379166124307
good_angle_mean0.21189327209342596
good_angle_median0.1079669872452238
good_angle_min0.0030213493876724944
reward_max-13.415154420528305
reward_mean-23.03618582431993
reward_median-16.97874402054681
reward_min-47.27952035410063
survival_time_max2.4333333333333345
survival_time_mean1.7200000000000015
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max0.7000000000000006
valid_direction_mean0.3266666666666671
valid_direction_median0.3000000000000005
valid_direction_min0
13733721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.415154420528305, "good_angle": 0.3147043198739996, "survival_time": 2.4333333333333345, "traveled_tiles": 3, "valid_direction": 0.7000000000000006}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -20.81093230098486, "good_angle": 0.05133578734780305, "survival_time": 1.5666666666666682, "traveled_tiles": 3, "valid_direction": 0.09999999999999998}, "ep003": {"nsteps": 58, "reward": -16.97874402054681, "good_angle": 0.1079669872452238, "survival_time": 1.933333333333336, "traveled_tiles": 3, "valid_direction": 0.3000000000000005}, "ep004": {"nsteps": 59, "reward": -16.696578025439027, "good_angle": 0.5824379166124307, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.5333333333333344}}
good_angle_max0.5824379166124307
good_angle_mean0.21189327209342596
good_angle_median0.1079669872452238
good_angle_min0.0030213493876724944
reward_max-13.415154420528305
reward_mean-23.03618582431993
reward_median-16.97874402054681
reward_min-47.27952035410063
survival_time_max2.4333333333333345
survival_time_mean1.7200000000000015
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max0.7000000000000006
valid_direction_mean0.3266666666666671
valid_direction_median0.3000000000000005
valid_direction_min0
13724721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:04:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7027721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.27166145187899216
deviation-center-line_median0.06982684751280697
in-drivable-lane_median0


other stats
deviation-center-line_max0.09121055353973138
deviation-center-line_mean0.07130333073964615
deviation-center-line_min0.05456890085637663
deviation-heading_max0.944685763458342
deviation-heading_mean0.3834970165266852
deviation-heading_median0.3264354941499832
deviation-heading_min0.05021748795992387
driven_any_max0.5284609511802155
driven_any_mean0.33849801886083447
driven_any_median0.28137456043563647
driven_any_min0.18279801253754996
driven_lanedir_max0.48202969322924094
driven_lanedir_mean0.276481825484506
driven_lanedir_min0.1543739659564478
in-drivable-lane_max0.6666666666666666
in-drivable-lane_mean0.13333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5284609511802155, "driven_lanedir": 0.27166145187899216, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.944685763458342, "deviation-center-line": 0.08501350579060386}, "ep001": {"driven_any": 0.28137456043563647, "driven_lanedir": 0.27965589558635484, "in-drivable-lane": 0, "deviation-heading": 0.05021748795992387, "deviation-center-line": 0.05589684599871194}, "ep002": {"driven_any": 0.4856321857248615, "driven_lanedir": 0.48202969322924094, "in-drivable-lane": 0, "deviation-heading": 0.1001570248122372, "deviation-center-line": 0.09121055353973138}, "ep003": {"driven_any": 0.18279801253754996, "driven_lanedir": 0.1543739659564478, "in-drivable-lane": 0, "deviation-heading": 0.49598931225293985, "deviation-center-line": 0.05456890085637663}, "ep004": {"driven_any": 0.21422438442590885, "driven_lanedir": 0.19468812077149433, "in-drivable-lane": 0, "deviation-heading": 0.3264354941499832, "deviation-center-line": 0.06982684751280697}}
7024721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7021721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8999999999999999


other stats
episodes
details{"ep000": {"nsteps": 70, "reward": -14.459956789069942, "good_angle": 0.7379630217116221, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.3000000000000005}, "ep001": {"nsteps": 16, "reward": -63.05317232757807, "good_angle": 0.006916687727668338, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 29, "reward": -34.96981922614163, "good_angle": 0.015756994520687698, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 27, "reward": -37.39793286389775, "good_angle": 0.4596092159046318, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.6333333333333333}, "ep004": {"nsteps": 25, "reward": -40.46419783353806, "good_angle": 0.2232183073046352, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max0.7379630217116221
good_angle_mean0.288692845433849
good_angle_median0.2232183073046352
good_angle_min0.006916687727668338
reward_max-14.459956789069942
reward_mean-38.06901580804509
reward_median-37.39793286389775
reward_min-63.05317232757807
survival_time_max2.333333333333335
survival_time_mean1.1133333333333335
survival_time_min0.5333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3000000000000005
valid_direction_mean0.4800000000000001
valid_direction_median0.4666666666666666
valid_direction_min0
6642721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission721/step2-scoring-nutonomy-P50-2570-job6642'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6459721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission721/step2-scoring-nutonomy-P50-2570-job6459'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6458721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission721/step2-scoring-nutonomy-P50-2110-job6458'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6410721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:01:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5547721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5546721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5543721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:02:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5542721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3583180518115114, "good_angle": 35.388577433801856, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.066666666666652}, "ep001": {"nsteps": 500, "reward": -0.32232150391326286, "good_angle": 27.701117487878584, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.33333333333335}, "ep002": {"nsteps": 500, "reward": -0.6438964181095361, "good_angle": 1.3346811401222445, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 2.5999999999999917}, "ep003": {"nsteps": 409, "reward": -2.8165878027633133, "good_angle": 23.786906038949652, "survival_time": 13.633333333333296, "traveled_tiles": 11, "valid_direction": 6.233333333333315}, "ep004": {"nsteps": 500, "reward": -0.7099452675133944, "good_angle": 1.1987815010916103, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 2.8333333333333277}}
good_angle_max35.388577433801856
good_angle_mean17.88201272036879
good_angle_median23.786906038949652
good_angle_min1.1987815010916103
reward_max-0.32232150391326286
reward_mean-0.9702138088222036
reward_median-0.6438964181095361
reward_min-2.8165878027633133
survival_time_max16.666666666666654
survival_time_mean16.05999999999998
survival_time_min13.633333333333296
traveled_tiles_max17
traveled_tiles_mean14
traveled_tiles_median13
traveled_tiles_min11
valid_direction_max6.233333333333315
valid_direction_mean4.613333333333327
valid_direction_median5.33333333333335
valid_direction_min2.5999999999999917
5541721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:02:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3583180518115114, "good_angle": 35.388577433801856, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.066666666666652}, "ep001": {"nsteps": 500, "reward": -0.32232150391326286, "good_angle": 27.701117487878584, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.33333333333335}, "ep002": {"nsteps": 500, "reward": -0.6438964181095361, "good_angle": 1.3346811401222445, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 2.5999999999999917}, "ep003": {"nsteps": 409, "reward": -2.8165878027633133, "good_angle": 23.786906038949652, "survival_time": 13.633333333333296, "traveled_tiles": 11, "valid_direction": 6.233333333333315}, "ep004": {"nsteps": 500, "reward": -0.7099452675133944, "good_angle": 1.1987815010916103, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 2.8333333333333277}}
good_angle_max35.388577433801856
good_angle_mean17.88201272036879
good_angle_median23.786906038949652
good_angle_min1.1987815010916103
reward_max-0.32232150391326286
reward_mean-0.9702138088222036
reward_median-0.6438964181095361
reward_min-2.8165878027633133
survival_time_max16.666666666666654
survival_time_mean16.05999999999998
survival_time_min13.633333333333296
traveled_tiles_max17
traveled_tiles_mean14
traveled_tiles_median13
traveled_tiles_min11
valid_direction_max6.233333333333315
valid_direction_mean4.613333333333327
valid_direction_median5.33333333333335
valid_direction_min2.5999999999999917
5540721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3583180518115114, "good_angle": 35.388577433801856, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.066666666666652}, "ep001": {"nsteps": 500, "reward": -0.32232150391326286, "good_angle": 27.701117487878584, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.33333333333335}, "ep002": {"nsteps": 500, "reward": -0.6438964181095361, "good_angle": 1.3346811401222445, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 2.5999999999999917}, "ep003": {"nsteps": 409, "reward": -2.8165878027633133, "good_angle": 23.786906038949652, "survival_time": 13.633333333333296, "traveled_tiles": 11, "valid_direction": 6.233333333333315}, "ep004": {"nsteps": 500, "reward": -0.7099452675133944, "good_angle": 1.1987815010916103, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 2.8333333333333277}}
good_angle_max35.388577433801856
good_angle_mean17.88201272036879
good_angle_median23.786906038949652
good_angle_min1.1987815010916103
reward_max-0.32232150391326286
reward_mean-0.9702138088222036
reward_median-0.6438964181095361
reward_min-2.8165878027633133
survival_time_max16.666666666666654
survival_time_mean16.05999999999998
survival_time_min13.633333333333296
traveled_tiles_max17
traveled_tiles_mean14
traveled_tiles_median13
traveled_tiles_min11
valid_direction_max6.233333333333315
valid_direction_mean4.613333333333327
valid_direction_median5.33333333333335
valid_direction_min2.5999999999999917
5535721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:07:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1