AI Driving Olympics Home Challenges Submissions Jobs

Submission 818

Submission818
Competingyes
Challengeaido1_LF1_r3-v3
Usergunshi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12148 step2-scoring: 12165 step3-videos: 12168 step4-viz: 12171
Next
User labelROS-based Lane Following
Admin priority50
Blessing50
User priority

12171

Click the images to see detailed statistics about the episode.

12168

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12171818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3083855982558559
deviation-center-line_median0.10805014213083708
in-drivable-lane_median0


other stats
deviation-center-line_max0.1253931262064992
deviation-center-line_mean0.08993164049723107
deviation-center-line_min0.02575017388270385
deviation-heading_max0.8219031647836553
deviation-heading_mean0.32794525685454246
deviation-heading_median0.23116968987580724
deviation-heading_min0.11637751695558604
driven_any_max0.5995277395742603
driven_any_mean0.3383756844876683
driven_any_median0.3212489493943731
driven_any_min0.09632193593653636
driven_lanedir_max0.3672981692325208
driven_lanedir_mean0.2720452957129906
driven_lanedir_min0.0590640233175046
in-drivable-lane_max0.5666666666666667
in-drivable-lane_mean0.11333333333333331
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5995277395742603, "driven_lanedir": 0.32846359640721245, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.8219031647836553, "deviation-center-line": 0.1253931262064992}, "ep001": {"driven_any": 0.3212489493943731, "driven_lanedir": 0.3083855982558559, "in-drivable-lane": 0, "deviation-heading": 0.23116968987580724, "deviation-center-line": 0.07937594066447065}, "ep002": {"driven_any": 0.09632193593653636, "driven_lanedir": 0.0590640233175046, "in-drivable-lane": 0, "deviation-heading": 0.2774487130670167, "deviation-center-line": 0.02575017388270385}, "ep003": {"driven_any": 0.37489834751954626, "driven_lanedir": 0.3672981692325208, "in-drivable-lane": 0, "deviation-heading": 0.1928271995906471, "deviation-center-line": 0.1110888196016446}, "ep004": {"driven_any": 0.29988145001362554, "driven_lanedir": 0.2970150913518592, "in-drivable-lane": 0, "deviation-heading": 0.11637751695558604, "deviation-center-line": 0.10805014213083708}}
12168818gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
12165818gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.0666666666666669


other stats
episodes
details{"ep000": {"nsteps": 58, "reward": -17.197546308667494, "good_angle": 1.1182921911063572, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.600000000000002}, "ep001": {"nsteps": 32, "reward": -30.889099814230576, "good_angle": 0.12943177989907056, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.20000000000000007}, "ep002": {"nsteps": 11, "reward": -90.93398553302342, "good_angle": 0.3153497778408451, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.3333333333333333}, "ep003": {"nsteps": 37, "reward": -26.73538103951393, "good_angle": 0.10270639275678148, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0.16666666666666718}, "ep004": {"nsteps": 30, "reward": -33.140036127964656, "good_angle": 0.020222921024106243, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.03333333333333333}}
good_angle_max1.1182921911063572
good_angle_mean0.33720061252543215
good_angle_median0.12943177989907056
good_angle_min0.020222921024106243
reward_max-17.197546308667494
reward_mean-39.77920976468001
reward_median-30.889099814230576
reward_min-90.93398553302342
survival_time_max1.933333333333336
survival_time_mean1.1200000000000006
survival_time_min0.36666666666666664
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.600000000000002
valid_direction_mean0.4666666666666671
valid_direction_median0.20000000000000007
valid_direction_min0.03333333333333333
12148818gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6775818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23121960360611823
deviation-center-line_median0.1998053111237546
in-drivable-lane_median0


other stats
deviation-center-line_max0.35396938863433036
deviation-center-line_mean0.2396109503483846
deviation-center-line_min0.12236485836105336
deviation-heading_max1.7316807421662197
deviation-heading_mean0.7964148451921946
deviation-heading_median0.6379761965328706
deviation-heading_min0.2125416965180202
driven_any_max0.7964647461318576
driven_any_mean0.3714411626523829
driven_any_median0.25000059357333293
driven_any_min0.18214745926228204
driven_lanedir_max0.5556189939906881
driven_lanedir_mean0.31101672831415683
driven_lanedir_min0.18011089490974985
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7964647461318576, "driven_lanedir": 0.5556189939906881, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7316807421662197, "deviation-center-line": 0.3417954704435611}, "ep001": {"driven_any": 0.18214745926228204, "driven_lanedir": 0.18011089490974985, "in-drivable-lane": 0, "deviation-heading": 0.2125416965180202, "deviation-center-line": 0.18011972317922345}, "ep002": {"driven_any": 0.4178774563356439, "driven_lanedir": 0.40573223402677105, "in-drivable-lane": 0, "deviation-heading": 0.6379761965328706, "deviation-center-line": 0.35396938863433036}, "ep003": {"driven_any": 0.2107155579587982, "driven_lanedir": 0.18240191503745695, "in-drivable-lane": 0, "deviation-heading": 0.7780653210245672, "deviation-center-line": 0.12236485836105336}, "ep004": {"driven_any": 0.25000059357333293, "driven_lanedir": 0.23121960360611823, "in-drivable-lane": 0, "deviation-heading": 0.6218102697192953, "deviation-center-line": 0.1998053111237546}}
6774818gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6768818gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 225, "reward": -4.598103830432616, "good_angle": 0.7916814903983082, "survival_time": 7.499999999999983, "traveled_tiles": 2, "valid_direction": 1.1333333333333293}, "ep001": {"nsteps": 53, "reward": -19.401000163465177, "good_angle": 0.03880116776771223, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.03333333333333344}, "ep002": {"nsteps": 119, "reward": -8.865654880509657, "good_angle": 0.2828610904180471, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep003": {"nsteps": 61, "reward": -16.721193666340874, "good_angle": 0.650290505208257, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 0.6333333333333349}, "ep004": {"nsteps": 72, "reward": -14.33374637323949, "good_angle": 0.4260768854306476, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.6999999999999993}}
good_angle_max0.7916814903983082
good_angle_mean0.43794222784459447
good_angle_median0.4260768854306476
good_angle_min0.03880116776771223
reward_max-4.598103830432616
reward_mean-12.783939782797564
reward_median-14.33374637323949
reward_min-19.401000163465177
survival_time_max7.499999999999983
survival_time_mean3.53333333333333
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1333333333333293
valid_direction_mean0.5799999999999991
valid_direction_median0.6333333333333349
valid_direction_min0.03333333333333344
6758818gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:05:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6549818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6549'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6428818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6428'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6260818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:03:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2482206145486816
deviation-center-line_median0.2210288078414068
in-drivable-lane_median0


other stats
deviation-center-line_max0.3617533163994265
deviation-center-line_mean0.23709828112705944
deviation-center-line_min0.13306158377372387
deviation-heading_max1.817713299610764
deviation-heading_mean0.8088235836719229
deviation-heading_median0.600322451860592
deviation-heading_min0.2619771005149048
driven_any_max0.5714385859974358
driven_any_mean0.34071983728228894
driven_any_median0.2500133890290756
driven_any_min0.19998324812322693
driven_lanedir_max0.41975948835652455
driven_lanedir_mean0.2776347080381498
driven_lanedir_min0.177555627093402
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5714385859974358, "driven_lanedir": 0.31131154120886473, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.817713299610764, "deviation-center-line": 0.2210288078414068}, "ep001": {"driven_any": 0.2500133890290756, "driven_lanedir": 0.2482206145486816, "in-drivable-lane": 0, "deviation-heading": 0.2619771005149048, "deviation-center-line": 0.26325975704890087}, "ep002": {"driven_any": 0.4321609929419086, "driven_lanedir": 0.41975948835652455, "in-drivable-lane": 0, "deviation-heading": 0.5966209504337485, "deviation-center-line": 0.3617533163994265}, "ep003": {"driven_any": 0.19998324812322693, "driven_lanedir": 0.177555627093402, "in-drivable-lane": 0, "deviation-heading": 0.7674841159396049, "deviation-center-line": 0.13306158377372387}, "ep004": {"driven_any": 0.2500029703197979, "driven_lanedir": 0.23132626898327624, "in-drivable-lane": 0, "deviation-heading": 0.600322451860592, "deviation-center-line": 0.20638794057183923}}
6258818gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes-0:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6256818gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 162, "reward": -6.294247111294097, "good_angle": 1.2764053089320708, "survival_time": 5.399999999999991, "traveled_tiles": 2, "valid_direction": 1.533333333333328}, "ep001": {"nsteps": 72, "reward": -14.467195924785402, "good_angle": 0.03534171482631649, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 123, "reward": -8.586208094910878, "good_angle": 0.2995188163020863, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep003": {"nsteps": 58, "reward": -17.613295278030222, "good_angle": 0.5074986181586296, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.9333333333333356}, "ep004": {"nsteps": 72, "reward": -14.35026094276044, "good_angle": 0.4259471676398854, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5666666666666655}}
good_angle_max1.2764053089320708
good_angle_mean0.5089423251717977
good_angle_median0.4259471676398854
good_angle_min0.03534171482631649
reward_max-6.294247111294097
reward_mean-12.262241470356209
reward_median-14.35026094276044
reward_min-17.613295278030222
survival_time_max5.399999999999991
survival_time_mean3.246666666666665
survival_time_min1.933333333333336
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.533333333333328
valid_direction_mean0.6866666666666655
valid_direction_median0.5666666666666655
valid_direction_min0
6250818gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:04:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6059818gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:06:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
6058818gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:08:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1