AI Driving Olympics Home Challenges Submissions Jobs

Submission 809

Submission809
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12081 step2-scoring: 12098 step3-videos: 12100 step4-viz: 12105
Next
User labelMy modified ROS-based Lane Following
Admin priority50
Blessing50
User priority

12105

Click the images to see detailed statistics about the episode.

12100

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12105809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.444178579774237
deviation-center-line_median0.12826890446979738
in-drivable-lane_median0.16666666666666718


other stats
deviation-center-line_max0.23378029579137977
deviation-center-line_mean0.1634599383856167
deviation-center-line_min0.12374555675210928
deviation-heading_max0.6947909196488959
deviation-heading_mean0.5160588612681785
deviation-heading_median0.5115343544746714
deviation-heading_min0.3884910776889076
driven_any_max3.051890682811933
driven_any_mean2.009113316929838
driven_any_median1.8037797538914375
driven_any_min1.542984271162147
driven_lanedir_max2.9972709716759565
driven_lanedir_mean1.7636565281614245
driven_lanedir_min1.170157678441656
in-drivable-lane_max0.5333333333333334
in-drivable-lane_mean0.22666666666666693
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.585242375654044, "driven_lanedir": 1.170157678441656, "in-drivable-lane": 0.5333333333333334, "deviation-heading": 0.6947909196488959, "deviation-center-line": 0.12374555675210928}, "ep001": {"driven_any": 2.0616695011296287, "driven_lanedir": 1.7694757310559175, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.5766668310649209, "deviation-center-line": 0.23378029579137977}, "ep002": {"driven_any": 3.051890682811933, "driven_lanedir": 2.9972709716759565, "in-drivable-lane": 0, "deviation-heading": 0.4088111234634964, "deviation-center-line": 0.20528807289839215}, "ep003": {"driven_any": 1.8037797538914375, "driven_lanedir": 1.444178579774237, "in-drivable-lane": 0.433333333333334, "deviation-heading": 0.3884910776889076, "deviation-center-line": 0.12826890446979738}, "ep004": {"driven_any": 1.542984271162147, "driven_lanedir": 1.4371996798593565, "in-drivable-lane": 0, "deviation-heading": 0.5115343544746714, "deviation-center-line": 0.12621686201640497}}
12100809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
12098809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.366666666666668


other stats
episodes
details{"ep000": {"nsteps": 72, "reward": -13.644303732499894, "good_angle": 0.5641034829301981, "survival_time": 2.4000000000000012, "traveled_tiles": 3, "valid_direction": 0.8333333333333327}, "ep001": {"nsteps": 71, "reward": -13.413029637240188, "good_angle": 0.15535558136576133, "survival_time": 2.366666666666668, "traveled_tiles": 5, "valid_direction": 0.4333333333333341}, "ep002": {"nsteps": 95, "reward": -10.095718156232646, "good_angle": 0.09461217427520222, "survival_time": 3.166666666666665, "traveled_tiles": 6, "valid_direction": 0.2999999999999995}, "ep003": {"nsteps": 60, "reward": -16.082385509709518, "good_angle": 0.1407729931527512, "survival_time": 2.0000000000000027, "traveled_tiles": 4, "valid_direction": 0.3000000000000004}, "ep004": {"nsteps": 55, "reward": -17.799928339164364, "good_angle": 0.2706085699043232, "survival_time": 1.8333333333333357, "traveled_tiles": 4, "valid_direction": 0.36666666666666736}}
good_angle_max0.5641034829301981
good_angle_mean0.2450905603256472
good_angle_median0.15535558136576133
good_angle_min0.09461217427520222
reward_max-10.095718156232646
reward_mean-14.20707307496932
reward_median-13.644303732499894
reward_min-17.799928339164364
survival_time_max3.166666666666665
survival_time_mean2.3533333333333344
survival_time_min1.8333333333333357
traveled_tiles_max6
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.8333333333333327
valid_direction_mean0.4466666666666669
valid_direction_median0.36666666666666736
valid_direction_min0.2999999999999995
12081809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes-0:04:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6789809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes-0:03:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2579668219643292
deviation-center-line_median0.1059593895156474
in-drivable-lane_median0


other stats
deviation-center-line_max0.23676070016860404
deviation-center-line_mean0.1239773311253622
deviation-center-line_min0.07144299629218012
deviation-heading_max0.8181796391735762
deviation-heading_mean0.4469072023299918
deviation-heading_median0.36906308614551
deviation-heading_min0.2710018149084613
driven_any_max1.0689339474507558
driven_any_mean0.4083166910259283
driven_any_median0.27009149109606245
driven_any_min0.07997017530105253
driven_lanedir_max0.8885961471158105
driven_lanedir_mean0.3628381430554117
driven_lanedir_min0.06769193659032569
in-drivable-lane_max0.2666666666666667
in-drivable-lane_mean0.053333333333333344
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0689339474507558, "driven_lanedir": 0.8885961471158105, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.8181796391735762, "deviation-center-line": 0.23676070016860404}, "ep001": {"driven_any": 0.07997017530105253, "driven_lanedir": 0.06769193659032569, "in-drivable-lane": 0, "deviation-heading": 0.36906308614551, "deviation-center-line": 0.07144299629218012}, "ep002": {"driven_any": 0.17198956616441874, "driven_lanedir": 0.15787482520656693, "in-drivable-lane": 0, "deviation-heading": 0.40961119047542144, "deviation-center-line": 0.09596478563038988}, "ep003": {"driven_any": 0.45059827511735223, "driven_lanedir": 0.44206098440002606, "in-drivable-lane": 0, "deviation-heading": 0.2710018149084613, "deviation-center-line": 0.10975878401998948}, "ep004": {"driven_any": 0.27009149109606245, "driven_lanedir": 0.2579668219643292, "in-drivable-lane": 0, "deviation-heading": 0.3666802809469904, "deviation-center-line": 0.1059593895156474}}
6560809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission809/step4-viz-nutonomy-P50-2570-job6560'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6434809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission809/step4-viz-nutonomy-P50-2210-job6434'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6286809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2579668219643292
deviation-center-line_median0.1059593895156474
in-drivable-lane_median0


other stats
deviation-center-line_max0.23676070016860404
deviation-center-line_mean0.1239773311253622
deviation-center-line_min0.07144299629218012
deviation-heading_max0.8181796391735762
deviation-heading_mean0.4469072023299918
deviation-heading_median0.36906308614551
deviation-heading_min0.2710018149084613
driven_any_max1.0689339474507558
driven_any_mean0.4083166910259283
driven_any_median0.27009149109606245
driven_any_min0.07997017530105253
driven_lanedir_max0.8885961471158105
driven_lanedir_mean0.3628381430554117
driven_lanedir_min0.06769193659032569
in-drivable-lane_max0.2666666666666667
in-drivable-lane_mean0.053333333333333344
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0689339474507558, "driven_lanedir": 0.8885961471158105, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.8181796391735762, "deviation-center-line": 0.23676070016860404}, "ep001": {"driven_any": 0.07997017530105253, "driven_lanedir": 0.06769193659032569, "in-drivable-lane": 0, "deviation-heading": 0.36906308614551, "deviation-center-line": 0.07144299629218012}, "ep002": {"driven_any": 0.17198956616441874, "driven_lanedir": 0.15787482520656693, "in-drivable-lane": 0, "deviation-heading": 0.40961119047542144, "deviation-center-line": 0.09596478563038988}, "ep003": {"driven_any": 0.45059827511735223, "driven_lanedir": 0.44206098440002606, "in-drivable-lane": 0, "deviation-heading": 0.2710018149084613, "deviation-center-line": 0.10975878401998948}, "ep004": {"driven_any": 0.27009149109606245, "driven_lanedir": 0.2579668219643292, "in-drivable-lane": 0, "deviation-heading": 0.3666802809469904, "deviation-center-line": 0.1059593895156474}}
6281809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6280809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.0333333333333332


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.825791479519102, "good_angle": 0.34161687192991563, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 0.8333333333333323}, "ep001": {"nsteps": 20, "reward": -50.64446276128293, "good_angle": 0.3399300848775853, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 28, "reward": -36.30582820624113, "good_angle": 0.3227372332688498, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.4333333333333333}, "ep003": {"nsteps": 39, "reward": -26.075828602298714, "good_angle": 0.0811972979379939, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 0.33333333333333326}, "ep004": {"nsteps": 31, "reward": -32.83416813611984, "good_angle": 0.2723518728988802, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.3999999999999999}}
good_angle_max0.34161687192991563
good_angle_mean0.27156667218264496
good_angle_median0.3227372332688498
good_angle_min0.0811972979379939
reward_max-12.825791479519102
reward_mean-31.737215837092343
reward_median-32.83416813611984
reward_min-50.64446276128293
survival_time_max2.666666666666667
survival_time_mean1.32
survival_time_min0.6666666666666666
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.8333333333333323
valid_direction_mean0.4799999999999997
valid_direction_median0.4
valid_direction_min0.33333333333333326
6274809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6010809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno-0:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6009809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6008809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno-0:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6007809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedno-0:04:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6006809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.333333333333304


other stats
episodes
details{"ep000": {"nsteps": 65, "reward": -16.05444321494836, "good_angle": 4.79012327568727, "survival_time": 2.1666666666666687, "traveled_tiles": 3, "valid_direction": 1.5000000000000016}, "ep001": {"nsteps": 490, "reward": -2.303853261350578, "good_angle": 26.80736864043892, "survival_time": 16.333333333333304, "traveled_tiles": 14, "valid_direction": 5.6999999999999975}, "ep002": {"nsteps": 210, "reward": -5.231226021996865, "good_angle": 0.8559525476973371, "survival_time": 6.999999999999985, "traveled_tiles": 7, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.3646079492368736, "good_angle": 32.31799804517526, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.466666666666653}, "ep004": {"nsteps": 500, "reward": -0.6484741693856194, "good_angle": 1.3290469812400538, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.066666666666663}}
good_angle_max32.31799804517526
good_angle_mean13.220097898047763
good_angle_median4.79012327568727
good_angle_min0.8559525476973371
reward_max-0.3646079492368736
reward_mean-4.920520923383659
reward_median-2.303853261350578
reward_min-16.05444321494836
survival_time_max16.666666666666654
survival_time_mean11.766666666666657
survival_time_min2.1666666666666687
traveled_tiles_max18
traveled_tiles_mean11.4
traveled_tiles_median14
traveled_tiles_min3
valid_direction_max5.6999999999999975
valid_direction_mean3.5399999999999947
valid_direction_median3.066666666666663
valid_direction_min1.5000000000000016
6005809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedno-0:02:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.333333333333304


other stats
episodes
details{"ep000": {"nsteps": 65, "reward": -16.05444321494836, "good_angle": 4.79012327568727, "survival_time": 2.1666666666666687, "traveled_tiles": 3, "valid_direction": 1.5000000000000016}, "ep001": {"nsteps": 490, "reward": -2.303853261350578, "good_angle": 26.80736864043892, "survival_time": 16.333333333333304, "traveled_tiles": 14, "valid_direction": 5.6999999999999975}, "ep002": {"nsteps": 210, "reward": -5.231226021996865, "good_angle": 0.8559525476973371, "survival_time": 6.999999999999985, "traveled_tiles": 7, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.3646079492368736, "good_angle": 32.31799804517526, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 5.466666666666653}, "ep004": {"nsteps": 500, "reward": -0.6484741693856194, "good_angle": 1.3290469812400538, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.066666666666663}}
good_angle_max32.31799804517526
good_angle_mean13.220097898047763
good_angle_median4.79012327568727
good_angle_min0.8559525476973371
reward_max-0.3646079492368736
reward_mean-4.920520923383659
reward_median-2.303853261350578
reward_min-16.05444321494836
survival_time_max16.666666666666654
survival_time_mean11.766666666666657
survival_time_min2.1666666666666687
traveled_tiles_max18
traveled_tiles_mean11.4
traveled_tiles_median14
traveled_tiles_min3
valid_direction_max5.6999999999999975
valid_direction_mean3.5399999999999947
valid_direction_median3.066666666666663
valid_direction_min1.5000000000000016
6004809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno-0:07:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6003809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:07:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6002809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno-0:05:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.