Duckietown Challenges Home Challenges Submissions

Submission 1042

Submission1042
Competingyes
Challengeaido1_LF1_r3-v3
UserRuixiang Zhang 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 11860 step2-scoring: 8353 step3-videos: 8398 step4-viz: 8400
Next
User labelstay young
Admin priority50
Blessingn/a
User priority50

8400

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8398

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11860step1-simulationerroryes0:06:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8400step4-vizsuccessyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04593065588153422
deviation-center-line_median0.04889858809432139
in-drivable-lane_median0


other stats
deviation-center-line_max0.05146284982227555
deviation-center-line_mean0.03672633422420539
deviation-center-line_min0
deviation-heading_max0.4693723938016831
deviation-heading_mean0.32252083548413774
deviation-heading_median0.3787742025787767
deviation-heading_min0
driven_any_max2.3231893140653552
driven_any_mean0.5290153980221113
driven_any_median0.07464062053222065
driven_any_min0.05598046539916547
driven_lanedir_max0.049006275094063856
driven_lanedir_mean0.036499239166509365
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.39333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3231893140653552, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05598046539916547, "driven_lanedir": 0.04042772695966379, "in-drivable-lane": 0, "deviation-heading": 0.3068924305301613, "deviation-center-line": 0.04889858809432139}, "ep002": {"driven_any": 0.07464062053222065, "driven_lanedir": 0.04713153789728497, "in-drivable-lane": 0, "deviation-heading": 0.45756515051006746, "deviation-center-line": 0.05146284982227555}, "ep003": {"driven_any": 0.12129100836485852, "driven_lanedir": 0.04593065588153422, "in-drivable-lane": 0.33333333333333326, "deviation-heading": 0.4693723938016831, "deviation-center-line": 0.03413515654502517}, "ep004": {"driven_any": 0.06997558174895666, "driven_lanedir": 0.049006275094063856, "in-drivable-lane": 0, "deviation-heading": 0.3787742025787767, "deviation-center-line": 0.04913507665940483}}
No reset possible
8398step3-videossuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8397step3-videossuccessyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8396step3-videosabortedyes0:00:13
Error while running [...]

Creating job8396-9079_videos_1 ... error
stderr | ERROR: for job8396-9079_videos_1  Cannot start service videos: network job8396-9079_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8396-9079_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8361step3-videoserroryes0:43:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 623, in _make_api_call
    raise error_class(parsed_response, operation_name)
ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8360step3-videossuccessyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8359step3-videosabortedyes0:00:11
Error while running [...]

Creating job8359-4213_videos_1 ... error
stderr | ERROR: for job8359-4213_videos_1  Cannot start service videos: network job8359-4213_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8359-4213_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8358step3-videosabortedyes0:00:11
Error while running [...]

Creating job8358-8880_videos_1 ... error
stderr | ERROR: for job8358-8880_videos_1  Cannot start service videos: network job8358-8880_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8358-8880_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8357step3-videossuccessyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8356step3-videossuccessyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8355step3-videossuccessyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8354step3-videoserroryes0:43:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 623, in _make_api_call
    raise error_class(parsed_response, operation_name)
ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8353step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.6635833896398544, "good_angle": 59.10111581671121, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 14, "reward": -72.08509808140141, "good_angle": 0.32793213429047213, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.3666666666666666}, "ep002": {"nsteps": 18, "reward": -56.13111195961634, "good_angle": 0.5592134700687729, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep003": {"nsteps": 28, "reward": -37.21505528422339, "good_angle": 0.9237378106184164, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8333333333333331}, "ep004": {"nsteps": 17, "reward": -59.37879015067045, "good_angle": 0.4376820075900353, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}}
good_angle_max59.10111581671121
good_angle_mean12.26993624785578
good_angle_median0.5592134700687729
good_angle_min0.32793213429047213
reward_max-1.6635833896398544
reward_mean-45.29472777311029
reward_median-56.13111195961634
reward_min-72.08509808140141
survival_time_max16.666666666666654
survival_time_mean3.846666666666664
survival_time_min0.4666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean3.4533333333333305
valid_direction_median0.49999999999999994
valid_direction_min0.3666666666666666
No reset possible
8352step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible