Duckietown Challenges Home Challenges Submissions

Submission 915

Submission915
Competingyes
Challengeaido1_LF1_r3-v3
UserRuixiang Zhang 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13085 step2-scoring: 13092 step3-videos: 13095 step4-viz: 13102
Next
User labelstay simple
Admin priority50
Blessingn/a
User priority50

13102

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13095

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13102step4-vizsuccessyes0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.03921392961407033
deviation-center-line_median0.445030572366352
in-drivable-lane_median7.9333333333333345


other stats
deviation-center-line_max0.6680359399940644
deviation-center-line_mean0.459549976987158
deviation-center-line_min0.22232493392721492
deviation-heading_max6.902707251856001
deviation-heading_mean6.783281906980965
deviation-heading_median6.866923898538065
deviation-heading_min6.441751848289143
driven_any_max0.12404611014730374
driven_any_mean0.11946056931605996
driven_any_median0.11831418410825086
driven_any_min0.11831418410823552
driven_lanedir_max0.03981141765480389
driven_lanedir_mean0.03849232525238348
driven_lanedir_min0.0348562921883151
in-drivable-lane_max8.699999999999985
in-drivable-lane_mean8.066666666666665
in-drivable-lane_min7.83333333333333
per-episodes
details{"ep000": {"driven_any": 0.12404611014730374, "driven_lanedir": 0.0348562921883151, "in-drivable-lane": 8.699999999999985, "deviation-heading": 6.441751848289143, "deviation-center-line": 0.6162870036259419}, "ep001": {"driven_any": 0.11831418410826308, "driven_lanedir": 0.03981141765480389, "in-drivable-lane": 7.83333333333333, "deviation-heading": 6.902707251856001, "deviation-center-line": 0.34607143502221654}, "ep002": {"driven_any": 0.11831418410825086, "driven_lanedir": 0.038956248463263954, "in-drivable-lane": 7.966666666666669, "deviation-heading": 6.868420595417059, "deviation-center-line": 0.22232493392721492}, "ep003": {"driven_any": 0.11831418410823552, "driven_lanedir": 0.039623738341464154, "in-drivable-lane": 7.899999999999999, "deviation-heading": 6.836605940804553, "deviation-center-line": 0.445030572366352}, "ep004": {"driven_any": 0.11831418410824668, "driven_lanedir": 0.03921392961407033, "in-drivable-lane": 7.9333333333333345, "deviation-heading": 6.866923898538065, "deviation-center-line": 0.6680359399940644}}
No reset possible
13095step3-videossuccessyes0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13092step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4789912769091316, "good_angle": 14.15575299696376, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666664}, "ep001": {"nsteps": 500, "reward": -0.9093585274128708, "good_angle": 14.054099572754517, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.066666666666665}, "ep002": {"nsteps": 500, "reward": -0.8488050066642463, "good_angle": 14.166130116097191, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.066666666666665}, "ep003": {"nsteps": 500, "reward": -0.990762283896096, "good_angle": 14.082831172568063, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.133333333333333}, "ep004": {"nsteps": 500, "reward": -1.1548459028888027, "good_angle": 14.133762001437656, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.033333333333331}}
good_angle_max14.166130116097191
good_angle_mean14.118515171964235
good_angle_median14.133762001437656
good_angle_min14.054099572754517
reward_max-0.4789912769091316
reward_mean-0.8765525995542296
reward_median-0.9093585274128708
reward_min-1.1548459028888027
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.166666666666664
valid_direction_mean13.09333333333333
valid_direction_median13.066666666666665
valid_direction_min13.033333333333331
No reset possible
13085step1-simulationsuccessyes0:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7615step4-vizsuccessyes0:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7614step4-vizsuccessyes0:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7613step3-videossuccessyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7612step3-videosabortedyes1:37:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 610, in _make_api_call
    operation_model, request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 136, in _send_request
    success_response, exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 210, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/76656221fa8202d9d61f4910f7fc13344b2309186fd4b28b6dd5844e2cec2514"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7611step2-scoringsuccessyes0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible