Duckietown Challenges Home Challenges Submissions

Submission 18702

Submission18702
Competingyes
Challengeaido-LF-full-sim-validation
UserJoakim Aarskog
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 130123 sim-1of4: 130120 sim-2of4: 130109 sim-3of4: 130137
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

130137

Click the images to see detailed statistics about the episode.

loop2-000

130123

Click the images to see detailed statistics about the episode.

zigzag-000

130120

Click the images to see detailed statistics about the episode.

loop-000

130109

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
130137sim-3of4successyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.399999999999982
in-drivable-lane_median2.299999999999992
driven_lanedir_consec_median2.1880396644408835
deviation-center-line_median0.2827801693798852


other stats
deviation-center-line_max0.2827801693798852
deviation-center-line_mean0.2827801693798852
deviation-center-line_min0.2827801693798852
deviation-heading_max1.2470778222704055
deviation-heading_mean1.2470778222704055
deviation-heading_median1.2470778222704055
deviation-heading_min1.2470778222704055
distance-from-start_max2.201074513575259
distance-from-start_mean2.201074513575259
distance-from-start_median2.201074513575259
distance-from-start_min2.201074513575259
driven_any_max3.041089608832464
driven_any_mean3.041089608832464
driven_any_median3.041089608832464
driven_any_min3.041089608832464
driven_lanedir_consec_max2.1880396644408835
driven_lanedir_consec_mean2.1880396644408835
driven_lanedir_consec_min2.1880396644408835
driven_lanedir_max2.1880396644408835
driven_lanedir_mean2.1880396644408835
driven_lanedir_median2.1880396644408835
driven_lanedir_min2.1880396644408835
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean2.299999999999992
in-drivable-lane_min2.299999999999992
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.041089608832464, "survival_time": 7.399999999999982, "driven_lanedir": 2.1880396644408835, "in-drivable-lane": 2.299999999999992, "deviation-heading": 1.2470778222704055, "distance-from-start": 2.201074513575259, "deviation-center-line": 0.2827801693798852, "driven_lanedir_consec": 2.1880396644408835}}
simulation-passed1
survival_time_max7.399999999999982
survival_time_mean7.399999999999982
survival_time_min7.399999999999982
No reset possible
130134sim-3of4successyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130131sim-3of4successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130128sim-3of4successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130125sim-3of4successyes0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130124sim-3of4successyes0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130123sim-0of4successyes0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.40000000000007
in-drivable-lane_median6.000000000000034
driven_lanedir_consec_median3.1512332539345023
deviation-center-line_median0.6849993948538036


other stats
deviation-center-line_max0.6849993948538036
deviation-center-line_mean0.6849993948538036
deviation-center-line_min0.6849993948538036
deviation-heading_max2.798762614644736
deviation-heading_mean2.798762614644736
deviation-heading_median2.798762614644736
deviation-heading_min2.798762614644736
distance-from-start_max3.4153672262347285
distance-from-start_mean3.4153672262347285
distance-from-start_median3.4153672262347285
distance-from-start_min3.4153672262347285
driven_any_max5.56690364129221
driven_any_mean5.56690364129221
driven_any_median5.56690364129221
driven_any_min5.56690364129221
driven_lanedir_consec_max3.1512332539345023
driven_lanedir_consec_mean3.1512332539345023
driven_lanedir_consec_min3.1512332539345023
driven_lanedir_max3.1512332539345023
driven_lanedir_mean3.1512332539345023
driven_lanedir_median3.1512332539345023
driven_lanedir_min3.1512332539345023
in-drivable-lane_max6.000000000000034
in-drivable-lane_mean6.000000000000034
in-drivable-lane_min6.000000000000034
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.56690364129221, "survival_time": 14.40000000000007, "driven_lanedir": 3.1512332539345023, "in-drivable-lane": 6.000000000000034, "deviation-heading": 2.798762614644736, "distance-from-start": 3.4153672262347285, "deviation-center-line": 0.6849993948538036, "driven_lanedir_consec": 3.1512332539345023}}
simulation-passed1
survival_time_max14.40000000000007
survival_time_mean14.40000000000007
survival_time_min14.40000000000007
No reset possible
130122sim-3of4successyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130121sim-0of4successyes0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130120sim-1of4successyes0:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.299999999999315
driven_lanedir_consec_median13.982014983681626
deviation-center-line_median2.5925288294897295


other stats
deviation-center-line_max2.5925288294897295
deviation-center-line_mean2.5925288294897295
deviation-center-line_min2.5925288294897295
deviation-heading_max8.776408183764394
deviation-heading_mean8.776408183764394
deviation-heading_median8.776408183764394
deviation-heading_min8.776408183764394
distance-from-start_max2.586550401385721
distance-from-start_mean2.586550401385721
distance-from-start_median2.586550401385721
distance-from-start_min2.586550401385721
driven_any_max26.670214661197168
driven_any_mean26.670214661197168
driven_any_median26.670214661197168
driven_any_min26.670214661197168
driven_lanedir_consec_max13.982014983681626
driven_lanedir_consec_mean13.982014983681626
driven_lanedir_consec_min13.982014983681626
driven_lanedir_max13.982014983681626
driven_lanedir_mean13.982014983681626
driven_lanedir_median13.982014983681626
driven_lanedir_min13.982014983681626
in-drivable-lane_max29.299999999999315
in-drivable-lane_mean29.299999999999315
in-drivable-lane_min29.299999999999315
per-episodes
details{"loop-000-ego0": {"driven_any": 26.670214661197168, "survival_time": 59.99999999999873, "driven_lanedir": 13.982014983681626, "in-drivable-lane": 29.299999999999315, "deviation-heading": 8.776408183764394, "distance-from-start": 2.586550401385721, "deviation-center-line": 2.5925288294897295, "driven_lanedir_consec": 13.982014983681626}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
130118sim-1of4successyes0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130117sim-1of4successyes0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130116sim-1of4successyes0:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130111sim-1of4timeoutyes----No reset possible
130110sim-3of4host-erroryes3:50:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get "https://registry-1.docker.io/v2/": read tcp 172.29.7.108:44218->35.170.144.174:443: read: connection reset by peer")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
130109sim-2of4successyes0:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.84999999999998
in-drivable-lane_median4.949999999999982
driven_lanedir_consec_median0.8894209326703845
deviation-center-line_median0.1836844557915258


other stats
deviation-center-line_max0.1836844557915258
deviation-center-line_mean0.1836844557915258
deviation-center-line_min0.1836844557915258
deviation-heading_max1.460441425913939
deviation-heading_mean1.460441425913939
deviation-heading_median1.460441425913939
deviation-heading_min1.460441425913939
distance-from-start_max2.073997242248557
distance-from-start_mean2.073997242248557
distance-from-start_median2.073997242248557
distance-from-start_min2.073997242248557
driven_any_max2.644451425910487
driven_any_mean2.644451425910487
driven_any_median2.644451425910487
driven_any_min2.644451425910487
driven_lanedir_consec_max0.8894209326703845
driven_lanedir_consec_mean0.8894209326703845
driven_lanedir_consec_min0.8894209326703845
driven_lanedir_max0.8894209326703845
driven_lanedir_mean0.8894209326703845
driven_lanedir_median0.8894209326703845
driven_lanedir_min0.8894209326703845
in-drivable-lane_max4.949999999999982
in-drivable-lane_mean4.949999999999982
in-drivable-lane_min4.949999999999982
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.644451425910487, "survival_time": 7.84999999999998, "driven_lanedir": 0.8894209326703845, "in-drivable-lane": 4.949999999999982, "deviation-heading": 1.460441425913939, "distance-from-start": 2.073997242248557, "deviation-center-line": 0.1836844557915258, "driven_lanedir_consec": 0.8894209326703845}}
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean7.84999999999998
survival_time_min7.84999999999998
No reset possible