Submission 19120

Submission

19120

Competing

yes

Challenge

aido-LF-sim-validation

User

Áron Tibor Tóth

Date submitted

2022-11-16 15:28:42+00:00

Last status update

2022-11-16 16:04:47+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 137548 sim-1of4: 137546 sim-2of4: 137541 sim-3of4: 137547

User label

bme-conti

Admin priority

Blessing

n/a

User priority

137548

Click the images to see detailed statistics about the episode.

autolab-000

137547

Click the images to see detailed statistics about the episode.

zigzag-000

137546

Click the images to see detailed statistics about the episode.

loop-000

137541

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

137548

sim-0of4

success

yes

2022-11-16 15:52:39+00:00

2022-11-16 16:00:57+00:00

0:08:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	16.63150261679938
survival_time_median	59.99999999999873
deviation-center-line_median	3.570465070791929
in-drivable-lane_median	1.0500000000000078

other stats

deviation-center-line_max	3.570465070791929
deviation-center-line_mean	3.570465070791929
deviation-center-line_min	3.570465070791929
deviation-heading_max	24.67023012419815
deviation-heading_mean	24.67023012419815
deviation-heading_median	24.67023012419815
deviation-heading_min	24.67023012419815
distance-from-start_max	3.2327567358732954
distance-from-start_mean	3.2327567358732954
distance-from-start_median	3.2327567358732954
distance-from-start_min	3.2327567358732954
driven_any_max	19.08665072677243
driven_any_mean	19.08665072677243
driven_any_median	19.08665072677243
driven_any_min	19.08665072677243
driven_lanedir_consec_max	16.63150261679938
driven_lanedir_consec_mean	16.63150261679938
driven_lanedir_consec_min	16.63150261679938
driven_lanedir_max	16.63150261679938
driven_lanedir_mean	16.63150261679938
driven_lanedir_median	16.63150261679938
driven_lanedir_min	16.63150261679938
in-drivable-lane_max	1.0500000000000078
in-drivable-lane_mean	1.0500000000000078
in-drivable-lane_min	1.0500000000000078
per-episodes	details {"autolab-000-ego0": {"driven_any": 19.08665072677243, "survival_time": 59.99999999999873, "driven_lanedir": 16.63150261679938, "in-drivable-lane": 1.0500000000000078, "deviation-heading": 24.67023012419815, "distance-from-start": 3.2327567358732954, "deviation-center-line": 3.570465070791929, "driven_lanedir_consec": 16.63150261679938}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

137547

sim-3of4

success

yes

2022-11-16 15:52:39+00:00

2022-11-16 16:01:28+00:00

0:08:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	12.230248694731577
survival_time_median	59.99999999999873
deviation-center-line_median	3.4926642493598647
in-drivable-lane_median	4.799999999999879

other stats

deviation-center-line_max	3.4926642493598647
deviation-center-line_mean	3.4926642493598647
deviation-center-line_min	3.4926642493598647
deviation-heading_max	24.977383520150752
deviation-heading_mean	24.977383520150752
deviation-heading_median	24.977383520150752
deviation-heading_min	24.977383520150752
distance-from-start_max	4.282731405460205
distance-from-start_mean	4.282731405460205
distance-from-start_median	4.282731405460205
distance-from-start_min	4.282731405460205
driven_any_max	19.171446102107694
driven_any_mean	19.171446102107694
driven_any_median	19.171446102107694
driven_any_min	19.171446102107694
driven_lanedir_consec_max	12.230248694731577
driven_lanedir_consec_mean	12.230248694731577
driven_lanedir_consec_min	12.230248694731577
driven_lanedir_max	15.208726794917537
driven_lanedir_mean	15.208726794917537
driven_lanedir_median	15.208726794917537
driven_lanedir_min	15.208726794917537
in-drivable-lane_max	4.799999999999879
in-drivable-lane_mean	4.799999999999879
in-drivable-lane_min	4.799999999999879
per-episodes	details {"zigzag-000-ego0": {"driven_any": 19.171446102107694, "survival_time": 59.99999999999873, "driven_lanedir": 15.208726794917537, "in-drivable-lane": 4.799999999999879, "deviation-heading": 24.977383520150752, "distance-from-start": 4.282731405460205, "deviation-center-line": 3.4926642493598647, "driven_lanedir_consec": 12.230248694731577}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

137546

sim-1of4

success

yes

2022-11-16 15:52:10+00:00

2022-11-16 15:59:42+00:00

0:07:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	15.223019809538089
survival_time_median	59.99999999999873
deviation-center-line_median	3.975153641158131
in-drivable-lane_median	3.049999999999965

other stats

deviation-center-line_max	3.975153641158131
deviation-center-line_mean	3.975153641158131
deviation-center-line_min	3.975153641158131
deviation-heading_max	27.037315835113812
deviation-heading_mean	27.037315835113812
deviation-heading_median	27.037315835113812
deviation-heading_min	27.037315835113812
distance-from-start_max	2.628160095468807
distance-from-start_mean	2.628160095468807
distance-from-start_median	2.628160095468807
distance-from-start_min	2.628160095468807
driven_any_max	18.80857969897567
driven_any_mean	18.80857969897567
driven_any_median	18.80857969897567
driven_any_min	18.80857969897567
driven_lanedir_consec_max	15.223019809538089
driven_lanedir_consec_mean	15.223019809538089
driven_lanedir_consec_min	15.223019809538089
driven_lanedir_max	15.223019809538089
driven_lanedir_mean	15.223019809538089
driven_lanedir_median	15.223019809538089
driven_lanedir_min	15.223019809538089
in-drivable-lane_max	3.049999999999965
in-drivable-lane_mean	3.049999999999965
in-drivable-lane_min	3.049999999999965
per-episodes	details {"loop-000-ego0": {"driven_any": 18.80857969897567, "survival_time": 59.99999999999873, "driven_lanedir": 15.223019809538089, "in-drivable-lane": 3.049999999999965, "deviation-heading": 27.037315835113812, "distance-from-start": 2.628160095468807, "deviation-center-line": 3.975153641158131, "driven_lanedir_consec": 15.223019809538089}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

137545

sim-3of4

host-error

yes

2022-11-16 15:51:45+00:00

2022-11-16 15:52:13+00:00

0:00:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137544

sim-0of4

host-error

yes

2022-11-16 15:51:45+00:00

2022-11-16 15:52:15+00:00

0:00:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137543

sim-1of4

host-error

yes

2022-11-16 15:50:26+00:00

2022-11-16 15:51:34+00:00

0:01:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 856, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1058, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137541

sim-2of4

success

yes

2022-11-16 15:49:51+00:00

2022-11-16 15:57:24+00:00

0:07:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1243471323313106
survival_time_median	59.99999999999873
deviation-center-line_median	3.438269090958073
in-drivable-lane_median	2.400000000000019

other stats

deviation-center-line_max	3.438269090958073
deviation-center-line_mean	3.438269090958073
deviation-center-line_min	3.438269090958073
deviation-heading_max	25.440008049112944
deviation-heading_mean	25.440008049112944
deviation-heading_median	25.440008049112944
deviation-heading_min	25.440008049112944
distance-from-start_max	1.3576185848416102
distance-from-start_mean	1.3576185848416102
distance-from-start_median	1.3576185848416102
distance-from-start_min	1.3576185848416102
driven_any_max	18.968913362264367
driven_any_mean	18.968913362264367
driven_any_median	18.968913362264367
driven_any_min	18.968913362264367
driven_lanedir_consec_max	3.1243471323313106
driven_lanedir_consec_mean	3.1243471323313106
driven_lanedir_consec_min	3.1243471323313106
driven_lanedir_max	15.921312764242115
driven_lanedir_mean	15.921312764242115
driven_lanedir_median	15.921312764242115
driven_lanedir_min	15.921312764242115
in-drivable-lane_max	2.400000000000019
in-drivable-lane_mean	2.400000000000019
in-drivable-lane_min	2.400000000000019
per-episodes	details {"loop2-000-ego0": {"driven_any": 18.968913362264367, "survival_time": 59.99999999999873, "driven_lanedir": 15.921312764242115, "in-drivable-lane": 2.400000000000019, "deviation-heading": 25.440008049112944, "distance-from-start": 1.3576185848416102, "deviation-center-line": 3.438269090958073, "driven_lanedir_consec": 3.1243471323313106}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

137539

sim-2of4

success

yes

2022-11-16 15:41:56+00:00

2022-11-16 15:49:11+00:00

0:07:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137538

sim-0of4

success

yes

2022-11-16 15:41:55+00:00

2022-11-16 15:51:01+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137537

sim-3of4

success

yes

2022-11-16 15:41:53+00:00

2022-11-16 15:51:09+00:00

0:09:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

137536

sim-1of4

success

yes

2022-11-16 15:41:53+00:00

2022-11-16 15:50:17+00:00

0:08:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible