Submission 13524

Submission

13524

Competing

yes

Challenge

aido-LFI-sim-validation

User

András Kalapos 🇭🇺

Date submitted

2021-01-31 22:16:42+00:00

Last status update

2021-12-04 20:47:24+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 105916 sim-1of4: 105913 sim-2of4: 105221 sim-3of4: 105220

User label

real-v1.0-3092-363

Admin priority

Blessing

n/a

User priority

105916

Click the images to see detailed statistics about the episode.

udem1-000

105913

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

105916

sim-0of4

success

yes

2021-11-03 05:01:04+00:00

2021-11-03 05:03:12+00:00

0:02:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.900000000000006
in-drivable-lane_median	0.9000000000000128
driven_lanedir_consec_median	3.9927128638103175
deviation-center-line_median	0.402646952953629

other stats

deviation-center-line_max	0.402646952953629
deviation-center-line_mean	0.402646952953629
deviation-center-line_min	0.402646952953629
deviation-heading_max	1.483782088683189
deviation-heading_mean	1.483782088683189
deviation-heading_median	1.483782088683189
deviation-heading_min	1.483782088683189
distance-from-start_max	2.2833851017187725
distance-from-start_mean	2.2833851017187725
distance-from-start_median	2.2833851017187725
distance-from-start_min	2.2833851017187725
driven_any_max	4.348763753977396
driven_any_mean	4.348763753977396
driven_any_median	4.348763753977396
driven_any_min	4.348763753977396
driven_lanedir_consec_max	3.9927128638103175
driven_lanedir_consec_mean	3.9927128638103175
driven_lanedir_consec_min	3.9927128638103175
driven_lanedir_max	4.184615792010203
driven_lanedir_mean	4.184615792010203
driven_lanedir_median	4.184615792010203
driven_lanedir_min	4.184615792010203
in-drivable-lane_max	0.9000000000000128
in-drivable-lane_mean	0.9000000000000128
in-drivable-lane_min	0.9000000000000128
per-episodes	details {"udem1-000-ego0": {"driven_any": 4.348763753977396, "survival_time": 9.900000000000006, "driven_lanedir": 4.184615792010203, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 1.483782088683189, "distance-from-start": 2.2833851017187725, "deviation-center-line": 0.402646952953629, "driven_lanedir_consec": 3.9927128638103175}}
simulation-passed	1
survival_time_max	9.900000000000006
survival_time_mean	9.900000000000006
survival_time_min	9.900000000000006

No reset possible

105913

sim-1of4

success

yes

2021-11-03 05:01:01+00:00

2021-11-03 05:06:58+00:00

0:05:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	9.850000000000108
driven_lanedir_consec_median	20.178101200238817
deviation-center-line_median	2.6774345233125554

other stats

deviation-center-line_max	2.6774345233125554
deviation-center-line_mean	2.6774345233125554
deviation-center-line_min	2.6774345233125554
deviation-heading_max	11.010529226842356
deviation-heading_mean	11.010529226842356
deviation-heading_median	11.010529226842356
deviation-heading_min	11.010529226842356
distance-from-start_max	2.342431193203391
distance-from-start_mean	2.342431193203391
distance-from-start_median	2.342431193203391
distance-from-start_min	2.342431193203391
driven_any_max	29.428070812860497
driven_any_mean	29.428070812860497
driven_any_median	29.428070812860497
driven_any_min	29.428070812860497
driven_lanedir_consec_max	20.178101200238817
driven_lanedir_consec_mean	20.178101200238817
driven_lanedir_consec_min	20.178101200238817
driven_lanedir_max	23.826816164628113
driven_lanedir_mean	23.826816164628113
driven_lanedir_median	23.826816164628113
driven_lanedir_min	23.826816164628113
in-drivable-lane_max	9.850000000000108
in-drivable-lane_mean	9.850000000000108
in-drivable-lane_min	9.850000000000108
per-episodes	details {"4way-000-ego0": {"driven_any": 29.428070812860497, "survival_time": 59.99999999999873, "driven_lanedir": 23.826816164628113, "in-drivable-lane": 9.850000000000108, "deviation-heading": 11.010529226842356, "distance-from-start": 2.342431193203391, "deviation-center-line": 2.6774345233125554, "driven_lanedir_consec": 20.178101200238817}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105900

sim-1of4

host-error

yes

2021-11-03 04:57:55+00:00

2021-11-03 05:00:21+00:00

0:02:26

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/9e1da346f6db71e11ea1bacd44ca547e0aee99e4390628ff739e0ce8e3390aff/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/9e1da346f6db71e11ea1bacd44ca547e0aee99e4390628ff739e0ce8e3390aff/json: Not Found ("No such container: 9e1da346f6db71e11ea1bacd44ca547e0aee99e4390628ff739e0ce8e3390aff")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105899

sim-0of4

host-error

yes

2021-11-03 04:57:51+00:00

2021-11-03 05:00:21+00:00

0:02:30

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/966098f61822bf4049c27d2fb445d5b5147e17c2ea7c6ded120fa1995e4da2e6/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/966098f61822bf4049c27d2fb445d5b5147e17c2ea7c6ded120fa1995e4da2e6/json: Not Found ("No such container: 966098f61822bf4049c27d2fb445d5b5147e17c2ea7c6ded120fa1995e4da2e6")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105221

sim-2of4

success

yes

2021-11-03 01:24:38+00:00

2021-11-03 01:25:48+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

105220

sim-3of4

success

yes

2021-11-03 01:24:38+00:00

2021-11-03 01:25:46+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

105216

sim-2of4

success

yes

2021-11-03 01:23:15+00:00

2021-11-03 01:24:24+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105215

sim-3of4

success

yes

2021-11-03 01:23:14+00:00

2021-11-03 01:24:26+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible