Evaluator 2455

ID	2455
evaluator	`nogpu-prod-03`
owner	I don't have one 😀
machine	nogpu-prod_e123e6a9ddfb
process	nogpu-prod-03_e123e6a9ddfb
version	6.1.27
first heard	2020-11-30 22:02:33+00:00
last heard	2020-12-01 00:13:11+00:00
status	inactive
# evaluating
# success	3 `44167`
# timeout	1 `45230`
# failed
# error
# aborted	4 `44629`
# host-error	10 `44509`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

45230

11809

Bea Baselines 🐤

template-ros

aido5-LFP-sim-validation

LFP-sim

timeout

nogpu-prod-03

2020-11-30 22:55:09+00:00

No reset possible

45205

11842

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI_multi-sim-validation

LFVIv-sim

aborted

nogpu-prod-03

2020-11-30 22:54:07+00:00

2020-11-30 22:54:40+00:00

0:00:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45180

11784

Bea Baselines 🐤

template-random

aido5-LF-sim-validation

LFv-sim

aborted

nogpu-prod-03

2020-11-30 22:53:08+00:00

2020-11-30 22:53:35+00:00

0:00:27

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45169

11810

Bea Baselines 🐤

template-ros

aido5-LFP-sim-testing

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:52:37+00:00

2020-11-30 22:52:59+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45133

11786

Bea Baselines 🐤

template-random

aido5-LFP-sim-testing

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:51:33+00:00

2020-11-30 22:51:55+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45088

11784

Bea Baselines 🐤

template-random

aido5-LF-sim-validation

LFv-sim

host-error

nogpu-prod-03

2020-11-30 22:50:23+00:00

2020-11-30 22:50:45+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ae1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0&fromImage=docker.io%2Fandreacensi%2Faido5-lf-sim-validation-lfv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45056

11786

Bea Baselines 🐤

template-random

aido5-LFP-sim-testing

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:49:27+00:00

2020-11-30 22:49:49+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45027

11809

Bea Baselines 🐤

template-ros

aido5-LFP-sim-validation

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:48:44+00:00

2020-11-30 22:49:05+00:00

0:00:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-validation-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44987

11817

Bea Baselines 🐤

template-ros

aido5-LFVI-sim-testing

LFVIt-sim

aborted

nogpu-prod-03

2020-11-30 22:47:39+00:00

2020-11-30 22:48:15+00:00

0:00:36

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44931

11807

Bea Baselines 🐤

template-ros

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-03

2020-11-30 22:46:04+00:00

2020-11-30 22:46:58+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0721644755727886
survival_time_median	0.49999999999999994
deviation-center-line_median	0.0075712652588192896
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.011697942560369318
agent_compute-ego_mean	0.011697942560369318
agent_compute-ego_median	0.011697942560369318
agent_compute-ego_min	0.011697942560369318
complete-iteration_max	0.151923114603216
complete-iteration_mean	0.151923114603216
complete-iteration_median	0.151923114603216
complete-iteration_min	0.151923114603216
deviation-center-line_max	0.0075712652588192896
deviation-center-line_mean	0.0075712652588192896
deviation-center-line_min	0.0075712652588192896
deviation-heading_max	0.03936267444701881
deviation-heading_mean	0.03936267444701881
deviation-heading_median	0.03936267444701881
deviation-heading_min	0.03936267444701881
driven_any_max	0.07229863879248773
driven_any_mean	0.07229863879248773
driven_any_median	0.07229863879248773
driven_any_min	0.07229863879248773
driven_lanedir_consec_max	0.0721644755727886
driven_lanedir_consec_mean	0.0721644755727886
driven_lanedir_consec_min	0.0721644755727886
driven_lanedir_max	0.0721644755727886
driven_lanedir_mean	0.0721644755727886
driven_lanedir_median	0.0721644755727886
driven_lanedir_min	0.0721644755727886
get_duckie_state_max	0.002168828790838068
get_duckie_state_mean	0.002168828790838068
get_duckie_state_median	0.002168828790838068
get_duckie_state_min	0.002168828790838068
get_robot_state_max	0.007308092984286221
get_robot_state_mean	0.007308092984286221
get_robot_state_median	0.007308092984286221
get_robot_state_min	0.007308092984286221
get_state_dump_max	0.006929224187677557
get_state_dump_mean	0.006929224187677557
get_state_dump_median	0.006929224187677557
get_state_dump_min	0.006929224187677557
get_ui_image_max	0.02800642360340465
get_ui_image_mean	0.02800642360340465
get_ui_image_median	0.02800642360340465
get_ui_image_min	0.02800642360340465
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.07229863879248773, "get_ui_image": 0.02800642360340465, "step_physics": 0.07487253709272905, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0721644755727886, "get_state_dump": 0.006929224187677557, "sim_render-ego": 0.003554755991155451, "get_robot_state": 0.007308092984286221, "get_duckie_state": 0.002168828790838068, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011697942560369318, "deviation-heading": 0.03936267444701881, "complete-iteration": 0.151923114603216, "set_robot_commands": 0.002184087579900568, "deviation-center-line": 0.0075712652588192896, "driven_lanedir_consec": 0.0721644755727886, "sim_compute_sim_state": 0.012964357029307972, "sim_compute_performance-ego": 0.002164038744839755}}
set_robot_commands_max	0.002184087579900568
set_robot_commands_mean	0.002184087579900568
set_robot_commands_median	0.002184087579900568
set_robot_commands_min	0.002184087579900568
sim_compute_performance-ego_max	0.002164038744839755
sim_compute_performance-ego_mean	0.002164038744839755
sim_compute_performance-ego_median	0.002164038744839755
sim_compute_performance-ego_min	0.002164038744839755
sim_compute_sim_state_max	0.012964357029307972
sim_compute_sim_state_mean	0.012964357029307972
sim_compute_sim_state_median	0.012964357029307972
sim_compute_sim_state_min	0.012964357029307972
sim_render-ego_max	0.003554755991155451
sim_render-ego_mean	0.003554755991155451
sim_render-ego_median	0.003554755991155451
sim_render-ego_min	0.003554755991155451
simulation-passed	1
step_physics_max	0.07487253709272905
step_physics_mean	0.07487253709272905
step_physics_median	0.07487253709272905
step_physics_min	0.07487253709272905
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

44860

11807

Bea Baselines 🐤

template-ros

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-03

2020-11-30 22:44:00+00:00

2020-11-30 22:44:56+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.045812830864241594
survival_time_median	0.49999999999999994
deviation-center-line_median	0.008125441219647006
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01261880181052468
agent_compute-ego_mean	0.01261880181052468
agent_compute-ego_median	0.01261880181052468
agent_compute-ego_min	0.01261880181052468
complete-iteration_max	0.1544723077253862
complete-iteration_mean	0.1544723077253862
complete-iteration_median	0.1544723077253862
complete-iteration_min	0.1544723077253862
deviation-center-line_max	0.008125441219647006
deviation-center-line_mean	0.008125441219647006
deviation-center-line_min	0.008125441219647006
deviation-heading_max	0.06422954420874384
deviation-heading_mean	0.06422954420874384
deviation-heading_median	0.06422954420874384
deviation-heading_min	0.06422954420874384
driven_any_max	0.04637209021976304
driven_any_mean	0.04637209021976304
driven_any_median	0.04637209021976304
driven_any_min	0.04637209021976304
driven_lanedir_consec_max	0.045812830864241594
driven_lanedir_consec_mean	0.045812830864241594
driven_lanedir_consec_min	0.045812830864241594
driven_lanedir_max	0.045812830864241594
driven_lanedir_mean	0.045812830864241594
driven_lanedir_median	0.045812830864241594
driven_lanedir_min	0.045812830864241594
get_duckie_state_max	0.0021835023706609554
get_duckie_state_mean	0.0021835023706609554
get_duckie_state_median	0.0021835023706609554
get_duckie_state_min	0.0021835023706609554
get_robot_state_max	0.007413799112493341
get_robot_state_mean	0.007413799112493341
get_robot_state_median	0.007413799112493341
get_robot_state_min	0.007413799112493341
get_state_dump_max	0.007017395713112571
get_state_dump_mean	0.007017395713112571
get_state_dump_median	0.007017395713112571
get_state_dump_min	0.007017395713112571
get_ui_image_max	0.027746937491677025
get_ui_image_mean	0.027746937491677025
get_ui_image_median	0.027746937491677025
get_ui_image_min	0.027746937491677025
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.04637209021976304, "get_ui_image": 0.027746937491677025, "step_physics": 0.07615895704789595, "survival_time": 0.49999999999999994, "driven_lanedir": 0.045812830864241594, "get_state_dump": 0.007017395713112571, "sim_render-ego": 0.0036214915188876066, "get_robot_state": 0.007413799112493341, "get_duckie_state": 0.0021835023706609554, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01261880181052468, "deviation-heading": 0.06422954420874384, "complete-iteration": 0.1544723077253862, "set_robot_commands": 0.002249609340320934, "deviation-center-line": 0.008125441219647006, "driven_lanedir_consec": 0.045812830864241594, "sim_compute_sim_state": 0.013146963986483488, "sim_compute_performance-ego": 0.00224193659695712}}
set_robot_commands_max	0.002249609340320934
set_robot_commands_mean	0.002249609340320934
set_robot_commands_median	0.002249609340320934
set_robot_commands_min	0.002249609340320934
sim_compute_performance-ego_max	0.00224193659695712
sim_compute_performance-ego_mean	0.00224193659695712
sim_compute_performance-ego_median	0.00224193659695712
sim_compute_performance-ego_min	0.00224193659695712
sim_compute_sim_state_max	0.013146963986483488
sim_compute_sim_state_mean	0.013146963986483488
sim_compute_sim_state_median	0.013146963986483488
sim_compute_sim_state_min	0.013146963986483488
sim_render-ego_max	0.0036214915188876066
sim_render-ego_mean	0.0036214915188876066
sim_render-ego_median	0.0036214915188876066
sim_render-ego_min	0.0036214915188876066
simulation-passed	1
step_physics_max	0.07615895704789595
step_physics_mean	0.07615895704789595
step_physics_median	0.07615895704789595
step_physics_min	0.07615895704789595
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

44821

11811

Bea Baselines 🐤

template-ros

aido5-LFV_multi-sim-validation

LFVmultibodyv-sim

host-error

nogpu-prod-03

2020-11-30 22:42:50+00:00

2020-11-30 22:43:12+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44793

11815

Bea Baselines 🐤

template-ros

aido5-LFV-sim-testing

LFVv-sim

host-error

nogpu-prod-03

2020-11-30 22:41:51+00:00

2020-11-30 22:42:13+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44629

11842

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI_multi-sim-validation

LFVIv-sim

aborted

nogpu-prod-03

2020-11-30 22:37:33+00:00

2020-11-30 22:37:54+00:00

0:00:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f&fromImage=docker.io%2Fandreacensi%2Faido5-lfvi_multi-sim-validation-lfviv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44580

11786

Bea Baselines 🐤

template-random

aido5-LFP-sim-testing

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:36:22+00:00

2020-11-30 22:36:44+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44559

11784

Bea Baselines 🐤

template-random

aido5-LF-sim-validation

LFv-sim

host-error

nogpu-prod-03

2020-11-30 22:35:31+00:00

2020-11-30 22:35:54+00:00

0:00:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ae1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0&fromImage=docker.io%2Fandreacensi%2Faido5-lf-sim-validation-lfv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44509

11809

Bea Baselines 🐤

template-ros

aido5-LFP-sim-validation

LFP-sim

host-error

nogpu-prod-03

2020-11-30 22:34:11+00:00

2020-11-30 22:34:33+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-validation-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44167

11793

Bea Baselines 🐤

template-random

aido5-LFVI-sim-testing

LFVIt-sim

success

nogpu-prod-03

2020-11-30 22:02:48+00:00

2020-11-30 22:33:49+00:00

0:31:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6833679940132369
survival_time_median	4.199999999999993
deviation-center-line_median	0.1679043415757897
in-drivable-lane_median	2.1999999999999935

other stats

agent_compute-ego_max	0.01168390295722268
agent_compute-ego_mean	0.010755644108336898
agent_compute-ego_median	0.010538346299501225
agent_compute-ego_min	0.010149064518156508
agent_compute-npc0_max	0.03805001486431469
agent_compute-npc0_mean	0.03402984820289915
agent_compute-npc0_median	0.03345424279399302
agent_compute-npc0_min	0.03152919109956718
agent_compute-npc1_max	0.0387432724237442
agent_compute-npc1_mean	0.0339925310255871
agent_compute-npc1_median	0.033353427052497865
agent_compute-npc1_min	0.03166212922050839
agent_compute-npc2_max	0.039080938696861266
agent_compute-npc2_mean	0.034145490406440215
agent_compute-npc2_median	0.03381247179848807
agent_compute-npc2_min	0.03145167350769043
agent_compute-npc3_max	0.037996071577072146
agent_compute-npc3_mean	0.03379388088243944
agent_compute-npc3_median	0.03384429812431335
agent_compute-npc3_min	0.03064538225715543
complete-iteration_max	0.970345887541771
complete-iteration_mean	0.8135023376316594
complete-iteration_median	0.7956343308473245
complete-iteration_min	0.7297311682759979
deviation-center-line_max	0.2459006864630789
deviation-center-line_mean	0.1610283547376138
deviation-center-line_min	0.07409910439780235
deviation-heading_max	1.4044443915979827
deviation-heading_mean	0.7337968617859545
deviation-heading_median	0.777522186249618
deviation-heading_min	0.2363714139209714
driven_any_max	3.41780393529469
driven_any_mean	2.0266007940321624
driven_any_median	1.735080871888136
driven_any_min	0.7567520068014945
driven_lanedir_consec_max	1.8136251927382008
driven_lanedir_consec_mean	0.7271290382469384
driven_lanedir_consec_min	0.4067111657247411
driven_lanedir_max	1.837861655910459
driven_lanedir_mean	0.7393001762981
driven_lanedir_median	0.6833679940132369
driven_lanedir_min	0.4067111657247411
get_duckie_state_max	4.067565455581203e-06
get_duckie_state_mean	2.348296985526736e-06
get_duckie_state_median	2.0365848719516648e-06
get_duckie_state_min	1.487961734633848e-06
get_robot_state_max	0.028131824731826783
get_robot_state_mean	0.025245092714768057
get_robot_state_median	0.02481027098669522
get_robot_state_min	0.02353284472510928
get_state_dump_max	0.018130618333816528
get_state_dump_mean	0.01606256561637572
get_state_dump_median	0.015890458355779232
get_state_dump_min	0.01475673062460763
get_ui_image_max	0.058069458603858946
get_ui_image_mean	0.04945719400127465
get_ui_image_median	0.04777919394629342
get_ui_image_min	0.04538785969769513
in-drivable-lane_max	5.1999999999999815
in-drivable-lane_mean	2.5999999999999917
in-drivable-lane_min	0.4999999999999998
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 1.65406851544617, "get_ui_image": 0.058069458603858946, "step_physics": 0.5974322557449341, "survival_time": 3.999999999999994, "driven_lanedir": 0.6467016616800385, "get_state_dump": 0.018130618333816528, "sim_render-ego": 0.0044850587844848635, "get_robot_state": 0.028131824731826783, "sim_render-npc0": 0.004396453499794006, "sim_render-npc1": 0.004373934864997864, "sim_render-npc2": 0.004383352398872375, "sim_render-npc3": 0.004414072632789612, "get_duckie_state": 3.606081008911133e-06, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.011623874306678772, "deviation-heading": 0.7649721039644373, "agent_compute-npc0": 0.037724700570106504, "agent_compute-npc1": 0.0387432724237442, "agent_compute-npc2": 0.039080938696861266, "agent_compute-npc3": 0.037996071577072146, "complete-iteration": 0.970345887541771, "set_robot_commands": 0.002819943428039551, "deviation-center-line": 0.1440401596261301, "driven_lanedir_consec": 0.6419379600343871, "sim_compute_sim_state": 0.05252380669116974, "sim_compute_performance-ego": 0.0027650386095047, "sim_compute_performance-npc0": 0.002767136693000794, "sim_compute_performance-npc1": 0.002673104405403137, "sim_compute_performance-npc2": 0.002708733081817627, "sim_compute_performance-npc3": 0.002683684229850769}, "udem1-sc1-0-ego": {"driven_any": 1.6598843726875137, "get_ui_image": 0.051771087411009234, "step_physics": 0.5061670615349287, "survival_time": 4.049999999999994, "driven_lanedir": 0.6833679940132369, "get_state_dump": 0.01659245549896617, "sim_render-ego": 0.004387655375916281, "get_robot_state": 0.0261231322347382, "sim_render-npc0": 0.0040495101316475575, "sim_render-npc1": 0.004169885023140613, "sim_render-npc2": 0.004284258242006655, "sim_render-npc3": 0.004393998487496081, "get_duckie_state": 2.2370138286072533e-06, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.0116543416623716, "deviation-heading": 0.2363714139209714, "agent_compute-npc0": 0.035089984352206005, "agent_compute-npc1": 0.03538413989691087, "agent_compute-npc2": 0.03508890411000193, "agent_compute-npc3": 0.03597408753854257, "complete-iteration": 0.8505995450196443, "set_robot_commands": 0.002921354623488438, "deviation-center-line": 0.1173131016238644, "driven_lanedir_consec": 0.6833679940132369, "sim_compute_sim_state": 0.04813982527933003, "sim_compute_performance-ego": 0.0027171888469178, "sim_compute_performance-npc0": 0.0025043693589575497, "sim_compute_performance-npc1": 0.0025591614805621867, "sim_compute_performance-npc2": 0.0025840335422092015, "sim_compute_performance-npc3": 0.0026368977111062885}, "udem1-sc2-0-ego": {"driven_any": 1.78060230066762, "get_ui_image": 0.048074012515188634, "step_physics": 0.4990512502604517, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4957883015635973, "get_state_dump": 0.016082900694046897, "sim_render-ego": 0.004103871597640816, "get_robot_state": 0.025549113065346903, "sim_render-npc0": 0.003983253720162928, "sim_render-npc1": 0.003962335915401064, "sim_render-npc2": 0.004036599192126044, "sim_render-npc3": 0.004104019581586465, "get_duckie_state": 2.345819582884339e-06, "in-drivable-lane": 2.5999999999999948, "agent_compute-ego": 0.010578572064980694, "deviation-heading": 0.8439353298778571, "agent_compute-npc0": 0.03345424279399302, "agent_compute-npc1": 0.03362533415871105, "agent_compute-npc2": 0.03348996173376324, "agent_compute-npc3": 0.03300613096390648, "complete-iteration": 0.8303947503539337, "set_robot_commands": 0.002687651535560345, "deviation-center-line": 0.1699458183761848, "driven_lanedir_consec": 0.4957883015635973, "sim_compute_sim_state": 0.051462167981027186, "sim_compute_performance-ego": 0.0026080553559051163, "sim_compute_performance-npc0": 0.002478358389317304, "sim_compute_performance-npc1": 0.0024053776401212847, "sim_compute_performance-npc2": 0.002424177082105615, "sim_compute_performance-npc3": 0.0024391755290415094}, "udem1-sc3-0-ego": {"driven_any": 1.66652752430704, "get_ui_image": 0.047762814164161685, "step_physics": 0.47178917229175565, "survival_time": 3.999999999999994, "driven_lanedir": 0.810986482562073, "get_state_dump": 0.015924370288848876, "sim_render-ego": 0.004127010703086853, "get_robot_state": 0.02486688196659088, "sim_render-npc0": 0.003982824087142944, "sim_render-npc1": 0.0040623098611831665, "sim_render-npc2": 0.004105505347251892, "sim_render-npc3": 0.004097679257392883, "get_duckie_state": 3.3676624298095703e-06, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.01046937108039856, "deviation-heading": 0.5221777959359774, "agent_compute-npc0": 0.03325774669647217, "agent_compute-npc1": 0.033353427052497865, "agent_compute-npc2": 0.03405194580554962, "agent_compute-npc3": 0.03384429812431335, "complete-iteration": 0.8060514450073242, "set_robot_commands": 0.0025515228509902952, "deviation-center-line": 0.07409910439780235, "driven_lanedir_consec": 0.8110371970430892, "sim_compute_sim_state": 0.054308930039405824, "sim_compute_performance-ego": 0.002643704414367676, "sim_compute_performance-npc0": 0.002358660101890564, "sim_compute_performance-npc1": 0.0024236321449279787, "sim_compute_performance-npc2": 0.0025168120861053466, "sim_compute_performance-npc3": 0.0024964332580566405}, "udem1-sc4-0-ego": {"driven_any": 1.713585130979954, "get_ui_image": 0.04538785969769513, "step_physics": 0.4234648781058229, "survival_time": 4.049999999999994, "driven_lanedir": 0.477333714889808, "get_state_dump": 0.0151006586757707, "sim_render-ego": 0.003930580468825352, "get_robot_state": 0.023547402134648076, "sim_render-npc0": 0.0037670812489073954, "sim_render-npc1": 0.0038159217363522378, "sim_render-npc2": 0.003823395128603335, "sim_render-npc3": 0.0038524174395902656, "get_duckie_state": 1.9544436607831792e-06, "in-drivable-lane": 2.3499999999999925, "agent_compute-ego": 0.010166647993488076, "deviation-heading": 0.8729402887745641, "agent_compute-npc0": 0.03152919109956718, "agent_compute-npc1": 0.031798589376755705, "agent_compute-npc2": 0.03195239879466869, "agent_compute-npc3": 0.03064538225715543, "complete-iteration": 0.7297311682759979, "set_robot_commands": 0.0024473284497673127, "deviation-center-line": 0.184707988976178, "driven_lanedir_consec": 0.477333714889808, "sim_compute_sim_state": 0.042888037952376, "sim_compute_performance-ego": 0.0023780398898654515, "sim_compute_performance-npc0": 0.002230070255420826, "sim_compute_performance-npc1": 0.0022803530280972703, "sim_compute_performance-npc2": 0.0022679140538345148, "sim_compute_performance-npc3": 0.0022627071098045067}, "udem1-sc5-0-ego": {"driven_any": 1.6818403724826831, "get_ui_image": 0.04777919394629342, "step_physics": 0.45093718313035513, "survival_time": 4.199999999999993, "driven_lanedir": 0.43918340276703793, "get_state_dump": 0.015575179031917028, "sim_render-ego": 0.004141214348021008, "get_robot_state": 0.02469727255049206, "sim_render-npc0": 0.004064247721717471, "sim_render-npc1": 0.004203268459865025, "sim_render-npc2": 0.0040135695820763, "sim_render-npc3": 0.0041462381680806475, "get_duckie_state": 2.1230606805710566e-06, "in-drivable-lane": 2.1999999999999935, "agent_compute-ego": 0.01071411655062721, "deviation-heading": 1.4044443915979827, "agent_compute-npc0": 0.03272596995035807, "agent_compute-npc1": 0.03366264842805408, "agent_compute-npc2": 0.03410732178460984, "agent_compute-npc3": 0.034308484622410367, "complete-iteration": 0.7861458545639401, "set_robot_commands": 0.0027554971831185477, "deviation-center-line": 0.1795493427001818, "driven_lanedir_consec": 0.4357083860821892, "sim_compute_sim_state": 0.05482551881245205, "sim_compute_performance-ego": 0.002660447642916725, "sim_compute_performance-npc0": 0.0024110589708600727, "sim_compute_performance-npc1": 0.0025434777850196475, "sim_compute_performance-npc2": 0.002398647013164702, "sim_compute_performance-npc3": 0.0024741802896772113}, "udem1-sc6-0-ego": {"driven_any": 2.961972313082518, "get_ui_image": 0.04858590036198713, "step_physics": 0.4408623394758805, "survival_time": 6.8999999999999835, "driven_lanedir": 0.8746039945577948, "get_state_dump": 0.015890458355779232, "sim_render-ego": 0.004035714743793875, "get_robot_state": 0.02481027098669522, "sim_render-npc0": 0.0039234489634417105, "sim_render-npc1": 0.003983150357785432, "sim_render-npc2": 0.004056685212729633, "sim_render-npc3": 0.004091613534568012, "get_duckie_state": 1.9730001256085825e-06, "in-drivable-lane": 4.199999999999985, "agent_compute-ego": 0.01049757176551266, "deviation-heading": 0.9576359045920072, "agent_compute-npc0": 0.03407505456952081, "agent_compute-npc1": 0.03256232842155125, "agent_compute-npc2": 0.03234316991723102, "agent_compute-npc3": 0.03294904853986657, "complete-iteration": 0.7716499532478444, "set_robot_commands": 0.0026155381962872934, "deviation-center-line": 0.19546381944791505, "driven_lanedir_consec": 0.7639095529729125, "sim_compute_sim_state": 0.05327253929082898, "sim_compute_performance-ego": 0.002572897551716238, "sim_compute_performance-npc0": 0.0023649395376011944, "sim_compute_performance-npc1": 0.0024159818455792856, "sim_compute_performance-npc2": 0.0024131916571354523, "sim_compute_performance-npc3": 0.0024678983550140824}, "udem1-sc7-0-ego": {"driven_any": 2.6898860562679774, "get_ui_image": 0.04579942321777344, "step_physics": 0.4573595657348633, "survival_time": 6.249999999999986, "driven_lanedir": 0.7202594905145643, "get_state_dump": 0.014819091796875, "sim_render-ego": 0.003894399642944336, "get_robot_state": 0.023600244522094728, "sim_render-npc0": 0.003839874267578125, "sim_render-npc1": 0.003875444412231445, "sim_render-npc2": 0.003887332916259766, "sim_render-npc3": 0.004029441833496094, "get_duckie_state": 1.9474029541015623e-06, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.010535139083862303, "deviation-heading": 1.2403877221153448, "agent_compute-npc0": 0.03255812835693359, "agent_compute-npc1": 0.03235136032104492, "agent_compute-npc2": 0.03145167350769043, "agent_compute-npc3": 0.032592567443847656, "complete-iteration": 0.7702779331207276, "set_robot_commands": 0.0026223793029785157, "deviation-center-line": 0.2459006864630789, "driven_lanedir_consec": 0.7041893367278476, "sim_compute_sim_state": 0.045098880767822265, "sim_compute_performance-ego": 0.0024431571960449217, "sim_compute_performance-npc0": 0.002259117126464844, "sim_compute_performance-npc1": 0.002302696228027344, "sim_compute_performance-npc2": 0.0023100223541259765, "sim_compute_performance-npc3": 0.0024210739135742186}, "udem1-sc8-0-ego": {"driven_any": 3.41780393529469, "get_ui_image": 0.048253991664984286, "step_physics": 0.46108753711749345, "survival_time": 7.79999999999998, "driven_lanedir": 1.0344677423234492, "get_state_dump": 0.01551185510097406, "sim_render-ego": 0.004209556640722813, "get_robot_state": 0.02619459995856652, "sim_render-npc0": 0.004031807948381473, "sim_render-npc1": 0.004146840327825301, "sim_render-npc2": 0.004181884802304781, "sim_render-npc3": 0.004321139592390794, "get_duckie_state": 1.91651857816256e-06, "in-drivable-lane": 5.1999999999999815, "agent_compute-ego": 0.010571493552281309, "deviation-heading": 0.2830663691341847, "agent_compute-npc0": 0.033483393681355014, "agent_compute-npc1": 0.03382596908471523, "agent_compute-npc2": 0.03381338180639805, "agent_compute-npc3": 0.0339321494102478, "complete-iteration": 0.7956343308473245, "set_robot_commands": 0.0026829380255479077, "deviation-center-line": 0.22509686603867096, "driven_lanedir_consec": 1.0339306308362946, "sim_compute_sim_state": 0.050793042549720176, "sim_compute_performance-ego": 0.002943839782323593, "sim_compute_performance-npc0": 0.002491481793232453, "sim_compute_performance-npc1": 0.002570619949927697, "sim_compute_performance-npc2": 0.0026088983584672976, "sim_compute_performance-npc3": 0.002636559498615754}, "udem1-sc9-0-ego": {"driven_any": 1.8315226746073816, "get_ui_image": 0.05513879385861484, "step_physics": 0.5412683378566395, "survival_time": 4.399999999999992, "driven_lanedir": 0.5239188590751227, "get_state_dump": 0.017610617659308693, "sim_render-ego": 0.004577205939726396, "get_robot_state": 0.02751913395794955, "sim_render-npc0": 0.0045184438878839665, "sim_render-npc1": 0.004422995177182284, "sim_render-npc2": 0.004443751140074296, "sim_render-npc3": 0.004446777430447665, "get_duckie_state": 2.874569459394975e-06, "in-drivable-lane": 2.549999999999992, "agent_compute-ego": 0.01168390295722268, "deviation-heading": 1.064452939187563, "agent_compute-npc0": 0.03805001486431469, "agent_compute-npc1": 0.03808620030229742, "agent_compute-npc2": 0.03741992603648792, "agent_compute-npc3": 0.03681281208992005, "complete-iteration": 0.9132116816260598, "set_robot_commands": 0.0029787421226501465, "deviation-center-line": 0.1423529139565091, "driven_lanedir_consec": 0.5239188590751227, "sim_compute_sim_state": 0.05819554220546375, "sim_compute_performance-ego": 0.002987119284543124, "sim_compute_performance-npc0": 0.00263866511258212, "sim_compute_performance-npc1": 0.0027618245645002885, "sim_compute_performance-npc2": 0.0027371238578449597, "sim_compute_performance-npc3": 0.002707261930812489}, "udem1-sc10-0-ego": {"driven_any": 2.8534593852780996, "get_ui_image": 0.05636208527015917, "step_physics": 0.5201102567441536, "survival_time": 6.5999999999999845, "driven_lanedir": 1.837861655910459, "get_state_dump": 0.01797760616649281, "sim_render-ego": 0.004567545471769391, "get_robot_state": 0.027366004206917503, "sim_render-npc0": 0.0044446587562561035, "sim_render-npc1": 0.004507200284437699, "sim_render-npc2": 0.004439032439029578, "sim_render-npc3": 0.004431870850649747, "get_duckie_state": 4.067565455581203e-06, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.01150919632478194, "deviation-heading": 0.8389720194437515, "agent_compute-npc0": 0.03768876104643851, "agent_compute-npc1": 0.03670187610568422, "agent_compute-npc2": 0.037109738046472725, "agent_compute-npc3": 0.03683532006812818, "complete-iteration": 0.8906051083044573, "set_robot_commands": 0.002980194308541038, "deviation-center-line": 0.24581087648635308, "driven_lanedir_consec": 1.8136251927382008, "sim_compute_sim_state": 0.05765879515445593, "sim_compute_performance-ego": 0.0028203346512534404, "sim_compute_performance-npc0": 0.0026528781110590153, "sim_compute_performance-npc1": 0.0027749989971970067, "sim_compute_performance-npc2": 0.0027355912959936895, "sim_compute_performance-npc3": 0.0026500116695057263}, "udem1-sc11-0-ego": {"driven_any": 1.687423944570554, "get_ui_image": 0.047695628234318325, "step_physics": 0.4331381292570205, "survival_time": 4.199999999999993, "driven_lanedir": 0.7130885069919716, "get_state_dump": 0.01559480315163022, "sim_render-ego": 0.003923529670352028, "get_robot_state": 0.02432759886696225, "sim_render-npc0": 0.0038068918954758417, "sim_render-npc1": 0.003892021519797189, "sim_render-npc2": 0.003921855063665481, "sim_render-npc3": 0.003770794187273298, "get_duckie_state": 1.7029898507254463e-06, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.010149064518156508, "deviation-heading": 0.41519422857338206, "agent_compute-npc0": 0.03361257768812634, "agent_compute-npc1": 0.03166212922050839, "agent_compute-npc2": 0.03221442302068075, "agent_compute-npc3": 0.03097399075826009, "complete-iteration": 0.7518872136161441, "set_robot_commands": 0.0024997450056530182, "deviation-center-line": 0.1070227212468813, "driven_lanedir_consec": 0.6902476101050405, "sim_compute_sim_state": 0.04860086384273711, "sim_compute_performance-ego": 0.0024687818118504117, "sim_compute_performance-npc0": 0.0022503421420142764, "sim_compute_performance-npc1": 0.00232065859295073, "sim_compute_performance-npc2": 0.00240116176151094, "sim_compute_performance-npc3": 0.0022045232000805085}, "udem1-sc12-0-ego": {"driven_any": 0.7567520068014945, "get_ui_image": 0.04667305378686814, "step_physics": 0.4792356945219494, "survival_time": 2.1000000000000005, "driven_lanedir": 0.5209264164273528, "get_state_dump": 0.01475673062460763, "sim_render-ego": 0.0037168037323724655, "get_robot_state": 0.02353284472510928, "sim_render-npc0": 0.003672889300755092, "sim_render-npc1": 0.0038527817953200568, "sim_render-npc2": 0.003949585415068127, "sim_render-npc3": 0.0037946530750819617, "get_duckie_state": 1.5837805611746653e-06, "in-drivable-lane": 0.4999999999999998, "agent_compute-ego": 0.010472150076003302, "deviation-heading": 0.4267154905767672, "agent_compute-npc0": 0.032474676767985024, "agent_compute-npc1": 0.03203799611046201, "agent_compute-npc2": 0.03381247179848807, "agent_compute-npc3": 0.033997660591488794, "complete-iteration": 0.7966561714808146, "set_robot_commands": 0.0026492164248511905, "deviation-center-line": 0.1205538453494299, "driven_lanedir_consec": 0.5209264164273528, "sim_compute_sim_state": 0.046275184268043154, "sim_compute_performance-ego": 0.002376090912591843, "sim_compute_performance-npc0": 0.002182801564534506, "sim_compute_performance-npc1": 0.00226551578158424, "sim_compute_performance-npc2": 0.002343172118777321, "sim_compute_performance-npc3": 0.002270392009190151}, "udem1-sc13-0-ego": {"driven_any": 2.3086025061206072, "get_ui_image": 0.047618614178951656, "step_physics": 0.4368049964726528, "survival_time": 5.349999999999989, "driven_lanedir": 0.4067111657247411, "get_state_dump": 0.015955490486644137, "sim_render-ego": 0.003829381176244433, "get_robot_state": 0.024461859854582314, "sim_render-npc0": 0.003809079945644486, "sim_render-npc1": 0.004026531059051228, "sim_render-npc2": 0.003911446188097802, "sim_render-npc3": 0.003970351174613026, "get_duckie_state": 2.0365848719516648e-06, "in-drivable-lane": 4.099999999999988, "agent_compute-ego": 0.010538346299501225, "deviation-heading": 0.3581647428449098, "agent_compute-npc0": 0.03236905213828399, "agent_compute-npc1": 0.03327809984438887, "agent_compute-npc2": 0.03364597971194258, "agent_compute-npc3": 0.031428103135010904, "complete-iteration": 0.7614601126341062, "set_robot_commands": 0.002532239272215656, "deviation-center-line": 0.09566373479923714, "driven_lanedir_consec": 0.4067111657247411, "sim_compute_sim_state": 0.05112815348901481, "sim_compute_performance-ego": 0.0023603818126928027, "sim_compute_performance-npc0": 0.0022331643327374324, "sim_compute_performance-npc1": 0.0023949480502404898, "sim_compute_performance-npc2": 0.002371649875819126, "sim_compute_performance-npc3": 0.0023590248321818416}, "udem1-sc14-0-ego": {"driven_any": 1.735080871888136, "get_ui_image": 0.04688599310725568, "step_physics": 0.4611358613852995, "survival_time": 4.149999999999993, "driven_lanedir": 0.9043032554702546, "get_state_dump": 0.01541564837995782, "sim_render-ego": 0.003881253391863352, "get_robot_state": 0.023948206959000552, "sim_render-npc0": 0.003797083015901496, "sim_render-npc1": 0.003948662654463067, "sim_render-npc2": 0.003940521952617599, "sim_render-npc3": 0.003985298685280673, "get_duckie_state": 1.487961734633848e-06, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.01017087338918663, "deviation-heading": 0.777522186249618, "agent_compute-npc0": 0.03235422846782638, "agent_compute-npc1": 0.03281459463648049, "agent_compute-npc2": 0.03260012132575713, "agent_compute-npc3": 0.03161210611642125, "complete-iteration": 0.7778839088348021, "set_robot_commands": 0.0024941283536244587, "deviation-center-line": 0.1679043415757897, "driven_lanedir_consec": 0.9043032554702546, "sim_compute_sim_state": 0.04685265184885048, "sim_compute_performance-ego": 0.0023727618068097585, "sim_compute_performance-npc0": 0.0021714302430669947, "sim_compute_performance-npc1": 0.0023181323545524873, "sim_compute_performance-npc2": 0.002346067543489387, "sim_compute_performance-npc3": 0.0023253911949065796}}
set_robot_commands_max	0.002980194308541038
set_robot_commands_mean	0.002682561272220914
set_robot_commands_median	0.0026492164248511905
set_robot_commands_min	0.0024473284497673127
sim_compute_performance-ego_max	0.002987119284543124
sim_compute_performance-ego_mean	0.0026078559712869064
sim_compute_performance-ego_median	0.0026080553559051163
sim_compute_performance-ego_min	0.0023603818126928027
sim_compute_performance-npc0_max	0.002767136693000794
sim_compute_performance-npc0_mean	0.002399631582182663
sim_compute_performance-npc0_median	0.0023649395376011944
sim_compute_performance-npc0_min	0.0021714302430669947
sim_compute_performance-npc1_max	0.0027749989971970067
sim_compute_performance-npc1_mean	0.0024673655232460715
sim_compute_performance-npc1_median	0.0024159818455792856
sim_compute_performance-npc1_min	0.00226551578158424
sim_compute_performance-npc2_max	0.0027371238578449597
sim_compute_performance-npc2_mean	0.0024778130454934104
sim_compute_performance-npc2_median	0.0024131916571354523
sim_compute_performance-npc2_min	0.0022679140538345148
sim_compute_performance-npc3_max	0.002707261930812489
sim_compute_performance-npc3_mean	0.0024690143154278846
sim_compute_performance-npc3_median	0.0024678983550140824
sim_compute_performance-npc3_min	0.0022045232000805085
sim_compute_sim_state_max	0.05819554220546375
sim_compute_sim_state_mean	0.05080159601151315
sim_compute_sim_state_median	0.05112815348901481
sim_compute_sim_state_min	0.042888037952376
sim_render-ego_max	0.004577205939726396
sim_render-ego_mean	0.004120718779184285
sim_render-ego_median	0.004103871597640816
sim_render-ego_min	0.0037168037323724655
sim_render-npc0_max	0.0045184438878839665
sim_render-npc0_mean	0.004005836559379373
sim_render-npc0_median	0.003982824087142944
sim_render-npc0_min	0.003672889300755092
sim_render-npc1_max	0.004507200284437699
sim_render-npc1_mean	0.004082885563268911
sim_render-npc1_median	0.004026531059051228
sim_render-npc1_min	0.0038159217363522378
sim_render-npc2_max	0.004443751140074296
sim_render-npc2_mean	0.0040919183347189105
sim_render-npc2_median	0.004036599192126044
sim_render-npc2_min	0.003823395128603335
sim_render-npc3_max	0.004446777430447665
sim_render-npc3_mean	0.0041233577287158145
sim_render-npc3_median	0.004097679257392883
sim_render-npc3_min	0.003770794187273298
simulation-passed	1
step_physics_max	0.5974322557449341
step_physics_mean	0.4786563013089467
step_physics_median	0.4611358613852995
step_physics_min	0.4234648781058229
survival_time_max	7.79999999999998
survival_time_mean	4.826666666666657
survival_time_min	2.1000000000000005

No reset possible