Duckietown Challenges Home Challenges Submissions

Evaluator 4927

ID4927
evaluatornogpu-prod-03
ownerI don't have one πŸ˜€
machinenogpu-prod_63065d60c28a
processnogpu-prod-03_63065d60c28a
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success44 58163
# timeout
# failed17 58369
# error1 58753
# aborted5 58240
# host-error13 59626
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6042713282AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ίreal-v1.0-3092-363aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:34:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.660644040711865
survival_time_median59.99999999999873
deviation-center-line_median2.5732641409273977
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012341070135467556
agent_compute-ego0_mean0.011603321411726774
agent_compute-ego0_median0.0114438768032687
agent_compute-ego0_min0.011184461904902144
complete-iteration_max0.2267892193933212
complete-iteration_mean0.1916900998746029
complete-iteration_median0.19334795691389328
complete-iteration_min0.1532752662773037
deviation-center-line_max2.7497821933347133
deviation-center-line_mean2.587513112810144
deviation-center-line_min2.453741976051067
deviation-heading_max8.087897181989774
deviation-heading_mean7.577772380214091
deviation-heading_median7.951548742240181
deviation-heading_min6.320094854386222
driven_any_max31.482557797437433
driven_any_mean29.579891750436328
driven_any_median28.985078749821152
driven_any_min28.866851704665574
driven_lanedir_consec_max31.245802316675046
driven_lanedir_consec_mean29.290640483010144
driven_lanedir_consec_min28.595471533941808
driven_lanedir_max31.245802316675046
driven_lanedir_mean29.290640483010144
driven_lanedir_median28.660644040711865
driven_lanedir_min28.595471533941808
get_duckie_state_max1.1875270109788067e-06
get_duckie_state_mean1.1415703906107704e-06
get_duckie_state_median1.1374015395190695e-06
get_duckie_state_min1.1039514724261358e-06
get_robot_state_max0.003522143971413796
get_robot_state_mean0.003327342493150951
get_robot_state_median0.003285418144372182
get_robot_state_min0.0032163897124456425
get_state_dump_max0.004513025680846914
get_state_dump_mean0.004202095148069078
get_state_dump_median0.004144069753419747
get_state_dump_min0.004007215404589905
get_ui_image_max0.03066283062435407
get_ui_image_mean0.02712846060378863
get_ui_image_median0.027842899643312782
get_ui_image_min0.02216521250417489
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 31.482557797437433, "get_ui_image": 0.02518355598259131, "step_physics": 0.10730128224743692, "survival_time": 59.99999999999873, "driven_lanedir": 31.245802316675046, "get_state_dump": 0.004249949141604815, "get_robot_state": 0.003347900884534596, "sim_render-ego0": 0.00353084376809202, "get_duckie_state": 1.1120906578908851e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.320094854386222, "agent_compute-ego0": 0.011592609102184032, "complete-iteration": 0.16735875894386107, "set_robot_commands": 0.00194519802890749, "deviation-center-line": 2.453741976051067, "driven_lanedir_consec": 31.245802316675046, "sim_compute_sim_state": 0.008372884904415184, "sim_compute_performance-ego0": 0.001760112355888932}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.935560847113425, "get_ui_image": 0.03066283062435407, "step_physics": 0.15156107063992236, "survival_time": 59.99999999999873, "driven_lanedir": 28.59830286312536, "get_state_dump": 0.00403819036523468, "get_robot_state": 0.0032163897124456425, "sim_render-ego0": 0.0033655073323118796, "get_duckie_state": 1.1875270109788067e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.087897181989774, "agent_compute-ego0": 0.011295144504353366, "complete-iteration": 0.21933715488392547, "set_robot_commands": 0.0017917658466780613, "deviation-center-line": 2.663665914396053, "driven_lanedir_consec": 28.59830286312536, "sim_compute_sim_state": 0.011662165787098906, "sim_compute_performance-ego0": 0.0016720215545705118}, "LF-norm-techtrack-000-ego0": {"driven_any": 29.03459665252888, "get_ui_image": 0.030502243304034254, "step_physics": 0.15597904949362928, "survival_time": 59.99999999999873, "driven_lanedir": 28.72298521829837, "get_state_dump": 0.004513025680846914, "get_robot_state": 0.003522143971413796, "sim_render-ego0": 0.003689418525918139, "get_duckie_state": 1.1627124211472537e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.888715162231757, "agent_compute-ego0": 0.012341070135467556, "complete-iteration": 0.2267892193933212, "set_robot_commands": 0.0020712225959263275, "deviation-center-line": 2.7497821933347133, "driven_lanedir_consec": 28.72298521829837, "sim_compute_sim_state": 0.01222308271632008, "sim_compute_performance-ego0": 0.001868267837511709}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.866851704665574, "get_ui_image": 0.02216521250417489, "step_physics": 0.10038484204917228, "survival_time": 59.99999999999873, "driven_lanedir": 28.595471533941808, "get_state_dump": 0.004007215404589905, "get_robot_state": 0.003222935404209769, "sim_render-ego0": 0.0033402226548905575, "get_duckie_state": 1.1039514724261358e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.014382322248606, "agent_compute-ego0": 0.011184461904902144, "complete-iteration": 0.1532752662773037, "set_robot_commands": 0.00181367752653276, "deviation-center-line": 2.4828623674587424, "driven_lanedir_consec": 28.595471533941808, "sim_compute_sim_state": 0.005426916055734906, "sim_compute_performance-ego0": 0.001658978013571454}}
set_robot_commands_max0.0020712225959263275
set_robot_commands_mean0.00190546599951116
set_robot_commands_median0.0018794377777201251
set_robot_commands_min0.0017917658466780613
sim_compute_performance-ego0_max0.001868267837511709
sim_compute_performance-ego0_mean0.0017398449403856517
sim_compute_performance-ego0_median0.001716066955229722
sim_compute_performance-ego0_min0.001658978013571454
sim_compute_sim_state_max0.01222308271632008
sim_compute_sim_state_mean0.009421262365892268
sim_compute_sim_state_median0.010017525345757044
sim_compute_sim_state_min0.005426916055734906
sim_render-ego0_max0.003689418525918139
sim_render-ego0_mean0.003481498070303149
sim_render-ego0_median0.0034481755502019495
sim_render-ego0_min0.0033402226548905575
simulation-passed1
step_physics_max0.15597904949362928
step_physics_mean0.1288065611075402
step_physics_median0.12943117644367963
step_physics_min0.10038484204917228
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6009111772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6008911772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6008611772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6008211772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6008111772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6007610933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6007210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6007110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6006911012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6005011010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-030:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5993112800Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LFP-sim-validationLFP-simsuccessyesnogpu-prod-030:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.250000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median1.700901555546012
deviation-center-line_median0.5429791903351483


other stats
agent_compute-ego0_max0.012783283918676242
agent_compute-ego0_mean0.01206111847292941
agent_compute-ego0_median0.012044335018143844
agent_compute-ego0_min0.011372519936753716
complete-iteration_max0.30137863564998546
complete-iteration_mean0.2557829811940065
complete-iteration_median0.26483142470846277
complete-iteration_min0.19209043970911496
deviation-center-line_max0.7474524979027529
deviation-center-line_mean0.5262449182483333
deviation-center-line_min0.27156879442028387
deviation-heading_max3.920466854835874
deviation-heading_mean2.5102639537843903
deviation-heading_median2.3261806374355034
deviation-heading_min1.468227685430679
driven_any_max2.4487013880719295
driven_any_mean1.6509014446020238
driven_any_median1.779478209906343
driven_any_min0.5959479705234799
driven_lanedir_consec_max2.276294796911712
driven_lanedir_consec_mean1.5588404027326512
driven_lanedir_consec_min0.5572637029268692
driven_lanedir_max2.276294796911712
driven_lanedir_mean1.5588404027326512
driven_lanedir_median1.700901555546012
driven_lanedir_min0.5572637029268692
get_duckie_state_max0.02479089135709016
get_duckie_state_mean0.017584387304978317
get_duckie_state_median0.020676863275675993
get_duckie_state_min0.004192931311471122
get_robot_state_max0.003848433494567871
get_robot_state_mean0.0037114457056746175
get_robot_state_median0.003696684336684348
get_robot_state_min0.003603980654761905
get_state_dump_max0.00869254962257717
get_state_dump_mean0.007564608542230507
get_state_dump_median0.008121797932741133
get_state_dump_min0.005322288680862594
get_ui_image_max0.03787787924421594
get_ui_image_mean0.033635931765786165
get_ui_image_median0.03496060264088666
get_ui_image_min0.02674464253715543
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.2044355712355763, "get_ui_image": 0.03292024861211362, "step_physics": 0.15125485088514246, "survival_time": 11.450000000000028, "driven_lanedir": 2.095448123324285, "get_state_dump": 0.00869254962257717, "get_robot_state": 0.003715034153150476, "sim_render-ego0": 0.003876727560292119, "get_duckie_state": 0.02479089135709016, "in-drivable-lane": 0.0, "deviation-heading": 2.886282538659531, "agent_compute-ego0": 0.011967286856278129, "complete-iteration": 0.2491632181665172, "set_robot_commands": 0.0021955749262934144, "deviation-center-line": 0.7174256913848289, "driven_lanedir_consec": 2.095448123324285, "sim_compute_sim_state": 0.007707900586335556, "sim_compute_performance-ego0": 0.0019493745720904807}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5959479705234799, "get_ui_image": 0.03787787924421594, "step_physics": 0.20186735467707856, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5572637029268692, "get_state_dump": 0.007864650259626673, "get_robot_state": 0.00367833452021822, "sim_render-ego0": 0.003856014698109728, "get_duckie_state": 0.020415615528187853, "in-drivable-lane": 0.0, "deviation-heading": 1.468227685430679, "agent_compute-ego0": 0.012121383180009555, "complete-iteration": 0.30137863564998546, "set_robot_commands": 0.002127193390054906, "deviation-center-line": 0.27156879442028387, "driven_lanedir_consec": 0.5572637029268692, "sim_compute_sim_state": 0.00952758180334213, "sim_compute_performance-ego0": 0.00195229560770887}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.3545208485771096, "get_ui_image": 0.03700095666965968, "step_physics": 0.1755361708117203, "survival_time": 7.049999999999983, "driven_lanedir": 1.3063549877677385, "get_state_dump": 0.008378945605855592, "get_robot_state": 0.003848433494567871, "sim_render-ego0": 0.003943755593098385, "get_duckie_state": 0.020938111023164133, "in-drivable-lane": 0.0, "deviation-heading": 1.766078736211476, "agent_compute-ego0": 0.012783283918676242, "complete-iteration": 0.28049963125040833, "set_robot_commands": 0.00221677733139253, "deviation-center-line": 0.3685326892854678, "driven_lanedir_consec": 1.3063549877677385, "sim_compute_sim_state": 0.013733774843350264, "sim_compute_performance-ego0": 0.0020235306780103227}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.4487013880719295, "get_ui_image": 0.02674464253715543, "step_physics": 0.12731862592173146, "survival_time": 13.600000000000058, "driven_lanedir": 2.276294796911712, "get_state_dump": 0.005322288680862594, "get_robot_state": 0.003603980654761905, "sim_render-ego0": 0.003662592325455103, "get_duckie_state": 0.004192931311471122, "in-drivable-lane": 0.0, "deviation-heading": 3.920466854835874, "agent_compute-ego0": 0.011372519936753716, "complete-iteration": 0.19209043970911496, "set_robot_commands": 0.002113356258406307, "deviation-center-line": 0.7474524979027529, "driven_lanedir_consec": 2.276294796911712, "sim_compute_sim_state": 0.005822145895206884, "sim_compute_performance-ego0": 0.0018467693538456176}}
set_robot_commands_max0.00221677733139253
set_robot_commands_mean0.002163225476536789
set_robot_commands_median0.00216138415817416
set_robot_commands_min0.002113356258406307
sim_compute_performance-ego0_max0.0020235306780103227
sim_compute_performance-ego0_mean0.001942992552913823
sim_compute_performance-ego0_median0.0019508350898996755
sim_compute_performance-ego0_min0.0018467693538456176
sim_compute_sim_state_max0.013733774843350264
sim_compute_sim_state_mean0.009197850782058708
sim_compute_sim_state_median0.008617741194838843
sim_compute_sim_state_min0.005822145895206884
sim_render-ego0_max0.003943755593098385
sim_render-ego0_mean0.003834772544238834
sim_render-ego0_median0.003866371129200924
sim_render-ego0_min0.003662592325455103
simulation-passed1
step_physics_max0.20186735467707856
step_physics_mean0.1639942505739182
step_physics_median0.16339551084843135
step_physics_min0.12731862592173146
survival_time_max13.600000000000058
survival_time_mean9.187500000000014
survival_time_min4.6499999999999915
No reset possible
5984910355Anthony CourchesneΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-031:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

β”‚ container_ids: [db242b590a0ea7614795ddb01d61cdd2d4e85a748ec586e5e0255725af4f832b,
β”‚                 45baafa83983da435559dae66a163c1968241bc217a38bdb3a8acb787c3228d7,
β”‚                 235e914cad5ab34f242facb8d8ba68cd8d86b1632f09e84500b9ec4004ffe5a0]
β”‚      services: dict[4]
β”‚                β”‚ solution:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/courchesnea/aido-submissions@sha256:0432ee8d2ad2fb445c4d139974411c8f837d67987a22e5f8737b6968c8d52714
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/ego-in
β”‚                β”‚ β”‚ β”‚ AIDO_REQUIRE_GPU: 1
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10355
β”‚                β”‚ β”‚ β”‚ submitter_name: CourchesneA
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_10_05_18_25_45@sha256:0432ee8d2ad2fb445c4d139974411c8f837d67987a22e5f8737b6968c8d52714
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_15_10_22-24372/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ evaluator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[10]
β”‚                β”‚ β”‚ β”‚ experiment_manager_parameters:
β”‚                β”‚ β”‚ β”‚ |episodes_per_scenario: 1
β”‚                β”‚ β”‚ β”‚ |episode_length_s: 0.5
β”‚                β”‚ β”‚ β”‚ |min_episode_length_s: 0.0
β”‚                β”‚ β”‚ β”‚ |seed: 20200922
β”‚                β”‚ β”‚ β”‚ |physics_dt: 0.05
β”‚                β”‚ β”‚ β”‚ |max_failures: 2
β”‚                β”‚ β”‚ β”‚ |fifo_dir: /fifos
β”‚                β”‚ β”‚ β”‚ |sim_in: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ |sim_out: /fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ |sm_in: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ |sm_out: /fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ |timeout_initialization: 120
β”‚                β”‚ β”‚ β”‚ |timeout_regular: 120
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ |port: 10123 # visualization port
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10355
β”‚                β”‚ β”‚ β”‚ submitter_name: CourchesneA
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_10_05_18_25_45@sha256:0432ee8d2ad2fb445c4d139974411c8f837d67987a22e5f8737b6968c8d52714
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_15_10_22-24372/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ simulator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |env_constructor: Simulator
β”‚                β”‚ β”‚ β”‚ |env_parameters:
β”‚                β”‚ β”‚ β”‚ |  max_steps: 500001 # we don't want the gym to reset itself
β”‚                β”‚ β”‚ β”‚ |  domain_rand: 0
β”‚                β”‚ β”‚ β”‚ |  camera_width: 640
β”‚                β”‚ β”‚ β”‚ |  camera_height: 480
β”‚                β”‚ β”‚ β”‚ |  distortion: true
β”‚                β”‚ β”‚ β”‚ |  num_tris_distractors: 0
β”‚                β”‚ β”‚ β”‚ |  color_ground: [0, 0.3, 0] # green
β”‚                β”‚ β”‚ β”‚ |  enable_leds: true
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10355
β”‚                β”‚ β”‚ β”‚ submitter_name: CourchesneA
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_10_05_18_25_45@sha256:0432ee8d2ad2fb445c4d139974411c8f837d67987a22e5f8737b6968c8d52714
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_15_10_22-24372/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ scenario_maker:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |maps:
β”‚                β”‚ β”‚ β”‚ |- udem1
β”‚                β”‚ β”‚ β”‚ |scenarios_per_map: 1
β”‚                β”‚ β”‚ β”‚ |robots_npcs: []
β”‚                β”‚ β”‚ β”‚ |robots_pcs: [ego]
β”‚                β”‚ β”‚ β”‚ |robots_parked: [parked]
β”‚                β”‚ β”‚ β”‚ |nduckies: 1
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10355
β”‚                β”‚ β”‚ β”‚ submitter_name: CourchesneA
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_10_05_18_25_45@sha256:0432ee8d2ad2fb445c4d139974411c8f837d67987a22e5f8737b6968c8d52714
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10355/sanity-check-nogpu-prod-03_63065d60c28a-job59849-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_15_10_22-24372/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚           res: dict[3]
β”‚                β”‚ evaluator: db242b590a0ea7614795ddb01d61cdd2d4e85a748ec586e5e0255725af4f832b
β”‚                β”‚ simulator: 45baafa83983da435559dae66a163c1968241bc217a38bdb3a8acb787c3228d7
β”‚                β”‚ solution: 235e914cad5ab34f242facb8d8ba68cd8d86b1632f09e84500b9ec4004ffe5a0
β”‚         names: dict[3]
β”‚                β”‚ db242b590a0ea7614795ddb01d61cdd2d4e85a748ec586e5e0255725af4f832b: nogpu-prod-03_63065d60c28a-job59849-931330_evaluator_1
β”‚                β”‚ 45baafa83983da435559dae66a163c1968241bc217a38bdb3a8acb787c3228d7: nogpu-prod-03_63065d60c28a-job59849-931330_simulator_1
β”‚                β”‚ 235e914cad5ab34f242facb8d8ba68cd8d86b1632f09e84500b9ec4004ffe5a0: nogpu-prod-03_63065d60c28a-job59849-931330_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: |db242b590a0ea7614795ddb01d61cdd2d4e85a748ec586e5e0255725af4f832b
β”‚         |45baafa83983da435559dae66a163c1968241bc217a38bdb3a8acb787c3228d7
β”‚         |235e914cad5ab34f242facb8d8ba68cd8d86b1632f09e84500b9ec4004ffe5a0
β”‚         |
β”‚  names: dict[3]
β”‚         β”‚ db242b590a0ea7614795ddb01d61cdd2d4e85a748ec586e5e0255725af4f832b: nogpu-prod-03_63065d60c28a-job59849-931330_evaluator_1
β”‚         β”‚ 45baafa83983da435559dae66a163c1968241bc217a38bdb3a8acb787c3228d7: nogpu-prod-03_63065d60c28a-job59849-931330_simulator_1
β”‚         β”‚ 235e914cad5ab34f242facb8d8ba68cd8d86b1632f09e84500b9ec4004ffe5a0: nogpu-prod-03_63065d60c28a-job59849-931330_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5972910110Raphael Jeanexercise_ros_templateaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-031:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

β”‚ container_ids: [216daece41b1b1b646aa27d93beb0fc1eff0ec125005a88f1e360e6f716a2b99,
β”‚                 9a1fc2580b3dc5dcf33b557bfd92bfe3f35cdee9822f11b4e947db0f062a4ebf,
β”‚                 c0e6b264a5bab958ea58b739aef14c5ad25925a6aa0a5f3a4ac2e2c6db37f793]
β”‚      services: dict[4]
β”‚                β”‚ solution:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/raphjean/aido-submissions@sha256:10a2a5a7d6fdcf7ab3bbb74c0b8296755c707ca37d472ce4c3a90ae04c3eeee1
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/ego-in
β”‚                β”‚ β”‚ β”‚ AIDO_REQUIRE_GPU: 1
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10110
β”‚                β”‚ β”‚ β”‚ submitter_name: raph
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_11_02_21_30_56@sha256:10a2a5a7d6fdcf7ab3bbb74c0b8296755c707ca37d472ce4c3a90ae04c3eeee1
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_47_58-20999/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ evaluator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[10]
β”‚                β”‚ β”‚ β”‚ experiment_manager_parameters:
β”‚                β”‚ β”‚ β”‚ |episodes_per_scenario: 1
β”‚                β”‚ β”‚ β”‚ |episode_length_s: 0.5
β”‚                β”‚ β”‚ β”‚ |min_episode_length_s: 0.0
β”‚                β”‚ β”‚ β”‚ |seed: 20200922
β”‚                β”‚ β”‚ β”‚ |physics_dt: 0.05
β”‚                β”‚ β”‚ β”‚ |max_failures: 2
β”‚                β”‚ β”‚ β”‚ |fifo_dir: /fifos
β”‚                β”‚ β”‚ β”‚ |sim_in: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ |sim_out: /fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ |sm_in: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ |sm_out: /fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ |timeout_initialization: 120
β”‚                β”‚ β”‚ β”‚ |timeout_regular: 120
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ |port: 10123 # visualization port
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10110
β”‚                β”‚ β”‚ β”‚ submitter_name: raph
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_11_02_21_30_56@sha256:10a2a5a7d6fdcf7ab3bbb74c0b8296755c707ca37d472ce4c3a90ae04c3eeee1
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_47_58-20999/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ simulator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |env_constructor: Simulator
β”‚                β”‚ β”‚ β”‚ |env_parameters:
β”‚                β”‚ β”‚ β”‚ |  max_steps: 500001 # we don't want the gym to reset itself
β”‚                β”‚ β”‚ β”‚ |  domain_rand: 0
β”‚                β”‚ β”‚ β”‚ |  camera_width: 640
β”‚                β”‚ β”‚ β”‚ |  camera_height: 480
β”‚                β”‚ β”‚ β”‚ |  distortion: true
β”‚                β”‚ β”‚ β”‚ |  num_tris_distractors: 0
β”‚                β”‚ β”‚ β”‚ |  color_ground: [0, 0.3, 0] # green
β”‚                β”‚ β”‚ β”‚ |  enable_leds: true
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10110
β”‚                β”‚ β”‚ β”‚ submitter_name: raph
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_11_02_21_30_56@sha256:10a2a5a7d6fdcf7ab3bbb74c0b8296755c707ca37d472ce4c3a90ae04c3eeee1
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_47_58-20999/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ scenario_maker:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |maps:
β”‚                β”‚ β”‚ β”‚ |- udem1
β”‚                β”‚ β”‚ β”‚ |scenarios_per_map: 1
β”‚                β”‚ β”‚ β”‚ |robots_npcs: []
β”‚                β”‚ β”‚ β”‚ |robots_pcs: [ego]
β”‚                β”‚ β”‚ β”‚ |robots_parked: [parked]
β”‚                β”‚ β”‚ β”‚ |nduckies: 1
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10110
β”‚                β”‚ β”‚ β”‚ submitter_name: raph
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_11_02_21_30_56@sha256:10a2a5a7d6fdcf7ab3bbb74c0b8296755c707ca37d472ce4c3a90ae04c3eeee1
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-03_63065d60c28a}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10110/sanity-check-nogpu-prod-03_63065d60c28a-job59729-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_47_58-20999/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚           res: dict[3]
β”‚                β”‚ evaluator: 216daece41b1b1b646aa27d93beb0fc1eff0ec125005a88f1e360e6f716a2b99
β”‚                β”‚ simulator: 9a1fc2580b3dc5dcf33b557bfd92bfe3f35cdee9822f11b4e947db0f062a4ebf
β”‚                β”‚ solution: c0e6b264a5bab958ea58b739aef14c5ad25925a6aa0a5f3a4ac2e2c6db37f793
β”‚         names: dict[3]
β”‚                β”‚ 216daece41b1b1b646aa27d93beb0fc1eff0ec125005a88f1e360e6f716a2b99: nogpu-prod-03_63065d60c28a-job59729-869031_evaluator_1
β”‚                β”‚ 9a1fc2580b3dc5dcf33b557bfd92bfe3f35cdee9822f11b4e947db0f062a4ebf: nogpu-prod-03_63065d60c28a-job59729-869031_simulator_1
β”‚                β”‚ c0e6b264a5bab958ea58b739aef14c5ad25925a6aa0a5f3a4ac2e2c6db37f793: nogpu-prod-03_63065d60c28a-job59729-869031_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: |216daece41b1b1b646aa27d93beb0fc1eff0ec125005a88f1e360e6f716a2b99
β”‚         |9a1fc2580b3dc5dcf33b557bfd92bfe3f35cdee9822f11b4e947db0f062a4ebf
β”‚         |c0e6b264a5bab958ea58b739aef14c5ad25925a6aa0a5f3a4ac2e2c6db37f793
β”‚         |
β”‚  names: dict[3]
β”‚         β”‚ 216daece41b1b1b646aa27d93beb0fc1eff0ec125005a88f1e360e6f716a2b99: nogpu-prod-03_63065d60c28a-job59729-869031_evaluator_1
β”‚         β”‚ 9a1fc2580b3dc5dcf33b557bfd92bfe3f35cdee9822f11b4e947db0f062a4ebf: nogpu-prod-03_63065d60c28a-job59729-869031_simulator_1
β”‚         β”‚ c0e6b264a5bab958ea58b739aef14c5ad25925a6aa0a5f3a4ac2e2c6db37f793: nogpu-prod-03_63065d60c28a-job59729-869031_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5970810141Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.053558382576377905
survival_time_median0.49999999999999994
deviation-center-line_median0.007804328582113536
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013516729528253729
agent_compute-ego_mean0.013516729528253729
agent_compute-ego_median0.013516729528253729
agent_compute-ego_min0.013516729528253729
complete-iteration_max0.1765993291681463
complete-iteration_mean0.1765993291681463
complete-iteration_median0.1765993291681463
complete-iteration_min0.1765993291681463
deviation-center-line_max0.007804328582113536
deviation-center-line_mean0.007804328582113536
deviation-center-line_min0.007804328582113536
deviation-heading_max0.05033810845554867
deviation-heading_mean0.05033810845554867
deviation-heading_median0.05033810845554867
deviation-heading_min0.05033810845554867
driven_any_max0.053759824235869315
driven_any_mean0.053759824235869315
driven_any_median0.053759824235869315
driven_any_min0.053759824235869315
driven_lanedir_consec_max0.053558382576377905
driven_lanedir_consec_mean0.053558382576377905
driven_lanedir_consec_min0.053558382576377905
driven_lanedir_max0.053558382576377905
driven_lanedir_mean0.053558382576377905
driven_lanedir_median0.053558382576377905
driven_lanedir_min0.053558382576377905
get_duckie_state_max0.0023729801177978516
get_duckie_state_mean0.0023729801177978516
get_duckie_state_median0.0023729801177978516
get_duckie_state_min0.0023729801177978516
get_robot_state_max0.008703015067360619
get_robot_state_mean0.008703015067360619
get_robot_state_median0.008703015067360619
get_robot_state_min0.008703015067360619
get_state_dump_max0.009022951126098633
get_state_dump_mean0.009022951126098633
get_state_dump_median0.009022951126098633
get_state_dump_min0.009022951126098633
get_ui_image_max0.03256815130060369
get_ui_image_mean0.03256815130060369
get_ui_image_median0.03256815130060369
get_ui_image_min0.03256815130060369
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.053759824235869315, "get_ui_image": 0.03256815130060369, "step_physics": 0.08569379286332564, "survival_time": 0.49999999999999994, "driven_lanedir": 0.053558382576377905, "get_state_dump": 0.009022951126098633, "sim_render-ego": 0.004492542960427024, "get_robot_state": 0.008703015067360619, "get_duckie_state": 0.0023729801177978516, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013516729528253729, "deviation-heading": 0.05033810845554867, "complete-iteration": 0.1765993291681463, "set_robot_commands": 0.0027256878939541903, "deviation-center-line": 0.007804328582113536, "driven_lanedir_consec": 0.053558382576377905, "sim_compute_sim_state": 0.014801762320778587, "sim_compute_performance-ego": 0.0026161237196488814}}
set_robot_commands_max0.0027256878939541903
set_robot_commands_mean0.0027256878939541903
set_robot_commands_median0.0027256878939541903
set_robot_commands_min0.0027256878939541903
sim_compute_performance-ego_max0.0026161237196488814
sim_compute_performance-ego_mean0.0026161237196488814
sim_compute_performance-ego_median0.0026161237196488814
sim_compute_performance-ego_min0.0026161237196488814
sim_compute_sim_state_max0.014801762320778587
sim_compute_sim_state_mean0.014801762320778587
sim_compute_sim_state_median0.014801762320778587
sim_compute_sim_state_min0.014801762320778587
sim_render-ego_max0.004492542960427024
sim_render-ego_mean0.004492542960427024
sim_render-ego_median0.004492542960427024
sim_render-ego_min0.004492542960427024
simulation-passed1
step_physics_max0.08569379286332564
step_physics_mean0.08569379286332564
step_physics_median0.08569379286332564
step_physics_min0.08569379286332564
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5968610141Mo KleitΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05355874060728105
survival_time_median0.49999999999999994
deviation-center-line_median0.007804043691582392
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013719558715820312
agent_compute-ego_mean0.013719558715820312
agent_compute-ego_median0.013719558715820312
agent_compute-ego_min0.013719558715820312
complete-iteration_max0.15671010450883346
complete-iteration_mean0.15671010450883346
complete-iteration_median0.15671010450883346
complete-iteration_min0.15671010450883346
deviation-center-line_max0.007804043691582392
deviation-center-line_mean0.007804043691582392
deviation-center-line_min0.007804043691582392
deviation-heading_max0.05030928554975304
deviation-heading_mean0.05030928554975304
deviation-heading_median0.05030928554975304
deviation-heading_min0.05030928554975304
driven_any_max0.05375983499563633
driven_any_mean0.05375983499563633
driven_any_median0.05375983499563633
driven_any_min0.05375983499563633
driven_lanedir_consec_max0.05355874060728105
driven_lanedir_consec_mean0.05355874060728105
driven_lanedir_consec_min0.05355874060728105
driven_lanedir_max0.05355874060728105
driven_lanedir_mean0.05355874060728105
driven_lanedir_median0.05355874060728105
driven_lanedir_min0.05355874060728105
get_duckie_state_max0.0022335702722722835
get_duckie_state_mean0.0022335702722722835
get_duckie_state_median0.0022335702722722835
get_duckie_state_min0.0022335702722722835
get_robot_state_max0.008284070275046608
get_robot_state_mean0.008284070275046608
get_robot_state_median0.008284070275046608
get_robot_state_min0.008284070275046608
get_state_dump_max0.007702177221124823
get_state_dump_mean0.007702177221124823
get_state_dump_median0.007702177221124823
get_state_dump_min0.007702177221124823
get_ui_image_max0.02822644060308283
get_ui_image_mean0.02822644060308283
get_ui_image_median0.02822644060308283
get_ui_image_min0.02822644060308283
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.05375983499563633, "get_ui_image": 0.02822644060308283, "step_physics": 0.0747877684506503, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05355874060728105, "get_state_dump": 0.007702177221124823, "sim_render-ego": 0.0037584521553733134, "get_robot_state": 0.008284070275046608, "get_duckie_state": 0.0022335702722722835, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013719558715820312, "deviation-heading": 0.05030928554975304, "complete-iteration": 0.15671010450883346, "set_robot_commands": 0.0022769841280850496, "deviation-center-line": 0.007804043691582392, "driven_lanedir_consec": 0.05355874060728105, "sim_compute_sim_state": 0.013370990753173828, "sim_compute_performance-ego": 0.002273407849398526}}
set_robot_commands_max0.0022769841280850496
set_robot_commands_mean0.0022769841280850496
set_robot_commands_median0.0022769841280850496
set_robot_commands_min0.0022769841280850496
sim_compute_performance-ego_max0.002273407849398526
sim_compute_performance-ego_mean0.002273407849398526
sim_compute_performance-ego_median0.002273407849398526
sim_compute_performance-ego_min0.002273407849398526
sim_compute_sim_state_max0.013370990753173828
sim_compute_sim_state_mean0.013370990753173828
sim_compute_sim_state_median0.013370990753173828
sim_compute_sim_state_min0.013370990753173828
sim_render-ego_max0.0037584521553733134
sim_render-ego_mean0.0037584521553733134
sim_render-ego_median0.0037584521553733134
sim_render-ego_min0.0037584521553733134
simulation-passed1
step_physics_max0.0747877684506503
step_physics_mean0.0747877684506503
step_physics_median0.0747877684506503
step_physics_min0.0747877684506503
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5966510138Fernanda Custodio Pereira do CarmoΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03428847325537232
survival_time_median0.49999999999999994
deviation-center-line_median0.007479814285456928
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012250098315152254
agent_compute-ego_mean0.012250098315152254
agent_compute-ego_median0.012250098315152254
agent_compute-ego_min0.012250098315152254
complete-iteration_max0.1644759394905784
complete-iteration_mean0.1644759394905784
complete-iteration_median0.1644759394905784
complete-iteration_min0.1644759394905784
deviation-center-line_max0.007479814285456928
deviation-center-line_mean0.007479814285456928
deviation-center-line_min0.007479814285456928
deviation-heading_max0.04912435799046452
deviation-heading_mean0.04912435799046452
deviation-heading_median0.04912435799046452
deviation-heading_min0.04912435799046452
driven_any_max0.03440639208123214
driven_any_mean0.03440639208123214
driven_any_median0.03440639208123214
driven_any_min0.03440639208123214
driven_lanedir_consec_max0.03428847325537232
driven_lanedir_consec_mean0.03428847325537232
driven_lanedir_consec_min0.03428847325537232
driven_lanedir_max0.03428847325537232
driven_lanedir_mean0.03428847325537232
driven_lanedir_median0.03428847325537232
driven_lanedir_min0.03428847325537232
get_duckie_state_max0.002248590642755682
get_duckie_state_mean0.002248590642755682
get_duckie_state_median0.002248590642755682
get_duckie_state_min0.002248590642755682
get_robot_state_max0.007692185315218839
get_robot_state_mean0.007692185315218839
get_robot_state_median0.007692185315218839
get_robot_state_min0.007692185315218839
get_state_dump_max0.007728251543912021
get_state_dump_mean0.007728251543912021
get_state_dump_median0.007728251543912021
get_state_dump_min0.007728251543912021
get_ui_image_max0.029813311316750267
get_ui_image_mean0.029813311316750267
get_ui_image_median0.029813311316750267
get_ui_image_min0.029813311316750267
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03440639208123214, "get_ui_image": 0.029813311316750267, "step_physics": 0.08256153626875444, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03428847325537232, "get_state_dump": 0.007728251543912021, "sim_render-ego": 0.003757151690396396, "get_robot_state": 0.007692185315218839, "get_duckie_state": 0.002248590642755682, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012250098315152254, "deviation-heading": 0.04912435799046452, "complete-iteration": 0.1644759394905784, "set_robot_commands": 0.002392443743619052, "deviation-center-line": 0.007479814285456928, "driven_lanedir_consec": 0.03428847325537232, "sim_compute_sim_state": 0.013688737695867363, "sim_compute_performance-ego": 0.002261747013438832}}
set_robot_commands_max0.002392443743619052
set_robot_commands_mean0.002392443743619052
set_robot_commands_median0.002392443743619052
set_robot_commands_min0.002392443743619052
sim_compute_performance-ego_max0.002261747013438832
sim_compute_performance-ego_mean0.002261747013438832
sim_compute_performance-ego_median0.002261747013438832
sim_compute_performance-ego_min0.002261747013438832
sim_compute_sim_state_max0.013688737695867363
sim_compute_sim_state_mean0.013688737695867363
sim_compute_sim_state_median0.013688737695867363
sim_compute_sim_state_min0.013688737695867363
sim_render-ego_max0.003757151690396396
sim_render-ego_mean0.003757151690396396
sim_render-ego_median0.003757151690396396
sim_render-ego_min0.003757151690396396
simulation-passed1
step_physics_max0.08256153626875444
step_physics_mean0.08256153626875444
step_physics_median0.08256153626875444
step_physics_min0.08256153626875444
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5964310153Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03684194363609228
survival_time_median0.49999999999999994
deviation-center-line_median0.007594152341477631
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013994260267777876
agent_compute-ego_mean0.013994260267777876
agent_compute-ego_median0.013994260267777876
agent_compute-ego_min0.013994260267777876
complete-iteration_max0.16498407450589267
complete-iteration_mean0.16498407450589267
complete-iteration_median0.16498407450589267
complete-iteration_min0.16498407450589267
deviation-center-line_max0.007594152341477631
deviation-center-line_mean0.007594152341477631
deviation-center-line_min0.007594152341477631
deviation-heading_max0.05198114838383987
deviation-heading_mean0.05198114838383987
deviation-heading_median0.05198114838383987
deviation-heading_min0.05198114838383987
driven_any_max0.03701146978473194
driven_any_mean0.03701146978473194
driven_any_median0.03701146978473194
driven_any_min0.03701146978473194
driven_lanedir_consec_max0.03684194363609228
driven_lanedir_consec_mean0.03684194363609228
driven_lanedir_consec_min0.03684194363609228
driven_lanedir_max0.03684194363609228
driven_lanedir_mean0.03684194363609228
driven_lanedir_median0.03684194363609228
driven_lanedir_min0.03684194363609228
get_duckie_state_max0.0024747631766579366
get_duckie_state_mean0.0024747631766579366
get_duckie_state_median0.0024747631766579366
get_duckie_state_min0.0024747631766579366
get_robot_state_max0.008138613267378374
get_robot_state_mean0.008138613267378374
get_robot_state_median0.008138613267378374
get_robot_state_min0.008138613267378374
get_state_dump_max0.007900779897516424
get_state_dump_mean0.007900779897516424
get_state_dump_median0.007900779897516424
get_state_dump_min0.007900779897516424
get_ui_image_max0.0313550125468861
get_ui_image_mean0.0313550125468861
get_ui_image_median0.0313550125468861
get_ui_image_min0.0313550125468861
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03701146978473194, "get_ui_image": 0.0313550125468861, "step_physics": 0.07841732285239479, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03684194363609228, "get_state_dump": 0.007900779897516424, "sim_render-ego": 0.0038164962421764026, "get_robot_state": 0.008138613267378374, "get_duckie_state": 0.0024747631766579366, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013994260267777876, "deviation-heading": 0.05198114838383987, "complete-iteration": 0.16498407450589267, "set_robot_commands": 0.002498084848577326, "deviation-center-line": 0.007594152341477631, "driven_lanedir_consec": 0.03684194363609228, "sim_compute_sim_state": 0.01393925059925426, "sim_compute_performance-ego": 0.002360300584272905}}
set_robot_commands_max0.002498084848577326
set_robot_commands_mean0.002498084848577326
set_robot_commands_median0.002498084848577326
set_robot_commands_min0.002498084848577326
sim_compute_performance-ego_max0.002360300584272905
sim_compute_performance-ego_mean0.002360300584272905
sim_compute_performance-ego_median0.002360300584272905
sim_compute_performance-ego_min0.002360300584272905
sim_compute_sim_state_max0.01393925059925426
sim_compute_sim_state_mean0.01393925059925426
sim_compute_sim_state_median0.01393925059925426
sim_compute_sim_state_min0.01393925059925426
sim_render-ego_max0.0038164962421764026
sim_render-ego_mean0.0038164962421764026
sim_render-ego_median0.0038164962421764026
sim_render-ego_min0.0038164962421764026
simulation-passed1
step_physics_max0.07841732285239479
step_physics_mean0.07841732285239479
step_physics_median0.07841732285239479
step_physics_min0.07841732285239479
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5962610152Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-030:01:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: ''
β”‚  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5960410172Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04414912218124156
survival_time_median0.49999999999999994
deviation-center-line_median0.0077103535461610605
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012146494605324486
agent_compute-ego_mean0.012146494605324486
agent_compute-ego_median0.012146494605324486
agent_compute-ego_min0.012146494605324486
complete-iteration_max0.16199144450100986
complete-iteration_mean0.16199144450100986
complete-iteration_median0.16199144450100986
complete-iteration_min0.16199144450100986
deviation-center-line_max0.0077103535461610605
deviation-center-line_mean0.0077103535461610605
deviation-center-line_min0.0077103535461610605
deviation-heading_max0.05378110280831811
deviation-heading_mean0.05378110280831811
deviation-heading_median0.05378110280831811
deviation-heading_min0.05378110280831811
driven_any_max0.04439708884668171
driven_any_mean0.04439708884668171
driven_any_median0.04439708884668171
driven_any_min0.04439708884668171
driven_lanedir_consec_max0.04414912218124156
driven_lanedir_consec_mean0.04414912218124156
driven_lanedir_consec_min0.04414912218124156
driven_lanedir_max0.04414912218124156
driven_lanedir_mean0.04414912218124156
driven_lanedir_median0.04414912218124156
driven_lanedir_min0.04414912218124156
get_duckie_state_max0.002395651557228782
get_duckie_state_mean0.002395651557228782
get_duckie_state_median0.002395651557228782
get_duckie_state_min0.002395651557228782
get_robot_state_max0.008002194491299715
get_robot_state_mean0.008002194491299715
get_robot_state_median0.008002194491299715
get_robot_state_min0.008002194491299715
get_state_dump_max0.00808362527327104
get_state_dump_mean0.00808362527327104
get_state_dump_median0.00808362527327104
get_state_dump_min0.00808362527327104
get_ui_image_max0.03134298324584961
get_ui_image_mean0.03134298324584961
get_ui_image_median0.03134298324584961
get_ui_image_min0.03134298324584961
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.04439708884668171, "get_ui_image": 0.03134298324584961, "step_physics": 0.07697454365816983, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04414912218124156, "get_state_dump": 0.00808362527327104, "sim_render-ego": 0.003945112228393555, "get_robot_state": 0.008002194491299715, "get_duckie_state": 0.002395651557228782, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012146494605324486, "deviation-heading": 0.05378110280831811, "complete-iteration": 0.16199144450100986, "set_robot_commands": 0.0026107484644109554, "deviation-center-line": 0.0077103535461610605, "driven_lanedir_consec": 0.04414912218124156, "sim_compute_sim_state": 0.013974688269875269, "sim_compute_performance-ego": 0.0024323463439941406}}
set_robot_commands_max0.0026107484644109554
set_robot_commands_mean0.0026107484644109554
set_robot_commands_median0.0026107484644109554
set_robot_commands_min0.0026107484644109554
sim_compute_performance-ego_max0.0024323463439941406
sim_compute_performance-ego_mean0.0024323463439941406
sim_compute_performance-ego_median0.0024323463439941406
sim_compute_performance-ego_min0.0024323463439941406
sim_compute_sim_state_max0.013974688269875269
sim_compute_sim_state_mean0.013974688269875269
sim_compute_sim_state_median0.013974688269875269
sim_compute_sim_state_min0.013974688269875269
sim_render-ego_max0.003945112228393555
sim_render-ego_mean0.003945112228393555
sim_render-ego_median0.003945112228393555
sim_render-ego_min0.003945112228393555
simulation-passed1
step_physics_max0.07697454365816983
step_physics_mean0.07697454365816983
step_physics_median0.07697454365816983
step_physics_min0.07697454365816983
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5958910173Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04139574696966708
survival_time_median0.49999999999999994
deviation-center-line_median0.007706671510075921
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.011945789510553534
agent_compute-ego_mean0.011945789510553534
agent_compute-ego_median0.011945789510553534
agent_compute-ego_min0.011945789510553534
complete-iteration_max0.1640981977636164
complete-iteration_mean0.1640981977636164
complete-iteration_median0.1640981977636164
complete-iteration_min0.1640981977636164
deviation-center-line_max0.007706671510075921
deviation-center-line_mean0.007706671510075921
deviation-center-line_min0.007706671510075921
deviation-heading_max0.053385811309260206
deviation-heading_mean0.053385811309260206
deviation-heading_median0.053385811309260206
deviation-heading_min0.053385811309260206
driven_any_max0.041624010300736494
driven_any_mean0.041624010300736494
driven_any_median0.041624010300736494
driven_any_min0.041624010300736494
driven_lanedir_consec_max0.04139574696966708
driven_lanedir_consec_mean0.04139574696966708
driven_lanedir_consec_min0.04139574696966708
driven_lanedir_max0.04139574696966708
driven_lanedir_mean0.04139574696966708
driven_lanedir_median0.04139574696966708
driven_lanedir_min0.04139574696966708
get_duckie_state_max0.0021540685133500533
get_duckie_state_mean0.0021540685133500533
get_duckie_state_median0.0021540685133500533
get_duckie_state_min0.0021540685133500533
get_robot_state_max0.007624257694591175
get_robot_state_mean0.007624257694591175
get_robot_state_median0.007624257694591175
get_robot_state_min0.007624257694591175
get_state_dump_max0.007546966726129705
get_state_dump_mean0.007546966726129705
get_state_dump_median0.007546966726129705
get_state_dump_min0.007546966726129705
get_ui_image_max0.03050440007990057
get_ui_image_mean0.03050440007990057
get_ui_image_median0.03050440007990057
get_ui_image_min0.03050440007990057
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.041624010300736494, "get_ui_image": 0.03050440007990057, "step_physics": 0.08246541023254395, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04139574696966708, "get_state_dump": 0.007546966726129705, "sim_render-ego": 0.003747593272816051, "get_robot_state": 0.007624257694591175, "get_duckie_state": 0.0021540685133500533, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011945789510553534, "deviation-heading": 0.053385811309260206, "complete-iteration": 0.1640981977636164, "set_robot_commands": 0.002223296598954634, "deviation-center-line": 0.007706671510075921, "driven_lanedir_consec": 0.04139574696966708, "sim_compute_sim_state": 0.01358229463750666, "sim_compute_performance-ego": 0.0022292570634321733}}
set_robot_commands_max0.002223296598954634
set_robot_commands_mean0.002223296598954634
set_robot_commands_median0.002223296598954634
set_robot_commands_min0.002223296598954634
sim_compute_performance-ego_max0.0022292570634321733
sim_compute_performance-ego_mean0.0022292570634321733
sim_compute_performance-ego_median0.0022292570634321733
sim_compute_performance-ego_min0.0022292570634321733
sim_compute_sim_state_max0.01358229463750666
sim_compute_sim_state_mean0.01358229463750666
sim_compute_sim_state_median0.01358229463750666
sim_compute_sim_state_min0.01358229463750666
sim_render-ego_max0.003747593272816051
sim_render-ego_mean0.003747593272816051
sim_render-ego_median0.003747593272816051
sim_render-ego_min0.003747593272816051
simulation-passed1
step_physics_max0.08246541023254395
step_physics_mean0.08246541023254395
step_physics_median0.08246541023254395
step_physics_min0.08246541023254395
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5956010199Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.042762940935430205
survival_time_median0.49999999999999994
deviation-center-line_median0.00770220782346985
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012904578989202326
agent_compute-ego_mean0.012904578989202326
agent_compute-ego_median0.012904578989202326
agent_compute-ego_min0.012904578989202326
complete-iteration_max0.1769933267073198
complete-iteration_mean0.1769933267073198
complete-iteration_median0.1769933267073198
complete-iteration_min0.1769933267073198
deviation-center-line_max0.00770220782346985
deviation-center-line_mean0.00770220782346985
deviation-center-line_min0.00770220782346985
deviation-heading_max0.05391744124134144
deviation-heading_mean0.05391744124134144
deviation-heading_median0.05391744124134144
deviation-heading_min0.05391744124134144
driven_any_max0.043008128602214646
driven_any_mean0.043008128602214646
driven_any_median0.043008128602214646
driven_any_min0.043008128602214646
driven_lanedir_consec_max0.042762940935430205
driven_lanedir_consec_mean0.042762940935430205
driven_lanedir_consec_min0.042762940935430205
driven_lanedir_max0.042762940935430205
driven_lanedir_mean0.042762940935430205
driven_lanedir_median0.042762940935430205
driven_lanedir_min0.042762940935430205
get_duckie_state_max0.002354751933704723
get_duckie_state_mean0.002354751933704723
get_duckie_state_median0.002354751933704723
get_duckie_state_min0.002354751933704723
get_robot_state_max0.008284460414539684
get_robot_state_mean0.008284460414539684
get_robot_state_median0.008284460414539684
get_robot_state_min0.008284460414539684
get_state_dump_max0.008050203323364258
get_state_dump_mean0.008050203323364258
get_state_dump_median0.008050203323364258
get_state_dump_min0.008050203323364258
get_ui_image_max0.03150205178694292
get_ui_image_mean0.03150205178694292
get_ui_image_median0.03150205178694292
get_ui_image_min0.03150205178694292
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.043008128602214646, "get_ui_image": 0.03150205178694292, "step_physics": 0.08817243576049805, "survival_time": 0.49999999999999994, "driven_lanedir": 0.042762940935430205, "get_state_dump": 0.008050203323364258, "sim_render-ego": 0.004249876195734198, "get_robot_state": 0.008284460414539684, "get_duckie_state": 0.002354751933704723, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012904578989202326, "deviation-heading": 0.05391744124134144, "complete-iteration": 0.1769933267073198, "set_robot_commands": 0.0028525482524525037, "deviation-center-line": 0.00770220782346985, "driven_lanedir_consec": 0.042762940935430205, "sim_compute_sim_state": 0.015913334759798916, "sim_compute_performance-ego": 0.0026166439056396484}}
set_robot_commands_max0.0028525482524525037
set_robot_commands_mean0.0028525482524525037
set_robot_commands_median0.0028525482524525037
set_robot_commands_min0.0028525482524525037
sim_compute_performance-ego_max0.0026166439056396484
sim_compute_performance-ego_mean0.0026166439056396484
sim_compute_performance-ego_median0.0026166439056396484
sim_compute_performance-ego_min0.0026166439056396484
sim_compute_sim_state_max0.015913334759798916
sim_compute_sim_state_mean0.015913334759798916
sim_compute_sim_state_median0.015913334759798916
sim_compute_sim_state_min0.015913334759798916
sim_render-ego_max0.004249876195734198
sim_render-ego_mean0.004249876195734198
sim_render-ego_median0.004249876195734198
sim_render-ego_min0.004249876195734198
simulation-passed1
step_physics_max0.08817243576049805
step_physics_mean0.08817243576049805
step_physics_median0.08817243576049805
step_physics_min0.08817243576049805
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5954210191Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03683803663820617
survival_time_median0.49999999999999994
deviation-center-line_median0.007643158820302206
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.011808612129905006
agent_compute-ego_mean0.011808612129905006
agent_compute-ego_median0.011808612129905006
agent_compute-ego_min0.011808612129905006
complete-iteration_max0.14902554858814587
complete-iteration_mean0.14902554858814587
complete-iteration_median0.14902554858814587
complete-iteration_min0.14902554858814587
deviation-center-line_max0.007643158820302206
deviation-center-line_mean0.007643158820302206
deviation-center-line_min0.007643158820302206
deviation-heading_max0.052862074103965734
deviation-heading_mean0.052862074103965734
deviation-heading_median0.052862074103965734
deviation-heading_min0.052862074103965734
driven_any_max0.037024697530195
driven_any_mean0.037024697530195
driven_any_median0.037024697530195
driven_any_min0.037024697530195
driven_lanedir_consec_max0.03683803663820617
driven_lanedir_consec_mean0.03683803663820617
driven_lanedir_consec_min0.03683803663820617
driven_lanedir_max0.03683803663820617
driven_lanedir_mean0.03683803663820617
driven_lanedir_median0.03683803663820617
driven_lanedir_min0.03683803663820617
get_duckie_state_max0.002176674929532138
get_duckie_state_mean0.002176674929532138
get_duckie_state_median0.002176674929532138
get_duckie_state_min0.002176674929532138
get_robot_state_max0.007574363188310103
get_robot_state_mean0.007574363188310103
get_robot_state_median0.007574363188310103
get_robot_state_min0.007574363188310103
get_state_dump_max0.007926789197054777
get_state_dump_mean0.007926789197054777
get_state_dump_median0.007926789197054777
get_state_dump_min0.007926789197054777
get_ui_image_max0.0276883298700506
get_ui_image_mean0.0276883298700506
get_ui_image_median0.0276883298700506
get_ui_image_min0.0276883298700506
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.037024697530195, "get_ui_image": 0.0276883298700506, "step_physics": 0.07040312073447487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03683803663820617, "get_state_dump": 0.007926789197054777, "sim_render-ego": 0.0036798390475186434, "get_robot_state": 0.007574363188310103, "get_duckie_state": 0.002176674929532138, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011808612129905006, "deviation-heading": 0.052862074103965734, "complete-iteration": 0.14902554858814587, "set_robot_commands": 0.0023549036546186967, "deviation-center-line": 0.007643158820302206, "driven_lanedir_consec": 0.03683803663820617, "sim_compute_sim_state": 0.013135953383012253, "sim_compute_performance-ego": 0.0021963986483487215}}
set_robot_commands_max0.0023549036546186967
set_robot_commands_mean0.0023549036546186967
set_robot_commands_median0.0023549036546186967
set_robot_commands_min0.0023549036546186967
sim_compute_performance-ego_max0.0021963986483487215
sim_compute_performance-ego_mean0.0021963986483487215
sim_compute_performance-ego_median0.0021963986483487215
sim_compute_performance-ego_min0.0021963986483487215
sim_compute_sim_state_max0.013135953383012253
sim_compute_sim_state_mean0.013135953383012253
sim_compute_sim_state_median0.013135953383012253
sim_compute_sim_state_min0.013135953383012253
sim_render-ego_max0.0036798390475186434
sim_render-ego_mean0.0036798390475186434
sim_render-ego_median0.0036798390475186434
sim_render-ego_min0.0036798390475186434
simulation-passed1
step_physics_max0.07040312073447487
step_physics_mean0.07040312073447487
step_physics_median0.07040312073447487
step_physics_min0.07040312073447487
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5952110221Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05344502773354787
survival_time_median0.49999999999999994
deviation-center-line_median0.007888198076840965
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.01381219517100941
agent_compute-ego_mean0.01381219517100941
agent_compute-ego_median0.01381219517100941
agent_compute-ego_min0.01381219517100941
complete-iteration_max0.17853025956587357
complete-iteration_mean0.17853025956587357
complete-iteration_median0.17853025956587357
complete-iteration_min0.17853025956587357
deviation-center-line_max0.007888198076840965
deviation-center-line_mean0.007888198076840965
deviation-center-line_min0.007888198076840965
deviation-heading_max0.05417632424158945
deviation-heading_mean0.05417632424158945
deviation-heading_median0.05417632424158945
deviation-heading_min0.05417632424158945
driven_any_max0.05376016154373709
driven_any_mean0.05376016154373709
driven_any_median0.05376016154373709
driven_any_min0.05376016154373709
driven_lanedir_consec_max0.05344502773354787
driven_lanedir_consec_mean0.05344502773354787
driven_lanedir_consec_min0.05344502773354787
driven_lanedir_max0.05344502773354787
driven_lanedir_mean0.05344502773354787
driven_lanedir_median0.05344502773354787
driven_lanedir_min0.05344502773354787
get_duckie_state_max0.0022734295238148084
get_duckie_state_mean0.0022734295238148084
get_duckie_state_median0.0022734295238148084
get_duckie_state_min0.0022734295238148084
get_robot_state_max0.007821299813010475
get_robot_state_mean0.007821299813010475
get_robot_state_median0.007821299813010475
get_robot_state_min0.007821299813010475
get_state_dump_max0.007533550262451172
get_state_dump_mean0.007533550262451172
get_state_dump_median0.007533550262451172
get_state_dump_min0.007533550262451172
get_ui_image_max0.03207390958612615
get_ui_image_mean0.03207390958612615
get_ui_image_median0.03207390958612615
get_ui_image_min0.03207390958612615
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.05376016154373709, "get_ui_image": 0.03207390958612615, "step_physics": 0.0910666205666282, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05344502773354787, "get_state_dump": 0.007533550262451172, "sim_render-ego": 0.004030054265802557, "get_robot_state": 0.007821299813010475, "get_duckie_state": 0.0022734295238148084, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01381219517100941, "deviation-heading": 0.05417632424158945, "complete-iteration": 0.17853025956587357, "set_robot_commands": 0.002710840918801048, "deviation-center-line": 0.007888198076840965, "driven_lanedir_consec": 0.05344502773354787, "sim_compute_sim_state": 0.01476177302273837, "sim_compute_performance-ego": 0.0023534948175603695}}
set_robot_commands_max0.002710840918801048
set_robot_commands_mean0.002710840918801048
set_robot_commands_median0.002710840918801048
set_robot_commands_min0.002710840918801048
sim_compute_performance-ego_max0.0023534948175603695
sim_compute_performance-ego_mean0.0023534948175603695
sim_compute_performance-ego_median0.0023534948175603695
sim_compute_performance-ego_min0.0023534948175603695
sim_compute_sim_state_max0.01476177302273837
sim_compute_sim_state_mean0.01476177302273837
sim_compute_sim_state_median0.01476177302273837
sim_compute_sim_state_min0.01476177302273837
sim_render-ego_max0.004030054265802557
sim_render-ego_mean0.004030054265802557
sim_render-ego_median0.004030054265802557
sim_render-ego_min0.004030054265802557
simulation-passed1
step_physics_max0.0910666205666282
step_physics_mean0.0910666205666282
step_physics_median0.0910666205666282
step_physics_min0.0910666205666282
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5947710227Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5945910242Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.039187610642987813
survival_time_median0.49999999999999994
deviation-center-line_median0.007569501296363675
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02078147367997603
agent_compute-ego_mean0.02078147367997603
agent_compute-ego_median0.02078147367997603
agent_compute-ego_min0.02078147367997603
complete-iteration_max0.1640456806529652
complete-iteration_mean0.1640456806529652
complete-iteration_median0.1640456806529652
complete-iteration_min0.1640456806529652
deviation-center-line_max0.007569501296363675
deviation-center-line_mean0.007569501296363675
deviation-center-line_min0.007569501296363675
deviation-heading_max0.05055768718734381
deviation-heading_mean0.05055768718734381
deviation-heading_median0.05055768718734381
deviation-heading_min0.05055768718734381
driven_any_max0.03934377680121057
driven_any_mean0.03934377680121057
driven_any_median0.03934377680121057
driven_any_min0.03934377680121057
driven_lanedir_consec_max0.039187610642987813
driven_lanedir_consec_mean0.039187610642987813
driven_lanedir_consec_min0.039187610642987813
driven_lanedir_max0.039187610642987813
driven_lanedir_mean0.039187610642987813
driven_lanedir_median0.039187610642987813
driven_lanedir_min0.039187610642987813
get_duckie_state_max0.002274014733054421
get_duckie_state_mean0.002274014733054421
get_duckie_state_median0.002274014733054421
get_duckie_state_min0.002274014733054421
get_robot_state_max0.007872906598177824
get_robot_state_mean0.007872906598177824
get_robot_state_median0.007872906598177824
get_robot_state_min0.007872906598177824
get_state_dump_max0.00734589316628196
get_state_dump_mean0.00734589316628196
get_state_dump_median0.00734589316628196
get_state_dump_min0.00734589316628196
get_ui_image_max0.02866018902171742
get_ui_image_mean0.02866018902171742
get_ui_image_median0.02866018902171742
get_ui_image_min0.02866018902171742
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03934377680121057, "get_ui_image": 0.02866018902171742, "step_physics": 0.07516941157254306, "survival_time": 0.49999999999999994, "driven_lanedir": 0.039187610642987813, "get_state_dump": 0.00734589316628196, "sim_render-ego": 0.003865480422973633, "get_robot_state": 0.007872906598177824, "get_duckie_state": 0.002274014733054421, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02078147367997603, "deviation-heading": 0.05055768718734381, "complete-iteration": 0.1640456806529652, "set_robot_commands": 0.0025856494903564453, "deviation-center-line": 0.007569501296363675, "driven_lanedir_consec": 0.039187610642987813, "sim_compute_sim_state": 0.0132348970933394, "sim_compute_performance-ego": 0.002173922278664329}}
set_robot_commands_max0.0025856494903564453
set_robot_commands_mean0.0025856494903564453
set_robot_commands_median0.0025856494903564453
set_robot_commands_min0.0025856494903564453
sim_compute_performance-ego_max0.002173922278664329
sim_compute_performance-ego_mean0.002173922278664329
sim_compute_performance-ego_median0.002173922278664329
sim_compute_performance-ego_min0.002173922278664329
sim_compute_sim_state_max0.0132348970933394
sim_compute_sim_state_mean0.0132348970933394
sim_compute_sim_state_median0.0132348970933394
sim_compute_sim_state_min0.0132348970933394
sim_render-ego_max0.003865480422973633
sim_render-ego_mean0.003865480422973633
sim_render-ego_median0.003865480422973633
sim_render-ego_min0.003865480422973633
simulation-passed1
step_physics_max0.07516941157254306
step_physics_mean0.07516941157254306
step_physics_median0.07516941157254306
step_physics_min0.07516941157254306
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5944210242Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04041934110033152
survival_time_median0.49999999999999994
deviation-center-line_median0.007617560338143944
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.012781143188476562
agent_compute-ego_mean0.012781143188476562
agent_compute-ego_median0.012781143188476562
agent_compute-ego_min0.012781143188476562
complete-iteration_max0.15281122381036932
complete-iteration_mean0.15281122381036932
complete-iteration_median0.15281122381036932
complete-iteration_min0.15281122381036932
deviation-center-line_max0.007617560338143944
deviation-center-line_mean0.007617560338143944
deviation-center-line_min0.007617560338143944
deviation-heading_max0.051089647592980465
deviation-heading_mean0.051089647592980465
deviation-heading_median0.051089647592980465
deviation-heading_min0.051089647592980465
driven_any_max0.04058932459152416
driven_any_mean0.04058932459152416
driven_any_median0.04058932459152416
driven_any_min0.04058932459152416
driven_lanedir_consec_max0.04041934110033152
driven_lanedir_consec_mean0.04041934110033152
driven_lanedir_consec_min0.04041934110033152
driven_lanedir_max0.04041934110033152
driven_lanedir_mean0.04041934110033152
driven_lanedir_median0.04041934110033152
driven_lanedir_min0.04041934110033152
get_duckie_state_max0.0027197924527254972
get_duckie_state_mean0.0027197924527254972
get_duckie_state_median0.0027197924527254972
get_duckie_state_min0.0027197924527254972
get_robot_state_max0.008368773893876509
get_robot_state_mean0.008368773893876509
get_robot_state_median0.008368773893876509
get_robot_state_min0.008368773893876509
get_state_dump_max0.007633512670343573
get_state_dump_mean0.007633512670343573
get_state_dump_median0.007633512670343573
get_state_dump_min0.007633512670343573
get_ui_image_max0.02751181342385032
get_ui_image_mean0.02751181342385032
get_ui_image_median0.02751181342385032
get_ui_image_min0.02751181342385032
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.04058932459152416, "get_ui_image": 0.02751181342385032, "step_physics": 0.07083426822315562, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04041934110033152, "get_state_dump": 0.007633512670343573, "sim_render-ego": 0.004080360585992987, "get_robot_state": 0.008368773893876509, "get_duckie_state": 0.0027197924527254972, "in-drivable-lane": 0.0, "agent_compute-ego": 0.012781143188476562, "deviation-heading": 0.051089647592980465, "complete-iteration": 0.15281122381036932, "set_robot_commands": 0.002772873098200018, "deviation-center-line": 0.007617560338143944, "driven_lanedir_consec": 0.04041934110033152, "sim_compute_sim_state": 0.013550563292069868, "sim_compute_performance-ego": 0.0024606097828258166}}
set_robot_commands_max0.002772873098200018
set_robot_commands_mean0.002772873098200018
set_robot_commands_median0.002772873098200018
set_robot_commands_min0.002772873098200018
sim_compute_performance-ego_max0.0024606097828258166
sim_compute_performance-ego_mean0.0024606097828258166
sim_compute_performance-ego_median0.0024606097828258166
sim_compute_performance-ego_min0.0024606097828258166
sim_compute_sim_state_max0.013550563292069868
sim_compute_sim_state_mean0.013550563292069868
sim_compute_sim_state_median0.013550563292069868
sim_compute_sim_state_min0.013550563292069868
sim_render-ego_max0.004080360585992987
sim_render-ego_mean0.004080360585992987
sim_render-ego_median0.004080360585992987
sim_render-ego_min0.004080360585992987
simulation-passed1
step_physics_max0.07083426822315562
step_physics_mean0.07083426822315562
step_physics_median0.07083426822315562
step_physics_min0.07083426822315562
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5941110265Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5939010286Melisande Tengexercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03213148792511822
survival_time_median0.49999999999999994
deviation-center-line_median0.007469975987153717
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02084450288252397
agent_compute-ego_mean0.02084450288252397
agent_compute-ego_median0.02084450288252397
agent_compute-ego_min0.02084450288252397
complete-iteration_max0.16535585576837714
complete-iteration_mean0.16535585576837714
complete-iteration_median0.16535585576837714
complete-iteration_min0.16535585576837714
deviation-center-line_max0.007469975987153717
deviation-center-line_mean0.007469975987153717
deviation-center-line_min0.007469975987153717
deviation-heading_max0.05032775306917478
deviation-heading_mean0.05032775306917478
deviation-heading_median0.05032775306917478
deviation-heading_min0.05032775306917478
driven_any_max0.03225599459414115
driven_any_mean0.03225599459414115
driven_any_median0.03225599459414115
driven_any_min0.03225599459414115
driven_lanedir_consec_max0.03213148792511822
driven_lanedir_consec_mean0.03213148792511822
driven_lanedir_consec_min0.03213148792511822
driven_lanedir_max0.03213148792511822
driven_lanedir_mean0.03213148792511822
driven_lanedir_median0.03213148792511822
driven_lanedir_min0.03213148792511822
get_duckie_state_max0.0022646947340531783
get_duckie_state_mean0.0022646947340531783
get_duckie_state_median0.0022646947340531783
get_duckie_state_min0.0022646947340531783
get_robot_state_max0.007589968768033114
get_robot_state_mean0.007589968768033114
get_robot_state_median0.007589968768033114
get_robot_state_min0.007589968768033114
get_state_dump_max0.0074472210624001245
get_state_dump_mean0.0074472210624001245
get_state_dump_median0.0074472210624001245
get_state_dump_min0.0074472210624001245
get_ui_image_max0.03100044077092951
get_ui_image_mean0.03100044077092951
get_ui_image_median0.03100044077092951
get_ui_image_min0.03100044077092951
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.03225599459414115, "get_ui_image": 0.03100044077092951, "step_physics": 0.07438787547024814, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03213148792511822, "get_state_dump": 0.0074472210624001245, "sim_render-ego": 0.003722841089422053, "get_robot_state": 0.007589968768033114, "get_duckie_state": 0.0022646947340531783, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02084450288252397, "deviation-heading": 0.05032775306917478, "complete-iteration": 0.16535585576837714, "set_robot_commands": 0.002245274457064542, "deviation-center-line": 0.007469975987153717, "driven_lanedir_consec": 0.03213148792511822, "sim_compute_sim_state": 0.013520782644098455, "sim_compute_performance-ego": 0.002250649712302468}}
set_robot_commands_max0.002245274457064542
set_robot_commands_mean0.002245274457064542
set_robot_commands_median0.002245274457064542
set_robot_commands_min0.002245274457064542
sim_compute_performance-ego_max0.002250649712302468
sim_compute_performance-ego_mean0.002250649712302468
sim_compute_performance-ego_median0.002250649712302468
sim_compute_performance-ego_min0.002250649712302468
sim_compute_sim_state_max0.013520782644098455
sim_compute_sim_state_mean0.013520782644098455
sim_compute_sim_state_median0.013520782644098455
sim_compute_sim_state_min0.013520782644098455
sim_render-ego_max0.003722841089422053
sim_render-ego_mean0.003722841089422053
sim_render-ego_median0.003722841089422053
sim_render-ego_min0.003722841089422053
simulation-passed1
step_physics_max0.07438787547024814
step_physics_mean0.07438787547024814
step_physics_median0.07438787547024814
step_physics_min0.07438787547024814
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5936310271Francois Hebertexercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.03138625586885668
survival_time_median0.49999999999999994
deviation-center-line_median0.007428794532772195
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013209538026289509
agent_compute-ego_mean0.013209538026289509
agent_compute-ego_median0.013209538026289509
agent_compute-ego_min0.013209538026289509
complete-iteration_max0.1647200801155784
complete-iteration_mean0.1647200801155784
complete-iteration_median0.1647200801155784
complete-iteration_min0.1647200801155784
deviation-center-line_max0.007428794532772195
deviation-center-line_mean0.007428794532772195
deviation-center-line_min0.007428794532772195
deviation-heading_max0.04837844183772641
deviation-heading_mean0.04837844183772641
deviation-heading_median0.04837844183772641
deviation-heading_min0.04837844183772641
driven_any_max0.031483266560018305
driven_any_mean0.031483266560018305
driven_any_median0.031483266560018305
driven_any_min0.031483266560018305
driven_lanedir_consec_max0.03138625586885668
driven_lanedir_consec_mean0.03138625586885668
driven_lanedir_consec_min0.03138625586885668
driven_lanedir_max0.03138625586885668
driven_lanedir_mean0.03138625586885668
driven_lanedir_median0.03138625586885668
driven_lanedir_min0.03138625586885668
get_duckie_state_max0.0023225004022771664
get_duckie_state_mean0.0023225004022771664
get_duckie_state_median0.0023225004022771664
get_duckie_state_min0.0023225004022771664
get_robot_state_max0.007847699252041903
get_robot_state_mean0.007847699252041903
get_robot_state_median0.007847699252041903
get_robot_state_min0.007847699252041903
get_state_dump_max0.007699879732998935
get_state_dump_mean0.007699879732998935
get_state_dump_median0.007699879732998935
get_state_dump_min0.007699879732998935
get_ui_image_max0.03069582852450284
get_ui_image_mean0.03069582852450284
get_ui_image_median0.03069582852450284
get_ui_image_min0.03069582852450284
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.031483266560018305, "get_ui_image": 0.03069582852450284, "step_physics": 0.07887014475735751, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03138625586885668, "get_state_dump": 0.007699879732998935, "sim_render-ego": 0.0048046762293035335, "get_robot_state": 0.007847699252041903, "get_duckie_state": 0.0023225004022771664, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013209538026289509, "deviation-heading": 0.04837844183772641, "complete-iteration": 0.1647200801155784, "set_robot_commands": 0.0029394843361594462, "deviation-center-line": 0.007428794532772195, "driven_lanedir_consec": 0.03138625586885668, "sim_compute_sim_state": 0.013593912124633787, "sim_compute_performance-ego": 0.002652016553011807}}
set_robot_commands_max0.0029394843361594462
set_robot_commands_mean0.0029394843361594462
set_robot_commands_median0.0029394843361594462
set_robot_commands_min0.0029394843361594462
sim_compute_performance-ego_max0.002652016553011807
sim_compute_performance-ego_mean0.002652016553011807
sim_compute_performance-ego_median0.002652016553011807
sim_compute_performance-ego_min0.002652016553011807
sim_compute_sim_state_max0.013593912124633787
sim_compute_sim_state_mean0.013593912124633787
sim_compute_sim_state_median0.013593912124633787
sim_compute_sim_state_min0.013593912124633787
sim_render-ego_max0.0048046762293035335
sim_render-ego_mean0.0048046762293035335
sim_render-ego_median0.0048046762293035335
sim_render-ego_min0.0048046762293035335
simulation-passed1
step_physics_max0.07887014475735751
step_physics_mean0.07887014475735751
step_physics_median0.07887014475735751
step_physics_min0.07887014475735751
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5933710297Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.02244553872397903
survival_time_median0.49999999999999994
deviation-center-line_median0.007326037441670405
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.011901920491998846
agent_compute-ego_mean0.011901920491998846
agent_compute-ego_median0.011901920491998846
agent_compute-ego_min0.011901920491998846
complete-iteration_max0.15649249336936258
complete-iteration_mean0.15649249336936258
complete-iteration_median0.15649249336936258
complete-iteration_min0.15649249336936258
deviation-center-line_max0.007326037441670405
deviation-center-line_mean0.007326037441670405
deviation-center-line_min0.007326037441670405
deviation-heading_max0.050980890078455125
deviation-heading_mean0.050980890078455125
deviation-heading_median0.050980890078455125
deviation-heading_min0.050980890078455125
driven_any_max0.0225389374306818
driven_any_mean0.0225389374306818
driven_any_median0.0225389374306818
driven_any_min0.0225389374306818
driven_lanedir_consec_max0.02244553872397903
driven_lanedir_consec_mean0.02244553872397903
driven_lanedir_consec_min0.02244553872397903
driven_lanedir_max0.02244553872397903
driven_lanedir_mean0.02244553872397903
driven_lanedir_median0.02244553872397903
driven_lanedir_min0.02244553872397903
get_duckie_state_max0.0022225813432173295
get_duckie_state_mean0.0022225813432173295
get_duckie_state_median0.0022225813432173295
get_duckie_state_min0.0022225813432173295
get_robot_state_max0.007758964191783558
get_robot_state_mean0.007758964191783558
get_robot_state_median0.007758964191783558
get_robot_state_min0.007758964191783558
get_state_dump_max0.00744197585365989
get_state_dump_mean0.00744197585365989
get_state_dump_median0.00744197585365989
get_state_dump_min0.00744197585365989
get_ui_image_max0.02940288457003507
get_ui_image_mean0.02940288457003507
get_ui_image_median0.02940288457003507
get_ui_image_min0.02940288457003507
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.0225389374306818, "get_ui_image": 0.02940288457003507, "step_physics": 0.07510889660228383, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02244553872397903, "get_state_dump": 0.00744197585365989, "sim_render-ego": 0.003849593075838956, "get_robot_state": 0.007758964191783558, "get_duckie_state": 0.0022225813432173295, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011901920491998846, "deviation-heading": 0.050980890078455125, "complete-iteration": 0.15649249336936258, "set_robot_commands": 0.002280647104436701, "deviation-center-line": 0.007326037441670405, "driven_lanedir_consec": 0.02244553872397903, "sim_compute_sim_state": 0.014117110859264028, "sim_compute_performance-ego": 0.002323259006847035}}
set_robot_commands_max0.002280647104436701
set_robot_commands_mean0.002280647104436701
set_robot_commands_median0.002280647104436701
set_robot_commands_min0.002280647104436701
sim_compute_performance-ego_max0.002323259006847035
sim_compute_performance-ego_mean0.002323259006847035
sim_compute_performance-ego_median0.002323259006847035
sim_compute_performance-ego_min0.002323259006847035
sim_compute_sim_state_max0.014117110859264028
sim_compute_sim_state_mean0.014117110859264028
sim_compute_sim_state_median0.014117110859264028
sim_compute_sim_state_min0.014117110859264028
sim_render-ego_max0.003849593075838956
sim_render-ego_mean0.003849593075838956
sim_render-ego_median0.003849593075838956
sim_render-ego_min0.003849593075838956
simulation-passed1
step_physics_max0.07510889660228383
step_physics_mean0.07510889660228383
step_physics_median0.07510889660228383
step_physics_min0.07510889660228383
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5931610300Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.02456813833413385
survival_time_median0.49999999999999994
deviation-center-line_median0.007408215920569602
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013638518073342064
agent_compute-ego_mean0.013638518073342064
agent_compute-ego_median0.013638518073342064
agent_compute-ego_min0.013638518073342064
complete-iteration_max0.16852040724320846
complete-iteration_mean0.16852040724320846
complete-iteration_median0.16852040724320846
complete-iteration_min0.16852040724320846
deviation-center-line_max0.007408215920569602
deviation-center-line_mean0.007408215920569602
deviation-center-line_min0.007408215920569602
deviation-heading_max0.053157354496133395
deviation-heading_mean0.053157354496133395
deviation-heading_median0.053157354496133395
deviation-heading_min0.053157354496133395
driven_any_max0.0246979531299717
driven_any_mean0.0246979531299717
driven_any_median0.0246979531299717
driven_any_min0.0246979531299717
driven_lanedir_consec_max0.02456813833413385
driven_lanedir_consec_mean0.02456813833413385
driven_lanedir_consec_min0.02456813833413385
driven_lanedir_max0.02456813833413385
driven_lanedir_mean0.02456813833413385
driven_lanedir_median0.02456813833413385
driven_lanedir_min0.02456813833413385
get_duckie_state_max0.0023737170479514384
get_duckie_state_mean0.0023737170479514384
get_duckie_state_median0.0023737170479514384
get_duckie_state_min0.0023737170479514384
get_robot_state_max0.008621367541226473
get_robot_state_mean0.008621367541226473
get_robot_state_median0.008621367541226473
get_robot_state_min0.008621367541226473
get_state_dump_max0.00850135629827326
get_state_dump_mean0.00850135629827326
get_state_dump_median0.00850135629827326
get_state_dump_min0.00850135629827326
get_ui_image_max0.03163994442332874
get_ui_image_mean0.03163994442332874
get_ui_image_median0.03163994442332874
get_ui_image_min0.03163994442332874
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.0246979531299717, "get_ui_image": 0.03163994442332874, "step_physics": 0.0805166634646329, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02456813833413385, "get_state_dump": 0.00850135629827326, "sim_render-ego": 0.003953196785666726, "get_robot_state": 0.008621367541226473, "get_duckie_state": 0.0023737170479514384, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013638518073342064, "deviation-heading": 0.053157354496133395, "complete-iteration": 0.16852040724320846, "set_robot_commands": 0.0023186423561789775, "deviation-center-line": 0.007408215920569602, "driven_lanedir_consec": 0.02456813833413385, "sim_compute_sim_state": 0.014539480209350586, "sim_compute_performance-ego": 0.0023308667269620028}}
set_robot_commands_max0.0023186423561789775
set_robot_commands_mean0.0023186423561789775
set_robot_commands_median0.0023186423561789775
set_robot_commands_min0.0023186423561789775
sim_compute_performance-ego_max0.0023308667269620028
sim_compute_performance-ego_mean0.0023308667269620028
sim_compute_performance-ego_median0.0023308667269620028
sim_compute_performance-ego_min0.0023308667269620028
sim_compute_sim_state_max0.014539480209350586
sim_compute_sim_state_mean0.014539480209350586
sim_compute_sim_state_median0.014539480209350586
sim_compute_sim_state_min0.014539480209350586
sim_render-ego_max0.003953196785666726
sim_render-ego_mean0.003953196785666726
sim_render-ego_median0.003953196785666726
sim_render-ego_min0.003953196785666726
simulation-passed1
step_physics_max0.0805166634646329
step_physics_mean0.0805166634646329
step_physics_median0.0805166634646329
step_physics_min0.0805166634646329
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5929310319Melisande Tengexercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.02672330320217764
survival_time_median0.49999999999999994
deviation-center-line_median0.00743447761861001
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013030767440795898
agent_compute-ego_mean0.013030767440795898
agent_compute-ego_median0.013030767440795898
agent_compute-ego_min0.013030767440795898
complete-iteration_max0.1533221114765514
complete-iteration_mean0.1533221114765514
complete-iteration_median0.1533221114765514
complete-iteration_min0.1533221114765514
deviation-center-line_max0.00743447761861001
deviation-center-line_mean0.00743447761861001
deviation-center-line_min0.00743447761861001
deviation-heading_max0.054087540152726175
deviation-heading_mean0.054087540152726175
deviation-heading_median0.054087540152726175
deviation-heading_min0.054087540152726175
driven_any_max0.02688007983061966
driven_any_mean0.02688007983061966
driven_any_median0.02688007983061966
driven_any_min0.02688007983061966
driven_lanedir_consec_max0.02672330320217764
driven_lanedir_consec_mean0.02672330320217764
driven_lanedir_consec_min0.02672330320217764
driven_lanedir_max0.02672330320217764
driven_lanedir_mean0.02672330320217764
driven_lanedir_median0.02672330320217764
driven_lanedir_min0.02672330320217764
get_duckie_state_max0.0021309852600097656
get_duckie_state_mean0.0021309852600097656
get_duckie_state_median0.0021309852600097656
get_duckie_state_min0.0021309852600097656
get_robot_state_max0.007522322914817117
get_robot_state_mean0.007522322914817117
get_robot_state_median0.007522322914817117
get_robot_state_min0.007522322914817117
get_state_dump_max0.007238431410356002
get_state_dump_mean0.007238431410356002
get_state_dump_median0.007238431410356002
get_state_dump_min0.007238431410356002
get_ui_image_max0.02791244333440607
get_ui_image_mean0.02791244333440607
get_ui_image_median0.02791244333440607
get_ui_image_min0.02791244333440607
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.02688007983061966, "get_ui_image": 0.02791244333440607, "step_physics": 0.07415749809958717, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02672330320217764, "get_state_dump": 0.007238431410356002, "sim_render-ego": 0.00367947058244185, "get_robot_state": 0.007522322914817117, "get_duckie_state": 0.0021309852600097656, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013030767440795898, "deviation-heading": 0.054087540152726175, "complete-iteration": 0.1533221114765514, "set_robot_commands": 0.0021960952065207743, "deviation-center-line": 0.00743447761861001, "driven_lanedir_consec": 0.02672330320217764, "sim_compute_sim_state": 0.013209884816950018, "sim_compute_performance-ego": 0.00216817855834961}}
set_robot_commands_max0.0021960952065207743
set_robot_commands_mean0.0021960952065207743
set_robot_commands_median0.0021960952065207743
set_robot_commands_min0.0021960952065207743
sim_compute_performance-ego_max0.00216817855834961
sim_compute_performance-ego_mean0.00216817855834961
sim_compute_performance-ego_median0.00216817855834961
sim_compute_performance-ego_min0.00216817855834961
sim_compute_sim_state_max0.013209884816950018
sim_compute_sim_state_mean0.013209884816950018
sim_compute_sim_state_median0.013209884816950018
sim_compute_sim_state_min0.013209884816950018
sim_render-ego_max0.00367947058244185
sim_render-ego_mean0.00367947058244185
sim_render-ego_median0.00367947058244185
sim_render-ego_min0.00367947058244185
simulation-passed1
step_physics_max0.07415749809958717
step_physics_mean0.07415749809958717
step_physics_median0.07415749809958717
step_physics_min0.07415749809958717
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5927810330Liam PaullΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.020315857257009014
survival_time_median0.49999999999999994
deviation-center-line_median0.00732600189855844
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.011745474555275658
agent_compute-ego_mean0.011745474555275658
agent_compute-ego_median0.011745474555275658
agent_compute-ego_min0.011745474555275658
complete-iteration_max0.15086234699596057
complete-iteration_mean0.15086234699596057
complete-iteration_median0.15086234699596057
complete-iteration_min0.15086234699596057
deviation-center-line_max0.00732600189855844
deviation-center-line_mean0.00732600189855844
deviation-center-line_min0.00732600189855844
deviation-heading_max0.05382367974463037
deviation-heading_mean0.05382367974463037
deviation-heading_median0.05382367974463037
deviation-heading_min0.05382367974463037
driven_any_max0.020428853127768706
driven_any_mean0.020428853127768706
driven_any_median0.020428853127768706
driven_any_min0.020428853127768706
driven_lanedir_consec_max0.020315857257009014
driven_lanedir_consec_mean0.020315857257009014
driven_lanedir_consec_min0.020315857257009014
driven_lanedir_max0.020315857257009014
driven_lanedir_mean0.020315857257009014
driven_lanedir_median0.020315857257009014
driven_lanedir_min0.020315857257009014
get_duckie_state_max0.0021179806102405896
get_duckie_state_mean0.0021179806102405896
get_duckie_state_median0.0021179806102405896
get_duckie_state_min0.0021179806102405896
get_robot_state_max0.007635961879383434
get_robot_state_mean0.007635961879383434
get_robot_state_median0.007635961879383434
get_robot_state_min0.007635961879383434
get_state_dump_max0.00719274174083363
get_state_dump_mean0.00719274174083363
get_state_dump_median0.00719274174083363
get_state_dump_min0.00719274174083363
get_ui_image_max0.02770729498429732
get_ui_image_mean0.02770729498429732
get_ui_image_median0.02770729498429732
get_ui_image_min0.02770729498429732
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.020428853127768706, "get_ui_image": 0.02770729498429732, "step_physics": 0.073035175150091, "survival_time": 0.49999999999999994, "driven_lanedir": 0.020315857257009014, "get_state_dump": 0.00719274174083363, "sim_render-ego": 0.0036167231473055754, "get_robot_state": 0.007635961879383434, "get_duckie_state": 0.0021179806102405896, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011745474555275658, "deviation-heading": 0.05382367974463037, "complete-iteration": 0.15086234699596057, "set_robot_commands": 0.002475370060313832, "deviation-center-line": 0.00732600189855844, "driven_lanedir_consec": 0.020315857257009014, "sim_compute_sim_state": 0.012929742986505682, "sim_compute_performance-ego": 0.0023299130526455965}}
set_robot_commands_max0.002475370060313832
set_robot_commands_mean0.002475370060313832
set_robot_commands_median0.002475370060313832
set_robot_commands_min0.002475370060313832
sim_compute_performance-ego_max0.0023299130526455965
sim_compute_performance-ego_mean0.0023299130526455965
sim_compute_performance-ego_median0.0023299130526455965
sim_compute_performance-ego_min0.0023299130526455965
sim_compute_sim_state_max0.012929742986505682
sim_compute_sim_state_mean0.012929742986505682
sim_compute_sim_state_median0.012929742986505682
sim_compute_sim_state_min0.012929742986505682
sim_render-ego_max0.0036167231473055754
sim_render-ego_mean0.0036167231473055754
sim_render-ego_median0.0036167231473055754
sim_render-ego_min0.0036167231473055754
simulation-passed1
step_physics_max0.073035175150091
step_physics_mean0.073035175150091
step_physics_median0.073035175150091
step_physics_min0.073035175150091
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5926010328Melisande Tengexercise_ros_templateaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.008012927515068213
survival_time_median0.49999999999999994
deviation-center-line_median0.007078057239344989
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013972043991088867
agent_compute-ego_mean0.013972043991088867
agent_compute-ego_median0.013972043991088867
agent_compute-ego_min0.013972043991088867
complete-iteration_max0.20204591751098633
complete-iteration_mean0.20204591751098633
complete-iteration_median0.20204591751098633
complete-iteration_min0.20204591751098633
deviation-center-line_max0.007078057239344989
deviation-center-line_mean0.007078057239344989
deviation-center-line_min0.007078057239344989
deviation-heading_max0.09444106146072156
deviation-heading_mean0.09444106146072156
deviation-heading_median0.09444106146072156
deviation-heading_min0.09444106146072156
driven_any_max0.008893511767925837
driven_any_mean0.008893511767925837
driven_any_median0.008893511767925837
driven_any_min0.008893511767925837
driven_lanedir_consec_max0.008012927515068213
driven_lanedir_consec_mean0.008012927515068213
driven_lanedir_consec_min0.008012927515068213
driven_lanedir_max0.008012927515068213
driven_lanedir_mean0.008012927515068213
driven_lanedir_median0.008012927515068213
driven_lanedir_min0.008012927515068213
get_duckie_state_max0.002859960902820934
get_duckie_state_mean0.002859960902820934
get_duckie_state_median0.002859960902820934
get_duckie_state_min0.002859960902820934
get_robot_state_max0.009836587038907135
get_robot_state_mean0.009836587038907135
get_robot_state_median0.009836587038907135
get_robot_state_min0.009836587038907135
get_state_dump_max0.00970734249461781
get_state_dump_mean0.00970734249461781
get_state_dump_median0.00970734249461781
get_state_dump_min0.00970734249461781
get_ui_image_max0.03220592845569958
get_ui_image_mean0.03220592845569958
get_ui_image_median0.03220592845569958
get_ui_image_min0.03220592845569958
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.008893511767925837, "get_ui_image": 0.03220592845569958, "step_physics": 0.10775871710343794, "survival_time": 0.49999999999999994, "driven_lanedir": 0.008012927515068213, "get_state_dump": 0.00970734249461781, "sim_render-ego": 0.004261710427024148, "get_robot_state": 0.009836587038907135, "get_duckie_state": 0.002859960902820934, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013972043991088867, "deviation-heading": 0.09444106146072156, "complete-iteration": 0.20204591751098633, "set_robot_commands": 0.003023407676003196, "deviation-center-line": 0.007078057239344989, "driven_lanedir_consec": 0.008012927515068213, "sim_compute_sim_state": 0.01567164334383878, "sim_compute_performance-ego": 0.002648440274325284}}
set_robot_commands_max0.003023407676003196
set_robot_commands_mean0.003023407676003196
set_robot_commands_median0.003023407676003196
set_robot_commands_min0.003023407676003196
sim_compute_performance-ego_max0.002648440274325284
sim_compute_performance-ego_mean0.002648440274325284
sim_compute_performance-ego_median0.002648440274325284
sim_compute_performance-ego_min0.002648440274325284
sim_compute_sim_state_max0.01567164334383878
sim_compute_sim_state_mean0.01567164334383878
sim_compute_sim_state_median0.01567164334383878
sim_compute_sim_state_min0.01567164334383878
sim_render-ego_max0.004261710427024148
sim_render-ego_mean0.004261710427024148
sim_render-ego_median0.004261710427024148
sim_render-ego_min0.004261710427024148
simulation-passed1
step_physics_max0.10775871710343794
step_physics_mean0.10775871710343794
step_physics_median0.10775871710343794
step_physics_min0.10775871710343794
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5924110330Liam PaullΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sanitysanity-checksuccessyesnogpu-prod-030:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.020309603233132023
survival_time_median0.49999999999999994
deviation-center-line_median0.007326778484664194
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.013234268535267223
agent_compute-ego_mean0.013234268535267223
agent_compute-ego_median0.013234268535267223
agent_compute-ego_min0.013234268535267223
complete-iteration_max0.16539079492742365
complete-iteration_mean0.16539079492742365
complete-iteration_median0.16539079492742365
complete-iteration_min0.16539079492742365
deviation-center-line_max0.007326778484664194
deviation-center-line_mean0.007326778484664194
deviation-center-line_min0.007326778484664194
deviation-heading_max0.054068506864681634
deviation-heading_mean0.054068506864681634
deviation-heading_median0.054068506864681634
deviation-heading_min0.054068506864681634
driven_any_max0.02042885123521755
driven_any_mean0.02042885123521755
driven_any_median0.02042885123521755
driven_any_min0.02042885123521755
driven_lanedir_consec_max0.020309603233132023
driven_lanedir_consec_mean0.020309603233132023
driven_lanedir_consec_min0.020309603233132023
driven_lanedir_max0.020309603233132023
driven_lanedir_mean0.020309603233132023
driven_lanedir_median0.020309603233132023
driven_lanedir_min0.020309603233132023
get_duckie_state_max0.0025684616782448507
get_duckie_state_mean0.0025684616782448507
get_duckie_state_median0.0025684616782448507
get_duckie_state_min0.0025684616782448507
get_robot_state_max0.008639162236993963
get_robot_state_mean0.008639162236993963
get_robot_state_median0.008639162236993963
get_robot_state_min0.008639162236993963
get_state_dump_max0.009310462258078836
get_state_dump_mean0.009310462258078836
get_state_dump_median0.009310462258078836
get_state_dump_min0.009310462258078836
get_ui_image_max0.030410679903897373
get_ui_image_mean0.030410679903897373
get_ui_image_median0.030410679903897373
get_ui_image_min0.030410679903897373
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.02042885123521755, "get_ui_image": 0.030410679903897373, "step_physics": 0.07520747184753418, "survival_time": 0.49999999999999994, "driven_lanedir": 0.020309603233132023, "get_state_dump": 0.009310462258078836, "sim_render-ego": 0.004561337557705966, "get_robot_state": 0.008639162236993963, "get_duckie_state": 0.0025684616782448507, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013234268535267223, "deviation-heading": 0.054068506864681634, "complete-iteration": 0.16539079492742365, "set_robot_commands": 0.003014542839743874, "deviation-center-line": 0.007326778484664194, "driven_lanedir_consec": 0.020309603233132023, "sim_compute_sim_state": 0.0153306397524747, "sim_compute_performance-ego": 0.0030184008858420634}}
set_robot_commands_max0.003014542839743874
set_robot_commands_mean0.003014542839743874
set_robot_commands_median0.003014542839743874
set_robot_commands_min0.003014542839743874
sim_compute_performance-ego_max0.0030184008858420634
sim_compute_performance-ego_mean0.0030184008858420634
sim_compute_performance-ego_median0.0030184008858420634
sim_compute_performance-ego_min0.0030184008858420634
sim_compute_sim_state_max0.0153306397524747
sim_compute_sim_state_mean0.0153306397524747
sim_compute_sim_state_median0.0153306397524747
sim_compute_sim_state_min0.0153306397524747
sim_render-ego_max0.004561337557705966
sim_render-ego_mean0.004561337557705966
sim_render-ego_median0.004561337557705966
sim_render-ego_min0.004561337557705966
simulation-passed1
step_physics_max0.07520747184753418
step_physics_mean0.07520747184753418
step_physics_median0.07520747184753418
step_physics_min0.07520747184753418
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5922410354Charlie GauthierΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 62, in on_received_get_commands
             ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
             ||   File "<string>", line 5, in __init__
             ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 52, in __post_init__
             ||     raise ValueError(msg)
             || ValueError: Expected values to be between -1 and 1. Obtained 0.1899999976158142, 1.3700000047683716
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5920710354Charlie GauthierΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 62, in on_received_get_commands
             ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
             ||   File "<string>", line 5, in __init__
             ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 52, in __post_init__
             ||     raise ValueError(msg)
             || ValueError: Expected values to be between -1 and 1. Obtained 0.1899999976158142, 3.5300002098083496
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5919110354Charlie GauthierΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 62, in on_received_get_commands
             ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
             ||   File "<string>", line 5, in __init__
             ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 52, in __post_init__
             ||     raise ValueError(msg)
             || ValueError: Expected values to be between -1 and 1. Obtained 0.1899999976158142, 1.3700000047683716
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5913210348Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sanitysanity-checkfailedyesnogpu-prod-030:04:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5910012889Robert MoniΒ πŸ‡­πŸ‡ΊspeedRLaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-030:16:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.030365765734611
survival_time_median32.29999999999936
deviation-center-line_median1.4063831424910758
in-drivable-lane_median0.6749999999999616


other stats
agent_compute-ego0_max0.0277911001636136
agent_compute-ego0_mean0.027217278315696872
agent_compute-ego0_median0.027217278315696872
agent_compute-ego0_min0.026643456467780147
complete-iteration_max0.3402123605051348
complete-iteration_mean0.30666647073369646
complete-iteration_median0.30666647073369646
complete-iteration_min0.2731205809622581
deviation-center-line_max2.425487362470115
deviation-center-line_mean1.4063831424910758
deviation-center-line_min0.3872789225120362
deviation-heading_max8.08762130178473
deviation-heading_mean5.041344056716535
deviation-heading_median5.041344056716535
deviation-heading_min1.9950668116483403
driven_any_max18.586120297358104
driven_any_mean9.800783643461353
driven_any_median9.800783643461353
driven_any_min1.015446989564601
driven_lanedir_consec_max17.384519931728224
driven_lanedir_consec_mean9.030365765734611
driven_lanedir_consec_min0.6762115997410034
driven_lanedir_max17.941501296049804
driven_lanedir_mean9.434583337401753
driven_lanedir_median9.434583337401753
driven_lanedir_min0.9276653787536993
get_duckie_state_max1.392056865076865e-06
get_duckie_state_mean1.326716047697187e-06
get_duckie_state_median1.326716047697187e-06
get_duckie_state_min1.2613752303175089e-06
get_robot_state_max0.00382612289536704
get_robot_state_mean0.003823603094907536
get_robot_state_median0.003823603094907536
get_robot_state_min0.003821083294448032
get_state_dump_max0.005085417019423618
get_state_dump_mean0.004924706249454448
get_state_dump_median0.004924706249454448
get_state_dump_min0.004763995479485276
get_ui_image_max0.043574266536261445
get_ui_image_mean0.041463132130569576
get_ui_image_median0.041463132130569576
get_ui_image_min0.039351997724877706
in-drivable-lane_max1.3499999999999233
in-drivable-lane_mean0.6749999999999616
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 1.015446989564601, "get_ui_image": 0.043574266536261445, "step_physics": 0.23960445260488855, "survival_time": 4.599999999999992, "driven_lanedir": 0.9276653787536993, "get_state_dump": 0.005085417019423618, "get_robot_state": 0.003821083294448032, "sim_render-ego0": 0.004305401156025548, "get_duckie_state": 1.392056865076865e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9950668116483403, "agent_compute-ego0": 0.0277911001636136, "complete-iteration": 0.3402123605051348, "set_robot_commands": 0.002443341798679803, "deviation-center-line": 0.3872789225120362, "driven_lanedir_consec": 0.6762115997410034, "sim_compute_sim_state": 0.011278583157447076, "sim_compute_performance-ego0": 0.0022188027699788413}, "LFI-norm-udem1-000-ego0": {"driven_any": 18.586120297358104, "get_ui_image": 0.039351997724877706, "step_physics": 0.17631100000290947, "survival_time": 59.99999999999873, "driven_lanedir": 17.941501296049804, "get_state_dump": 0.004763995479485276, "get_robot_state": 0.00382612289536704, "sim_render-ego0": 0.004028626623796881, "get_duckie_state": 1.2613752303175089e-06, "in-drivable-lane": 1.3499999999999233, "deviation-heading": 8.08762130178473, "agent_compute-ego0": 0.026643456467780147, "complete-iteration": 0.2731205809622581, "set_robot_commands": 0.002332158926424635, "deviation-center-line": 2.425487362470115, "driven_lanedir_consec": 17.384519931728224, "sim_compute_sim_state": 0.013672114014129258, "sim_compute_performance-ego0": 0.0021006463469315528}}
set_robot_commands_max0.002443341798679803
set_robot_commands_mean0.0023877503625522193
set_robot_commands_median0.0023877503625522193
set_robot_commands_min0.002332158926424635
sim_compute_performance-ego0_max0.0022188027699788413
sim_compute_performance-ego0_mean0.002159724558455197
sim_compute_performance-ego0_median0.002159724558455197
sim_compute_performance-ego0_min0.0021006463469315528
sim_compute_sim_state_max0.013672114014129258
sim_compute_sim_state_mean0.012475348585788169
sim_compute_sim_state_median0.012475348585788169
sim_compute_sim_state_min0.011278583157447076
sim_render-ego0_max0.004305401156025548
sim_render-ego0_mean0.004167013889911215
sim_render-ego0_median0.004167013889911215
sim_render-ego0_min0.004028626623796881
simulation-passed1
step_physics_max0.23960445260488855
step_physics_mean0.20795772630389903
step_physics_median0.20795772630389903
step_physics_min0.17631100000290947
survival_time_max59.99999999999873
survival_time_mean32.29999999999936
survival_time_min4.599999999999992
No reset possible
5908112777Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-030:35:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0758584010759435
survival_time_median16.525000000000098
deviation-center-line_median0.3747968708141932
in-drivable-lane_median9.000000000000092


other stats
agent_compute-ego0_max0.08926408802349262
agent_compute-ego0_mean0.0687110156884819
agent_compute-ego0_median0.07194755962499155
agent_compute-ego0_min0.041684855480451845
agent_compute-npc0_max0.02679736227602572
agent_compute-npc0_mean0.023491925907491978
agent_compute-npc0_median0.023259359137547196
agent_compute-npc0_min0.020651623078847776
agent_compute-npc1_max0.02997961052561301
agent_compute-npc1_mean0.02866307631507404
agent_compute-npc1_median0.029053552923800186
agent_compute-npc1_min0.02695606549580892
agent_compute-npc2_max0.03509913285573323
agent_compute-npc2_mean0.03332261956449514
agent_compute-npc2_median0.03421815799432489
agent_compute-npc2_min0.030650567843427293
agent_compute-npc3_max0.04693757692972819
agent_compute-npc3_mean0.04482677377494011
agent_compute-npc3_median0.04482677377494011
agent_compute-npc3_min0.04271597062015203
complete-iteration_max1.5391661914574646
complete-iteration_mean1.0349588310008435
complete-iteration_median1.138724435347519
complete-iteration_min0.32322026185087255
deviation-center-line_max0.566655269865469
deviation-center-line_mean0.37168385481115906
deviation-center-line_min0.1704864077507807
deviation-heading_max3.3261174372284907
deviation-heading_mean1.8834143431663437
deviation-heading_median1.6930201701467509
deviation-heading_min0.8214995951433816
driven_any_max3.9466645566124625
driven_any_mean2.3257936391582663
driven_any_median2.215621877529241
driven_any_min0.9252662449621206
driven_lanedir_consec_max2.0012254133432825
driven_lanedir_consec_mean1.1983420423594946
driven_lanedir_consec_min0.6404259539428088
driven_lanedir_max2.0012254133432825
driven_lanedir_mean1.1983420423594946
driven_lanedir_median1.0758584010759435
driven_lanedir_min0.6404259539428088
get_duckie_state_max1.7617400542262516e-06
get_duckie_state_mean1.5542315011062915e-06
get_duckie_state_median1.548180571477268e-06
get_duckie_state_min1.3588248072443782e-06
get_robot_state_max0.019611030301420748
get_robot_state_mean0.01517502798111181
get_robot_state_median0.016890744270788984
get_robot_state_min0.00730759308144853
get_state_dump_max0.011903399827158576
get_state_dump_mean0.00985354613479544
get_state_dump_median0.01063117140482817
get_state_dump_min0.006248441902366844
get_ui_image_max0.05937411189079285
get_ui_image_mean0.04796244995759265
get_ui_image_median0.05080652000010252
get_ui_image_min0.030862647939372708
in-drivable-lane_max14.050000000000145
in-drivable-lane_mean8.23750000000008
in-drivable-lane_min0.8999999999999968
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 2.292924395738812, "get_ui_image": 0.04455816973132724, "step_physics": 0.6882412128292572, "survival_time": 18.300000000000125, "driven_lanedir": 1.483973822791913, "get_state_dump": 0.009627593635538294, "get_robot_state": 0.014611458583488775, "sim_render-ego0": 0.004018480186566345, "sim_render-npc0": 0.003783176640398821, "sim_render-npc1": 0.003883214347693836, "sim_render-npc2": 0.0039984725151789614, "get_duckie_state": 1.5208116993917107e-06, "in-drivable-lane": 7.300000000000104, "deviation-heading": 1.0917277491201776, "agent_compute-ego0": 0.07303984743372946, "agent_compute-npc0": 0.020651623078847776, "agent_compute-npc1": 0.029053552923800186, "agent_compute-npc2": 0.03421815799432489, "complete-iteration": 0.981981484051946, "set_robot_commands": 0.0023205000957935967, "deviation-center-line": 0.40888844383161144, "driven_lanedir_consec": 1.483973822791913, "sim_compute_sim_state": 0.03498572354745475, "sim_compute_performance-ego0": 0.0021686190155611376, "sim_compute_performance-npc0": 0.0019318323369247063, "sim_compute_performance-npc1": 0.001973196336294065, "sim_compute_performance-npc2": 0.0020331816712257323}, "LFV-norm-zigzag-000-ego0": {"driven_any": 0.9252662449621206, "get_ui_image": 0.05937411189079285, "step_physics": 0.8909652352333068, "survival_time": 5.949999999999987, "driven_lanedir": 0.6404259539428088, "get_state_dump": 0.011634749174118044, "get_robot_state": 0.019170029958089193, "sim_render-ego0": 0.004523293177286784, "sim_render-npc0": 0.003854668140411377, "sim_render-npc1": 0.004100718100865682, "sim_render-npc2": 0.004020396868387858, "sim_render-npc3": 0.004133490721384684, "get_duckie_state": 1.5755494435628255e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.294312591173324, "agent_compute-ego0": 0.07085527181625366, "agent_compute-npc0": 0.0241150697072347, "agent_compute-npc1": 0.02695606549580892, "agent_compute-npc2": 0.03509913285573323, "agent_compute-npc3": 0.04693757692972819, "complete-iteration": 1.295467386643092, "set_robot_commands": 0.0024507602055867514, "deviation-center-line": 0.34070529779677505, "driven_lanedir_consec": 0.6404259539428088, "sim_compute_sim_state": 0.06630535920461018, "sim_compute_performance-ego0": 0.0024209956328074137, "sim_compute_performance-npc0": 0.0019910653432210286, "sim_compute_performance-npc1": 0.0022075613339742023, "sim_compute_performance-npc2": 0.0021810650825500487, "sim_compute_performance-npc3": 0.0022382994492848715}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.9466645566124625, "get_ui_image": 0.057054870268877816, "step_physics": 1.1332272740796363, "survival_time": 28.850000000000275, "driven_lanedir": 2.0012254133432825, "get_state_dump": 0.011903399827158576, "get_robot_state": 0.019611030301420748, "sim_render-ego0": 0.00438536987172691, "sim_render-npc0": 0.0040777067824631, "sim_render-npc1": 0.004157332400549654, "sim_render-npc2": 0.004222059332375708, "sim_render-npc3": 0.004222345599666186, "get_duckie_state": 1.7617400542262516e-06, "in-drivable-lane": 14.050000000000145, "deviation-heading": 3.3261174372284907, "agent_compute-ego0": 0.08926408802349262, "agent_compute-npc0": 0.022403648567859688, "agent_compute-npc1": 0.02997961052561301, "agent_compute-npc2": 0.030650567843427293, "agent_compute-npc3": 0.04271597062015203, "complete-iteration": 1.5391661914574646, "set_robot_commands": 0.002504318230704865, "deviation-center-line": 0.566655269865469, "driven_lanedir_consec": 2.0012254133432825, "sim_compute_sim_state": 0.05763958812172438, "sim_compute_performance-ego0": 0.0024073000185217412, "sim_compute_performance-npc0": 0.0021523575469284324, "sim_compute_performance-npc1": 0.0021626582195189586, "sim_compute_performance-npc2": 0.002135038375854492, "sim_compute_performance-npc3": 0.002177594029779665}, "LFV-norm-small_loop-000-ego0": {"driven_any": 2.1383193593196697, "get_ui_image": 0.030862647939372708, "step_physics": 0.1823876226270521, "survival_time": 14.750000000000076, "driven_lanedir": 0.6677429793599741, "get_state_dump": 0.006248441902366844, "get_robot_state": 0.00730759308144853, "sim_render-ego0": 0.004012501723057515, "sim_render-npc0": 0.00370070177155572, "get_duckie_state": 1.3588248072443782e-06, "in-drivable-lane": 10.70000000000008, "deviation-heading": 0.8214995951433816, "agent_compute-ego0": 0.041684855480451845, "agent_compute-npc0": 0.02679736227602572, "complete-iteration": 0.32322026185087255, "set_robot_commands": 0.002253401923824001, "deviation-center-line": 0.1704864077507807, "driven_lanedir_consec": 0.6677429793599741, "sim_compute_sim_state": 0.011735110669522672, "sim_compute_performance-ego0": 0.00202491637822744, "sim_compute_performance-npc0": 0.0019113719463348389}}
set_robot_commands_max0.002504318230704865
set_robot_commands_mean0.0023822451139773036
set_robot_commands_median0.002385630150690174
set_robot_commands_min0.002253401923824001
sim_compute_performance-ego0_max0.0024209956328074137
sim_compute_performance-ego0_mean0.002255457761279434
sim_compute_performance-ego0_median0.002287959517041439
sim_compute_performance-ego0_min0.00202491637822744
sim_compute_performance-npc0_max0.0021523575469284324
sim_compute_performance-npc0_mean0.0019966567933522514
sim_compute_performance-npc0_median0.0019614488400728674
sim_compute_performance-npc0_min0.0019113719463348389
sim_compute_performance-npc1_max0.0022075613339742023
sim_compute_performance-npc1_mean0.002114471963262409
sim_compute_performance-npc1_median0.0021626582195189586
sim_compute_performance-npc1_min0.001973196336294065
sim_compute_performance-npc2_max0.0021810650825500487
sim_compute_performance-npc2_mean0.0021164283765434245
sim_compute_performance-npc2_median0.002135038375854492
sim_compute_performance-npc2_min0.0020331816712257323
sim_compute_performance-npc3_max0.0022382994492848715
sim_compute_performance-npc3_mean0.0022079467395322685
sim_compute_performance-npc3_median0.0022079467395322685
sim_compute_performance-npc3_min0.002177594029779665
sim_compute_sim_state_max0.06630535920461018
sim_compute_sim_state_mean0.04266644538582799
sim_compute_sim_state_median0.046312655834589565
sim_compute_sim_state_min0.011735110669522672
sim_render-ego0_max0.004523293177286784
sim_render-ego0_mean0.004234911239659389
sim_render-ego0_median0.004201925029146628
sim_render-ego0_min0.004012501723057515
sim_render-npc0_max0.0040777067824631
sim_render-npc0_mean0.0038540633337072546
sim_render-npc0_median0.003818922390405098
sim_render-npc0_min0.00370070177155572
sim_render-npc1_max0.004157332400549654
sim_render-npc1_mean0.004047088283036391
sim_render-npc1_median0.004100718100865682
sim_render-npc1_min0.003883214347693836
sim_render-npc2_max0.004222059332375708
sim_render-npc2_mean0.004080309571980842
sim_render-npc2_median0.004020396868387858
sim_render-npc2_min0.0039984725151789614
sim_render-npc3_max0.004222345599666186
sim_render-npc3_mean0.004177918160525435
sim_render-npc3_median0.004177918160525435
sim_render-npc3_min0.004133490721384684
simulation-passed1
step_physics_max1.1332272740796363
step_physics_mean0.7237053361923131
step_physics_median0.789603224031282
step_physics_min0.1823876226270521
survival_time_max28.850000000000275
survival_time_mean16.962500000000116
survival_time_min5.949999999999987
No reset possible
5905412745Andrea CensiΒ πŸ‡¨πŸ‡­JetBrains Researchaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-030:48:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median24.00686584097174
survival_time_median59.99999999999873
deviation-center-line_median3.3193047250047876
in-drivable-lane_median1.4249999999999847


other stats
agent_compute-ego0_max0.08218123414534316
agent_compute-ego0_mean0.0652092512600825
agent_compute-ego0_median0.0700390641635701
agent_compute-ego0_min0.0385776425678466
complete-iteration_max0.4087958391461146
complete-iteration_mean0.3202126395890953
complete-iteration_median0.29690741817718935
complete-iteration_min0.2782398828558878
deviation-center-line_max3.634206158067267
deviation-center-line_mean3.281450218008572
deviation-center-line_min2.852985263957446
deviation-heading_max18.897089971558085
deviation-heading_mean15.2442871821355
deviation-heading_median14.843078904225784
deviation-heading_min12.393900948532352
driven_any_max28.17085026719496
driven_any_mean25.47538578345563
driven_any_median25.47665931773208
driven_any_min22.7773742311634
driven_lanedir_consec_max27.338942275272224
driven_lanedir_consec_mean23.850225687395913
driven_lanedir_consec_min20.048228792367937
driven_lanedir_max27.338942275272224
driven_lanedir_mean23.850225687395913
driven_lanedir_median24.00686584097174
driven_lanedir_min20.048228792367937
get_duckie_state_max1.4916546239543218e-06
get_duckie_state_mean1.4661452256074851e-06
get_duckie_state_median1.4778577120079784e-06
get_duckie_state_min1.4172108544596625e-06
get_robot_state_max0.00436579615349178
get_robot_state_mean0.004185159140879864
get_robot_state_median0.004162200583109351
get_robot_state_min0.004050439243808972
get_state_dump_max0.005397513546018576
get_state_dump_mean0.005284665724717013
get_state_dump_median0.0052821245122015425
get_state_dump_min0.005176900328446387
get_ui_image_max0.04163979769348602
get_ui_image_mean0.03443279671331528
get_ui_image_median0.03274785817215385
get_ui_image_min0.030595672815467396
in-drivable-lane_max4.149999999999931
in-drivable-lane_mean1.7499999999999751
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 25.789638559130815, "get_ui_image": 0.03140112819719275, "step_physics": 0.17314991744531383, "survival_time": 59.99999999999873, "driven_lanedir": 24.559171809812113, "get_state_dump": 0.0052121173928520465, "get_robot_state": 0.004050439243808972, "sim_render-ego0": 0.004293262511863995, "get_duckie_state": 1.48986797348645e-06, "in-drivable-lane": 0.9499999999999816, "deviation-heading": 14.366263028724326, "agent_compute-ego0": 0.06780578790358163, "complete-iteration": 0.30060058112545474, "set_robot_commands": 0.0024932254661032796, "deviation-center-line": 2.852985263957446, "driven_lanedir_consec": 24.559171809812113, "sim_compute_sim_state": 0.009810105847081576, "sim_compute_performance-ego0": 0.0022864963093169226}, "LF-norm-zigzag-000-ego0": {"driven_any": 22.7773742311634, "get_ui_image": 0.04163979769348602, "step_physics": 0.25078612263256267, "survival_time": 59.99999999999873, "driven_lanedir": 20.048228792367937, "get_state_dump": 0.005352131631551039, "get_robot_state": 0.004260186251752283, "sim_render-ego0": 0.004503762493721155, "get_duckie_state": 1.4658474505295067e-06, "in-drivable-lane": 4.149999999999931, "deviation-heading": 18.897089971558085, "agent_compute-ego0": 0.08218123414534316, "complete-iteration": 0.4087958391461146, "set_robot_commands": 0.002651300160315114, "deviation-center-line": 3.552969421124407, "driven_lanedir_consec": 20.048228792367937, "sim_compute_sim_state": 0.014883596037547853, "sim_compute_performance-ego0": 0.002438691930905865}, "LF-norm-techtrack-000-ego0": {"driven_any": 25.163680076333343, "get_ui_image": 0.034094588147114954, "step_physics": 0.18870413035377673, "survival_time": 59.99999999999873, "driven_lanedir": 23.45455987213137, "get_state_dump": 0.005176900328446387, "get_robot_state": 0.004064214914466419, "sim_render-ego0": 0.004201299641948259, "get_duckie_state": 1.4172108544596625e-06, "in-drivable-lane": 1.899999999999988, "deviation-heading": 15.31989477972724, "agent_compute-ego0": 0.0385776425678466, "complete-iteration": 0.293214255228924, "set_robot_commands": 0.0024720347989707265, "deviation-center-line": 3.634206158067267, "driven_lanedir_consec": 23.45455987213137, "sim_compute_sim_state": 0.013596327080516196, "sim_compute_performance-ego0": 0.00222700978198913}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.17085026719496, "get_ui_image": 0.030595672815467396, "step_physics": 0.14861536224517696, "survival_time": 59.99999999999873, "driven_lanedir": 27.338942275272224, "get_state_dump": 0.005397513546018576, "get_robot_state": 0.00436579615349178, "sim_render-ego0": 0.004545512544820946, "get_duckie_state": 1.4916546239543218e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.393900948532352, "agent_compute-ego0": 0.07227234042355857, "complete-iteration": 0.2782398828558878, "set_robot_commands": 0.002733618492488559, "deviation-center-line": 3.085640028885168, "driven_lanedir_consec": 27.338942275272224, "sim_compute_sim_state": 0.007197288946744107, "sim_compute_performance-ego0": 0.002414907841360837}}
set_robot_commands_max0.002733618492488559
set_robot_commands_mean0.00258754472946942
set_robot_commands_median0.0025722628132091967
set_robot_commands_min0.0024720347989707265
sim_compute_performance-ego0_max0.002438691930905865
sim_compute_performance-ego0_mean0.002341776465893189
sim_compute_performance-ego0_median0.00235070207533888
sim_compute_performance-ego0_min0.00222700978198913
sim_compute_sim_state_max0.014883596037547853
sim_compute_sim_state_mean0.011371829477972432
sim_compute_sim_state_median0.011703216463798884
sim_compute_sim_state_min0.007197288946744107
sim_render-ego0_max0.004545512544820946
sim_render-ego0_mean0.004385959298088589
sim_render-ego0_median0.004398512502792575
sim_render-ego0_min0.004201299641948259
simulation-passed1
step_physics_max0.25078612263256267
step_physics_mean0.19031388316920755
step_physics_median0.1809270238995453
step_physics_min0.14861536224517696
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5905012749Raphael Jeansim-exercise-1aido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-030:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3877510148520034
survival_time_median16.650000000000134
deviation-center-line_median0.6130867702059761
in-drivable-lane_median2.2000000000000313


other stats
agent_compute-ego0_max0.01290232011641579
agent_compute-ego0_mean0.012399995782400005
agent_compute-ego0_median0.012399995782400005
agent_compute-ego0_min0.011897671448384215
complete-iteration_max0.28706925490806845
complete-iteration_mean0.24832099229336152
complete-iteration_median0.24832099229336152
complete-iteration_min0.20957272967865465
deviation-center-line_max0.9379621640712692
deviation-center-line_mean0.6130867702059761
deviation-center-line_min0.28821137634068295
deviation-heading_max7.275041430919313
deviation-heading_mean4.371585845562776
deviation-heading_median4.371585845562776
deviation-heading_min1.4681302602062378
driven_any_max5.568441872573567
driven_any_mean3.034953706341411
driven_any_median3.034953706341411
driven_any_min0.5014655401092551
driven_lanedir_consec_max4.296065341419718
driven_lanedir_consec_mean2.3877510148520034
driven_lanedir_consec_min0.47943668828428887
driven_lanedir_max4.622923254511241
driven_lanedir_mean2.551180254941079
driven_lanedir_median2.551180254941079
driven_lanedir_min0.4794372553709172
get_duckie_state_max2.2170187413007363e-06
get_duckie_state_mean1.983189579522968e-06
get_duckie_state_median1.983189579522968e-06
get_duckie_state_min1.7493604177451997e-06
get_robot_state_max0.003832112783673166
get_robot_state_mean0.003712397375255296
get_robot_state_median0.003712397375255296
get_robot_state_min0.003592681966837425
get_state_dump_max0.004926295116029936
get_state_dump_mean0.004728023111165769
get_state_dump_median0.004728023111165769
get_state_dump_min0.0045297511063016015
get_ui_image_max0.0420188054271128
get_ui_image_mean0.03953117203528038
get_ui_image_median0.03953117203528038
get_ui_image_min0.03704353864344795
in-drivable-lane_max4.4000000000000625
in-drivable-lane_mean2.2000000000000313
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.5014655401092551, "get_ui_image": 0.0420188054271128, "step_physics": 0.2044066889532681, "survival_time": 4.299999999999993, "driven_lanedir": 0.4794372553709172, "get_state_dump": 0.004926295116029936, "get_robot_state": 0.003832112783673166, "sim_render-ego0": 0.0038997715917126886, "get_duckie_state": 2.2170187413007363e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4681302602062378, "agent_compute-ego0": 0.01290232011641579, "complete-iteration": 0.28706925490806845, "set_robot_commands": 0.0024362322927891523, "deviation-center-line": 0.28821137634068295, "driven_lanedir_consec": 0.47943668828428887, "sim_compute_sim_state": 0.010519485364015075, "sim_compute_performance-ego0": 0.0020304274284976653}, "LFI-norm-udem1-000-ego0": {"driven_any": 5.568441872573567, "get_ui_image": 0.03704353864344795, "step_physics": 0.1312441185706659, "survival_time": 29.000000000000277, "driven_lanedir": 4.622923254511241, "get_state_dump": 0.0045297511063016015, "get_robot_state": 0.003592681966837425, "sim_render-ego0": 0.003787722316748509, "get_duckie_state": 1.7493604177451997e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 7.275041430919313, "agent_compute-ego0": 0.011897671448384215, "complete-iteration": 0.20957272967865465, "set_robot_commands": 0.0021392761532492972, "deviation-center-line": 0.9379621640712692, "driven_lanedir_consec": 4.296065341419718, "sim_compute_sim_state": 0.013274736125374826, "sim_compute_performance-ego0": 0.001976381685975907}}
set_robot_commands_max0.0024362322927891523
set_robot_commands_mean0.002287754223019225
set_robot_commands_median0.002287754223019225
set_robot_commands_min0.0021392761532492972
sim_compute_performance-ego0_max0.0020304274284976653
sim_compute_performance-ego0_mean0.002003404557236786
sim_compute_performance-ego0_median0.002003404557236786
sim_compute_performance-ego0_min0.001976381685975907
sim_compute_sim_state_max0.013274736125374826
sim_compute_sim_state_mean0.01189711074469495
sim_compute_sim_state_median0.01189711074469495
sim_compute_sim_state_min0.010519485364015075
sim_render-ego0_max0.0038997715917126886
sim_render-ego0_mean0.003843746954230599
sim_render-ego0_median0.003843746954230599
sim_render-ego0_min0.003787722316748509
simulation-passed1
step_physics_max0.2044066889532681
step_physics_mean0.167825403761967
step_physics_median0.167825403761967
step_physics_min0.1312441185706659
survival_time_max29.000000000000277
survival_time_mean16.650000000000134
survival_time_min4.299999999999993
No reset possible
5904012751Raphael Jeansim-exercise-1aido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-030:13:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.88762852045026
survival_time_median35.69999999999938
deviation-center-line_median1.0155001417417018
in-drivable-lane_median10.024999999999723


other stats
agent_compute-ego0_max0.01398524967343526
agent_compute-ego0_mean0.013874283119223908
agent_compute-ego0_median0.013874283119223908
agent_compute-ego0_min0.013763316565012555
complete-iteration_max0.2968151642245497
complete-iteration_mean0.2584154585727735
complete-iteration_median0.2584154585727735
complete-iteration_min0.22001575292099723
deviation-center-line_max1.8673802981973728
deviation-center-line_mean1.0155001417417018
deviation-center-line_min0.16361998528603103
deviation-heading_max9.953359489110838
deviation-heading_mean5.570724145171563
deviation-heading_median5.570724145171563
deviation-heading_min1.1880888012322883
driven_any_max12.31922290651738
driven_any_mean7.352907895497416
driven_any_median7.352907895497416
driven_any_min2.386592884477451
driven_lanedir_consec_max8.980904171922575
driven_lanedir_consec_mean4.88762852045026
driven_lanedir_consec_min0.7943528689779449
driven_lanedir_max9.887922742126058
driven_lanedir_mean5.355944374157609
driven_lanedir_median5.355944374157609
driven_lanedir_min0.8239660061891605
get_duckie_state_max1.3671846413592511e-06
get_duckie_state_mean1.3618879725777392e-06
get_duckie_state_median1.3618879725777392e-06
get_duckie_state_min1.3565913037962268e-06
get_robot_state_max0.0038656605383194168
get_robot_state_mean0.003835266903544232
get_robot_state_median0.003835266903544232
get_robot_state_min0.0038048732687690472
get_state_dump_max0.00496864110621823
get_state_dump_mean0.004886753008319677
get_state_dump_median0.004886753008319677
get_state_dump_min0.0048048649104211255
get_ui_image_max0.04040688614657872
get_ui_image_mean0.03907541766102763
get_ui_image_median0.03907541766102763
get_ui_image_min0.037743949175476535
in-drivable-lane_max12.099999999999415
in-drivable-lane_mean10.024999999999723
in-drivable-lane_min7.950000000000031
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 2.386592884477451, "get_ui_image": 0.04040688614657872, "step_physics": 0.2128704041893305, "survival_time": 11.400000000000029, "driven_lanedir": 0.8239660061891605, "get_state_dump": 0.00496864110621823, "get_robot_state": 0.0038656605383194168, "sim_render-ego0": 0.004160326120634787, "get_duckie_state": 1.3565913037962268e-06, "in-drivable-lane": 7.950000000000031, "deviation-heading": 1.1880888012322883, "agent_compute-ego0": 0.01398524967343526, "complete-iteration": 0.2968151642245497, "set_robot_commands": 0.0024244910244337857, "deviation-center-line": 0.16361998528603103, "driven_lanedir_consec": 0.7943528689779449, "sim_compute_sim_state": 0.011936319967544755, "sim_compute_performance-ego0": 0.0021108123412819407}, "LFI-full-udem1-000-ego0": {"driven_any": 12.31922290651738, "get_ui_image": 0.037743949175476535, "step_physics": 0.1389534991547825, "survival_time": 59.99999999999873, "driven_lanedir": 9.887922742126058, "get_state_dump": 0.0048048649104211255, "get_robot_state": 0.0038048732687690472, "sim_render-ego0": 0.0039621763284954795, "get_duckie_state": 1.3671846413592511e-06, "in-drivable-lane": 12.099999999999415, "deviation-heading": 9.953359489110838, "agent_compute-ego0": 0.013763316565012555, "complete-iteration": 0.22001575292099723, "set_robot_commands": 0.0022650134255745133, "deviation-center-line": 1.8673802981973728, "driven_lanedir_consec": 8.980904171922575, "sim_compute_sim_state": 0.0126016354382187, "sim_compute_performance-ego0": 0.002031599849983615}}
set_robot_commands_max0.0024244910244337857
set_robot_commands_mean0.0023447522250041493
set_robot_commands_median0.0023447522250041493
set_robot_commands_min0.0022650134255745133
sim_compute_performance-ego0_max0.0021108123412819407
sim_compute_performance-ego0_mean0.002071206095632778
sim_compute_performance-ego0_median0.002071206095632778
sim_compute_performance-ego0_min0.002031599849983615
sim_compute_sim_state_max0.0126016354382187
sim_compute_sim_state_mean0.012268977702881727
sim_compute_sim_state_median0.012268977702881727
sim_compute_sim_state_min0.011936319967544755
sim_render-ego0_max0.004160326120634787
sim_render-ego0_mean0.004061251224565133
sim_render-ego0_median0.004061251224565133
sim_render-ego0_min0.0039621763284954795
simulation-passed1
step_physics_max0.2128704041893305
step_physics_mean0.1759119516720565
step_physics_median0.1759119516720565
step_physics_min0.1389534991547825
survival_time_max59.99999999999873
survival_time_mean35.69999999999938
survival_time_min11.400000000000029
No reset possible
5900712767Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-030:26:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1554550606245053
survival_time_median7.92500000000001
deviation-center-line_median0.39107964776873055
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego0_max0.0866728194972925
agent_compute-ego0_mean0.07071698162630792
agent_compute-ego0_median0.08025975259058273
agent_compute-ego0_min0.03567560182677375
agent_compute-npc0_max0.02712045775519477
agent_compute-npc0_mean0.023558002663063703
agent_compute-npc0_median0.023144561711914948
agent_compute-npc0_min0.020822429473230143
agent_compute-npc1_max0.02965505917867025
agent_compute-npc1_mean0.02892065562454914
agent_compute-npc1_median0.029301752244806013
agent_compute-npc1_min0.02780515545017117
agent_compute-npc2_max0.03810099717024919
agent_compute-npc2_mean0.03568707337716142
agent_compute-npc2_median0.03797723608439598
agent_compute-npc2_min0.030982986876839085
agent_compute-npc3_max0.04983422782394912
agent_compute-npc3_mean0.047828953752679496
agent_compute-npc3_median0.047828953752679496
agent_compute-npc3_min0.04582367968140987
complete-iteration_max1.7432465302316766
complete-iteration_mean1.1930784540729238
complete-iteration_median1.2873976188595575
complete-iteration_min0.4542720483409034
deviation-center-line_max0.9660791982762588
deviation-center-line_mean0.4919889186822939
deviation-center-line_min0.21971718091545567
deviation-heading_max5.509448609754067
deviation-heading_mean2.778519506945578
deviation-heading_median2.3212505899894595
deviation-heading_min0.9621282380493272
driven_any_max10.528209507367723
driven_any_mean4.159232014726945
driven_any_median2.53887585108163
driven_any_min1.0309668493767998
driven_lanedir_consec_max10.12969456906877
driven_lanedir_consec_mean3.85165404225703
driven_lanedir_consec_min0.9660114787103375
driven_lanedir_max10.12969456906877
driven_lanedir_mean3.85165404225703
driven_lanedir_median2.1554550606245053
driven_lanedir_min0.9660114787103375
get_duckie_state_max1.7484029134114585e-06
get_duckie_state_mean1.6832823791887522e-06
get_duckie_state_median1.6971753239746564e-06
get_duckie_state_min1.5903759553942377e-06
get_robot_state_max0.01954231345862673
get_robot_state_mean0.015681685161667125
get_robot_state_median0.017500535199809222
get_robot_state_min0.008183356788423326
get_state_dump_max0.012346118361085326
get_state_dump_mean0.010442137670074531
get_state_dump_median0.011174334487594924
get_state_dump_min0.007073763344022963
get_ui_image_max0.06312293796748905
get_ui_image_mean0.05126514895858319
get_ui_image_median0.05345693628355935
get_ui_image_min0.035023785299725003
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.4749999999999994
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 10.528209507367723, "get_ui_image": 0.04794930952362472, "step_physics": 0.7923370101318653, "survival_time": 25.900000000000233, "driven_lanedir": 10.12969456906877, "get_state_dump": 0.010189015052222104, "get_robot_state": 0.015494097174936636, "sim_render-ego0": 0.004184775269789503, "sim_render-npc0": 0.003870188615685024, "sim_render-npc1": 0.003955508932212874, "sim_render-npc2": 0.004129691390403203, "get_duckie_state": 1.5903759553942377e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 5.509448609754067, "agent_compute-ego0": 0.08256141390644287, "agent_compute-npc0": 0.020822429473230143, "agent_compute-npc1": 0.029301752244806013, "agent_compute-npc2": 0.03797723608439598, "complete-iteration": 1.107005108298594, "set_robot_commands": 0.002521010492578407, "deviation-center-line": 0.9660791982762588, "driven_lanedir_consec": 10.12969456906877, "sim_compute_sim_state": 0.03591958406113935, "sim_compute_performance-ego0": 0.0022462847604916964, "sim_compute_performance-npc0": 0.002110011775139898, "sim_compute_performance-npc1": 0.0020084739420455316, "sim_compute_performance-npc2": 0.002146257371112331}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.275511333603771, "get_ui_image": 0.06312293796748905, "step_physics": 1.0426211802514045, "survival_time": 4.499999999999992, "driven_lanedir": 0.9994303160669208, "get_state_dump": 0.012346118361085326, "get_robot_state": 0.01950697322468181, "sim_render-ego0": 0.0042585724002712376, "sim_render-npc0": 0.004134757178170341, "sim_render-npc1": 0.0041441734020526595, "sim_render-npc2": 0.004216112933316074, "sim_render-npc3": 0.0043191883590195206, "get_duckie_state": 1.6794099912538633e-06, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 1.4524634067176576, "agent_compute-ego0": 0.07795809127472259, "agent_compute-npc0": 0.02441118313716008, "agent_compute-npc1": 0.02780515545017117, "agent_compute-npc2": 0.03810099717024919, "agent_compute-npc3": 0.04983422782394912, "complete-iteration": 1.4677901294205216, "set_robot_commands": 0.0027076281034029447, "deviation-center-line": 0.21971718091545567, "driven_lanedir_consec": 0.9994303160669208, "sim_compute_sim_state": 0.06685484634650933, "sim_compute_performance-ego0": 0.0022638970678979225, "sim_compute_performance-npc0": 0.0021392172509497338, "sim_compute_performance-npc1": 0.0021603212251768006, "sim_compute_performance-npc2": 0.00218309936942635, "sim_compute_performance-npc3": 0.002267441906771817}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.802240368559489, "get_ui_image": 0.05896456304349398, "step_physics": 1.333557024336698, "survival_time": 11.350000000000026, "driven_lanedir": 3.31147980518209, "get_state_dump": 0.012159653922967743, "get_robot_state": 0.01954231345862673, "sim_render-ego0": 0.004175760244068347, "sim_render-npc0": 0.004008800314183821, "sim_render-npc1": 0.0040799358434844436, "sim_render-npc2": 0.004151977990802966, "sim_render-npc3": 0.004310657057845802, "get_duckie_state": 1.7149406566954496e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 3.1900377732612615, "agent_compute-ego0": 0.0866728194972925, "agent_compute-npc0": 0.021877940286669815, "agent_compute-npc1": 0.02965505917867025, "agent_compute-npc2": 0.030982986876839085, "agent_compute-npc3": 0.04582367968140987, "complete-iteration": 1.7432465302316766, "set_robot_commands": 0.0025757708047565663, "deviation-center-line": 0.5146683606325, "driven_lanedir_consec": 3.31147980518209, "sim_compute_sim_state": 0.059536614961791454, "sim_compute_performance-ego0": 0.002368982423815811, "sim_compute_performance-npc0": 0.002079488938314873, "sim_compute_performance-npc1": 0.002144450681251392, "sim_compute_performance-npc2": 0.002191768403638874, "sim_compute_performance-npc3": 0.002219315160784805}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.0309668493767998, "get_ui_image": 0.035023785299725003, "step_physics": 0.31264394521713257, "survival_time": 3.5499999999999954, "driven_lanedir": 0.9660114787103375, "get_state_dump": 0.007073763344022963, "get_robot_state": 0.008183356788423326, "sim_render-ego0": 0.004288471407360501, "sim_render-npc0": 0.004037095440758599, "get_duckie_state": 1.7484029134114585e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9621282380493272, "agent_compute-ego0": 0.03567560182677375, "agent_compute-npc0": 0.02712045775519477, "complete-iteration": 0.4542720483409034, "set_robot_commands": 0.002391464180416531, "deviation-center-line": 0.2674909349049611, "driven_lanedir_consec": 0.9660114787103375, "sim_compute_sim_state": 0.0108979774845971, "sim_compute_performance-ego0": 0.002251310480965508, "sim_compute_performance-npc0": 0.002105928129620022}}
set_robot_commands_max0.0027076281034029447
set_robot_commands_mean0.002548968395288612
set_robot_commands_median0.0025483906486674867
set_robot_commands_min0.002391464180416531
sim_compute_performance-ego0_max0.002368982423815811
sim_compute_performance-ego0_mean0.0022826186832927346
sim_compute_performance-ego0_median0.0022576037744317153
sim_compute_performance-ego0_min0.0022462847604916964
sim_compute_performance-npc0_max0.0021392172509497338
sim_compute_performance-npc0_mean0.002108661523506132
sim_compute_performance-npc0_median0.0021079699523799604
sim_compute_performance-npc0_min0.002079488938314873
sim_compute_performance-npc1_max0.0021603212251768006
sim_compute_performance-npc1_mean0.002104415282824574
sim_compute_performance-npc1_median0.002144450681251392
sim_compute_performance-npc1_min0.0020084739420455316
sim_compute_performance-npc2_max0.002191768403638874
sim_compute_performance-npc2_mean0.002173708381392518
sim_compute_performance-npc2_median0.00218309936942635
sim_compute_performance-npc2_min0.002146257371112331
sim_compute_performance-npc3_max0.002267441906771817
sim_compute_performance-npc3_mean0.0022433785337783113
sim_compute_performance-npc3_median0.0022433785337783113
sim_compute_performance-npc3_min0.002219315160784805
sim_compute_sim_state_max0.06685484634650933
sim_compute_sim_state_mean0.043302255713509305
sim_compute_sim_state_median0.0477280995114654
sim_compute_sim_state_min0.0108979774845971
sim_render-ego0_max0.004288471407360501
sim_render-ego0_mean0.004226894830372397
sim_render-ego0_median0.00422167383503037
sim_render-ego0_min0.004175760244068347
sim_render-npc0_max0.004134757178170341
sim_render-npc0_mean0.004012710387199446
sim_render-npc0_median0.00402294787747121
sim_render-npc0_min0.003870188615685024
sim_render-npc1_max0.0041441734020526595
sim_render-npc1_mean0.004059872725916659
sim_render-npc1_median0.0040799358434844436
sim_render-npc1_min0.003955508932212874
sim_render-npc2_max0.004216112933316074
sim_render-npc2_mean0.004165927438174081
sim_render-npc2_median0.004151977990802966
sim_render-npc2_min0.004129691390403203
sim_render-npc3_max0.0043191883590195206
sim_render-npc3_mean0.004314922708432661
sim_render-npc3_median0.004314922708432661
sim_render-npc3_min0.004310657057845802
simulation-passed1
step_physics_max1.333557024336698
step_physics_mean0.8702897899842751
step_physics_median0.917479095191635
step_physics_min0.31264394521713257
survival_time_max25.900000000000233
survival_time_mean11.32500000000006
survival_time_min3.5499999999999954
No reset possible
5900112785Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-030:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4760492846687213
survival_time_median6.374999999999986
deviation-center-line_median0.20433365028155903
in-drivable-lane_median4.849999999999987


other stats
agent_compute-ego0_max0.013885035911130522
agent_compute-ego0_mean0.013081250548559398
agent_compute-ego0_median0.013186307130331788
agent_compute-ego0_min0.012067352022443498
complete-iteration_max0.3374728747411324
complete-iteration_mean0.28122077206383
complete-iteration_median0.2806702161345851
complete-iteration_min0.22606978124501753
deviation-center-line_max0.7372836090435235
deviation-center-line_mean0.29350435150965115
deviation-center-line_min0.02806649643196301
deviation-heading_max4.540823822538324
deviation-heading_mean1.9893045595639811
deviation-heading_median1.455217897803512
deviation-heading_min0.5059586201105765
driven_any_max4.89384370747007
driven_any_mean2.168782523835997
driven_any_median1.4910319510339365
driven_any_min0.7992224858060428
driven_lanedir_consec_max2.7375919843840357
driven_lanedir_consec_mean0.9506754692285296
driven_lanedir_consec_min0.11301132319263996
driven_lanedir_max2.7375919843840357
driven_lanedir_mean0.9506754692285296
driven_lanedir_median0.4760492846687213
driven_lanedir_min0.11301132319263996
get_duckie_state_max0.02518997852157497
get_duckie_state_mean0.01808348130133072
get_duckie_state_median0.021413593057272622
get_duckie_state_min0.004316760569202657
get_robot_state_max0.004091135618194498
get_robot_state_mean0.003895213796051267
get_robot_state_median0.0038806357188984407
get_robot_state_min0.003728448128213688
get_state_dump_max0.008898492129343861
get_state_dump_mean0.0078459246320936
get_state_dump_median0.008522495361916117
get_state_dump_min0.005440215675198302
get_ui_image_max0.04148767269328836
get_ui_image_mean0.03430936370563279
get_ui_image_median0.03420978544927804
get_ui_image_min0.027330211230686737
in-drivable-lane_max7.1000000000000885
in-drivable-lane_mean4.337500000000015
in-drivable-lane_min0.549999999999998
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.917242622720528, "get_ui_image": 0.03292087938800548, "step_physics": 0.1697943075647894, "survival_time": 7.89999999999998, "driven_lanedir": 0.11301132319263996, "get_state_dump": 0.008898492129343861, "get_robot_state": 0.0038617062118818176, "sim_render-ego0": 0.003977040824650219, "get_duckie_state": 0.02518997852157497, "in-drivable-lane": 6.94999999999998, "deviation-heading": 0.5059586201105765, "agent_compute-ego0": 0.01309244287838726, "complete-iteration": 0.2691561156098948, "set_robot_commands": 0.0023192309733456786, "deviation-center-line": 0.02806649643196301, "driven_lanedir_consec": 0.11301132319263996, "sim_compute_sim_state": 0.007036727929265244, "sim_compute_performance-ego0": 0.001965860150895029}, "LFP-norm-zigzag-000-ego0": {"driven_any": 4.89384370747007, "get_ui_image": 0.04148767269328836, "step_physics": 0.22234450460439073, "survival_time": 18.60000000000013, "driven_lanedir": 2.7375919843840357, "get_state_dump": 0.00868574863464519, "get_robot_state": 0.004091135618194498, "sim_render-ego0": 0.0041581881270012335, "get_duckie_state": 0.022415009644331945, "in-drivable-lane": 7.1000000000000885, "deviation-heading": 4.540823822538324, "agent_compute-ego0": 0.013885035911130522, "complete-iteration": 0.3374728747411324, "set_robot_commands": 0.0024547755878029176, "deviation-center-line": 0.7372836090435235, "driven_lanedir_consec": 2.7375919843840357, "sim_compute_sim_state": 0.01567420627092868, "sim_compute_performance-ego0": 0.0021671379539346565}, "LFP-norm-techtrack-000-ego0": {"driven_any": 0.7992224858060428, "get_ui_image": 0.03549869151055059, "step_physics": 0.19351987295512912, "survival_time": 3.899999999999994, "driven_lanedir": 0.13640882121244724, "get_state_dump": 0.008359242089187043, "get_robot_state": 0.003899565225915064, "sim_render-ego0": 0.0038327838801130464, "get_duckie_state": 0.0204121764702133, "in-drivable-lane": 2.749999999999994, "deviation-heading": 0.7891147367338515, "agent_compute-ego0": 0.01328017138227632, "complete-iteration": 0.29218431665927547, "set_robot_commands": 0.0022320023065880885, "deviation-center-line": 0.0577669749948617, "driven_lanedir_consec": 0.13640882121244724, "sim_compute_sim_state": 0.00908159606064422, "sim_compute_performance-ego0": 0.001970345460915867}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.064821279347345, "get_ui_image": 0.027330211230686737, "step_physics": 0.15878079375442194, "survival_time": 4.849999999999991, "driven_lanedir": 0.8156897481249954, "get_state_dump": 0.005440215675198302, "get_robot_state": 0.003728448128213688, "sim_render-ego0": 0.00384495209674446, "get_duckie_state": 0.004316760569202657, "in-drivable-lane": 0.549999999999998, "deviation-heading": 2.121321058873173, "agent_compute-ego0": 0.012067352022443498, "complete-iteration": 0.22606978124501753, "set_robot_commands": 0.002263336765522859, "deviation-center-line": 0.3509003255682564, "driven_lanedir_consec": 0.8156897481249954, "sim_compute_sim_state": 0.006237952076658911, "sim_compute_performance-ego0": 0.0019690211938352}}
set_robot_commands_max0.0024547755878029176
set_robot_commands_mean0.002317336408314886
set_robot_commands_median0.0022912838694342692
set_robot_commands_min0.0022320023065880885
sim_compute_performance-ego0_max0.0021671379539346565
sim_compute_performance-ego0_mean0.002018091189895188
sim_compute_performance-ego0_median0.0019696833273755337
sim_compute_performance-ego0_min0.001965860150895029
sim_compute_sim_state_max0.01567420627092868
sim_compute_sim_state_mean0.009507620584374264
sim_compute_sim_state_median0.008059161994954732
sim_compute_sim_state_min0.006237952076658911
sim_render-ego0_max0.0041581881270012335
sim_render-ego0_mean0.00395324123212724
sim_render-ego0_median0.00391099646069734
sim_render-ego0_min0.0038327838801130464
simulation-passed1
step_physics_max0.22234450460439073
step_physics_mean0.1861098697196828
step_physics_median0.18165709025995924
step_physics_min0.15878079375442194
survival_time_max18.60000000000013
survival_time_mean8.812500000000025
survival_time_min3.899999999999994
No reset possible
5891512821Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-031:53:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.6648730896757975
survival_time_median59.99999999999873
deviation-center-line_median3.6816988727117295
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego0_max0.013217503581813332
agent_compute-ego0_mean0.012910015061480956
agent_compute-ego0_median0.013093328844957688
agent_compute-ego0_min0.012550156082737754
agent_compute-ego1_max0.012292263410569826
agent_compute-ego1_mean0.012057601606256598
agent_compute-ego1_median0.01211688818284415
agent_compute-ego1_min0.011613335679559147
complete-iteration_max1.2186243513587829
complete-iteration_mean0.9184464920954402
complete-iteration_median0.9601668628625926
complete-iteration_min0.3444407389444463
deviation-center-line_max6.8061229905690235
deviation-center-line_mean3.110531870478269
deviation-center-line_min0.2510014367118118
deviation-heading_max39.01692473854389
deviation-heading_mean16.139698368186536
deviation-heading_median18.21737519777684
deviation-heading_min1.2658548814446504
driven_any_max12.351797067857383
driven_any_mean7.351132437128406
driven_any_median9.618527146297836
driven_any_min1.136076090962484
driven_lanedir_consec_max11.357718902528466
driven_lanedir_consec_mean6.02700627074329
driven_lanedir_consec_min0.8729610777237207
driven_lanedir_max11.357718902528466
driven_lanedir_mean6.263360875920654
driven_lanedir_median7.301254164226468
driven_lanedir_min0.8729610777237207
get_duckie_state_max2.3248292921385497e-06
get_duckie_state_mean2.1872917450407815e-06
get_duckie_state_median2.224693396741321e-06
get_duckie_state_min1.865274765912224e-06
get_robot_state_max0.015042151340735544
get_robot_state_mean0.013687952828866643
get_robot_state_median0.014730796871365706
get_robot_state_min0.007057458162307739
get_state_dump_max0.00989291471406681
get_state_dump_mean0.00923065781899862
get_state_dump_median0.00975284900320878
get_state_dump_min0.006124994334052591
get_ui_image_max0.04877636950776341
get_ui_image_mean0.04465781376289441
get_ui_image_median0.047931837605077035
get_ui_image_min0.03012990951538086
in-drivable-lane_max52.29999999999873
in-drivable-lane_mean10.289285714285423
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.351797067857383, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 11.335588289683512, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 1.2499999999999716, "deviation-heading": 17.604156196650386, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 3.5970818396405897, "driven_lanedir_consec": 11.335588289683512, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.5712368940087, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 6.012991586022755, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 27.799999999998477, "deviation-heading": 8.989287504667587, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 2.047990081486739, "driven_lanedir_consec": 6.012991586022755, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.322318618857918, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 1.2299312115531742, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 52.29999999999873, "deviation-heading": 3.4701205647526145, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 0.47120177924920104, "driven_lanedir_consec": 1.1937288881714148, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 12.305599067824756, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 10.913621102277109, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 3.1999999999998323, "deviation-heading": 18.209846903577308, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 3.766315905782869, "driven_lanedir_consec": 10.913621102277109, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 9.822913344445864, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 8.816854699785235, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 19.50811253170587, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 5.050346867220948, "driven_lanedir_consec": 8.816854699785235, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.173604186437672, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 11.136626019070322, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 0.8500000000000121, "deviation-heading": 18.50411865015321, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.164099044121296, "driven_lanedir_consec": 11.136626019070322, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.665817398586972, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 8.589516742430181, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 18.224903491976377, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.884249950271387, "driven_lanedir_consec": 5.31675459332884, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.329749097064765, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 11.357718902528466, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 0.0, "deviation-heading": 19.883107668912515, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.318611668162077, "driven_lanedir_consec": 11.357718902528466, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.762522832224445, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 10.619110682781098, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 1.550000000000022, "deviation-heading": 18.541832009368303, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 4.0621131742629855, "driven_lanedir_consec": 10.619110682781098, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.497603839592919, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 1.328181155287271, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 51.99999999999885, "deviation-heading": 1.2658548814446504, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 0.33780465998057935, "driven_lanedir_consec": 1.328181155287271, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 2.479472907816198, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 2.353874814365641, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 0.0, "deviation-heading": 39.01692473854389, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 6.8061229905690235, "driven_lanedir_consec": 2.353874814365641, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.2728734678524107, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 2.0836125546021647, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 38.93044223749277, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 3.3756183588465603, "driven_lanedir_consec": 2.0836125546021647, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.224269306265181, "get_ui_image": 0.03012990951538086, "step_physics": 0.25194814801216125, "survival_time": 6.749999999999984, "driven_lanedir": 0.8729610777237207, "get_state_dump": 0.006124994334052591, "get_robot_state": 0.007057458162307739, "sim_render-ego0": 0.003660957602893605, "sim_render-ego1": 0.003922153921688304, "get_duckie_state": 1.865274765912224e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.6420912560159036, "agent_compute-ego0": 0.012648128411349128, "agent_compute-ego1": 0.011613335679559147, "complete-iteration": 0.3444407389444463, "set_robot_commands": 0.002161863972158993, "deviation-center-line": 0.2510014367118118, "driven_lanedir_consec": 0.8729610777237207, "sim_compute_sim_state": 0.008993057643665987, "sim_compute_performance-ego0": 0.0018437890445484831, "sim_compute_performance-ego1": 0.00193175147561466}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.136076090962484, "get_ui_image": 0.03012990951538086, "step_physics": 0.25194814801216125, "survival_time": 6.749999999999984, "driven_lanedir": 1.0364634247785138, "get_state_dump": 0.006124994334052591, "get_robot_state": 0.007057458162307739, "sim_render-ego0": 0.003660957602893605, "sim_render-ego1": 0.003922153921688304, "get_duckie_state": 1.865274765912224e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.164978519350116, "agent_compute-ego0": 0.012648128411349128, "agent_compute-ego1": 0.011613335679559147, "complete-iteration": 0.3444407389444463, "set_robot_commands": 0.002161863972158993, "deviation-center-line": 0.4148884303897118, "driven_lanedir_consec": 1.0364634247785138, "sim_compute_sim_state": 0.008993057643665987, "sim_compute_performance-ego0": 0.0018437890445484831, "sim_compute_performance-ego1": 0.00193175147561466}}
set_robot_commands_max0.002503518492419046
set_robot_commands_mean0.002324927884088697
set_robot_commands_median0.0023384457523876385
set_robot_commands_min0.002161863972158993
sim_compute_performance-ego0_max0.0022003741982973783
sim_compute_performance-ego0_mean0.002128063429902294
sim_compute_performance-ego0_median0.00217216040669234
sim_compute_performance-ego0_min0.0018437890445484831
sim_compute_performance-ego1_max0.002117216934470908
sim_compute_performance-ego1_mean0.0020471748317541128
sim_compute_performance-ego1_median0.0020565732531900908
sim_compute_performance-ego1_min0.00193175147561466
sim_compute_sim_state_max0.04342404591054543
sim_compute_sim_state_mean0.02714760045482296
sim_compute_sim_state_median0.026253815594561192
sim_compute_sim_state_min0.008993057643665987
sim_render-ego0_max0.004106724292015056
sim_render-ego0_mean0.003946194996546406
sim_render-ego0_median0.003953353147104908
sim_render-ego0_min0.003660957602893605
sim_render-ego1_max0.004269505222075984
sim_render-ego1_mean0.004143666420480816
sim_render-ego1_median0.004180357974865061
sim_render-ego1_min0.003922153921688304
simulation-passed1
step_physics_max1.0407248646251517
step_physics_mean0.7462430574382161
step_physics_median0.7615132522424194
step_physics_min0.25194814801216125
survival_time_max59.99999999999873
survival_time_mean51.84999999999894
survival_time_min6.749999999999984
No reset possible
5889612845Raphael Jeanexercise_state_estimationaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-030:20:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3179945309130097
survival_time_median18.60000000000013
deviation-center-line_median0.7930768547640676
in-drivable-lane_median0.92500000000001


other stats
agent_compute-ego0_max0.013014683172331384
agent_compute-ego0_mean0.012726994954597773
agent_compute-ego0_median0.012726994954597773
agent_compute-ego0_min0.012439306736864162
agent_compute-npc0_max0.046963260401433435
agent_compute-npc0_mean0.04591834467818604
agent_compute-npc0_median0.04591834467818604
agent_compute-npc0_min0.04487342895493865
agent_compute-npc1_max0.04341656198449283
agent_compute-npc1_mean0.03968179445168686
agent_compute-npc1_median0.03968179445168686
agent_compute-npc1_min0.0359470269188809
agent_compute-npc2_max0.04219347380197026
agent_compute-npc2_mean0.03770930140003985
agent_compute-npc2_median0.03770930140003985
agent_compute-npc2_min0.03322512899810944
complete-iteration_max1.132611067682995
complete-iteration_mean1.1100552442647609
complete-iteration_median1.1100552442647609
complete-iteration_min1.087499420846527
deviation-center-line_max1.2535529385468998
deviation-center-line_mean0.7930768547640676
deviation-center-line_min0.3326007709812355
deviation-heading_max4.474912575888296
deviation-heading_mean3.3268192464207615
deviation-heading_median3.3268192464207615
deviation-heading_min2.178725916953227
driven_any_max5.4963904926648
driven_any_mean3.942626438333265
driven_any_median3.942626438333265
driven_any_min2.3888623840017287
driven_lanedir_consec_max5.013919274035899
driven_lanedir_consec_mean3.3179945309130097
driven_lanedir_consec_min1.6220697877901198
driven_lanedir_max5.393730171807507
driven_lanedir_mean3.658878895785705
driven_lanedir_median3.658878895785705
driven_lanedir_min1.9240276197639028
get_duckie_state_max1.5721678515892797e-06
get_duckie_state_mean1.5414754540536105e-06
get_duckie_state_median1.5414754540536105e-06
get_duckie_state_min1.5107830565179411e-06
get_robot_state_max0.014974101703969678
get_robot_state_mean0.014694783601798274
get_robot_state_median0.014694783601798274
get_robot_state_min0.014415465499626872
get_state_dump_max0.01016381877151566
get_state_dump_mean0.00998860515091664
get_state_dump_median0.00998860515091664
get_state_dump_min0.009813391530317624
get_ui_image_max0.055492112384968664
get_ui_image_mean0.05355662065030971
get_ui_image_median0.05355662065030971
get_ui_image_min0.05162112891565075
in-drivable-lane_max1.85000000000002
in-drivable-lane_mean0.92500000000001
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.3888623840017287, "get_ui_image": 0.055492112384968664, "step_physics": 0.8005752228013235, "survival_time": 9.900000000000006, "driven_lanedir": 1.9240276197639028, "get_state_dump": 0.01016381877151566, "get_robot_state": 0.014974101703969678, "sim_render-ego0": 0.0041441534032773735, "sim_render-npc0": 0.004272663413579739, "sim_render-npc1": 0.004257742484011243, "sim_render-npc2": 0.004063517604041938, "get_duckie_state": 1.5107830565179411e-06, "in-drivable-lane": 1.85000000000002, "deviation-heading": 2.178725916953227, "agent_compute-ego0": 0.013014683172331384, "agent_compute-npc0": 0.046963260401433435, "agent_compute-npc1": 0.0359470269188809, "agent_compute-npc2": 0.03322512899810944, "complete-iteration": 1.087499420846527, "set_robot_commands": 0.002307819960704401, "deviation-center-line": 0.3326007709812355, "driven_lanedir_consec": 1.6220697877901198, "sim_compute_sim_state": 0.04192983325402341, "sim_compute_performance-ego0": 0.002254391435402722, "sim_compute_performance-npc0": 0.0021086158464901413, "sim_compute_performance-npc1": 0.0021367288714078205, "sim_compute_performance-npc2": 0.0021249744760331196}, "LFVI-norm-udem1-000-ego0": {"driven_any": 5.4963904926648, "get_ui_image": 0.05162112891565075, "step_physics": 0.8362583268495103, "survival_time": 27.300000000000253, "driven_lanedir": 5.393730171807507, "get_state_dump": 0.009813391530317624, "get_robot_state": 0.014415465499626872, "sim_render-ego0": 0.003986391332511274, "sim_render-npc0": 0.00408871343846295, "sim_render-npc1": 0.003977119595738608, "sim_render-npc2": 0.004052068895134237, "get_duckie_state": 1.5721678515892797e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.474912575888296, "agent_compute-ego0": 0.012439306736864162, "agent_compute-npc0": 0.04487342895493865, "agent_compute-npc1": 0.04341656198449283, "agent_compute-npc2": 0.04219347380197026, "complete-iteration": 1.132611067682995, "set_robot_commands": 0.0023035471356547075, "deviation-center-line": 1.2535529385468998, "driven_lanedir_consec": 5.013919274035899, "sim_compute_sim_state": 0.04373641685332415, "sim_compute_performance-ego0": 0.002155498351213919, "sim_compute_performance-npc0": 0.002010708971040994, "sim_compute_performance-npc1": 0.002069155520451352, "sim_compute_performance-npc2": 0.0020289765415505475}}
set_robot_commands_max0.002307819960704401
set_robot_commands_mean0.002305683548179554
set_robot_commands_median0.002305683548179554
set_robot_commands_min0.0023035471356547075
sim_compute_performance-ego0_max0.002254391435402722
sim_compute_performance-ego0_mean0.0022049448933083205
sim_compute_performance-ego0_median0.0022049448933083205
sim_compute_performance-ego0_min0.002155498351213919
sim_compute_performance-npc0_max0.0021086158464901413
sim_compute_performance-npc0_mean0.0020596624087655677
sim_compute_performance-npc0_median0.0020596624087655677
sim_compute_performance-npc0_min0.002010708971040994
sim_compute_performance-npc1_max0.0021367288714078205
sim_compute_performance-npc1_mean0.0021029421959295864
sim_compute_performance-npc1_median0.0021029421959295864
sim_compute_performance-npc1_min0.002069155520451352
sim_compute_performance-npc2_max0.0021249744760331196
sim_compute_performance-npc2_mean0.0020769755087918333
sim_compute_performance-npc2_median0.0020769755087918333
sim_compute_performance-npc2_min0.0020289765415505475
sim_compute_sim_state_max0.04373641685332415
sim_compute_sim_state_mean0.04283312505367378
sim_compute_sim_state_median0.04283312505367378
sim_compute_sim_state_min0.04192983325402341
sim_render-ego0_max0.0041441534032773735
sim_render-ego0_mean0.004065272367894324
sim_render-ego0_median0.004065272367894324
sim_render-ego0_min0.003986391332511274
sim_render-npc0_max0.004272663413579739
sim_render-npc0_mean0.004180688426021345
sim_render-npc0_median0.004180688426021345
sim_render-npc0_min0.00408871343846295
sim_render-npc1_max0.004257742484011243
sim_render-npc1_mean0.004117431039874926
sim_render-npc1_median0.004117431039874926
sim_render-npc1_min0.003977119595738608
sim_render-npc2_max0.004063517604041938
sim_render-npc2_mean0.004057793249588088
sim_render-npc2_median0.004057793249588088
sim_render-npc2_min0.004052068895134237
simulation-passed1
step_physics_max0.8362583268495103
step_physics_mean0.818416774825417
step_physics_median0.818416774825417
step_physics_min0.8005752228013235
survival_time_max27.300000000000253
survival_time_mean18.60000000000013
survival_time_min9.900000000000006
No reset possible
5887612832Melisande Tengexercise_state_estimationaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-030:24:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5046611398928795
survival_time_median21.02500000000005
deviation-center-line_median1.0395783554278586
in-drivable-lane_median0.6749999999999976


other stats
agent_compute-ego0_max0.013614542010117643
agent_compute-ego0_mean0.013570703382127394
agent_compute-ego0_median0.013570703382127394
agent_compute-ego0_min0.013526864754137145
agent_compute-npc0_max0.043941158874362125
agent_compute-npc0_mean0.04183997998648564
agent_compute-npc0_median0.04183997998648564
agent_compute-npc0_min0.03973880109860915
agent_compute-npc1_max0.04809761114147197
agent_compute-npc1_mean0.04390765286355475
agent_compute-npc1_median0.04390765286355475
agent_compute-npc1_min0.03971769458563753
agent_compute-npc2_max0.04528295459533606
agent_compute-npc2_mean0.041950066523259645
agent_compute-npc2_median0.041950066523259645
agent_compute-npc2_min0.03861717845118323
complete-iteration_max1.3451281111369762
complete-iteration_mean1.2773867257797993
complete-iteration_median1.2773867257797993
complete-iteration_min1.2096453404226224
deviation-center-line_max1.7030638231823207
deviation-center-line_mean1.0395783554278586
deviation-center-line_min0.3760928876733965
deviation-heading_max5.460873421568088
deviation-heading_mean3.975752652687932
deviation-heading_median3.975752652687932
deviation-heading_min2.490631883807776
driven_any_max6.77186240182263
driven_any_mean3.9053818050044353
driven_any_median3.9053818050044353
driven_any_min1.0389012081862408
driven_lanedir_consec_max6.387342282885868
driven_lanedir_consec_mean3.5046611398928795
driven_lanedir_consec_min0.6219799968998914
driven_lanedir_max6.648866439103365
driven_lanedir_mean3.68146997865298
driven_lanedir_median3.68146997865298
driven_lanedir_min0.7140735182025955
get_duckie_state_max1.6455556832107844e-06
get_duckie_state_mean1.587935141977849e-06
get_duckie_state_median1.587935141977849e-06
get_duckie_state_min1.5303146007449128e-06
get_robot_state_max0.015438360994269536
get_robot_state_mean0.01518949438994284
get_robot_state_median0.01518949438994284
get_robot_state_min0.014940627785616145
get_state_dump_max0.010091004251432018
get_state_dump_mean0.009967007743256946
get_state_dump_median0.009967007743256946
get_state_dump_min0.009843011235081873
get_ui_image_max0.05819352467854818
get_ui_image_mean0.057610448016676793
get_ui_image_median0.057610448016676793
get_ui_image_min0.05702737135480541
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.6749999999999976
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 6.77186240182263, "get_ui_image": 0.05819352467854818, "step_physics": 0.8923214947810026, "survival_time": 35.65000000000011, "driven_lanedir": 6.648866439103365, "get_state_dump": 0.010091004251432018, "get_robot_state": 0.015438360994269536, "sim_render-ego0": 0.0041955392233797816, "sim_render-npc0": 0.004308508557765758, "sim_render-npc1": 0.004176471079764914, "sim_render-npc2": 0.004195105795766793, "get_duckie_state": 1.6455556832107844e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.460873421568088, "agent_compute-ego0": 0.013614542010117643, "agent_compute-npc0": 0.043941158874362125, "agent_compute-npc1": 0.04809761114147197, "agent_compute-npc2": 0.04528295459533606, "complete-iteration": 1.2096453404226224, "set_robot_commands": 0.0025131084671875343, "deviation-center-line": 1.7030638231823207, "driven_lanedir_consec": 6.387342282885868, "sim_compute_sim_state": 0.04680225495196858, "sim_compute_performance-ego0": 0.002331299942080714, "sim_compute_performance-npc0": 0.0021721862611316497, "sim_compute_performance-npc1": 0.002177449835448706, "sim_compute_performance-npc2": 0.0021615021702956084}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.0389012081862408, "get_ui_image": 0.05702737135480541, "step_physics": 1.05443839878999, "survival_time": 6.399999999999985, "driven_lanedir": 0.7140735182025955, "get_state_dump": 0.009843011235081873, "get_robot_state": 0.014940627785616145, "sim_render-ego0": 0.004057575565899989, "sim_render-npc0": 0.004254501919413722, "sim_render-npc1": 0.004101710726124371, "sim_render-npc2": 0.00404100824696149, "get_duckie_state": 1.5303146007449128e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 2.490631883807776, "agent_compute-ego0": 0.013526864754137145, "agent_compute-npc0": 0.03973880109860915, "agent_compute-npc1": 0.03971769458563753, "agent_compute-npc2": 0.03861717845118323, "complete-iteration": 1.3451281111369762, "set_robot_commands": 0.002355982166852138, "deviation-center-line": 0.3760928876733965, "driven_lanedir_consec": 0.6219799968998914, "sim_compute_sim_state": 0.04258752238842868, "sim_compute_performance-ego0": 0.0021904919498650604, "sim_compute_performance-npc0": 0.0021466765292855196, "sim_compute_performance-npc1": 0.002060234084609867, "sim_compute_performance-npc2": 0.0021182714506637217}}
set_robot_commands_max0.0025131084671875343
set_robot_commands_mean0.0024345453170198364
set_robot_commands_median0.0024345453170198364
set_robot_commands_min0.002355982166852138
sim_compute_performance-ego0_max0.002331299942080714
sim_compute_performance-ego0_mean0.002260895945972887
sim_compute_performance-ego0_median0.002260895945972887
sim_compute_performance-ego0_min0.0021904919498650604
sim_compute_performance-npc0_max0.0021721862611316497
sim_compute_performance-npc0_mean0.0021594313952085845
sim_compute_performance-npc0_median0.0021594313952085845
sim_compute_performance-npc0_min0.0021466765292855196
sim_compute_performance-npc1_max0.002177449835448706
sim_compute_performance-npc1_mean0.0021188419600292868
sim_compute_performance-npc1_median0.0021188419600292868
sim_compute_performance-npc1_min0.002060234084609867
sim_compute_performance-npc2_max0.0021615021702956084
sim_compute_performance-npc2_mean0.002139886810479665
sim_compute_performance-npc2_median0.002139886810479665
sim_compute_performance-npc2_min0.0021182714506637217
sim_compute_sim_state_max0.04680225495196858
sim_compute_sim_state_mean0.044694888670198635
sim_compute_sim_state_median0.044694888670198635
sim_compute_sim_state_min0.04258752238842868
sim_render-ego0_max0.0041955392233797816
sim_render-ego0_mean0.004126557394639885
sim_render-ego0_median0.004126557394639885
sim_render-ego0_min0.004057575565899989
sim_render-npc0_max0.004308508557765758
sim_render-npc0_mean0.00428150523858974
sim_render-npc0_median0.00428150523858974
sim_render-npc0_min0.004254501919413722
sim_render-npc1_max0.004176471079764914
sim_render-npc1_mean0.0041390909029446424
sim_render-npc1_median0.0041390909029446424
sim_render-npc1_min0.004101710726124371
sim_render-npc2_max0.004195105795766793
sim_render-npc2_mean0.004118057021364141
sim_render-npc2_median0.004118057021364141
sim_render-npc2_min0.00404100824696149
simulation-passed1
step_physics_max1.05443839878999
step_physics_mean0.9733799467854962
step_physics_median0.9733799467854962
step_physics_min0.8923214947810026
survival_time_max35.65000000000011
survival_time_mean21.02500000000005
survival_time_min6.399999999999985
No reset possible
5886412839Raphael Jeanexercise_state_estimationaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-030:16:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.246174388416057
survival_time_median44.99999999999951
deviation-center-line_median1.9817830411466248
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego0_max0.012936743173273675
agent_compute-ego0_mean0.012810892713014242
agent_compute-ego0_median0.012810892713014242
agent_compute-ego0_min0.012685042252754807
complete-iteration_max0.2428995729881198
complete-iteration_mean0.22870816570529512
complete-iteration_median0.22870816570529512
complete-iteration_min0.2145167584224704
deviation-center-line_max2.1134447469679256
deviation-center-line_mean1.9817830411466248
deviation-center-line_min1.850121335325324
deviation-heading_max9.094943594136756
deviation-heading_mean8.976854113750544
deviation-heading_median8.976854113750544
deviation-heading_min8.858764633364336
driven_any_max15.676676907570648
driven_any_mean10.39823547051268
driven_any_median10.39823547051268
driven_any_min5.119794033454714
driven_lanedir_consec_max14.550674730078349
driven_lanedir_consec_mean9.246174388416057
driven_lanedir_consec_min3.941674046753764
driven_lanedir_max15.4210767307603
driven_lanedir_mean10.050790261244591
driven_lanedir_median10.050790261244591
driven_lanedir_min4.680503791728881
get_duckie_state_max1.3797334744013884e-06
get_duckie_state_mean1.35301183585912e-06
get_duckie_state_median1.35301183585912e-06
get_duckie_state_min1.3262901973168518e-06
get_robot_state_max0.003853957321522734
get_robot_state_mean0.0038170240949483058
get_robot_state_median0.0038170240949483058
get_robot_state_min0.003780090868373877
get_state_dump_max0.004880590169084647
get_state_dump_mean0.004858492050156153
get_state_dump_median0.004858492050156153
get_state_dump_min0.00483639393122766
get_ui_image_max0.03933759970430728
get_ui_image_mean0.03926404163680637
get_ui_image_median0.03926404163680637
get_ui_image_min0.03919048356930547
in-drivable-lane_max0.8000000000000114
in-drivable-lane_mean0.4000000000000057
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 5.119794033454714, "get_ui_image": 0.03919048356930547, "step_physics": 0.16102751082866243, "survival_time": 30.00000000000029, "driven_lanedir": 4.680503791728881, "get_state_dump": 0.004880590169084647, "get_robot_state": 0.003780090868373877, "sim_render-ego0": 0.003836607179308493, "get_duckie_state": 1.3797334744013884e-06, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 9.094943594136756, "agent_compute-ego0": 0.012685042252754807, "complete-iteration": 0.2428995729881198, "set_robot_commands": 0.002247201424470162, "deviation-center-line": 1.850121335325324, "driven_lanedir_consec": 3.941674046753764, "sim_compute_sim_state": 0.013169270783613208, "sim_compute_performance-ego0": 0.001994083011011514}, "LFI-norm-udem1-000-ego0": {"driven_any": 15.676676907570648, "get_ui_image": 0.03933759970430728, "step_physics": 0.131032343212512, "survival_time": 59.99999999999873, "driven_lanedir": 15.4210767307603, "get_state_dump": 0.00483639393122766, "get_robot_state": 0.003853957321522734, "sim_render-ego0": 0.004000111483812928, "get_duckie_state": 1.3262901973168518e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.858764633364336, "agent_compute-ego0": 0.012936743173273675, "complete-iteration": 0.2145167584224704, "set_robot_commands": 0.002273145464437391, "deviation-center-line": 2.1134447469679256, "driven_lanedir_consec": 14.550674730078349, "sim_compute_sim_state": 0.014053429493201364, "sim_compute_performance-ego0": 0.002098546834115085}}
set_robot_commands_max0.002273145464437391
set_robot_commands_mean0.0022601734444537766
set_robot_commands_median0.0022601734444537766
set_robot_commands_min0.002247201424470162
sim_compute_performance-ego0_max0.002098546834115085
sim_compute_performance-ego0_mean0.0020463149225632997
sim_compute_performance-ego0_median0.0020463149225632997
sim_compute_performance-ego0_min0.001994083011011514
sim_compute_sim_state_max0.014053429493201364
sim_compute_sim_state_mean0.013611350138407289
sim_compute_sim_state_median0.013611350138407289
sim_compute_sim_state_min0.013169270783613208
sim_render-ego0_max0.004000111483812928
sim_render-ego0_mean0.003918359331560711
sim_render-ego0_median0.003918359331560711
sim_render-ego0_min0.003836607179308493
simulation-passed1
step_physics_max0.16102751082866243
step_physics_mean0.1460299270205872
step_physics_median0.1460299270205872
step_physics_min0.131032343212512
survival_time_max59.99999999999873
survival_time_mean44.99999999999951
survival_time_min30.00000000000029
No reset possible
5882412830Melisande Tengexercise_state_estimationaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-031:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.972072790045024
survival_time_median32.27499999999991
deviation-center-line_median1.5553403615865744
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013355757175734596
agent_compute-ego0_mean0.012875310059114114
agent_compute-ego0_median0.01274130597485745
agent_compute-ego0_min0.012662871111006963
agent_compute-npc0_max0.030798733383293055
agent_compute-npc0_mean0.02477611754437412
agent_compute-npc0_median0.02302237820759482
agent_compute-npc0_min0.02226098037901379
agent_compute-npc1_max0.03388598476137434
agent_compute-npc1_mean0.0327454846999111
agent_compute-npc1_median0.032196676335110835
agent_compute-npc1_min0.03215379300324813
agent_compute-npc2_max0.03913684572492327
agent_compute-npc2_mean0.03203892291199041
agent_compute-npc2_median0.028619954129947694
agent_compute-npc2_min0.028359968881100272
agent_compute-npc3_max0.04538117399538197
agent_compute-npc3_mean0.03977709152207051
agent_compute-npc3_median0.03977709152207051
agent_compute-npc3_min0.03417300904875905
complete-iteration_max1.32918388491234
complete-iteration_mean0.9618204705412206
complete-iteration_median1.0697680907507778
complete-iteration_min0.378561815750986
deviation-center-line_max2.288714502379913
deviation-center-line_mean1.5834318272998034
deviation-center-line_min0.9343320836461512
deviation-heading_max9.490798060668642
deviation-heading_mean6.2019301809856415
deviation-heading_median6.2999752131514475
deviation-heading_min2.7169722369710283
driven_any_max11.663143863186502
driven_any_mean6.930699500183806
driven_any_median6.111399455812376
driven_any_min3.836855225923971
driven_lanedir_consec_max11.454802247369004
driven_lanedir_consec_mean6.780008267077061
driven_lanedir_consec_min3.721085240849191
driven_lanedir_max11.454802247369004
driven_lanedir_mean6.780008267077061
driven_lanedir_median5.972072790045024
driven_lanedir_min3.721085240849191
get_duckie_state_max1.7303781411082474e-06
get_duckie_state_mean1.594249632268321e-06
get_duckie_state_median1.653117751811931e-06
get_duckie_state_min1.340384884341174e-06
get_robot_state_max0.019026384320865383
get_robot_state_mean0.015327487084594034
get_robot_state_median0.017143869494634964
get_robot_state_min0.00799582502824083
get_state_dump_max0.01188178761581648
get_state_dump_mean0.010130826666583378
get_state_dump_median0.010984019746938354
get_state_dump_min0.00667347955664032
get_ui_image_max0.058423899839560735
get_ui_image_mean0.04934869350364764
get_ui_image_median0.05113755954060578
get_ui_image_min0.036695755093818304
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.895617970960163, "get_ui_image": 0.04764951864878337, "step_physics": 0.6585911501021612, "survival_time": 20.950000000000163, "driven_lanedir": 3.8370397101617097, "get_state_dump": 0.01011612926210676, "get_robot_state": 0.015360747632526216, "sim_render-ego0": 0.004206307729085286, "sim_render-npc0": 0.004382102830069405, "sim_render-npc1": 0.00424804857798985, "sim_render-npc2": 0.004283439545404343, "get_duckie_state": 1.6655240740094866e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.7169722369710283, "agent_compute-ego0": 0.012662871111006963, "agent_compute-npc0": 0.02226098037901379, "agent_compute-npc1": 0.03388598476137434, "agent_compute-npc2": 0.03913684572492327, "complete-iteration": 0.9029452011698768, "set_robot_commands": 0.002415414083571661, "deviation-center-line": 0.9343320836461512, "driven_lanedir_consec": 3.8370397101617097, "sim_compute_sim_state": 0.027177130040668303, "sim_compute_performance-ego0": 0.00230223053977603, "sim_compute_performance-npc0": 0.0021701324553716752, "sim_compute_performance-npc1": 0.0021801942870730445, "sim_compute_performance-npc2": 0.002214404514857701}, "LFV-norm-zigzag-000-ego0": {"driven_any": 8.327180940664588, "get_ui_image": 0.058423899839560735, "step_physics": 1.000145987819833, "survival_time": 43.59999999999966, "driven_lanedir": 8.107105869928338, "get_state_dump": 0.01188178761581648, "get_robot_state": 0.019026384320865383, "sim_render-ego0": 0.004189264050600591, "sim_render-npc0": 0.004235192262839615, "sim_render-npc1": 0.004269001819833447, "sim_render-npc2": 0.004224977678995908, "sim_render-npc3": 0.004137744608613634, "get_duckie_state": 1.7303781411082474e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.27493344228605, "agent_compute-ego0": 0.012677293462851612, "agent_compute-npc0": 0.02335562929937793, "agent_compute-npc1": 0.032196676335110835, "agent_compute-npc2": 0.028619954129947694, "agent_compute-npc3": 0.03417300904875905, "complete-iteration": 1.32918388491234, "set_robot_commands": 0.0023908849980549852, "deviation-center-line": 2.11471963255578, "driven_lanedir_consec": 8.107105869928338, "sim_compute_sim_state": 0.06416104640064917, "sim_compute_performance-ego0": 0.0023041162021108235, "sim_compute_performance-npc0": 0.002131084123154823, "sim_compute_performance-npc1": 0.002155583612151435, "sim_compute_performance-npc2": 0.0022007231040508885, "sim_compute_performance-npc3": 0.0021616951023726667}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.836855225923971, "get_ui_image": 0.05462560043242819, "step_physics": 0.9042730786374226, "survival_time": 20.65000000000016, "driven_lanedir": 3.721085240849191, "get_state_dump": 0.011851910231769947, "get_robot_state": 0.018926991356743708, "sim_render-ego0": 0.004143373977734847, "sim_render-npc0": 0.0043156705616752885, "sim_render-npc1": 0.004225202804602287, "sim_render-npc2": 0.004284490709719451, "sim_render-npc3": 0.0041971056933564265, "get_duckie_state": 1.6407114296143755e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.325016984016845, "agent_compute-ego0": 0.012805318486863289, "agent_compute-npc0": 0.022689127115811704, "agent_compute-npc1": 0.03215379300324813, "agent_compute-npc2": 0.028359968881100272, "agent_compute-npc3": 0.04538117399538197, "complete-iteration": 1.2365909803316788, "set_robot_commands": 0.0024357060879324943, "deviation-center-line": 0.9959610906173691, "driven_lanedir_consec": 3.721085240849191, "sim_compute_sim_state": 0.060763217400813446, "sim_compute_performance-ego0": 0.002301819658509775, "sim_compute_performance-npc0": 0.0021402979818519186, "sim_compute_performance-npc1": 0.0021681255764431423, "sim_compute_performance-npc2": 0.002195623185899522, "sim_compute_performance-npc3": 0.002197274839244603}, "LFV-norm-small_loop-000-ego0": {"driven_any": 11.663143863186502, "get_ui_image": 0.036695755093818304, "step_physics": 0.2530378941989362, "survival_time": 59.99999999999873, "driven_lanedir": 11.454802247369004, "get_state_dump": 0.00667347955664032, "get_robot_state": 0.00799582502824083, "sim_render-ego0": 0.004200914519514072, "sim_render-npc0": 0.004376256396431014, "get_duckie_state": 1.340384884341174e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.490798060668642, "agent_compute-ego0": 0.013355757175734596, "agent_compute-npc0": 0.030798733383293055, "complete-iteration": 0.378561815750986, "set_robot_commands": 0.002631765321132841, "deviation-center-line": 2.288714502379913, "driven_lanedir_consec": 11.454802247369004, "sim_compute_sim_state": 0.011646777366619126, "sim_compute_performance-ego0": 0.0022553271993213052, "sim_compute_performance-npc0": 0.0022249642657201354}}
set_robot_commands_max0.002631765321132841
set_robot_commands_mean0.0024684426226729956
set_robot_commands_median0.0024255600857520775
set_robot_commands_min0.0023908849980549852
sim_compute_performance-ego0_max0.0023041162021108235
sim_compute_performance-ego0_mean0.0022908733999294833
sim_compute_performance-ego0_median0.0023020250991429023
sim_compute_performance-ego0_min0.0022553271993213052
sim_compute_performance-npc0_max0.0022249642657201354
sim_compute_performance-npc0_mean0.002166619706524638
sim_compute_performance-npc0_median0.002155215218611797
sim_compute_performance-npc0_min0.002131084123154823
sim_compute_performance-npc1_max0.0021801942870730445
sim_compute_performance-npc1_mean0.0021679678252225407
sim_compute_performance-npc1_median0.0021681255764431423
sim_compute_performance-npc1_min0.002155583612151435
sim_compute_performance-npc2_max0.002214404514857701
sim_compute_performance-npc2_mean0.002203583601602704
sim_compute_performance-npc2_median0.0022007231040508885
sim_compute_performance-npc2_min0.002195623185899522
sim_compute_performance-npc3_max0.002197274839244603
sim_compute_performance-npc3_mean0.002179484970808634
sim_compute_performance-npc3_median0.002179484970808634
sim_compute_performance-npc3_min0.0021616951023726667
sim_compute_sim_state_max0.06416104640064917
sim_compute_sim_state_mean0.04093704280218751
sim_compute_sim_state_median0.04397017372074088
sim_compute_sim_state_min0.011646777366619126
sim_render-ego0_max0.004206307729085286
sim_render-ego0_mean0.004184965069233699
sim_render-ego0_median0.004195089285057332
sim_render-ego0_min0.004143373977734847
sim_render-npc0_max0.004382102830069405
sim_render-npc0_mean0.004327305512753831
sim_render-npc0_median0.004345963479053151
sim_render-npc0_min0.004235192262839615
sim_render-npc1_max0.004269001819833447
sim_render-npc1_mean0.004247417734141861
sim_render-npc1_median0.00424804857798985
sim_render-npc1_min0.004225202804602287
sim_render-npc2_max0.004284490709719451
sim_render-npc2_mean0.004264302644706568
sim_render-npc2_median0.004283439545404343
sim_render-npc2_min0.004224977678995908
sim_render-npc3_max0.0041971056933564265
sim_render-npc3_mean0.004167425150985031
sim_render-npc3_median0.004167425150985031
sim_render-npc3_min0.004137744608613634
simulation-passed1
step_physics_max1.000145987819833
step_physics_mean0.7040120276895883
step_physics_median0.7814321143697919
step_physics_min0.2530378941989362
survival_time_max59.99999999999873
survival_time_mean36.29999999999968
survival_time_min20.65000000000016
No reset possible
5880212872Raphael Jeansim-exercise-2aido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-030:44:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.666552983235838
survival_time_median20.275000000000155
deviation-center-line_median1.019489654582991
in-drivable-lane_median0.9249999999999968


other stats
agent_compute-ego0_max0.01390995843069894
agent_compute-ego0_mean0.01326525713381773
agent_compute-ego0_median0.01320532470842092
agent_compute-ego0_min0.012740420687730146
agent_compute-npc0_max0.033230350131080263
agent_compute-npc0_mean0.02524290040962533
agent_compute-npc0_median0.02268337653717042
agent_compute-npc0_min0.022374498433080217
agent_compute-npc1_max0.032064054204129624
agent_compute-npc1_mean0.03074398894522563
agent_compute-npc1_median0.03025020476310484
agent_compute-npc1_min0.029917707868442413
agent_compute-npc2_max0.03925378569241228
agent_compute-npc2_mean0.03151474387186295
agent_compute-npc2_median0.027681215553526664
agent_compute-npc2_min0.027609230369649903
agent_compute-npc3_max0.04442151944348766
agent_compute-npc3_mean0.03888211887622972
agent_compute-npc3_median0.03888211887622972
agent_compute-npc3_min0.03334271830897177
complete-iteration_max1.317028522491455
complete-iteration_mean0.9890139316401872
complete-iteration_median1.1257381563008957
complete-iteration_min0.3875508914675032
deviation-center-line_max2.752177101745079
deviation-center-line_mean1.407654654036975
deviation-center-line_min0.8394622052368395
deviation-heading_max9.789163790873198
deviation-heading_mean5.202946834383823
deviation-heading_median3.729174382194988
deviation-heading_min3.564274782272119
driven_any_max11.163028946848009
driven_any_mean6.011723426608617
driven_any_median4.618180086555956
driven_any_min3.6475045864745432
driven_lanedir_consec_max10.51602013169858
driven_lanedir_consec_mean5.056290827087949
driven_lanedir_consec_min2.3760372101815417
driven_lanedir_max10.51602013169858
driven_lanedir_mean5.42591771432678
driven_lanedir_median3.840667395646139
driven_lanedir_min3.5063159343162624
get_duckie_state_max1.8840548635899336e-06
get_duckie_state_mean1.7698730996780015e-06
get_duckie_state_median1.7340208894462997e-06
get_duckie_state_min1.7273957562294735e-06
get_robot_state_max0.018914788391939392
get_robot_state_mean0.015299904202314469
get_robot_state_median0.016975465753938608
get_robot_state_min0.008333896909441267
get_state_dump_max0.011873694741801851
get_state_dump_mean0.010118932577722057
get_state_dump_median0.010760013240330477
get_state_dump_min0.00708200908842541
get_ui_image_max0.05719201180242723
get_ui_image_mean0.04950350412128899
get_ui_image_median0.05175897455274801
get_ui_image_min0.03730405557723272
in-drivable-lane_max6.900000000000003
in-drivable-lane_mean2.187499999999999
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.95982972029495, "get_ui_image": 0.04888953970766616, "step_physics": 0.7394848575537232, "survival_time": 17.35000000000011, "driven_lanedir": 3.826790032155414, "get_state_dump": 0.010092158427183655, "get_robot_state": 0.015520359592876214, "sim_render-ego0": 0.004288942649446684, "sim_render-npc0": 0.004404235160213777, "sim_render-npc1": 0.004389748491089919, "sim_render-npc2": 0.00436057989624725, "get_duckie_state": 1.8840548635899336e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.7587211188883294, "agent_compute-ego0": 0.013188523122634011, "agent_compute-npc0": 0.022374498433080217, "agent_compute-npc1": 0.032064054204129624, "agent_compute-npc2": 0.03925378569241228, "complete-iteration": 0.985423329232753, "set_robot_commands": 0.0026880927469538547, "deviation-center-line": 1.0160382404098856, "driven_lanedir_consec": 3.826790032155414, "sim_compute_sim_state": 0.027356210111201495, "sim_compute_performance-ego0": 0.0023948837970865183, "sim_compute_performance-npc0": 0.002228819775855404, "sim_compute_performance-npc1": 0.0022391252134038113, "sim_compute_performance-npc2": 0.002254244239850976}, "LFV-norm-zigzag-000-ego0": {"driven_any": 5.276530452816963, "get_ui_image": 0.05719201180242723, "step_physics": 0.9972872621269636, "survival_time": 23.200000000000195, "driven_lanedir": 3.854544759136864, "get_state_dump": 0.011427868053477298, "get_robot_state": 0.018430571915001, "sim_render-ego0": 0.004119047554590369, "sim_render-npc0": 0.004167490108038789, "sim_render-npc1": 0.004242354054604807, "sim_render-npc2": 0.004158590685936712, "sim_render-npc3": 0.00417003785410235, "get_duckie_state": 1.7371228946152554e-06, "in-drivable-lane": 6.900000000000003, "deviation-heading": 3.6996276455016472, "agent_compute-ego0": 0.013222126294207827, "agent_compute-npc0": 0.022723904476370863, "agent_compute-npc1": 0.03025020476310484, "agent_compute-npc2": 0.027609230369649903, "agent_compute-npc3": 0.03334271830897177, "complete-iteration": 1.317028522491455, "set_robot_commands": 0.0024420553638089086, "deviation-center-line": 1.0229410687560965, "driven_lanedir_consec": 2.3760372101815417, "sim_compute_sim_state": 0.06149765240248813, "sim_compute_performance-ego0": 0.0022700750699607276, "sim_compute_performance-npc0": 0.0020995381057903333, "sim_compute_performance-npc1": 0.0021210106470251596, "sim_compute_performance-npc2": 0.002126688085576539, "sim_compute_performance-npc3": 0.002143854735999979}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.6475045864745432, "get_ui_image": 0.05462840939782987, "step_physics": 0.938268934845165, "survival_time": 15.650000000000087, "driven_lanedir": 3.5063159343162624, "get_state_dump": 0.011873694741801851, "get_robot_state": 0.018914788391939392, "sim_render-ego0": 0.0041909954350465425, "sim_render-npc0": 0.004194429725598378, "sim_render-npc1": 0.004131901036402223, "sim_render-npc2": 0.004054671639849426, "sim_render-npc3": 0.004123305818837159, "get_duckie_state": 1.7273957562294735e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.564274782272119, "agent_compute-ego0": 0.012740420687730146, "agent_compute-npc0": 0.02264284859796998, "agent_compute-npc1": 0.029917707868442413, "agent_compute-npc2": 0.027681215553526664, "agent_compute-npc3": 0.04442151944348766, "complete-iteration": 1.2660529833690377, "set_robot_commands": 0.002418614496850664, "deviation-center-line": 0.8394622052368395, "driven_lanedir_consec": 3.5063159343162624, "sim_compute_sim_state": 0.06106757054663008, "sim_compute_performance-ego0": 0.002344364573241799, "sim_compute_performance-npc0": 0.0021299427481973245, "sim_compute_performance-npc1": 0.0021349875031003527, "sim_compute_performance-npc2": 0.0021696029954655156, "sim_compute_performance-npc3": 0.002110688549697779}, "LFV-norm-small_loop-000-ego0": {"driven_any": 11.163028946848009, "get_ui_image": 0.03730405557723272, "step_physics": 0.2560464350382487, "survival_time": 52.44999999999916, "driven_lanedir": 10.51602013169858, "get_state_dump": 0.00708200908842541, "get_robot_state": 0.008333896909441267, "sim_render-ego0": 0.00438888118380592, "sim_render-npc0": 0.004582445962088449, "get_duckie_state": 1.7309188842773437e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 9.789163790873198, "agent_compute-ego0": 0.01390995843069894, "agent_compute-npc0": 0.033230350131080263, "complete-iteration": 0.3875508914675032, "set_robot_commands": 0.0027477757136027017, "deviation-center-line": 2.752177101745079, "driven_lanedir_consec": 10.51602013169858, "sim_compute_sim_state": 0.012402220907665434, "sim_compute_performance-ego0": 0.0023927368436540875, "sim_compute_performance-npc0": 0.002344958214532761}}
set_robot_commands_max0.0027477757136027017
set_robot_commands_mean0.0025741345803040323
set_robot_commands_median0.0025650740553813814
set_robot_commands_min0.002418614496850664
sim_compute_performance-ego0_max0.0023948837970865183
sim_compute_performance-ego0_mean0.0023505150709857833
sim_compute_performance-ego0_median0.002368550708447943
sim_compute_performance-ego0_min0.0022700750699607276
sim_compute_performance-npc0_max0.002344958214532761
sim_compute_performance-npc0_mean0.0022008147110939556
sim_compute_performance-npc0_median0.0021793812620263643
sim_compute_performance-npc0_min0.0020995381057903333
sim_compute_performance-npc1_max0.0022391252134038113
sim_compute_performance-npc1_mean0.002165041121176441
sim_compute_performance-npc1_median0.0021349875031003527
sim_compute_performance-npc1_min0.0021210106470251596
sim_compute_performance-npc2_max0.002254244239850976
sim_compute_performance-npc2_mean0.0021835117736310103
sim_compute_performance-npc2_median0.0021696029954655156
sim_compute_performance-npc2_min0.002126688085576539
sim_compute_performance-npc3_max0.002143854735999979
sim_compute_performance-npc3_mean0.002127271642848879
sim_compute_performance-npc3_median0.002127271642848879
sim_compute_performance-npc3_min0.002110688549697779
sim_compute_sim_state_max0.06149765240248813
sim_compute_sim_state_mean0.04058091349199629
sim_compute_sim_state_median0.04421189032891579
sim_compute_sim_state_min0.012402220907665434
sim_render-ego0_max0.00438888118380592
sim_render-ego0_mean0.004246966705722379
sim_render-ego0_median0.004239969042246614
sim_render-ego0_min0.004119047554590369
sim_render-npc0_max0.004582445962088449
sim_render-npc0_mean0.004337150238984849
sim_render-npc0_median0.004299332442906078
sim_render-npc0_min0.004167490108038789
sim_render-npc1_max0.004389748491089919
sim_render-npc1_mean0.004254667860698984
sim_render-npc1_median0.004242354054604807
sim_render-npc1_min0.004131901036402223
sim_render-npc2_max0.00436057989624725
sim_render-npc2_mean0.004191280740677796
sim_render-npc2_median0.004158590685936712
sim_render-npc2_min0.004054671639849426
sim_render-npc3_max0.00417003785410235
sim_render-npc3_mean0.004146671836469755
sim_render-npc3_median0.004146671836469755
sim_render-npc3_min0.004123305818837159
simulation-passed1
step_physics_max0.9972872621269636
step_physics_mean0.7327718723910251
step_physics_median0.8388768961994442
step_physics_min0.2560464350382487
survival_time_max52.44999999999916
survival_time_mean27.162499999999888
survival_time_min15.650000000000087
No reset possible
5879112775Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-030:15:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6365105134202884
survival_time_median22.700000000000188
deviation-center-line_median0.6159017522868648
in-drivable-lane_median6.775000000000085


other stats
agent_compute-ego0_max0.09573614128381322
agent_compute-ego0_mean0.08268241491779355
agent_compute-ego0_median0.08781610822586244
agent_compute-ego0_min0.05936130193563608
complete-iteration_max0.2679218556664207
complete-iteration_mean0.2484510262137686
complete-iteration_median0.25657939194330104
complete-iteration_min0.21272346530205163
deviation-center-line_max1.0720210241946435
deviation-center-line_mean0.6580191746704405
deviation-center-line_min0.3282521699133885
deviation-heading_max3.3698846904623054
deviation-heading_mean2.2980357243663843
deviation-heading_median2.2605115575111023
deviation-heading_min1.3012350919810267
driven_any_max3.860531794376661
driven_any_mean2.8701552443656615
driven_any_median2.8837263943508487
driven_any_min1.8526363943842885
driven_lanedir_consec_max3.0866258172371905
driven_lanedir_consec_mean1.8021507950226603
driven_lanedir_consec_min0.8489563360128749
driven_lanedir_max3.0866258172371905
driven_lanedir_mean1.8021507950226603
driven_lanedir_median1.6365105134202884
driven_lanedir_min0.8489563360128749
get_duckie_state_max1.7192793188628203e-06
get_duckie_state_mean1.6410944111800316e-06
get_duckie_state_median1.6897176970363502e-06
get_duckie_state_min1.4656629317846057e-06
get_robot_state_max0.004123119440945712
get_robot_state_mean0.003982139834582781
get_robot_state_median0.003996485464240239
get_robot_state_min0.0038124689689049353
get_state_dump_max0.0050701882622458715
get_state_dump_mean0.004922558326529316
get_state_dump_median0.0049358885193479625
get_state_dump_min0.0047482680051754685
get_ui_image_max0.03937239110888586
get_ui_image_mean0.03349838714415922
get_ui_image_median0.032873394614039625
get_ui_image_min0.028874368239671756
in-drivable-lane_max12.600000000000144
in-drivable-lane_mean7.525000000000092
in-drivable-lane_min3.950000000000056
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.8526363943842885, "get_ui_image": 0.028874368239671756, "step_physics": 0.10079032335525905, "survival_time": 15.550000000000086, "driven_lanedir": 0.8489563360128749, "get_state_dump": 0.0047482680051754685, "get_robot_state": 0.0038124689689049353, "sim_render-ego0": 0.0038690100877712937, "get_duckie_state": 1.4656629317846057e-06, "in-drivable-lane": 8.800000000000102, "deviation-heading": 1.3012350919810267, "agent_compute-ego0": 0.05936130193563608, "complete-iteration": 0.21272346530205163, "set_robot_commands": 0.002309038853033995, "deviation-center-line": 0.3282521699133885, "driven_lanedir_consec": 0.8489563360128749, "sim_compute_sim_state": 0.006774474412966997, "sim_compute_performance-ego0": 0.0020894285960075185}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.949478897935425, "get_ui_image": 0.03937239110888586, "step_physics": 0.10878396592598052, "survival_time": 21.300000000000168, "driven_lanedir": 0.9726101258527432, "get_state_dump": 0.004903576133960304, "get_robot_state": 0.0039776343093264575, "sim_render-ego0": 0.004068361791570516, "get_duckie_state": 1.715273711943794e-06, "in-drivable-lane": 12.600000000000144, "deviation-heading": 3.3698846904623054, "agent_compute-ego0": 0.09022303208255096, "complete-iteration": 0.2677902237313693, "set_robot_commands": 0.002344046041055362, "deviation-center-line": 0.5411089022134143, "driven_lanedir_consec": 0.9726101258527432, "sim_compute_sim_state": 0.011804603581127017, "sim_compute_performance-ego0": 0.002209307717495278}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.860531794376661, "get_ui_image": 0.03649868835102428, "step_physics": 0.11276673273606734, "survival_time": 27.450000000000255, "driven_lanedir": 3.0866258172371905, "get_state_dump": 0.0050701882622458715, "get_robot_state": 0.004123119440945712, "sim_render-ego0": 0.004216199788180264, "get_duckie_state": 1.6641616821289064e-06, "in-drivable-lane": 4.7500000000000675, "deviation-heading": 2.012756386339164, "agent_compute-ego0": 0.08540918436917391, "complete-iteration": 0.2679218556664207, "set_robot_commands": 0.002502346472306685, "deviation-center-line": 0.6906946023603153, "driven_lanedir_consec": 3.0866258172371905, "sim_compute_sim_state": 0.014926834106445313, "sim_compute_performance-ego0": 0.002299051284790039}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.817973890766272, "get_ui_image": 0.029248100877054976, "step_physics": 0.0954215901732198, "survival_time": 24.100000000000207, "driven_lanedir": 2.300410900987834, "get_state_dump": 0.0049682009047356205, "get_robot_state": 0.00401533661915402, "sim_render-ego0": 0.00404061836732347, "get_duckie_state": 1.7192793188628203e-06, "in-drivable-lane": 3.950000000000056, "deviation-heading": 2.508266728683041, "agent_compute-ego0": 0.09573614128381322, "complete-iteration": 0.24536856015523276, "set_robot_commands": 0.002332355665123981, "deviation-center-line": 1.0720210241946435, "driven_lanedir_consec": 2.300410900987834, "sim_compute_sim_state": 0.007344314523858807, "sim_compute_performance-ego0": 0.002158899978574512}}
set_robot_commands_max0.002502346472306685
set_robot_commands_mean0.0023719467578800055
set_robot_commands_median0.0023382008530896713
set_robot_commands_min0.002309038853033995
sim_compute_performance-ego0_max0.002299051284790039
sim_compute_performance-ego0_mean0.0021891718942168366
sim_compute_performance-ego0_median0.0021841038480348947
sim_compute_performance-ego0_min0.0020894285960075185
sim_compute_sim_state_max0.014926834106445313
sim_compute_sim_state_mean0.010212556656099532
sim_compute_sim_state_median0.009574459052492912
sim_compute_sim_state_min0.006774474412966997
sim_render-ego0_max0.004216199788180264
sim_render-ego0_mean0.004048547508711386
sim_render-ego0_median0.004054490079446993
sim_render-ego0_min0.0038690100877712937
simulation-passed1
step_physics_max0.11276673273606734
step_physics_mean0.10444065304763168
step_physics_median0.10478714464061978
step_physics_min0.0954215901732198
survival_time_max27.450000000000255
survival_time_mean22.10000000000018
survival_time_min15.550000000000086
No reset possible
5877312747Raphael Jeansim-exercise-1aido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-030:31:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.208761868345862
survival_time_median57.99999999999884
deviation-center-line_median2.369543776694785
in-drivable-lane_median6.024999999999739


other stats
agent_compute-ego0_max0.014738008170060707
agent_compute-ego0_mean0.013909663050447902
agent_compute-ego0_median0.013667237607039476
agent_compute-ego0_min0.013566168817651957
complete-iteration_max0.2866975807807815
complete-iteration_mean0.2303353685440137
complete-iteration_median0.2200119636338716
complete-iteration_min0.19461996612753005
deviation-center-line_max2.7355786543429206
deviation-center-line_mean1.8960988487230248
deviation-center-line_min0.10972918715960842
deviation-heading_max12.562894998059184
deviation-heading_mean8.594102966629217
deviation-heading_median10.573554366994337
deviation-heading_min0.6664081344690148
driven_any_max11.376458501893373
driven_any_mean8.726854083297015
driven_any_median10.515937771291703
driven_any_min2.4990822887112776
driven_lanedir_consec_max10.748929710635078
driven_lanedir_consec_mean7.511612987878053
driven_lanedir_consec_min0.8799985041854084
driven_lanedir_max10.748929710635078
driven_lanedir_mean7.511612987878053
driven_lanedir_median9.208761868345862
driven_lanedir_min0.8799985041854084
get_duckie_state_max2.2431494484485035e-06
get_duckie_state_mean2.1170387684857385e-06
get_duckie_state_median2.0834914016123795e-06
get_duckie_state_min2.0580228222696907e-06
get_robot_state_max0.004316694299939652
get_robot_state_mean0.004185479587418698
get_robot_state_median0.004164717624841886
get_robot_state_min0.004095788800051369
get_state_dump_max0.005204296447861362
get_state_dump_mean0.005069704747969604
get_state_dump_median0.00505195483632901
get_state_dump_min0.004970612871359032
get_ui_image_max0.044926812950993926
get_ui_image_mean0.03677473950781869
get_ui_image_median0.035576554758165596
get_ui_image_min0.0310190355639496
in-drivable-lane_max10.400000000000071
in-drivable-lane_mean6.1624999999998735
in-drivable-lane_min2.1999999999999424
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.376458501893373, "get_ui_image": 0.033389756919740145, "step_physics": 0.12733768980072302, "survival_time": 59.99999999999873, "driven_lanedir": 10.748929710635078, "get_state_dump": 0.005018264427470923, "get_robot_state": 0.004095788800051369, "sim_render-ego0": 0.004130679105938126, "get_duckie_state": 2.0580228222696907e-06, "in-drivable-lane": 2.1999999999999424, "deviation-heading": 11.043240734039347, "agent_compute-ego0": 0.013566168817651957, "complete-iteration": 0.20242208207675955, "set_robot_commands": 0.0026042653956480765, "deviation-center-line": 2.4453381162640073, "driven_lanedir_consec": 10.748929710635078, "sim_compute_sim_state": 0.009892714212180973, "sim_compute_performance-ego0": 0.0022944292359109923}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.4990822887112776, "get_ui_image": 0.044926812950993926, "step_physics": 0.19358824508290895, "survival_time": 14.150000000000066, "driven_lanedir": 0.8799985041854084, "get_state_dump": 0.005204296447861362, "get_robot_state": 0.004316694299939652, "sim_render-ego0": 0.00438064672577549, "get_duckie_state": 2.2431494484485035e-06, "in-drivable-lane": 10.400000000000071, "deviation-heading": 0.6664081344690148, "agent_compute-ego0": 0.014738008170060707, "complete-iteration": 0.2866975807807815, "set_robot_commands": 0.0027848843117834815, "deviation-center-line": 0.10972918715960842, "driven_lanedir_consec": 0.8799985041854084, "sim_compute_sim_state": 0.014133819392029668, "sim_compute_performance-ego0": 0.0025120814081648706}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.861716667756228, "get_ui_image": 0.037763352596591054, "step_physics": 0.15307961554451846, "survival_time": 59.99999999999873, "driven_lanedir": 9.95398541999267, "get_state_dump": 0.004970612871359032, "get_robot_state": 0.004158256055909727, "sim_render-ego0": 0.004201842386657054, "get_duckie_state": 2.0790655944468476e-06, "in-drivable-lane": 3.499999999999966, "deviation-heading": 12.562894998059184, "agent_compute-ego0": 0.013632802145367957, "complete-iteration": 0.2376018451909836, "set_robot_commands": 0.0025877627008265005, "deviation-center-line": 2.7355786543429206, "driven_lanedir_consec": 9.95398541999267, "sim_compute_sim_state": 0.01482634858028974, "sim_compute_performance-ego0": 0.002288962482512742}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.17015887482718, "get_ui_image": 0.0310190355639496, "step_physics": 0.12476366338295984, "survival_time": 55.99999999999896, "driven_lanedir": 8.463538316699054, "get_state_dump": 0.005085645245187098, "get_robot_state": 0.004171179193774044, "sim_render-ego0": 0.004186497959678031, "get_duckie_state": 2.087917208777912e-06, "in-drivable-lane": 8.549999999999514, "deviation-heading": 10.103867999949324, "agent_compute-ego0": 0.013701673068710996, "complete-iteration": 0.19461996612753005, "set_robot_commands": 0.0025948325403028043, "deviation-center-line": 2.2937494371255633, "driven_lanedir_consec": 8.463538316699054, "sim_compute_sim_state": 0.006744906479072401, "sim_compute_performance-ego0": 0.002258787189180781}}
set_robot_commands_max0.0027848843117834815
set_robot_commands_mean0.0026429362371402157
set_robot_commands_median0.0025995489679754404
set_robot_commands_min0.0025877627008265005
sim_compute_performance-ego0_max0.0025120814081648706
sim_compute_performance-ego0_mean0.0023385650789423465
sim_compute_performance-ego0_median0.0022916958592118673
sim_compute_performance-ego0_min0.002258787189180781
sim_compute_sim_state_max0.01482634858028974
sim_compute_sim_state_mean0.011399447165893197
sim_compute_sim_state_median0.01201326680210532
sim_compute_sim_state_min0.006744906479072401
sim_render-ego0_max0.00438064672577549
sim_render-ego0_mean0.004224916544512175
sim_render-ego0_median0.0041941701731675425
sim_render-ego0_min0.004130679105938126
simulation-passed1
step_physics_max0.19358824508290895
step_physics_mean0.14969230345277756
step_physics_median0.14020865267262073
step_physics_min0.12476366338295984
survival_time_max59.99999999999873
survival_time_mean47.53749999999912
survival_time_min14.150000000000066
No reset possible
5875312739Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-030:11:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5871011772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-030:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586896729Andrea CensiΒ πŸ‡¨πŸ‡­template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01188487062851588
agent_compute-ego0_mean0.01052297665971354
agent_compute-ego0_median0.010176407182274232
agent_compute-ego0_min0.00985422164578981
complete-iteration_max0.20410877466201785
complete-iteration_mean0.17248740497814116
complete-iteration_median0.16657522486315834
complete-iteration_min0.1526903955242302
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.2814998626708984e-06
get_duckie_state_mean1.205186198583358e-06
get_duckie_state_median1.2348363474298456e-06
get_duckie_state_min1.0695722368028428e-06
get_robot_state_max0.003931400676568349
get_robot_state_mean0.0035679768882557455
get_robot_state_median0.0035052854377093656
get_robot_state_min0.003329936001035902
get_state_dump_max0.00820980966091156
get_state_dump_mean0.005359857859627476
get_state_dump_median0.004476782346598447
get_state_dump_min0.004276057084401448
get_ui_image_max0.035100535206172775
get_ui_image_mean0.029053977329965317
get_ui_image_median0.027753808846076332
get_ui_image_min0.02560775642153583
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02560775642153583, "step_physics": 0.09282604048523722, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004461250727689719, "get_robot_state": 0.003492251227173624, "sim_render-ego0": 0.0035264718381664423, "get_duckie_state": 1.2102006356927414e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.00985422164578981, "complete-iteration": 0.1526903955242302, "set_robot_commands": 0.0019820777675773524, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009014562715457964, "sim_compute_performance-ego0": 0.0018438749675509297}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.035100535206172775, "step_physics": 0.13356478836225427, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0044923139655071755, "get_robot_state": 0.0035183196482451067, "sim_render-ego0": 0.003805834314097529, "get_duckie_state": 1.2594720591669495e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010369847650113314, "complete-iteration": 0.20410877466201785, "set_robot_commands": 0.0021374692087588105, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009087995342586351, "sim_compute_performance-ego0": 0.0019482529681661856}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.027993857860565186, "step_physics": 0.11121087272961934, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004276057084401448, "get_robot_state": 0.003329936001035902, "sim_render-ego0": 0.003648708264032999, "get_duckie_state": 1.0695722368028428e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.009982966714435153, "complete-iteration": 0.1715584529770745, "set_robot_commands": 0.0021327369742923314, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007054040829340617, "sim_compute_performance-ego0": 0.001852499114142524}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.027513759831587475, "step_physics": 0.09576738874117534, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.00820980966091156, "get_robot_state": 0.003931400676568349, "sim_render-ego0": 0.0036687105894088745, "get_duckie_state": 1.2814998626708984e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01188487062851588, "complete-iteration": 0.16159199674924216, "set_robot_commands": 0.0025547842184702554, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.005994026859601338, "sim_compute_performance-ego0": 0.0019823312759399414}}
set_robot_commands_max0.0025547842184702554
set_robot_commands_mean0.002201767042274687
set_robot_commands_median0.002135103091525571
set_robot_commands_min0.0019820777675773524
sim_compute_performance-ego0_max0.0019823312759399414
sim_compute_performance-ego0_mean0.0019067395814498951
sim_compute_performance-ego0_median0.0019003760411543547
sim_compute_performance-ego0_min0.0018438749675509297
sim_compute_sim_state_max0.009087995342586351
sim_compute_sim_state_mean0.007787656436746567
sim_compute_sim_state_median0.008034301772399291
sim_compute_sim_state_min0.005994026859601338
sim_render-ego0_max0.003805834314097529
sim_render-ego0_mean0.003662431251426461
sim_render-ego0_median0.003658709426720937
sim_render-ego0_min0.0035264718381664423
simulation-passed1
step_physics_max0.13356478836225427
step_physics_mean0.10834227257957156
step_physics_median0.10348913073539734
step_physics_min0.09282604048523722
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
586746756Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586606758Liam PaullΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586546761Charlie GauthierΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 62, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 52, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 0.1899999976158142, -3.9099998474121094
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586326803Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586246805Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
585906824Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:28:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.193737390407806
survival_time_median59.99999999999873
deviation-center-line_median3.832314601257519
in-drivable-lane_median3.125000000000011


other stats
agent_compute-ego0_max0.034466773905652635
agent_compute-ego0_mean0.03354495785214268
agent_compute-ego0_median0.034051719950597345
agent_compute-ego0_min0.0316096176017234
complete-iteration_max0.2519201725087267
complete-iteration_mean0.20857599109476185
complete-iteration_median0.2005974915899107
complete-iteration_min0.1811888086904991
deviation-center-line_max4.685032234694474
deviation-center-line_mean3.2624000033075147
deviation-center-line_min0.6999385760205453
deviation-heading_max10.39656997840679
deviation-heading_mean7.638966456536949
deviation-heading_median9.169353049207125
deviation-heading_min1.820589749326752
driven_any_max7.921206678719825
driven_any_mean6.293025327914234
driven_any_median7.917805489844332
driven_any_min1.4152836532484458
driven_lanedir_consec_max7.514759997041104
driven_lanedir_consec_mean5.7247031686016845
driven_lanedir_consec_min0.99657789655002
driven_lanedir_max7.514759997041104
driven_lanedir_mean5.7247031686016845
driven_lanedir_median7.193737390407806
driven_lanedir_min0.99657789655002
get_duckie_state_max1.2593900631309846e-06
get_duckie_state_mean1.239824339815801e-06
get_duckie_state_median1.236659898845282e-06
get_duckie_state_min1.2265874984416557e-06
get_robot_state_max0.0037280179181761984
get_robot_state_mean0.0036615135593807287
get_robot_state_median0.003676822540861284
get_robot_state_min0.0035643912376241483
get_state_dump_max0.004719172132776139
get_state_dump_mean0.004644054988658546
get_state_dump_median0.0046325270877491925
get_state_dump_min0.004591993646359662
get_ui_image_max0.03560309815914073
get_ui_image_mean0.030771711369068654
get_ui_image_median0.030516928082004773
get_ui_image_min0.02644989115312435
in-drivable-lane_max3.800000000000054
in-drivable-lane_mean2.8500000000000174
in-drivable-lane_min1.3499999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921206678719825, "get_ui_image": 0.02881375637578527, "step_physics": 0.10184215347931644, "survival_time": 59.99999999999873, "driven_lanedir": 7.288759770188896, "get_state_dump": 0.004591993646359662, "get_robot_state": 0.00369039800740797, "sim_render-ego0": 0.003791539893360758, "get_duckie_state": 1.2593900631309846e-06, "in-drivable-lane": 2.75, "deviation-heading": 8.728020864173535, "agent_compute-ego0": 0.034030697327867135, "complete-iteration": 0.19073670948673344, "set_robot_commands": 0.00230103368862384, "deviation-center-line": 4.685032234694474, "driven_lanedir_consec": 7.288759770188896, "sim_compute_sim_state": 0.00957144289389935, "sim_compute_performance-ego0": 0.0020156672951780093}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4152836532484458, "get_ui_image": 0.03560309815914073, "step_physics": 0.15488400763653695, "survival_time": 11.700000000000031, "driven_lanedir": 0.99657789655002, "get_state_dump": 0.004719172132776139, "get_robot_state": 0.0035643912376241483, "sim_render-ego0": 0.0037703422789878032, "get_duckie_state": 1.2265874984416557e-06, "in-drivable-lane": 3.500000000000022, "deviation-heading": 1.820589749326752, "agent_compute-ego0": 0.034466773905652635, "complete-iteration": 0.2519201725087267, "set_robot_commands": 0.002190436708166244, "deviation-center-line": 0.6999385760205453, "driven_lanedir_consec": 0.99657789655002, "sim_compute_sim_state": 0.010659763660836728, "sim_compute_performance-ego0": 0.0019765316171849027}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914460667877226, "get_ui_image": 0.03222009978822427, "step_physics": 0.11705307817578216, "survival_time": 59.99999999999873, "driven_lanedir": 7.098715010626716, "get_state_dump": 0.00460024062640264, "get_robot_state": 0.003663247074314597, "sim_render-ego0": 0.0037636824392657, "get_duckie_state": 1.2407294915776563e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 10.39656997840679, "agent_compute-ego0": 0.0316096176017234, "complete-iteration": 0.2104582736930879, "set_robot_commands": 0.002278817087089291, "deviation-center-line": 3.199889053142761, "driven_lanedir_consec": 7.098715010626716, "sim_compute_sim_state": 0.013174347833828764, "sim_compute_performance-ego0": 0.0020084899232151307}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.921150311811439, "get_ui_image": 0.02644989115312435, "step_physics": 0.09778114659502346, "survival_time": 59.99999999999873, "driven_lanedir": 7.514759997041104, "get_state_dump": 0.004664813549095745, "get_robot_state": 0.0037280179181761984, "sim_render-ego0": 0.003846725357462226, "get_duckie_state": 1.2325903061129072e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 9.610685234240714, "agent_compute-ego0": 0.03407274257332756, "complete-iteration": 0.1811888086904991, "set_robot_commands": 0.002295009500279613, "deviation-center-line": 4.464740149372278, "driven_lanedir_consec": 7.514759997041104, "sim_compute_sim_state": 0.0062627703025875045, "sim_compute_performance-ego0": 0.001999946756227924}}
set_robot_commands_max0.00230103368862384
set_robot_commands_mean0.002266324246039747
set_robot_commands_median0.002286913293684452
set_robot_commands_min0.002190436708166244
sim_compute_performance-ego0_max0.0020156672951780093
sim_compute_performance-ego0_mean0.002000158897951492
sim_compute_performance-ego0_median0.0020042183397215273
sim_compute_performance-ego0_min0.0019765316171849027
sim_compute_sim_state_max0.013174347833828764
sim_compute_sim_state_mean0.009917081172788089
sim_compute_sim_state_median0.01011560327736804
sim_compute_sim_state_min0.0062627703025875045
sim_render-ego0_max0.003846725357462226
sim_render-ego0_mean0.003793072492269122
sim_render-ego0_median0.00378094108617428
sim_render-ego0_min0.0037636824392657
simulation-passed1
step_physics_max0.15488400763653695
step_physics_mean0.11789009647166476
step_physics_median0.1094476158275493
step_physics_min0.09778114659502346
survival_time_max59.99999999999873
survival_time_mean47.92499999999905
survival_time_min11.700000000000031
No reset possible
585606836Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:45:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013995481271926407
agent_compute-ego0_mean0.013302880957362852
agent_compute-ego0_median0.013161236697887003
agent_compute-ego0_min0.01289356916175099
complete-iteration_max0.3718624422691148
complete-iteration_mean0.3195191796475108
complete-iteration_median0.32225719320089197
complete-iteration_min0.26169988991914445
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.566892460323591e-06
get_duckie_state_mean1.4768154992350531e-06
get_duckie_state_median1.4555245811595806e-06
get_duckie_state_min1.4293203742974604e-06
get_robot_state_max0.004039854133853706
get_robot_state_mean0.0039281008841096105
get_robot_state_median0.003916397479848997
get_robot_state_min0.0038397544428867463
get_state_dump_max0.005234456479202004
get_state_dump_mean0.004966746708634096
get_state_dump_median0.004929105109914355
get_state_dump_min0.0047743201355056695
get_ui_image_max0.037064913210523416
get_ui_image_mean0.03231832362730041
get_ui_image_median0.0322426497985878
get_ui_image_min0.027723081701502613
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029863242602765214, "step_physics": 0.23231487984859775, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004936279404868095, "get_robot_state": 0.003940925709313894, "sim_render-ego0": 0.004038307887132122, "get_duckie_state": 1.465450417092202e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012910886172152478, "complete-iteration": 0.3017842318989851, "set_robot_commands": 0.002365459113394986, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009160899599823328, "sim_compute_performance-ego0": 0.002161294197063462}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.037064913210523416, "step_physics": 0.2911792496261152, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0047743201355056695, "get_robot_state": 0.0038397544428867463, "sim_render-ego0": 0.004009759396339436, "get_duckie_state": 1.4455987452269593e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013995481271926407, "complete-iteration": 0.3718624422691148, "set_robot_commands": 0.00237694608480309, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012358099098110278, "sim_compute_performance-ego0": 0.002171230554382172}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03462205699441038, "step_physics": 0.26675478723225843, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005234456479202004, "get_robot_state": 0.004039854133853706, "sim_render-ego0": 0.004155992171250215, "get_duckie_state": 1.566892460323591e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01341158722362153, "complete-iteration": 0.34273015450279876, "set_robot_commands": 0.002384475625424858, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009778065447207792, "sim_compute_performance-ego0": 0.002249195017882132}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027723081701502613, "step_physics": 0.1971735702168435, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004921930814960616, "get_robot_state": 0.0038918692503841, "sim_render-ego0": 0.003983331461135394, "get_duckie_state": 1.4293203742974604e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01289356916175099, "complete-iteration": 0.26169988991914445, "set_robot_commands": 0.002377714741537712, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0065292956727827514, "sim_compute_performance-ego0": 0.00211269115031907}}
set_robot_commands_max0.002384475625424858
set_robot_commands_mean0.0023761488912901613
set_robot_commands_median0.002377330413170401
set_robot_commands_min0.002365459113394986
sim_compute_performance-ego0_max0.002249195017882132
sim_compute_performance-ego0_mean0.002173602729911709
sim_compute_performance-ego0_median0.002166262375722817
sim_compute_performance-ego0_min0.00211269115031907
sim_compute_sim_state_max0.012358099098110278
sim_compute_sim_state_mean0.009456589954481035
sim_compute_sim_state_median0.00946948252351556
sim_compute_sim_state_min0.0065292956727827514
sim_render-ego0_max0.004155992171250215
sim_render-ego0_mean0.004046847728964292
sim_render-ego0_median0.004024033641735779
sim_render-ego0_min0.003983331461135394
simulation-passed1
step_physics_max0.2911792496261152
step_physics_mean0.24685562173095377
step_physics_median0.2495348335404281
step_physics_min0.1971735702168435
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585456843Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:21:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2243241297352627
survival_time_median42.024999999999494
deviation-center-line_median0.747257951404214
in-drivable-lane_median8.200000000000067


other stats
agent_compute-ego0_max0.02024394027291471
agent_compute-ego0_mean0.01438267409233926
agent_compute-ego0_median0.01272819586563339
agent_compute-ego0_min0.011830364365175546
complete-iteration_max0.2092748367724641
complete-iteration_mean0.18027773509869427
complete-iteration_median0.17562967049617467
complete-iteration_min0.16057676262996368
deviation-center-line_max2.2281644088068955
deviation-center-line_mean0.972835986296101
deviation-center-line_min0.16866363356908076
deviation-heading_max9.756520239555329
deviation-heading_mean4.9908059796273365
deviation-heading_median4.4826030288547685
deviation-heading_min1.2414976212444817
driven_any_max5.285752152246861
driven_any_mean3.1833072371315785
driven_any_median3.4153046549737964
driven_any_min0.6168674863318603
driven_lanedir_consec_max5.197109290389603
driven_lanedir_consec_mean1.9629539624327752
driven_lanedir_consec_min0.20605829987097304
driven_lanedir_max5.197109290389603
driven_lanedir_mean1.9629539624327752
driven_lanedir_median1.2243241297352627
driven_lanedir_min0.20605829987097304
get_duckie_state_max1.3502150619585896e-06
get_duckie_state_mean1.3356074793148958e-06
get_duckie_state_median1.3368656938696706e-06
get_duckie_state_min1.318483467561653e-06
get_robot_state_max0.003869925013787542
get_robot_state_mean0.0037383332674230606
get_robot_state_median0.0037085136330960943
get_robot_state_min0.003666380789712511
get_state_dump_max0.004838207778485986
get_state_dump_mean0.004713182640098797
get_state_dump_median0.0046926351778961905
get_state_dump_min0.004629252426116821
get_ui_image_max0.03775964005623457
get_ui_image_mean0.03136159155861544
get_ui_image_median0.03073255812891907
get_ui_image_min0.02622160992038904
in-drivable-lane_max49.049999999998896
in-drivable-lane_mean16.362499999999756
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.611621186658674, "get_ui_image": 0.028105421717387127, "step_physics": 0.10117870305915434, "survival_time": 24.850000000000215, "driven_lanedir": 1.946389744777358, "get_state_dump": 0.004629252426116821, "get_robot_state": 0.003682315110202774, "sim_render-ego0": 0.003795088055622147, "get_duckie_state": 1.318483467561653e-06, "in-drivable-lane": 9.20000000000013, "deviation-heading": 2.1374474326626163, "agent_compute-ego0": 0.011830364365175546, "complete-iteration": 0.1674517110648404, "set_robot_commands": 0.002230525016784668, "deviation-center-line": 0.5372554835723327, "driven_lanedir_consec": 1.946389744777358, "sim_compute_sim_state": 0.009882113540986457, "sim_compute_performance-ego0": 0.002035086892216081}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6168674863318603, "get_ui_image": 0.03775964005623457, "step_physics": 0.13067003729429888, "survival_time": 9.6, "driven_lanedir": 0.20605829987097304, "get_state_dump": 0.004747410512341119, "get_robot_state": 0.003734712155989415, "sim_render-ego0": 0.003921850975313335, "get_duckie_state": 1.3502150619585896e-06, "in-drivable-lane": 7.200000000000002, "deviation-heading": 1.2414976212444817, "agent_compute-ego0": 0.012966819377760811, "complete-iteration": 0.2092748367724641, "set_robot_commands": 0.0021666405732149903, "deviation-center-line": 0.16866363356908076, "driven_lanedir_consec": 0.20605829987097304, "sim_compute_sim_state": 0.011167681896624789, "sim_compute_performance-ego0": 0.002051320100695358}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.285752152246861, "get_ui_image": 0.03335969454045101, "step_physics": 0.10765258120458192, "survival_time": 59.99999999999873, "driven_lanedir": 5.197109290389603, "get_state_dump": 0.004838207778485986, "get_robot_state": 0.003869925013787542, "sim_render-ego0": 0.00394176742020098, "get_duckie_state": 1.32450354684898e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.756520239555329, "agent_compute-ego0": 0.012489572353505968, "complete-iteration": 0.18380762992750893, "set_robot_commands": 0.0022903125947162967, "deviation-center-line": 2.2281644088068955, "driven_lanedir_consec": 5.197109290389603, "sim_compute_sim_state": 0.013204398103598056, "sim_compute_performance-ego0": 0.0020751099503109795}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.218988123288919, "get_ui_image": 0.02622160992038904, "step_physics": 0.09197645710490424, "survival_time": 59.199999999998774, "driven_lanedir": 0.5022585146931675, "get_state_dump": 0.004637859843451262, "get_robot_state": 0.003666380789712511, "sim_render-ego0": 0.003791486563058845, "get_duckie_state": 1.3492278408903611e-06, "in-drivable-lane": 49.049999999998896, "deviation-heading": 6.827758625046921, "agent_compute-ego0": 0.02024394027291471, "complete-iteration": 0.16057676262996368, "set_robot_commands": 0.0022117956781186133, "deviation-center-line": 0.9572604192360954, "driven_lanedir_consec": 0.5022585146931675, "sim_compute_sim_state": 0.005803275007738846, "sim_compute_performance-ego0": 0.001941004282311548}}
set_robot_commands_max0.0022903125947162967
set_robot_commands_mean0.0022248184657086417
set_robot_commands_median0.0022211603474516406
set_robot_commands_min0.0021666405732149903
sim_compute_performance-ego0_max0.0020751099503109795
sim_compute_performance-ego0_mean0.0020256303063834915
sim_compute_performance-ego0_median0.00204320349645572
sim_compute_performance-ego0_min0.001941004282311548
sim_compute_sim_state_max0.013204398103598056
sim_compute_sim_state_mean0.010014367137237036
sim_compute_sim_state_median0.01052489771880562
sim_compute_sim_state_min0.005803275007738846
sim_render-ego0_max0.00394176742020098
sim_render-ego0_mean0.0038625482535488264
sim_render-ego0_median0.0038584695154677408
sim_render-ego0_min0.003791486563058845
simulation-passed1
step_physics_max0.13067003729429888
step_physics_mean0.10786944466573484
step_physics_median0.10441564213186812
step_physics_min0.09197645710490424
survival_time_max59.99999999999873
survival_time_mean38.412499999999426
survival_time_min9.6
No reset possible
585256848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:08:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 861 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
584729241Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:28:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.4654384705185315
survival_time_median59.99999999999873
deviation-center-line_median3.905837771373278
in-drivable-lane_median7.074999999999881


other stats
agent_compute-ego0_max0.03576255307614225
agent_compute-ego0_mean0.03385844483365566
agent_compute-ego0_median0.034354958704965105
agent_compute-ego0_min0.030961308848550174
complete-iteration_max0.22407210799096855
complete-iteration_mean0.19720792180497168
complete-iteration_median0.1960146281244753
complete-iteration_min0.17273032297996757
deviation-center-line_max4.16528263952744
deviation-center-line_mean3.0564783909117703
deviation-center-line_min0.24895538137308423
deviation-heading_max12.901899964138211
deviation-heading_mean8.901636266824383
deviation-heading_median10.623554265441683
deviation-heading_min1.4575365722759526
driven_any_max8.338173081200086
driven_any_mean6.573662761320811
driven_any_median8.334641204588582
driven_any_min1.287195554905996
driven_lanedir_consec_max7.812305197777154
driven_lanedir_consec_mean5.360086722834983
driven_lanedir_consec_min0.6971647525257132
driven_lanedir_max7.812305197777154
driven_lanedir_mean5.360086722834983
driven_lanedir_median6.4654384705185315
driven_lanedir_min0.6971647525257132
get_duckie_state_max2.153509363941507e-06
get_duckie_state_mean2.0444586374473984e-06
get_duckie_state_median2.063848227921409e-06
get_duckie_state_min1.896628730005269e-06
get_robot_state_max0.003903196018800251
get_robot_state_mean0.003704669182781807
get_robot_state_median0.003667391011558107
get_robot_state_min0.003580698689210762
get_state_dump_max0.00500554724795733
get_state_dump_mean0.004763762276788406
get_state_dump_median0.00476873248542576
get_state_dump_min0.004512036888344774
get_ui_image_max0.03574985439337573
get_ui_image_mean0.03071796683125381
get_ui_image_median0.030550668579057097
get_ui_image_min0.026020675773525317
in-drivable-lane_max13.249999999999686
in-drivable-lane_mean7.462499999999871
in-drivable-lane_min2.450000000000035
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.338173081200086, "get_ui_image": 0.028431050485615728, "step_physics": 0.096412348409775, "survival_time": 59.99999999999873, "driven_lanedir": 7.812305197777154, "get_state_dump": 0.004892680170534056, "get_robot_state": 0.0037148598330304784, "sim_render-ego0": 0.0038180712557752167, "get_duckie_state": 2.153509363941507e-06, "in-drivable-lane": 2.450000000000035, "deviation-heading": 9.45507383049701, "agent_compute-ego0": 0.03458484245478164, "complete-iteration": 0.18603564241744397, "set_robot_commands": 0.002288524157597957, "deviation-center-line": 4.100556244684057, "driven_lanedir_consec": 7.812305197777154, "sim_compute_sim_state": 0.009769028172107858, "sim_compute_performance-ego0": 0.002025115698402271}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.287195554905996, "get_ui_image": 0.03574985439337573, "step_physics": 0.12636941150554176, "survival_time": 10.25000000000001, "driven_lanedir": 0.6971647525257132, "get_state_dump": 0.004512036888344774, "get_robot_state": 0.003580698689210762, "sim_render-ego0": 0.0037361418159262646, "get_duckie_state": 2.018456320160801e-06, "in-drivable-lane": 4.700000000000022, "deviation-heading": 1.4575365722759526, "agent_compute-ego0": 0.03576255307614225, "complete-iteration": 0.22407210799096855, "set_robot_commands": 0.0022070106950778405, "deviation-center-line": 0.24895538137308423, "driven_lanedir_consec": 0.6971647525257132, "sim_compute_sim_state": 0.010067560140369008, "sim_compute_performance-ego0": 0.0019935276901837692}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.33114586748588, "get_ui_image": 0.032670286672498466, "step_physics": 0.1113317074327048, "survival_time": 59.99999999999873, "driven_lanedir": 6.68432036937936, "get_state_dump": 0.00500554724795733, "get_robot_state": 0.003903196018800251, "sim_render-ego0": 0.003963251296526983, "get_duckie_state": 2.109240135682016e-06, "in-drivable-lane": 9.44999999999974, "deviation-heading": 12.901899964138211, "agent_compute-ego0": 0.030961308848550174, "complete-iteration": 0.20599361383150655, "set_robot_commands": 0.0023467211203213835, "deviation-center-line": 3.711119298062499, "driven_lanedir_consec": 6.68432036937936, "sim_compute_sim_state": 0.013534776177831135, "sim_compute_performance-ego0": 0.002171736970531454}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.338136541691282, "get_ui_image": 0.026020675773525317, "step_physics": 0.09018226527453065, "survival_time": 59.99999999999873, "driven_lanedir": 6.246556571657704, "get_state_dump": 0.004644784800317464, "get_robot_state": 0.003619922190085736, "sim_render-ego0": 0.0037402054550844262, "get_duckie_state": 1.896628730005269e-06, "in-drivable-lane": 13.249999999999686, "deviation-heading": 11.792034700386354, "agent_compute-ego0": 0.03412507495514856, "complete-iteration": 0.17273032297996757, "set_robot_commands": 0.002237434490435725, "deviation-center-line": 4.16528263952744, "driven_lanedir_consec": 6.246556571657704, "sim_compute_sim_state": 0.006108854533631438, "sim_compute_performance-ego0": 0.001959165069681719}}
set_robot_commands_max0.0023467211203213835
set_robot_commands_mean0.002269922615858226
set_robot_commands_median0.002262979324016841
set_robot_commands_min0.0022070106950778405
sim_compute_performance-ego0_max0.002171736970531454
sim_compute_performance-ego0_mean0.0020373863571998036
sim_compute_performance-ego0_median0.0020093216942930203
sim_compute_performance-ego0_min0.001959165069681719
sim_compute_sim_state_max0.013534776177831135
sim_compute_sim_state_mean0.00987005475598486
sim_compute_sim_state_median0.009918294156238431
sim_compute_sim_state_min0.006108854533631438
sim_render-ego0_max0.003963251296526983
sim_render-ego0_mean0.0038144174558282225
sim_render-ego0_median0.0037791383554298215
sim_render-ego0_min0.0037361418159262646
simulation-passed1
step_physics_max0.12636941150554176
step_physics_mean0.10607393315563804
step_physics_median0.1038720279212399
step_physics_min0.09018226527453065
survival_time_max59.99999999999873
survival_time_mean47.56249999999905
survival_time_min10.25000000000001
No reset possible
5843312737Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:32:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.828141311485189
survival_time_median55.87499999999896
deviation-center-line_median1.7386112511970913
in-drivable-lane_median14.699999999999632


other stats
agent_compute-ego0_max0.1380007469485344
agent_compute-ego0_mean0.10752836859048188
agent_compute-ego0_median0.12389119490024687
agent_compute-ego0_min0.044330337612899305
complete-iteration_max0.30823170379322007
complete-iteration_mean0.27285273713902325
complete-iteration_median0.2825555523468195
complete-iteration_min0.218068140069234
deviation-center-line_max1.8776060012442255
deviation-center-line_mean1.4141191757655898
deviation-center-line_min0.3016481994239513
deviation-heading_max14.311127092350436
deviation-heading_mean8.595618381694635
deviation-heading_median9.090332159945902
deviation-heading_min1.8906821145362973
driven_any_max8.389841591121678
driven_any_mean5.539418201499728
driven_any_median6.3357160196492135
driven_any_min1.096399175578807
driven_lanedir_consec_max6.228560774638849
driven_lanedir_consec_mean3.1442628990981016
driven_lanedir_consec_min0.6922081987831795
driven_lanedir_max6.405147781126093
driven_lanedir_mean3.8995097047542657
driven_lanedir_median4.248773792383672
driven_lanedir_min0.6953434531236241
get_duckie_state_max2.4493207636567737e-06
get_duckie_state_mean2.3613932618371163e-06
get_duckie_state_median2.3589379518589046e-06
get_duckie_state_min2.2783763799738825e-06
get_robot_state_max0.003972128321305205
get_robot_state_mean0.003928846205855557
get_robot_state_median0.0039369708592449
get_robot_state_min0.0038693147836272247
get_state_dump_max0.004876722994538927
get_state_dump_mean0.004826569078713821
get_state_dump_median0.004835298792383756
get_state_dump_min0.004758955735548847
get_ui_image_max0.038538947068586314
get_ui_image_mean0.03267130576361381
get_ui_image_median0.03200042796046742
get_ui_image_min0.028145420064934087
in-drivable-lane_max24.349999999999422
in-drivable-lane_mean14.512499999999676
in-drivable-lane_min4.300000000000013
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.389841591121678, "get_ui_image": 0.03043128648070273, "step_physics": 0.09783407293886666, "survival_time": 59.99999999999873, "driven_lanedir": 6.405147781126093, "get_state_dump": 0.004820820096132658, "get_robot_state": 0.003962252360398723, "sim_render-ego0": 0.004158532788215529, "get_duckie_state": 2.2783763799738825e-06, "in-drivable-lane": 16.249999999999076, "deviation-heading": 9.312504804312074, "agent_compute-ego0": 0.1380007469485344, "complete-iteration": 0.2943841225896449, "set_robot_commands": 0.0024266538770867825, "deviation-center-line": 1.8776060012442255, "driven_lanedir_consec": 6.228560774638849, "sim_compute_sim_state": 0.01041379796773766, "sim_compute_performance-ego0": 0.002243349296067974}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.331510146490845, "get_ui_image": 0.038538947068586314, "step_physics": 0.12034273745930792, "survival_time": 51.7499999999992, "driven_lanedir": 2.58696706151976, "get_state_dump": 0.0048497774886348535, "get_robot_state": 0.003972128321305205, "sim_render-ego0": 0.0041286319379180555, "get_duckie_state": 2.3229702098949537e-06, "in-drivable-lane": 24.349999999999422, "deviation-heading": 14.311127092350436, "agent_compute-ego0": 0.1197500880160387, "complete-iteration": 0.30823170379322007, "set_robot_commands": 0.0023967391275531076, "deviation-center-line": 1.6634539353155948, "driven_lanedir_consec": 1.6185961961949642, "sim_compute_sim_state": 0.011917935375081066, "sim_compute_performance-ego0": 0.0022427216459885526}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.096399175578807, "get_ui_image": 0.03356956944023211, "step_physics": 0.11439023681522643, "survival_time": 9.650000000000002, "driven_lanedir": 0.6953434531236241, "get_state_dump": 0.004876722994538927, "get_robot_state": 0.0038693147836272247, "sim_render-ego0": 0.0039262624131035555, "get_duckie_state": 2.4493207636567737e-06, "in-drivable-lane": 4.300000000000013, "deviation-heading": 1.8906821145362973, "agent_compute-ego0": 0.044330337612899305, "complete-iteration": 0.218068140069234, "set_robot_commands": 0.002280092730964582, "deviation-center-line": 0.3016481994239513, "driven_lanedir_consec": 0.6922081987831795, "sim_compute_sim_state": 0.008657094129582042, "sim_compute_performance-ego0": 0.002074181419057944}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.339921892807583, "get_ui_image": 0.028145420064934087, "step_physics": 0.09094849871556825, "survival_time": 59.99999999999873, "driven_lanedir": 5.910580523247585, "get_state_dump": 0.004758955735548847, "get_robot_state": 0.003911689358091076, "sim_render-ego0": 0.004035078814186522, "get_duckie_state": 2.394905693822856e-06, "in-drivable-lane": 13.150000000000189, "deviation-heading": 8.868159515579732, "agent_compute-ego0": 0.12803230178445504, "complete-iteration": 0.27072698210399415, "set_robot_commands": 0.0024078863050221006, "deviation-center-line": 1.8137685670785877, "driven_lanedir_consec": 4.037686426775414, "sim_compute_sim_state": 0.006229773052129817, "sim_compute_performance-ego0": 0.002165807871695462}}
set_robot_commands_max0.0024266538770867825
set_robot_commands_mean0.002377843010156643
set_robot_commands_median0.002402312716287604
set_robot_commands_min0.002280092730964582
sim_compute_performance-ego0_max0.002243349296067974
sim_compute_performance-ego0_mean0.002181515058202483
sim_compute_performance-ego0_median0.0022042647588420075
sim_compute_performance-ego0_min0.002074181419057944
sim_compute_sim_state_max0.011917935375081066
sim_compute_sim_state_mean0.009304650131132646
sim_compute_sim_state_median0.00953544604865985
sim_compute_sim_state_min0.006229773052129817
sim_render-ego0_max0.004158532788215529
sim_render-ego0_mean0.004062126488355916
sim_render-ego0_median0.004081855376052289
sim_render-ego0_min0.0039262624131035555
simulation-passed1
step_physics_max0.12034273745930792
step_physics_mean0.10587888648224232
step_physics_median0.10611215487704656
step_physics_min0.09094849871556825
survival_time_max59.99999999999873
survival_time_mean45.34999999999916
survival_time_min9.650000000000002
No reset possible
584169276Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
584039277Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583889286Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583779294Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:03:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583699297Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-030:02:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
582489312Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:25:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.031820652770268
survival_time_median49.9999999999993
deviation-center-line_median2.890422675124041
in-drivable-lane_median3.4499999999998687


other stats
agent_compute-ego0_max0.012406478362732317
agent_compute-ego0_mean0.012276380741659668
agent_compute-ego0_median0.012284028484818316
agent_compute-ego0_min0.01213098763426972
complete-iteration_max0.1979052769832122
complete-iteration_mean0.17552726892415405
complete-iteration_median0.17495263801231964
complete-iteration_min0.15429852268876482
deviation-center-line_max3.758763972217636
deviation-center-line_mean2.5023341170384743
deviation-center-line_min0.4697271456881783
deviation-heading_max12.82412797422542
deviation-heading_mean8.260324347972649
deviation-heading_median9.078803948993649
deviation-heading_min2.0595615196778807
driven_any_max11.679181502401502
driven_any_mean8.223934584604503
driven_any_median9.015676038053552
driven_any_min3.185204759909409
driven_lanedir_consec_max7.104699727992231
driven_lanedir_consec_mean5.146472905121384
driven_lanedir_consec_min1.4175505869527705
driven_lanedir_max11.29941124583484
driven_lanedir_mean7.387417596565012
driven_lanedir_median8.41635427673622
driven_lanedir_min1.4175505869527705
get_duckie_state_max2.30358800324274e-06
get_duckie_state_mean2.202856139607719e-06
get_duckie_state_median2.22553352004613e-06
get_duckie_state_min2.056769515095876e-06
get_robot_state_max0.003805351098510844
get_robot_state_mean0.003676816666338264
get_robot_state_median0.003668067316877763
get_robot_state_min0.003565780933086689
get_state_dump_max0.004711381600957231
get_state_dump_mean0.004611894442696353
get_state_dump_median0.0045920555990656385
get_state_dump_min0.004552084971696902
get_ui_image_max0.03427312679779835
get_ui_image_mean0.030095626159444507
get_ui_image_median0.030282848125690973
get_ui_image_min0.02554368158859774
in-drivable-lane_max11.500000000000124
in-drivable-lane_mean4.774999999999968
in-drivable-lane_min0.70000000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.679181502401502, "get_ui_image": 0.028943001281014093, "step_physics": 0.10325940344156968, "survival_time": 59.99999999999873, "driven_lanedir": 11.29941124583484, "get_state_dump": 0.004711381600957231, "get_robot_state": 0.003805351098510844, "sim_render-ego0": 0.003842394119694668, "get_duckie_state": 2.30358800324274e-06, "in-drivable-lane": 0.70000000000001, "deviation-heading": 11.522751178524354, "agent_compute-ego0": 0.012376527206586064, "complete-iteration": 0.17183745850333565, "set_robot_commands": 0.002266838786802522, "deviation-center-line": 3.751344232044408, "driven_lanedir_consec": 6.253869021466859, "sim_compute_sim_state": 0.010468882386829336, "sim_compute_performance-ego0": 0.002075689420612726}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.185204759909409, "get_ui_image": 0.03427312679779835, "step_physics": 0.1253918115909283, "survival_time": 19.45000000000014, "driven_lanedir": 1.4175505869527705, "get_state_dump": 0.004552084971696902, "get_robot_state": 0.003565780933086689, "sim_render-ego0": 0.003664032006875063, "get_duckie_state": 2.1659410916841942e-06, "in-drivable-lane": 11.500000000000124, "deviation-heading": 2.0595615196778807, "agent_compute-ego0": 0.012191529763050568, "complete-iteration": 0.1979052769832122, "set_robot_commands": 0.0020778521513327573, "deviation-center-line": 0.4697271456881783, "driven_lanedir_consec": 1.4175505869527705, "sim_compute_sim_state": 0.010203690406603691, "sim_compute_performance-ego0": 0.0019014523579524113}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.531352203733553, "get_ui_image": 0.03162269497036785, "step_physics": 0.10669178790069848, "survival_time": 39.999999999999865, "driven_lanedir": 6.810000834221187, "get_state_dump": 0.004589244816335995, "get_robot_state": 0.0036260673913467542, "sim_render-ego0": 0.0036889935254157706, "get_duckie_state": 2.056769515095876e-06, "in-drivable-lane": 4.89999999999978, "deviation-heading": 6.634856719462939, "agent_compute-ego0": 0.012406478362732317, "complete-iteration": 0.17806781752130363, "set_robot_commands": 0.0021248685286732647, "deviation-center-line": 2.029501118203675, "driven_lanedir_consec": 5.809772284073675, "sim_compute_sim_state": 0.01130362336852875, "sim_compute_performance-ego0": 0.0019284964500741568}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.499999872373552, "get_ui_image": 0.02554368158859774, "step_physics": 0.09404513798188806, "survival_time": 59.99999999999873, "driven_lanedir": 10.022707719251253, "get_state_dump": 0.0045948663817952816, "get_robot_state": 0.003710067242408771, "sim_render-ego0": 0.003754696977029335, "get_duckie_state": 2.285125948408065e-06, "in-drivable-lane": 1.9999999999999576, "deviation-heading": 12.82412797422542, "agent_compute-ego0": 0.01213098763426972, "complete-iteration": 0.15429852268876482, "set_robot_commands": 0.002183860585056276, "deviation-center-line": 3.758763972217636, "driven_lanedir_consec": 7.104699727992231, "sim_compute_sim_state": 0.006277977874336592, "sim_compute_performance-ego0": 0.001972915925749335}}
set_robot_commands_max0.002266838786802522
set_robot_commands_mean0.002163355012966205
set_robot_commands_median0.00215436455686477
set_robot_commands_min0.0020778521513327573
sim_compute_performance-ego0_max0.002075689420612726
sim_compute_performance-ego0_mean0.001969638538597157
sim_compute_performance-ego0_median0.0019507061879117456
sim_compute_performance-ego0_min0.0019014523579524113
sim_compute_sim_state_max0.01130362336852875
sim_compute_sim_state_mean0.009563543509074592
sim_compute_sim_state_median0.010336286396716514
sim_compute_sim_state_min0.006277977874336592
sim_render-ego0_max0.003842394119694668
sim_render-ego0_mean0.003737529157253709
sim_render-ego0_median0.003721845251222553
sim_render-ego0_min0.003664032006875063
simulation-passed1
step_physics_max0.1253918115909283
step_physics_mean0.10734703522877112
step_physics_median0.10497559567113408
step_physics_min0.09404513798188806
survival_time_max59.99999999999873
survival_time_mean44.862499999999365
survival_time_min19.45000000000014
No reset possible
5824710933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-030:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5824411012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-030:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5824311012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-030:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5824011010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-030:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
581639359Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-030:28:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.54689419706198
survival_time_median59.99999999999873
deviation-center-line_median3.2935970626730127
in-drivable-lane_median2.5250000000000052


other stats
agent_compute-ego0_max0.012461079248877786
agent_compute-ego0_mean0.012287766608323989
agent_compute-ego0_median0.012280897134256816
agent_compute-ego0_min0.012128192915904532
complete-iteration_max0.2059133421514452
complete-iteration_mean0.18229540424291585
complete-iteration_median0.18232052232899537
complete-iteration_min0.1586272301622275
deviation-center-line_max3.734998441672635
deviation-center-line_mean2.6529615929571184
deviation-center-line_min0.28965380480981306
deviation-heading_max11.558472233218126
deviation-heading_mean7.2056292741706045
deviation-heading_median7.952152873544231
deviation-heading_min1.359739116375834
driven_any_max11.25640613619164
driven_any_mean8.845938231341176
driven_any_median11.251434795914582
driven_any_min1.6244771973439
driven_lanedir_consec_max11.108231564802152
driven_lanedir_consec_mean7.238467797823782
driven_lanedir_consec_min0.7518512323690201
driven_lanedir_max11.108231564802152
driven_lanedir_mean8.18486466903984
driven_lanedir_median10.439687939494092
driven_lanedir_min0.7518512323690201
get_duckie_state_max1.3852496627566222e-06
get_duckie_state_mean1.345722835180609e-06
get_duckie_state_median1.3434178923519257e-06
get_duckie_state_min1.3108058932619626e-06
get_robot_state_max0.003773759147904497
get_robot_state_mean0.0036970016791007896
get_robot_state_median0.0036891200560316456
get_robot_state_min0.0036360074564353705
get_state_dump_max0.004646067416836677
get_state_dump_mean0.004547667094351096
get_state_dump_median0.004534726138912966
get_state_dump_min0.0044751486827417745
get_ui_image_max0.03451494703587798
get_ui_image_mean0.029820575686083633
get_ui_image_median0.029827474356690215
get_ui_image_min0.02511240699507613
in-drivable-lane_max5.349999999999923
in-drivable-lane_mean2.5999999999999837
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.25640613619164, "get_ui_image": 0.02735635541460099, "step_physics": 0.0967787574669602, "survival_time": 59.99999999999873, "driven_lanedir": 11.108231564802152, "get_state_dump": 0.004646067416836677, "get_robot_state": 0.003773759147904497, "sim_render-ego0": 0.003821381720575464, "get_duckie_state": 1.3852496627566222e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.656681152513693, "agent_compute-ego0": 0.012205191000018092, "complete-iteration": 0.1622373958511416, "set_robot_commands": 0.00225272940954102, "deviation-center-line": 3.074519834557604, "driven_lanedir_consec": 11.108231564802152, "sim_compute_sim_state": 0.009257161349281482, "sim_compute_performance-ego0": 0.0020632374594352523}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6244771973439, "get_ui_image": 0.03451494703587798, "step_physics": 0.13301173927857704, "survival_time": 9.650000000000002, "driven_lanedir": 0.7518512323690201, "get_state_dump": 0.0044751486827417745, "get_robot_state": 0.0036360074564353705, "sim_render-ego0": 0.003813805039395991, "get_duckie_state": 1.3567737697326031e-06, "in-drivable-lane": 5.0500000000000105, "deviation-heading": 1.359739116375834, "agent_compute-ego0": 0.01235660326849554, "complete-iteration": 0.2059133421514452, "set_robot_commands": 0.0022038848129744383, "deviation-center-line": 0.28965380480981306, "driven_lanedir_consec": 0.7518512323690201, "sim_compute_sim_state": 0.00981192121800688, "sim_compute_performance-ego0": 0.002008545030023634}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.246680059297471, "get_ui_image": 0.03229859329877944, "step_physics": 0.12970430447993728, "survival_time": 59.99999999999873, "driven_lanedir": 9.82354821111102, "get_state_dump": 0.004591305190379376, "get_robot_state": 0.0037411841425073833, "sim_render-ego0": 0.003808132317739165, "get_duckie_state": 1.3300620149712478e-06, "in-drivable-lane": 5.349999999999923, "deviation-heading": 11.558472233218126, "agent_compute-ego0": 0.012461079248877786, "complete-iteration": 0.20240364880684908, "set_robot_commands": 0.0022556767872628524, "deviation-center-line": 3.734998441672635, "driven_lanedir_consec": 6.0379607262467925, "sim_compute_sim_state": 0.011442885807809186, "sim_compute_performance-ego0": 0.002017643727628913}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.25618953253169, "get_ui_image": 0.02511240699507613, "step_physics": 0.09923506140411148, "survival_time": 59.99999999999873, "driven_lanedir": 11.055827667877166, "get_state_dump": 0.004478147087446557, "get_robot_state": 0.003637055969555908, "sim_render-ego0": 0.003697417757096239, "get_duckie_state": 1.3108058932619626e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.247624594574768, "agent_compute-ego0": 0.012128192915904532, "complete-iteration": 0.1586272301622275, "set_robot_commands": 0.002193823940648723, "deviation-center-line": 3.5126742907884214, "driven_lanedir_consec": 11.055827667877166, "sim_compute_sim_state": 0.006094813049087715, "sim_compute_performance-ego0": 0.00197041818839525}}
set_robot_commands_max0.0022556767872628524
set_robot_commands_mean0.0022265287376067584
set_robot_commands_median0.0022283071112577293
set_robot_commands_min0.002193823940648723
sim_compute_performance-ego0_max0.0020632374594352523
sim_compute_performance-ego0_mean0.0020149611013707625
sim_compute_performance-ego0_median0.0020130943788262733
sim_compute_performance-ego0_min0.00197041818839525
sim_compute_sim_state_max0.011442885807809186
sim_compute_sim_state_mean0.009151695356046315
sim_compute_sim_state_median0.009534541283644182
sim_compute_sim_state_min0.006094813049087715
sim_render-ego0_max0.003821381720575464
sim_render-ego0_mean0.003785184208701715
sim_render-ego0_median0.0038109686785675776
sim_render-ego0_min0.003697417757096239
simulation-passed1
step_physics_max0.13301173927857704
step_physics_mean0.1146824656573965
step_physics_median0.11446968294202438
step_physics_min0.0967787574669602
survival_time_max59.99999999999873
survival_time_mean47.41249999999904
survival_time_min9.650000000000002
No reset possible