Duckietown Challenges Home Challenges Submissions

Evaluator 5374

ID5374
evaluatorgpu-production-spot-0-05
ownerI don't have one 😀
machinegpu-production-spot-0_932fd3b790fa
processgpu-production-spot-0-05_932fd3b790fa
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success10 79764
# timeout
# failed
# error
# aborted4 79837
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)245.9 GB
Disk (MB)969.3 GB
Disk available (MB)853.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7984213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7984113798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7984013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7983713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7983016111Ryan Arya Pratamacollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-050:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.04


other stats
nsamples200
No reset possible
7982816096Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-050:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.025


other stats
nsamples400
No reset possible
7982516096Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-050:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.025


other stats
nsamples400
No reset possible
7981716103Asoka Vardhan Sexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-050:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1876000000001


other stats
agent_compute-ego0_max0.011819372164425298
agent_compute-ego0_mean0.011819372164425298
agent_compute-ego0_median0.011819372164425298
agent_compute-ego0_min0.011819372164425298
complete-iteration_max0.238017008244277
complete-iteration_mean0.238017008244277
complete-iteration_median0.238017008244277
complete-iteration_min0.238017008244277
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1876000000001
distance-from-start_median2.1876000000001
distance-from-start_min2.1876000000001
driven_any_max2.187600000000121
driven_any_mean2.187600000000121
driven_any_median2.187600000000121
driven_any_min2.187600000000121
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09539051316232083
get_duckie_state_mean0.09539051316232083
get_duckie_state_median0.09539051316232083
get_duckie_state_min0.09539051316232083
get_robot_state_max0.003958123342968653
get_robot_state_mean0.003958123342968653
get_robot_state_median0.003958123342968653
get_robot_state_min0.003958123342968653
get_state_dump_max0.019699831618449976
get_state_dump_mean0.019699831618449976
get_state_dump_median0.019699831618449976
get_state_dump_min0.019699831618449976
get_ui_image_max0.015950277546909298
get_ui_image_mean0.015950277546909298
get_ui_image_median0.015950277546909298
get_ui_image_min0.015950277546909298
in-drivable-lane_max37.50000000000001
in-drivable-lane_mean37.50000000000001
in-drivable-lane_median37.50000000000001
in-drivable-lane_min37.50000000000001
per-episodes
details{"d45-ego0": {"driven_any": 2.187600000000121, "get_ui_image": 0.015950277546909298, "step_physics": 0.07222752088554373, "survival_time": 37.50000000000001, "driven_lanedir": 0.0, "get_state_dump": 0.019699831618449976, "get_robot_state": 0.003958123342968653, "sim_render-ego0": 0.003818373229309976, "get_duckie_state": 0.09539051316232083, "in-drivable-lane": 37.50000000000001, "deviation-heading": 0.0, "agent_compute-ego0": 0.011819372164425298, "complete-iteration": 0.238017008244277, "set_robot_commands": 0.002387877628107998, "distance-from-start": 2.1876000000001, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010611773489635889, "sim_compute_performance-ego0": 0.0020531277840686703}}
set_robot_commands_max0.002387877628107998
set_robot_commands_mean0.002387877628107998
set_robot_commands_median0.002387877628107998
set_robot_commands_min0.002387877628107998
sim_compute_performance-ego0_max0.0020531277840686703
sim_compute_performance-ego0_mean0.0020531277840686703
sim_compute_performance-ego0_median0.0020531277840686703
sim_compute_performance-ego0_min0.0020531277840686703
sim_compute_sim_state_max0.010611773489635889
sim_compute_sim_state_mean0.010611773489635889
sim_compute_sim_state_median0.010611773489635889
sim_compute_sim_state_min0.010611773489635889
sim_render-ego0_max0.003818373229309976
sim_render-ego0_mean0.003818373229309976
sim_render-ego0_median0.003818373229309976
sim_render-ego0_min0.003818373229309976
simulation-passed1
step_physics_max0.07222752088554373
step_physics_mean0.07222752088554373
step_physics_median0.07222752088554373
step_physics_min0.07222752088554373
survival_time_max37.50000000000001
survival_time_mean37.50000000000001
survival_time_median37.50000000000001
survival_time_min37.50000000000001
No reset possible
7981216112Carlos Gavidiatemplate-randomaido-hello-sim-validation370successnogpu-production-spot-0-050:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011245982213453814
agent_compute-ego0_mean0.011245982213453814
agent_compute-ego0_median0.011245982213453814
agent_compute-ego0_min0.011245982213453814
complete-iteration_max0.14391367001966995
complete-iteration_mean0.14391367001966995
complete-iteration_median0.14391367001966995
complete-iteration_min0.14391367001966995
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004366950555281205
get_duckie_state_mean0.004366950555281205
get_duckie_state_median0.004366950555281205
get_duckie_state_min0.004366950555281205
get_robot_state_max0.003852389075539329
get_robot_state_mean0.003852389075539329
get_robot_state_median0.003852389075539329
get_robot_state_min0.003852389075539329
get_state_dump_max0.005892314694144509
get_state_dump_mean0.005892314694144509
get_state_dump_median0.005892314694144509
get_state_dump_min0.005892314694144509
get_ui_image_max0.028326760638843883
get_ui_image_mean0.028326760638843883
get_ui_image_median0.028326760638843883
get_ui_image_min0.028326760638843883
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.028326760638843883, "step_physics": 0.0766528844833374, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005892314694144509, "get_robot_state": 0.003852389075539329, "sim_render-ego0": 0.0038124214519153943, "get_duckie_state": 0.004366950555281205, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011245982213453814, "complete-iteration": 0.14391367001966995, "set_robot_commands": 0.0024122108112681995, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005254203622991388, "sim_compute_performance-ego0": 0.0020146857608448377}}
set_robot_commands_max0.0024122108112681995
set_robot_commands_mean0.0024122108112681995
set_robot_commands_median0.0024122108112681995
set_robot_commands_min0.0024122108112681995
sim_compute_performance-ego0_max0.0020146857608448377
sim_compute_performance-ego0_mean0.0020146857608448377
sim_compute_performance-ego0_median0.0020146857608448377
sim_compute_performance-ego0_min0.0020146857608448377
sim_compute_sim_state_max0.005254203622991388
sim_compute_sim_state_mean0.005254203622991388
sim_compute_sim_state_median0.005254203622991388
sim_compute_sim_state_min0.005254203622991388
sim_render-ego0_max0.0038124214519153943
sim_render-ego0_mean0.0038124214519153943
sim_render-ego0_median0.0038124214519153943
sim_render-ego0_min0.0038124214519153943
simulation-passed1
step_physics_max0.0766528844833374
step_physics_mean0.0766528844833374
step_physics_median0.0766528844833374
step_physics_min0.0766528844833374
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7979316116Carlos Gavidiaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-050:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.0547167694901676


other stats
agent_compute-ego0_max0.011795192011608705
agent_compute-ego0_mean0.011795192011608705
agent_compute-ego0_median0.011795192011608705
agent_compute-ego0_min0.011795192011608705
complete-iteration_max0.21468247595135875
complete-iteration_mean0.21468247595135875
complete-iteration_median0.21468247595135875
complete-iteration_min0.21468247595135875
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.0547167694901676
distance-from-start_median2.0547167694901676
distance-from-start_min2.0547167694901676
driven_any_max2.0950856032887817
driven_any_mean2.0950856032887817
driven_any_median2.0950856032887817
driven_any_min2.0950856032887817
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0836481757474463
get_duckie_state_mean0.0836481757474463
get_duckie_state_median0.0836481757474463
get_duckie_state_min0.0836481757474463
get_robot_state_max0.003882380280152386
get_robot_state_mean0.003882380280152386
get_robot_state_median0.003882380280152386
get_robot_state_min0.003882380280152386
get_state_dump_max0.017806883049329654
get_state_dump_mean0.017806883049329654
get_state_dump_median0.017806883049329654
get_state_dump_min0.017806883049329654
get_ui_image_max0.011977600135866908
get_ui_image_mean0.011977600135866908
get_ui_image_median0.011977600135866908
get_ui_image_min0.011977600135866908
in-drivable-lane_max29.90000000000029
in-drivable-lane_mean29.90000000000029
in-drivable-lane_median29.90000000000029
in-drivable-lane_min29.90000000000029
per-episodes
details{"d40-ego0": {"driven_any": 2.0950856032887817, "get_ui_image": 0.011977600135866908, "step_physics": 0.06778746495063795, "survival_time": 29.90000000000029, "driven_lanedir": 0.0, "get_state_dump": 0.017806883049329654, "get_robot_state": 0.003882380280152386, "sim_render-ego0": 0.003675796352762213, "get_duckie_state": 0.0836481757474463, "in-drivable-lane": 29.90000000000029, "deviation-heading": 0.0, "agent_compute-ego0": 0.011795192011608705, "complete-iteration": 0.21468247595135875, "set_robot_commands": 0.0024022128625783776, "distance-from-start": 2.0547167694901676, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009668934126330138, "sim_compute_performance-ego0": 0.001940153277975092}}
set_robot_commands_max0.0024022128625783776
set_robot_commands_mean0.0024022128625783776
set_robot_commands_median0.0024022128625783776
set_robot_commands_min0.0024022128625783776
sim_compute_performance-ego0_max0.001940153277975092
sim_compute_performance-ego0_mean0.001940153277975092
sim_compute_performance-ego0_median0.001940153277975092
sim_compute_performance-ego0_min0.001940153277975092
sim_compute_sim_state_max0.009668934126330138
sim_compute_sim_state_mean0.009668934126330138
sim_compute_sim_state_median0.009668934126330138
sim_compute_sim_state_min0.009668934126330138
sim_render-ego0_max0.003675796352762213
sim_render-ego0_mean0.003675796352762213
sim_render-ego0_median0.003675796352762213
sim_render-ego0_min0.003675796352762213
simulation-passed1
step_physics_max0.06778746495063795
step_physics_mean0.06778746495063795
step_physics_median0.06778746495063795
step_physics_min0.06778746495063795
survival_time_max29.90000000000029
survival_time_mean29.90000000000029
survival_time_median29.90000000000029
survival_time_min29.90000000000029
No reset possible
7978516116Carlos Gavidiaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-050:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2261470733553472


other stats
agent_compute-ego0_max0.011616965844517662
agent_compute-ego0_mean0.011616965844517662
agent_compute-ego0_median0.011616965844517662
agent_compute-ego0_min0.011616965844517662
complete-iteration_max0.2105213346935454
complete-iteration_mean0.2105213346935454
complete-iteration_median0.2105213346935454
complete-iteration_min0.2105213346935454
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2261470733553472
distance-from-start_median1.2261470733553472
distance-from-start_min1.2261470733553472
driven_any_max1.253172540515088
driven_any_mean1.253172540515088
driven_any_median1.253172540515088
driven_any_min1.253172540515088
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0818702308904557
get_duckie_state_mean0.0818702308904557
get_duckie_state_median0.0818702308904557
get_duckie_state_min0.0818702308904557
get_robot_state_max0.0038508886382693334
get_robot_state_mean0.0038508886382693334
get_robot_state_median0.0038508886382693334
get_robot_state_min0.0038508886382693334
get_state_dump_max0.017608026663462322
get_state_dump_mean0.017608026663462322
get_state_dump_median0.017608026663462322
get_state_dump_min0.017608026663462322
get_ui_image_max0.011771373805545623
get_ui_image_mean0.011771373805545623
get_ui_image_median0.011771373805545623
get_ui_image_min0.011771373805545623
in-drivable-lane_max16.750000000000103
in-drivable-lane_mean16.750000000000103
in-drivable-lane_median16.750000000000103
in-drivable-lane_min16.750000000000103
per-episodes
details{"d40-ego0": {"driven_any": 1.253172540515088, "get_ui_image": 0.011771373805545623, "step_physics": 0.06539144899163928, "survival_time": 16.750000000000103, "driven_lanedir": 0.0, "get_state_dump": 0.017608026663462322, "get_robot_state": 0.0038508886382693334, "sim_render-ego0": 0.003745817712375096, "get_duckie_state": 0.0818702308904557, "in-drivable-lane": 16.750000000000103, "deviation-heading": 0.0, "agent_compute-ego0": 0.011616965844517662, "complete-iteration": 0.2105213346935454, "set_robot_commands": 0.0024081234421048847, "distance-from-start": 1.2261470733553472, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010207254262197584, "sim_compute_performance-ego0": 0.001951451102892558}}
set_robot_commands_max0.0024081234421048847
set_robot_commands_mean0.0024081234421048847
set_robot_commands_median0.0024081234421048847
set_robot_commands_min0.0024081234421048847
sim_compute_performance-ego0_max0.001951451102892558
sim_compute_performance-ego0_mean0.001951451102892558
sim_compute_performance-ego0_median0.001951451102892558
sim_compute_performance-ego0_min0.001951451102892558
sim_compute_sim_state_max0.010207254262197584
sim_compute_sim_state_mean0.010207254262197584
sim_compute_sim_state_median0.010207254262197584
sim_compute_sim_state_min0.010207254262197584
sim_render-ego0_max0.003745817712375096
sim_render-ego0_mean0.003745817712375096
sim_render-ego0_median0.003745817712375096
sim_render-ego0_min0.003745817712375096
simulation-passed1
step_physics_max0.06539144899163928
step_physics_mean0.06539144899163928
step_physics_median0.06539144899163928
step_physics_min0.06539144899163928
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_median16.750000000000103
survival_time_min16.750000000000103
No reset possible
7978016124Maximilian van Amerongentemplate-randomaido-hello-sim-validation370successnogpu-production-spot-0-050:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011936946348710491
agent_compute-ego0_mean0.011936946348710491
agent_compute-ego0_median0.011936946348710491
agent_compute-ego0_min0.011936946348710491
complete-iteration_max0.1552990566600453
complete-iteration_mean0.1552990566600453
complete-iteration_median0.1552990566600453
complete-iteration_min0.1552990566600453
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.00497171011838046
get_duckie_state_mean0.00497171011838046
get_duckie_state_median0.00497171011838046
get_duckie_state_min0.00497171011838046
get_robot_state_max0.004176036878065629
get_robot_state_mean0.004176036878065629
get_robot_state_median0.004176036878065629
get_robot_state_min0.004176036878065629
get_state_dump_max0.006241982633417303
get_state_dump_mean0.006241982633417303
get_state_dump_median0.006241982633417303
get_state_dump_min0.006241982633417303
get_ui_image_max0.02892161499370228
get_ui_image_mean0.02892161499370228
get_ui_image_median0.02892161499370228
get_ui_image_min0.02892161499370228
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02892161499370228, "step_physics": 0.0848237547007474, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.006241982633417303, "get_robot_state": 0.004176036878065629, "sim_render-ego0": 0.004113831303336404, "get_duckie_state": 0.00497171011838046, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011936946348710491, "complete-iteration": 0.1552990566600453, "set_robot_commands": 0.002413066950711337, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005450059067119251, "sim_compute_performance-ego0": 0.002152746373956854}}
set_robot_commands_max0.002413066950711337
set_robot_commands_mean0.002413066950711337
set_robot_commands_median0.002413066950711337
set_robot_commands_min0.002413066950711337
sim_compute_performance-ego0_max0.002152746373956854
sim_compute_performance-ego0_mean0.002152746373956854
sim_compute_performance-ego0_median0.002152746373956854
sim_compute_performance-ego0_min0.002152746373956854
sim_compute_sim_state_max0.005450059067119251
sim_compute_sim_state_mean0.005450059067119251
sim_compute_sim_state_median0.005450059067119251
sim_compute_sim_state_min0.005450059067119251
sim_render-ego0_max0.004113831303336404
sim_render-ego0_mean0.004113831303336404
sim_render-ego0_median0.004113831303336404
sim_render-ego0_min0.004113831303336404
simulation-passed1
step_physics_max0.0848237547007474
step_physics_mean0.0848237547007474
step_physics_median0.0848237547007474
step_physics_min0.0848237547007474
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7977716124Maximilian van Amerongentemplate-randomaido-hello-sim-validation370successnogpu-production-spot-0-050:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011712491512298584
agent_compute-ego0_mean0.011712491512298584
agent_compute-ego0_median0.011712491512298584
agent_compute-ego0_min0.011712491512298584
complete-iteration_max0.142876690084284
complete-iteration_mean0.142876690084284
complete-iteration_median0.142876690084284
complete-iteration_min0.142876690084284
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004542069001631303
get_duckie_state_mean0.004542069001631303
get_duckie_state_median0.004542069001631303
get_duckie_state_min0.004542069001631303
get_robot_state_max0.0039584582502191715
get_robot_state_mean0.0039584582502191715
get_robot_state_median0.0039584582502191715
get_robot_state_min0.0039584582502191715
get_state_dump_max0.005854915488849987
get_state_dump_mean0.005854915488849987
get_state_dump_median0.005854915488849987
get_state_dump_min0.005854915488849987
get_ui_image_max0.028622486374594948
get_ui_image_mean0.028622486374594948
get_ui_image_median0.028622486374594948
get_ui_image_min0.028622486374594948
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.028622486374594948, "step_physics": 0.07432498173280196, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005854915488849987, "get_robot_state": 0.0039584582502191715, "sim_render-ego0": 0.004023535685105758, "get_duckie_state": 0.004542069001631303, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011712491512298584, "complete-iteration": 0.142876690084284, "set_robot_commands": 0.0022714408961209383, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005391408096660267, "sim_compute_performance-ego0": 0.0020899935202165084}}
set_robot_commands_max0.0022714408961209383
set_robot_commands_mean0.0022714408961209383
set_robot_commands_median0.0022714408961209383
set_robot_commands_min0.0022714408961209383
sim_compute_performance-ego0_max0.0020899935202165084
sim_compute_performance-ego0_mean0.0020899935202165084
sim_compute_performance-ego0_median0.0020899935202165084
sim_compute_performance-ego0_min0.0020899935202165084
sim_compute_sim_state_max0.005391408096660267
sim_compute_sim_state_mean0.005391408096660267
sim_compute_sim_state_median0.005391408096660267
sim_compute_sim_state_min0.005391408096660267
sim_render-ego0_max0.004023535685105758
sim_render-ego0_mean0.004023535685105758
sim_render-ego0_median0.004023535685105758
sim_render-ego0_min0.004023535685105758
simulation-passed1
step_physics_max0.07432498173280196
step_physics_mean0.07432498173280196
step_physics_median0.07432498173280196
step_physics_min0.07432498173280196
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7976416128Denis Medvedevbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-050:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median30.14999999999936
deviation-center-line_median0.18314150160327003
driven_lanedir_consec_median0.05669855692985032
survival_time_median32.699999999999356


other stats
agent_compute-ego0_max0.006733957780610531
agent_compute-ego0_mean0.006661255148438797
agent_compute-ego0_median0.006661255148438797
agent_compute-ego0_min0.006588552516267063
complete-iteration_max0.11346429611225112
complete-iteration_mean0.11115434067341944
complete-iteration_median0.11115434067341944
complete-iteration_min0.10884438523458778
deviation-center-line_max0.2493434723904528
deviation-center-line_mean0.18314150160327003
deviation-center-line_min0.11693953081608728
deviation-heading_max3.8108526384074657
deviation-heading_mean2.553493933520432
deviation-heading_median2.553493933520432
deviation-heading_min1.2961352286333987
distance-from-start_max1.3740174336587985
distance-from-start_mean0.8957330613023821
distance-from-start_median0.8957330613023821
distance-from-start_min0.4174486889459657
driven_any_max6.248355452016018
driven_any_mean3.34743430724601
driven_any_median3.34743430724601
driven_any_min0.4465131624760028
driven_lanedir_consec_max0.06735590482632314
driven_lanedir_consec_mean0.05669855692985032
driven_lanedir_consec_min0.046041209033377495
driven_lanedir_max0.07764153280446662
driven_lanedir_mean0.07249871881539488
driven_lanedir_median0.07249871881539488
driven_lanedir_min0.06735590482632314
get_duckie_state_max1.2321932726756024e-06
get_duckie_state_mean1.1793331878850703e-06
get_duckie_state_median1.1793331878850703e-06
get_duckie_state_min1.1264731030945385e-06
get_robot_state_max0.004544339048753091
get_robot_state_mean0.0041392493385854785
get_robot_state_median0.0041392493385854785
get_robot_state_min0.003734159628417867
get_state_dump_max0.0046791374136548524
get_state_dump_mean0.004657763570228612
get_state_dump_median0.004657763570228612
get_state_dump_min0.004636389726802372
get_ui_image_max0.022424672267319857
get_ui_image_mean0.0223864965397901
get_ui_image_median0.0223864965397901
get_ui_image_min0.02234832081226034
in-drivable-lane_max58.299999999998725
in-drivable-lane_mean30.14999999999936
in-drivable-lane_min1.999999999999996
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 0.4465131624760028, "get_ui_image": 0.02234832081226034, "step_physics": 0.05898309847630493, "survival_time": 5.399999999999989, "driven_lanedir": 0.07764153280446662, "get_state_dump": 0.0046791374136548524, "get_robot_state": 0.004544339048753091, "sim_render-ego0": 0.0035765739755892973, "get_duckie_state": 1.1264731030945385e-06, "in-drivable-lane": 1.999999999999996, "deviation-heading": 3.8108526384074657, "agent_compute-ego0": 0.006733957780610531, "complete-iteration": 0.10884438523458778, "set_robot_commands": 0.0026100775517454936, "distance-from-start": 0.4174486889459657, "deviation-center-line": 0.2493434723904528, "driven_lanedir_consec": 0.046041209033377495, "sim_compute_sim_state": 0.0033554352751565637, "sim_compute_performance-ego0": 0.0019346158438866292}, "LF-small-loop-001-ego0": {"driven_any": 6.248355452016018, "get_ui_image": 0.022424672267319857, "step_physics": 0.0637934039177049, "survival_time": 59.99999999999873, "driven_lanedir": 0.06735590482632314, "get_state_dump": 0.004636389726802372, "get_robot_state": 0.003734159628417867, "sim_render-ego0": 0.003675818741073418, "get_duckie_state": 1.2321932726756024e-06, "in-drivable-lane": 58.299999999998725, "deviation-heading": 1.2961352286333987, "agent_compute-ego0": 0.006588552516267063, "complete-iteration": 0.11346429611225112, "set_robot_commands": 0.0026985161707462815, "distance-from-start": 1.3740174336587985, "deviation-center-line": 0.11693953081608728, "driven_lanedir_consec": 0.06735590482632314, "sim_compute_sim_state": 0.0038646011924267218, "sim_compute_performance-ego0": 0.001967975241655513}}
set_robot_commands_max0.0026985161707462815
set_robot_commands_mean0.0026542968612458875
set_robot_commands_median0.0026542968612458875
set_robot_commands_min0.0026100775517454936
sim_compute_performance-ego0_max0.001967975241655513
sim_compute_performance-ego0_mean0.0019512955427710712
sim_compute_performance-ego0_median0.0019512955427710712
sim_compute_performance-ego0_min0.0019346158438866292
sim_compute_sim_state_max0.0038646011924267218
sim_compute_sim_state_mean0.0036100182337916423
sim_compute_sim_state_median0.0036100182337916423
sim_compute_sim_state_min0.0033554352751565637
sim_render-ego0_max0.003675818741073418
sim_render-ego0_mean0.0036261963583313576
sim_render-ego0_median0.0036261963583313576
sim_render-ego0_min0.0035765739755892973
simulation-passed1
step_physics_max0.0637934039177049
step_physics_mean0.06138825119700491
step_physics_median0.06138825119700491
step_physics_min0.05898309847630493
survival_time_max59.99999999999873
survival_time_mean32.699999999999356
survival_time_min5.399999999999989
No reset possible