Duckietown Challenges Home Challenges Submissions

Evaluator 5095

ID5095
evaluatorgpu-production-spot-3-04
ownerI don't have one 😀
machinegpu-prod_99c8c49278a2
processgpu-production-spot-3-04_99c8c49278a2
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success6 65879
# timeout
# failed
# error
# aborted2 66330
# host-error1 66044
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)238.9 GB
Disk (MB)969.3 GB
Disk available (MB)862.2 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6633213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-3-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6633013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-3-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6632113910YU CHENCBC Net v2 - testaido-LFP-sim-validationsim-2of4successnogpu-production-spot-3-040:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.399999999999982
in-drivable-lane_median3.2499999999999902
driven_lanedir_consec_median1.2760353207262332
deviation-center-line_median0.3100918720863112


other stats
agent_compute-ego0_max0.09521936410225476
agent_compute-ego0_mean0.09521936410225476
agent_compute-ego0_median0.09521936410225476
agent_compute-ego0_min0.09521936410225476
complete-iteration_max0.32653783951829746
complete-iteration_mean0.32653783951829746
complete-iteration_median0.32653783951829746
complete-iteration_min0.32653783951829746
deviation-center-line_max0.3100918720863112
deviation-center-line_mean0.3100918720863112
deviation-center-line_min0.3100918720863112
deviation-heading_max1.5375345494455095
deviation-heading_mean1.5375345494455095
deviation-heading_median1.5375345494455095
deviation-heading_min1.5375345494455095
driven_any_max2.4948892820154236
driven_any_mean2.4948892820154236
driven_any_median2.4948892820154236
driven_any_min2.4948892820154236
driven_lanedir_consec_max1.2760353207262332
driven_lanedir_consec_mean1.2760353207262332
driven_lanedir_consec_min1.2760353207262332
driven_lanedir_max1.2760353207262332
driven_lanedir_mean1.2760353207262332
driven_lanedir_median1.2760353207262332
driven_lanedir_min1.2760353207262332
get_duckie_state_max0.026603285898298225
get_duckie_state_mean0.026603285898298225
get_duckie_state_median0.026603285898298225
get_duckie_state_min0.026603285898298225
get_robot_state_max0.004044353561913407
get_robot_state_mean0.004044353561913407
get_robot_state_median0.004044353561913407
get_robot_state_min0.004044353561913407
get_state_dump_max0.00938624823653458
get_state_dump_mean0.00938624823653458
get_state_dump_median0.00938624823653458
get_state_dump_min0.00938624823653458
get_ui_image_max0.03440790688431503
get_ui_image_mean0.03440790688431503
get_ui_image_median0.03440790688431503
get_ui_image_min0.03440790688431503
in-drivable-lane_max3.2499999999999902
in-drivable-lane_mean3.2499999999999902
in-drivable-lane_min3.2499999999999902
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.4948892820154236, "get_ui_image": 0.03440790688431503, "step_physics": 0.13939968851588716, "survival_time": 7.399999999999982, "driven_lanedir": 1.2760353207262332, "get_state_dump": 0.00938624823653458, "get_robot_state": 0.004044353561913407, "sim_render-ego0": 0.0040579242194258925, "get_duckie_state": 0.026603285898298225, "in-drivable-lane": 3.2499999999999902, "deviation-heading": 1.5375345494455095, "agent_compute-ego0": 0.09521936410225476, "complete-iteration": 0.32653783951829746, "set_robot_commands": 0.0028485627782424824, "deviation-center-line": 0.3100918720863112, "driven_lanedir_consec": 1.2760353207262332, "sim_compute_sim_state": 0.00834856097330183, "sim_compute_performance-ego0": 0.0021083386952445013}}
set_robot_commands_max0.0028485627782424824
set_robot_commands_mean0.0028485627782424824
set_robot_commands_median0.0028485627782424824
set_robot_commands_min0.0028485627782424824
sim_compute_performance-ego0_max0.0021083386952445013
sim_compute_performance-ego0_mean0.0021083386952445013
sim_compute_performance-ego0_median0.0021083386952445013
sim_compute_performance-ego0_min0.0021083386952445013
sim_compute_sim_state_max0.00834856097330183
sim_compute_sim_state_mean0.00834856097330183
sim_compute_sim_state_median0.00834856097330183
sim_compute_sim_state_min0.00834856097330183
sim_render-ego0_max0.0040579242194258925
sim_render-ego0_mean0.0040579242194258925
sim_render-ego0_median0.0040579242194258925
sim_render-ego0_min0.0040579242194258925
simulation-passed1
step_physics_max0.13939968851588716
step_physics_mean0.13939968851588716
step_physics_median0.13939968851588716
step_physics_min0.13939968851588716
survival_time_max7.399999999999982
survival_time_mean7.399999999999982
survival_time_min7.399999999999982
No reset possible
6627913692Samuel Alexandertemplate-pytorchaido-LF-sim-validationsim-2of4successnogpu-production-spot-3-040:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0955084548718832
survival_time_median59.99999999999873
deviation-center-line_median1.2188088471226326
in-drivable-lane_median46.19999999999861


other stats
agent_compute-ego0_max0.015492554806749787
agent_compute-ego0_mean0.015492554806749787
agent_compute-ego0_median0.015492554806749787
agent_compute-ego0_min0.015492554806749787
complete-iteration_max0.25067050808375324
complete-iteration_mean0.25067050808375324
complete-iteration_median0.25067050808375324
complete-iteration_min0.25067050808375324
deviation-center-line_max1.2188088471226326
deviation-center-line_mean1.2188088471226326
deviation-center-line_min1.2188088471226326
deviation-heading_max9.491394627491768
deviation-heading_mean9.491394627491768
deviation-heading_median9.491394627491768
deviation-heading_min9.491394627491768
driven_any_max6.435535778187721
driven_any_mean6.435535778187721
driven_any_median6.435535778187721
driven_any_min6.435535778187721
driven_lanedir_consec_max1.0955084548718832
driven_lanedir_consec_mean1.0955084548718832
driven_lanedir_consec_min1.0955084548718832
driven_lanedir_max1.0955084548718832
driven_lanedir_mean1.0955084548718832
driven_lanedir_median1.0955084548718832
driven_lanedir_min1.0955084548718832
get_duckie_state_max1.3129895771671397e-06
get_duckie_state_mean1.3129895771671397e-06
get_duckie_state_median1.3129895771671397e-06
get_duckie_state_min1.3129895771671397e-06
get_robot_state_max0.004135747436282041
get_robot_state_mean0.004135747436282041
get_robot_state_median0.004135747436282041
get_robot_state_min0.004135747436282041
get_state_dump_max0.005184429273517999
get_state_dump_mean0.005184429273517999
get_state_dump_median0.005184429273517999
get_state_dump_min0.005184429273517999
get_ui_image_max0.02936150608809167
get_ui_image_mean0.02936150608809167
get_ui_image_median0.02936150608809167
get_ui_image_min0.02936150608809167
in-drivable-lane_max46.19999999999861
in-drivable-lane_mean46.19999999999861
in-drivable-lane_min46.19999999999861
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 6.435535778187721, "get_ui_image": 0.02936150608809167, "step_physics": 0.18053992801065943, "survival_time": 59.99999999999873, "driven_lanedir": 1.0955084548718832, "get_state_dump": 0.005184429273517999, "get_robot_state": 0.004135747436282041, "sim_render-ego0": 0.004209270286718872, "get_duckie_state": 1.3129895771671397e-06, "in-drivable-lane": 46.19999999999861, "deviation-heading": 9.491394627491768, "agent_compute-ego0": 0.015492554806749787, "complete-iteration": 0.25067050808375324, "set_robot_commands": 0.002594658377565611, "deviation-center-line": 1.2188088471226326, "driven_lanedir_consec": 1.0955084548718832, "sim_compute_sim_state": 0.006841448324109791, "sim_compute_performance-ego0": 0.0022253680487258746}}
set_robot_commands_max0.002594658377565611
set_robot_commands_mean0.002594658377565611
set_robot_commands_median0.002594658377565611
set_robot_commands_min0.002594658377565611
sim_compute_performance-ego0_max0.0022253680487258746
sim_compute_performance-ego0_mean0.0022253680487258746
sim_compute_performance-ego0_median0.0022253680487258746
sim_compute_performance-ego0_min0.0022253680487258746
sim_compute_sim_state_max0.006841448324109791
sim_compute_sim_state_mean0.006841448324109791
sim_compute_sim_state_median0.006841448324109791
sim_compute_sim_state_min0.006841448324109791
sim_render-ego0_max0.004209270286718872
sim_render-ego0_mean0.004209270286718872
sim_render-ego0_median0.004209270286718872
sim_render-ego0_min0.004209270286718872
simulation-passed1
step_physics_max0.18053992801065943
step_physics_mean0.18053992801065943
step_physics_median0.18053992801065943
step_physics_min0.18053992801065943
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6626513694Samuel Alexandertemplate-tensorflowaido-LF-sim-validationsim-0of4successnogpu-production-spot-3-040:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3821741977999218
survival_time_median3.4999999999999956
deviation-center-line_median0.13653642291573528
in-drivable-lane_median1.999999999999995


other stats
agent_compute-ego0_max0.04704333359087017
agent_compute-ego0_mean0.04704333359087017
agent_compute-ego0_median0.04704333359087017
agent_compute-ego0_min0.04704333359087017
complete-iteration_max0.24237976611500056
complete-iteration_mean0.24237976611500056
complete-iteration_median0.24237976611500056
complete-iteration_min0.24237976611500056
deviation-center-line_max0.13653642291573528
deviation-center-line_mean0.13653642291573528
deviation-center-line_min0.13653642291573528
deviation-heading_max0.7476866687954493
deviation-heading_mean0.7476866687954493
deviation-heading_median0.7476866687954493
deviation-heading_min0.7476866687954493
driven_any_max1.134277242861363
driven_any_mean1.134277242861363
driven_any_median1.134277242861363
driven_any_min1.134277242861363
driven_lanedir_consec_max0.3821741977999218
driven_lanedir_consec_mean0.3821741977999218
driven_lanedir_consec_min0.3821741977999218
driven_lanedir_max0.3821741977999218
driven_lanedir_mean0.3821741977999218
driven_lanedir_median0.3821741977999218
driven_lanedir_min0.3821741977999218
get_duckie_state_max1.534609727456536e-06
get_duckie_state_mean1.534609727456536e-06
get_duckie_state_median1.534609727456536e-06
get_duckie_state_min1.534609727456536e-06
get_robot_state_max0.004253676239873322
get_robot_state_mean0.004253676239873322
get_robot_state_median0.004253676239873322
get_robot_state_min0.004253676239873322
get_state_dump_max0.005715286228018747
get_state_dump_mean0.005715286228018747
get_state_dump_median0.005715286228018747
get_state_dump_min0.005715286228018747
get_ui_image_max0.03361772147702499
get_ui_image_mean0.03361772147702499
get_ui_image_median0.03361772147702499
get_ui_image_min0.03361772147702499
in-drivable-lane_max1.999999999999995
in-drivable-lane_mean1.999999999999995
in-drivable-lane_min1.999999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.134277242861363, "get_ui_image": 0.03361772147702499, "step_physics": 0.13341523895800952, "survival_time": 3.4999999999999956, "driven_lanedir": 0.3821741977999218, "get_state_dump": 0.005715286228018747, "get_robot_state": 0.004253676239873322, "sim_render-ego0": 0.004469032018957004, "get_duckie_state": 1.534609727456536e-06, "in-drivable-lane": 1.999999999999995, "deviation-heading": 0.7476866687954493, "agent_compute-ego0": 0.04704333359087017, "complete-iteration": 0.24237976611500056, "set_robot_commands": 0.002636936348928532, "deviation-center-line": 0.13653642291573528, "driven_lanedir_consec": 0.3821741977999218, "sim_compute_sim_state": 0.00876924689386932, "sim_compute_performance-ego0": 0.002354887169851384}}
set_robot_commands_max0.002636936348928532
set_robot_commands_mean0.002636936348928532
set_robot_commands_median0.002636936348928532
set_robot_commands_min0.002636936348928532
sim_compute_performance-ego0_max0.002354887169851384
sim_compute_performance-ego0_mean0.002354887169851384
sim_compute_performance-ego0_median0.002354887169851384
sim_compute_performance-ego0_min0.002354887169851384
sim_compute_sim_state_max0.00876924689386932
sim_compute_sim_state_mean0.00876924689386932
sim_compute_sim_state_median0.00876924689386932
sim_compute_sim_state_min0.00876924689386932
sim_render-ego0_max0.004469032018957004
sim_render-ego0_mean0.004469032018957004
sim_render-ego0_median0.004469032018957004
sim_render-ego0_min0.004469032018957004
simulation-passed1
step_physics_max0.13341523895800952
step_physics_mean0.13341523895800952
step_physics_median0.13341523895800952
step_physics_min0.13341523895800952
survival_time_max3.4999999999999956
survival_time_mean3.4999999999999956
survival_time_min3.4999999999999956
No reset possible
6604413578Márton Tim 🇭🇺3626aido-LFV_multi-sim-validation403host-errornogpu-production-spot-3-040:55:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1144, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6602113964YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LF-sim-validationsim-0of4successnogpu-production-spot-3-040:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.96274662267339
survival_time_median59.99999999999873
deviation-center-line_median4.36077555899698
in-drivable-lane_median19.599999999999625


other stats
agent_compute-ego0_max0.09727939955896382
agent_compute-ego0_mean0.09727939955896382
agent_compute-ego0_median0.09727939955896382
agent_compute-ego0_min0.09727939955896382
complete-iteration_max0.2991024647823083
complete-iteration_mean0.2991024647823083
complete-iteration_median0.2991024647823083
complete-iteration_min0.2991024647823083
deviation-center-line_max4.36077555899698
deviation-center-line_mean4.36077555899698
deviation-center-line_min4.36077555899698
deviation-heading_max7.465147160964964
deviation-heading_mean7.465147160964964
deviation-heading_median7.465147160964964
deviation-heading_min7.465147160964964
driven_any_max24.402484056104218
driven_any_mean24.402484056104218
driven_any_median24.402484056104218
driven_any_min24.402484056104218
driven_lanedir_consec_max15.96274662267339
driven_lanedir_consec_mean15.96274662267339
driven_lanedir_consec_min15.96274662267339
driven_lanedir_max15.96274662267339
driven_lanedir_mean15.96274662267339
driven_lanedir_median15.96274662267339
driven_lanedir_min15.96274662267339
get_duckie_state_max1.4577082650647572e-06
get_duckie_state_mean1.4577082650647572e-06
get_duckie_state_median1.4577082650647572e-06
get_duckie_state_min1.4577082650647572e-06
get_robot_state_max0.004037071127974918
get_robot_state_mean0.004037071127974918
get_robot_state_median0.004037071127974918
get_robot_state_min0.004037071127974918
get_state_dump_max0.0050854446687468085
get_state_dump_mean0.0050854446687468085
get_state_dump_median0.0050854446687468085
get_state_dump_min0.0050854446687468085
get_ui_image_max0.031640500252094
get_ui_image_mean0.031640500252094
get_ui_image_median0.031640500252094
get_ui_image_min0.031640500252094
in-drivable-lane_max19.599999999999625
in-drivable-lane_mean19.599999999999625
in-drivable-lane_min19.599999999999625
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 24.402484056104218, "get_ui_image": 0.031640500252094, "step_physics": 0.14153867716793217, "survival_time": 59.99999999999873, "driven_lanedir": 15.96274662267339, "get_state_dump": 0.0050854446687468085, "get_robot_state": 0.004037071127974918, "sim_render-ego0": 0.0042137647052291624, "get_duckie_state": 1.4577082650647572e-06, "in-drivable-lane": 19.599999999999625, "deviation-heading": 7.465147160964964, "agent_compute-ego0": 0.09727939955896382, "complete-iteration": 0.2991024647823083, "set_robot_commands": 0.002591333024011464, "deviation-center-line": 4.36077555899698, "driven_lanedir_consec": 15.96274662267339, "sim_compute_sim_state": 0.010373505227869496, "sim_compute_performance-ego0": 0.0022473247918757076}}
set_robot_commands_max0.002591333024011464
set_robot_commands_mean0.002591333024011464
set_robot_commands_median0.002591333024011464
set_robot_commands_min0.002591333024011464
sim_compute_performance-ego0_max0.0022473247918757076
sim_compute_performance-ego0_mean0.0022473247918757076
sim_compute_performance-ego0_median0.0022473247918757076
sim_compute_performance-ego0_min0.0022473247918757076
sim_compute_sim_state_max0.010373505227869496
sim_compute_sim_state_mean0.010373505227869496
sim_compute_sim_state_median0.010373505227869496
sim_compute_sim_state_min0.010373505227869496
sim_render-ego0_max0.0042137647052291624
sim_render-ego0_mean0.0042137647052291624
sim_render-ego0_median0.0042137647052291624
sim_render-ego0_min0.0042137647052291624
simulation-passed1
step_physics_max0.14153867716793217
step_physics_mean0.14153867716793217
step_physics_median0.14153867716793217
step_physics_min0.14153867716793217
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6596514013YU CHENCBC Net v2 test - APR 6 anomaly + mar 28 bcaido-LF-sim-validationsim-0of4successnogpu-production-spot-3-040:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.93627409542607
survival_time_median59.99999999999873
deviation-center-line_median3.040932058921358
in-drivable-lane_median19.24999999999956


other stats
agent_compute-ego0_max0.09036433547859288
agent_compute-ego0_mean0.09036433547859288
agent_compute-ego0_median0.09036433547859288
agent_compute-ego0_min0.09036433547859288
complete-iteration_max0.2902393366871627
complete-iteration_mean0.2902393366871627
complete-iteration_median0.2902393366871627
complete-iteration_min0.2902393366871627
deviation-center-line_max3.040932058921358
deviation-center-line_mean3.040932058921358
deviation-center-line_min3.040932058921358
deviation-heading_max8.419811799453889
deviation-heading_mean8.419811799453889
deviation-heading_median8.419811799453889
deviation-heading_min8.419811799453889
driven_any_max27.10618108471678
driven_any_mean27.10618108471678
driven_any_median27.10618108471678
driven_any_min27.10618108471678
driven_lanedir_consec_max17.93627409542607
driven_lanedir_consec_mean17.93627409542607
driven_lanedir_consec_min17.93627409542607
driven_lanedir_max17.93627409542607
driven_lanedir_mean17.93627409542607
driven_lanedir_median17.93627409542607
driven_lanedir_min17.93627409542607
get_duckie_state_max1.826949361758268e-06
get_duckie_state_mean1.826949361758268e-06
get_duckie_state_median1.826949361758268e-06
get_duckie_state_min1.826949361758268e-06
get_robot_state_max0.003894305646072121
get_robot_state_mean0.003894305646072121
get_robot_state_median0.003894305646072121
get_robot_state_min0.003894305646072121
get_state_dump_max0.00485616480678841
get_state_dump_mean0.00485616480678841
get_state_dump_median0.00485616480678841
get_state_dump_min0.00485616480678841
get_ui_image_max0.030910915975070417
get_ui_image_mean0.030910915975070417
get_ui_image_median0.030910915975070417
get_ui_image_min0.030910915975070417
in-drivable-lane_max19.24999999999956
in-drivable-lane_mean19.24999999999956
in-drivable-lane_min19.24999999999956
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 27.10618108471678, "get_ui_image": 0.030910915975070417, "step_physics": 0.14161197946629456, "survival_time": 59.99999999999873, "driven_lanedir": 17.93627409542607, "get_state_dump": 0.00485616480678841, "get_robot_state": 0.003894305646072121, "sim_render-ego0": 0.004041653886425009, "get_duckie_state": 1.826949361758268e-06, "in-drivable-lane": 19.24999999999956, "deviation-heading": 8.419811799453889, "agent_compute-ego0": 0.09036433547859288, "complete-iteration": 0.2902393366871627, "set_robot_commands": 0.0024777407650149533, "deviation-center-line": 3.040932058921358, "driven_lanedir_consec": 17.93627409542607, "sim_compute_sim_state": 0.00987521774266582, "sim_compute_performance-ego0": 0.0021170980229564353}}
set_robot_commands_max0.0024777407650149533
set_robot_commands_mean0.0024777407650149533
set_robot_commands_median0.0024777407650149533
set_robot_commands_min0.0024777407650149533
sim_compute_performance-ego0_max0.0021170980229564353
sim_compute_performance-ego0_mean0.0021170980229564353
sim_compute_performance-ego0_median0.0021170980229564353
sim_compute_performance-ego0_min0.0021170980229564353
sim_compute_sim_state_max0.00987521774266582
sim_compute_sim_state_mean0.00987521774266582
sim_compute_sim_state_median0.00987521774266582
sim_compute_sim_state_min0.00987521774266582
sim_render-ego0_max0.004041653886425009
sim_render-ego0_mean0.004041653886425009
sim_render-ego0_median0.004041653886425009
sim_render-ego0_min0.004041653886425009
simulation-passed1
step_physics_max0.14161197946629456
step_physics_mean0.14161197946629456
step_physics_median0.14161197946629456
step_physics_min0.14161197946629456
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6587913535András Kalapos 🇭🇺3090aido-LF-sim-validationsim-3of4successnogpu-production-spot-3-040:14:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.28083045831719
survival_time_median59.99999999999873
deviation-center-line_median2.355452757143367
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.014879965960830572
agent_compute-ego0_mean0.014879965960830572
agent_compute-ego0_median0.014879965960830572
agent_compute-ego0_min0.014879965960830572
complete-iteration_max0.2991997991175973
complete-iteration_mean0.2991997991175973
complete-iteration_median0.2991997991175973
complete-iteration_min0.2991997991175973
deviation-center-line_max2.355452757143367
deviation-center-line_mean2.355452757143367
deviation-center-line_min2.355452757143367
deviation-heading_max9.08862765447716
deviation-heading_mean9.08862765447716
deviation-heading_median9.08862765447716
deviation-heading_min9.08862765447716
driven_any_max27.751246933058397
driven_any_mean27.751246933058397
driven_any_median27.751246933058397
driven_any_min27.751246933058397
driven_lanedir_consec_max27.28083045831719
driven_lanedir_consec_mean27.28083045831719
driven_lanedir_consec_min27.28083045831719
driven_lanedir_max27.28083045831719
driven_lanedir_mean27.28083045831719
driven_lanedir_median27.28083045831719
driven_lanedir_min27.28083045831719
get_duckie_state_max1.441231377416606e-06
get_duckie_state_mean1.441231377416606e-06
get_duckie_state_median1.441231377416606e-06
get_duckie_state_min1.441231377416606e-06
get_robot_state_max0.004111081535472759
get_robot_state_mean0.004111081535472759
get_robot_state_median0.004111081535472759
get_robot_state_min0.004111081535472759
get_state_dump_max0.005183151222883315
get_state_dump_mean0.005183151222883315
get_state_dump_median0.005183151222883315
get_state_dump_min0.005183151222883315
get_ui_image_max0.0397768225102103
get_ui_image_mean0.0397768225102103
get_ui_image_median0.0397768225102103
get_ui_image_min0.0397768225102103
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 27.751246933058397, "get_ui_image": 0.0397768225102103, "step_physics": 0.2113289700062646, "survival_time": 59.99999999999873, "driven_lanedir": 27.28083045831719, "get_state_dump": 0.005183151222883315, "get_robot_state": 0.004111081535472759, "sim_render-ego0": 0.004201129513120373, "get_duckie_state": 1.441231377416606e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.08862765447716, "agent_compute-ego0": 0.014879965960830572, "complete-iteration": 0.2991997991175973, "set_robot_commands": 0.0025006341100433883, "deviation-center-line": 2.355452757143367, "driven_lanedir_consec": 27.28083045831719, "sim_compute_sim_state": 0.014879915934617474, "sim_compute_performance-ego0": 0.002240471796231107}}
set_robot_commands_max0.0025006341100433883
set_robot_commands_mean0.0025006341100433883
set_robot_commands_median0.0025006341100433883
set_robot_commands_min0.0025006341100433883
sim_compute_performance-ego0_max0.002240471796231107
sim_compute_performance-ego0_mean0.002240471796231107
sim_compute_performance-ego0_median0.002240471796231107
sim_compute_performance-ego0_min0.002240471796231107
sim_compute_sim_state_max0.014879915934617474
sim_compute_sim_state_mean0.014879915934617474
sim_compute_sim_state_median0.014879915934617474
sim_compute_sim_state_min0.014879915934617474
sim_render-ego0_max0.004201129513120373
sim_render-ego0_mean0.004201129513120373
sim_render-ego0_median0.004201129513120373
sim_render-ego0_min0.004201129513120373
simulation-passed1
step_physics_max0.2113289700062646
step_physics_mean0.2113289700062646
step_physics_median0.2113289700062646
step_physics_min0.2113289700062646
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible