Duckietown Challenges Home Challenges Submissions

Evaluator 5403

ID5403
evaluatornogpu-production-b-spot-0-04
ownerI don't have one 😀
machinenogpu-production-b-spot-0_d233c157f675
processnogpu-production-b-spot-0-04_d233c157f675
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success14 80225
# timeout
# failed
# error
# aborted4 80347
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)184.7 GB
RAM free (MB)181.8 GB
Disk (MB)969.3 GB
Disk available (MB)956.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8037716195Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-040:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.9152751613295105


other stats
agent_compute-ego0_max0.010468658916452989
agent_compute-ego0_mean0.010468658916452989
agent_compute-ego0_median0.010468658916452989
agent_compute-ego0_min0.010468658916452989
complete-iteration_max0.2567003831506413
complete-iteration_mean0.2567003831506413
complete-iteration_median0.2567003831506413
complete-iteration_min0.2567003831506413
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.9152751613295105
distance-from-start_median2.9152751613295105
distance-from-start_min2.9152751613295105
driven_any_max2.9951636385957836
driven_any_mean2.9951636385957836
driven_any_median2.9951636385957836
driven_any_min2.9951636385957836
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10206031799316406
get_duckie_state_mean0.10206031799316406
get_duckie_state_median0.10206031799316406
get_duckie_state_min0.10206031799316406
get_robot_state_max0.0036886771094990288
get_robot_state_mean0.0036886771094990288
get_robot_state_median0.0036886771094990288
get_robot_state_min0.0036886771094990288
get_state_dump_max0.018054776013216232
get_state_dump_mean0.018054776013216232
get_state_dump_median0.018054776013216232
get_state_dump_min0.018054776013216232
get_ui_image_max0.03870275441338034
get_ui_image_mean0.03870275441338034
get_ui_image_median0.03870275441338034
get_ui_image_min0.03870275441338034
in-drivable-lane_max9.299999999999995
in-drivable-lane_mean9.299999999999995
in-drivable-lane_median9.299999999999995
in-drivable-lane_min9.299999999999995
per-episodes
details{"d50-ego0": {"driven_any": 2.9951636385957836, "get_ui_image": 0.03870275441338034, "step_physics": 0.06781288519262631, "survival_time": 9.299999999999995, "driven_lanedir": 0.0, "get_state_dump": 0.018054776013216232, "get_robot_state": 0.0036886771094990288, "sim_render-ego0": 0.0034934250428714855, "get_duckie_state": 0.10206031799316406, "in-drivable-lane": 9.299999999999995, "deviation-heading": 0.0, "agent_compute-ego0": 0.010468658916452989, "complete-iteration": 0.2567003831506413, "set_robot_commands": 0.0021737833074069917, "distance-from-start": 2.9152751613295105, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00813486231839593, "sim_compute_performance-ego0": 0.002005591112024644}}
set_robot_commands_max0.0021737833074069917
set_robot_commands_mean0.0021737833074069917
set_robot_commands_median0.0021737833074069917
set_robot_commands_min0.0021737833074069917
sim_compute_performance-ego0_max0.002005591112024644
sim_compute_performance-ego0_mean0.002005591112024644
sim_compute_performance-ego0_median0.002005591112024644
sim_compute_performance-ego0_min0.002005591112024644
sim_compute_sim_state_max0.00813486231839593
sim_compute_sim_state_mean0.00813486231839593
sim_compute_sim_state_median0.00813486231839593
sim_compute_sim_state_min0.00813486231839593
sim_render-ego0_max0.0034934250428714855
sim_render-ego0_mean0.0034934250428714855
sim_render-ego0_median0.0034934250428714855
sim_render-ego0_min0.0034934250428714855
simulation-passed1
step_physics_max0.06781288519262631
step_physics_mean0.06781288519262631
step_physics_median0.06781288519262631
step_physics_min0.06781288519262631
survival_time_max9.299999999999995
survival_time_mean9.299999999999995
survival_time_median9.299999999999995
survival_time_min9.299999999999995
No reset possible
8037116195Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-040:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.4807020671156153


other stats
agent_compute-ego0_max0.010638751262842222
agent_compute-ego0_mean0.010638751262842222
agent_compute-ego0_median0.010638751262842222
agent_compute-ego0_min0.010638751262842222
complete-iteration_max0.25818925680116167
complete-iteration_mean0.25818925680116167
complete-iteration_median0.25818925680116167
complete-iteration_min0.25818925680116167
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.4807020671156153
distance-from-start_median2.4807020671156153
distance-from-start_min2.4807020671156153
driven_any_max2.6220893074028093
driven_any_mean2.6220893074028093
driven_any_median2.6220893074028093
driven_any_min2.6220893074028093
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09274682749149411
get_duckie_state_mean0.09274682749149411
get_duckie_state_median0.09274682749149411
get_duckie_state_min0.09274682749149411
get_robot_state_max0.00374056433522424
get_robot_state_mean0.00374056433522424
get_robot_state_median0.00374056433522424
get_robot_state_min0.00374056433522424
get_state_dump_max0.0183440834976906
get_state_dump_mean0.0183440834976906
get_state_dump_median0.0183440834976906
get_state_dump_min0.0183440834976906
get_ui_image_max0.04061086233272109
get_ui_image_mean0.04061086233272109
get_ui_image_median0.04061086233272109
get_ui_image_min0.04061086233272109
in-drivable-lane_max8.549999999999986
in-drivable-lane_mean8.549999999999986
in-drivable-lane_median8.549999999999986
in-drivable-lane_min8.549999999999986
per-episodes
details{"d50-ego0": {"driven_any": 2.6220893074028093, "get_ui_image": 0.04061086233272109, "step_physics": 0.07604610365490581, "survival_time": 8.549999999999986, "driven_lanedir": 0.0, "get_state_dump": 0.0183440834976906, "get_robot_state": 0.00374056433522424, "sim_render-ego0": 0.0033819606137830156, "get_duckie_state": 0.09274682749149411, "in-drivable-lane": 8.549999999999986, "deviation-heading": 0.0, "agent_compute-ego0": 0.010638751262842222, "complete-iteration": 0.25818925680116167, "set_robot_commands": 0.0020341568214948787, "distance-from-start": 2.4807020671156153, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008772001710048941, "sim_compute_performance-ego0": 0.0017781021983124489}}
set_robot_commands_max0.0020341568214948787
set_robot_commands_mean0.0020341568214948787
set_robot_commands_median0.0020341568214948787
set_robot_commands_min0.0020341568214948787
sim_compute_performance-ego0_max0.0017781021983124489
sim_compute_performance-ego0_mean0.0017781021983124489
sim_compute_performance-ego0_median0.0017781021983124489
sim_compute_performance-ego0_min0.0017781021983124489
sim_compute_sim_state_max0.008772001710048941
sim_compute_sim_state_mean0.008772001710048941
sim_compute_sim_state_median0.008772001710048941
sim_compute_sim_state_min0.008772001710048941
sim_render-ego0_max0.0033819606137830156
sim_render-ego0_mean0.0033819606137830156
sim_render-ego0_median0.0033819606137830156
sim_render-ego0_min0.0033819606137830156
simulation-passed1
step_physics_max0.07604610365490581
step_physics_mean0.07604610365490581
step_physics_median0.07604610365490581
step_physics_min0.07604610365490581
survival_time_max8.549999999999986
survival_time_mean8.549999999999986
survival_time_median8.549999999999986
survival_time_min8.549999999999986
No reset possible
8035516193Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-040:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6357775829750003


other stats
agent_compute-ego0_max0.010140035155270243
agent_compute-ego0_mean0.010140035155270243
agent_compute-ego0_median0.010140035155270243
agent_compute-ego0_min0.010140035155270243
complete-iteration_max0.2632527436427639
complete-iteration_mean0.2632527436427639
complete-iteration_median0.2632527436427639
complete-iteration_min0.2632527436427639
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6357775829750003
distance-from-start_median2.6357775829750003
distance-from-start_min2.6357775829750003
driven_any_max2.9642923088166553
driven_any_mean2.9642923088166553
driven_any_median2.9642923088166553
driven_any_min2.9642923088166553
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10455474416934636
get_duckie_state_mean0.10455474416934636
get_duckie_state_median0.10455474416934636
get_duckie_state_min0.10455474416934636
get_robot_state_max0.0032870905577923825
get_robot_state_mean0.0032870905577923825
get_robot_state_median0.0032870905577923825
get_robot_state_min0.0032870905577923825
get_state_dump_max0.01945852921493839
get_state_dump_mean0.01945852921493839
get_state_dump_median0.01945852921493839
get_state_dump_min0.01945852921493839
get_ui_image_max0.04101890474380693
get_ui_image_mean0.04101890474380693
get_ui_image_median0.04101890474380693
get_ui_image_min0.04101890474380693
in-drivable-lane_max41.99999999999975
in-drivable-lane_mean41.99999999999975
in-drivable-lane_median41.99999999999975
in-drivable-lane_min41.99999999999975
per-episodes
details{"d60-ego0": {"driven_any": 2.9642923088166553, "get_ui_image": 0.04101890474380693, "step_physics": 0.0695131304147836, "survival_time": 41.99999999999975, "driven_lanedir": 0.0, "get_state_dump": 0.01945852921493839, "get_robot_state": 0.0032870905577923825, "sim_render-ego0": 0.0030970202047958103, "get_duckie_state": 0.10455474416934636, "in-drivable-lane": 41.99999999999975, "deviation-heading": 0.0, "agent_compute-ego0": 0.010140035155270243, "complete-iteration": 0.2632527436427639, "set_robot_commands": 0.001929585913840712, "distance-from-start": 2.6357775829750003, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008548577815542323, "sim_compute_performance-ego0": 0.0016172691984777643}}
set_robot_commands_max0.001929585913840712
set_robot_commands_mean0.001929585913840712
set_robot_commands_median0.001929585913840712
set_robot_commands_min0.001929585913840712
sim_compute_performance-ego0_max0.0016172691984777643
sim_compute_performance-ego0_mean0.0016172691984777643
sim_compute_performance-ego0_median0.0016172691984777643
sim_compute_performance-ego0_min0.0016172691984777643
sim_compute_sim_state_max0.008548577815542323
sim_compute_sim_state_mean0.008548577815542323
sim_compute_sim_state_median0.008548577815542323
sim_compute_sim_state_min0.008548577815542323
sim_render-ego0_max0.0030970202047958103
sim_render-ego0_mean0.0030970202047958103
sim_render-ego0_median0.0030970202047958103
sim_render-ego0_min0.0030970202047958103
simulation-passed1
step_physics_max0.0695131304147836
step_physics_mean0.0695131304147836
step_physics_median0.0695131304147836
step_physics_min0.0695131304147836
survival_time_max41.99999999999975
survival_time_mean41.99999999999975
survival_time_median41.99999999999975
survival_time_min41.99999999999975
No reset possible
8035313798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8035213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8035013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8034713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:58
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8032816192Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-040:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.515843544385863


other stats
agent_compute-ego0_max0.009888865667230944
agent_compute-ego0_mean0.009888865667230944
agent_compute-ego0_median0.009888865667230944
agent_compute-ego0_min0.009888865667230944
complete-iteration_max0.19152102330151727
complete-iteration_mean0.19152102330151727
complete-iteration_median0.19152102330151727
complete-iteration_min0.19152102330151727
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.515843544385863
distance-from-start_median4.515843544385863
distance-from-start_min4.515843544385863
driven_any_max4.687255110404271
driven_any_mean4.687255110404271
driven_any_median4.687255110404271
driven_any_min4.687255110404271
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0588172246428097
get_duckie_state_mean0.0588172246428097
get_duckie_state_median0.0588172246428097
get_duckie_state_min0.0588172246428097
get_robot_state_max0.0033337084686054902
get_robot_state_mean0.0033337084686054902
get_robot_state_median0.0033337084686054902
get_robot_state_min0.0033337084686054902
get_state_dump_max0.011723342011956609
get_state_dump_mean0.011723342011956609
get_state_dump_median0.011723342011956609
get_state_dump_min0.011723342011956609
get_ui_image_max0.032079147240694834
get_ui_image_mean0.032079147240694834
get_ui_image_median0.032079147240694834
get_ui_image_min0.032079147240694834
in-drivable-lane_max33.95000000000021
in-drivable-lane_mean33.95000000000021
in-drivable-lane_median33.95000000000021
in-drivable-lane_min33.95000000000021
per-episodes
details{"d30-ego0": {"driven_any": 4.687255110404271, "get_ui_image": 0.032079147240694834, "step_physics": 0.06214194543221418, "survival_time": 33.95000000000021, "driven_lanedir": 0.0, "get_state_dump": 0.011723342011956609, "get_robot_state": 0.0033337084686054902, "sim_render-ego0": 0.0032592219464919144, "get_duckie_state": 0.0588172246428097, "in-drivable-lane": 33.95000000000021, "deviation-heading": 0.0, "agent_compute-ego0": 0.009888865667230944, "complete-iteration": 0.19152102330151727, "set_robot_commands": 0.00195236977408914, "distance-from-start": 4.515843544385863, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006447174268610337, "sim_compute_performance-ego0": 0.0017908681841457591}}
set_robot_commands_max0.00195236977408914
set_robot_commands_mean0.00195236977408914
set_robot_commands_median0.00195236977408914
set_robot_commands_min0.00195236977408914
sim_compute_performance-ego0_max0.0017908681841457591
sim_compute_performance-ego0_mean0.0017908681841457591
sim_compute_performance-ego0_median0.0017908681841457591
sim_compute_performance-ego0_min0.0017908681841457591
sim_compute_sim_state_max0.006447174268610337
sim_compute_sim_state_mean0.006447174268610337
sim_compute_sim_state_median0.006447174268610337
sim_compute_sim_state_min0.006447174268610337
sim_render-ego0_max0.0032592219464919144
sim_render-ego0_mean0.0032592219464919144
sim_render-ego0_median0.0032592219464919144
sim_render-ego0_min0.0032592219464919144
simulation-passed1
step_physics_max0.06214194543221418
step_physics_mean0.06214194543221418
step_physics_median0.06214194543221418
step_physics_min0.06214194543221418
survival_time_max33.95000000000021
survival_time_mean33.95000000000021
survival_time_median33.95000000000021
survival_time_min33.95000000000021
No reset possible
8028816014Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-040:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.105


other stats
nsamples400
No reset possible
8028315874Bea Baselines 🐤collision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.54
false_positive_rate0.53


other stats
nsamples400
No reset possible
8027515875Bea Baselines 🐤collision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-040:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.56
false_positive_rate0.51


other stats
nsamples200
No reset possible
8026715873Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnonogpu-production-b-spot-0-040:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.52
false_positive_rate0.53


other stats
nsamples200
No reset possible
8025915874Bea Baselines 🐤collision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.53
false_positive_rate0.525


other stats
nsamples400
No reset possible
8025215893Shengjie Hu 🇨🇭All truemooc-collision-check-valistep1successnonogpu-production-b-spot-0-040:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples400
No reset possible
8023916025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-040:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.075
false_positive_rate0.02


other stats
nsamples400
No reset possible
8023815873Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnonogpu-production-b-spot-0-040:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.52


other stats
nsamples200
No reset possible
8023615873Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnonogpu-production-b-spot-0-040:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.5
false_positive_rate0.5


other stats
nsamples200
No reset possible
8022516083Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-040:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible