Evaluator 5296

ID	5296
evaluator	`nogpu-production-b-spot-0-01`
owner	I don't have one 😀
machine	nogpu-production-b-spot-0_8883000b6fc0
process	nogpu-production-b-spot-0-01_8883000b6fc0
version	6.2.7
first heard	2021-06-18 15:37:12+00:00
last heard	2021-06-21 12:57:37+00:00
status	inactive
# evaluating
# success	1 `79181`
# timeout
# failed
# error
# aborted	1 `79136`
# host-error
arm	0
x86_64	1
Mac	0
gpu available	0
Number of processors	96
Processor frequency (MHz)	0.0 GHz
Free % of processors	99%
RAM total (MB)	184.7 GB
RAM free (MB)	181.0 GB
Disk (MB)	969.3 GB
Disk available (MB)	965.3 GB
Docker Hub
P1	1
P2
Cloud simulations	1
PI Camera	0
# Duckiebots	0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

79181

15950

Shubhra Aich

exercises_braitenberg

mooc-BV1

sim-4of5

success

nogpu-production-b-spot-0-01

2021-06-21 05:47:40+00:00

2021-06-21 05:51:32+00:00

0:03:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

1.0924946461991134

other stats

agent_compute-ego0_max	0.009809224366100594
agent_compute-ego0_mean	0.009809224366100594
agent_compute-ego0_median	0.009809224366100594
agent_compute-ego0_min	0.009809224366100594
complete-iteration_max	0.2519827784409169
complete-iteration_mean	0.2519827784409169
complete-iteration_median	0.2519827784409169
complete-iteration_min	0.2519827784409169
deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	1.0924946461991134
distance-from-start_median	1.0924946461991134
distance-from-start_min	1.0924946461991134
driven_any_max	1.0948597585370925
driven_any_mean	1.0948597585370925
driven_any_median	1.0948597585370925
driven_any_min	1.0948597585370925
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	0.09803093052326851
get_duckie_state_mean	0.09803093052326851
get_duckie_state_median	0.09803093052326851
get_duckie_state_min	0.09803093052326851
get_robot_state_max	0.0030624127283887573
get_robot_state_mean	0.0030624127283887573
get_robot_state_median	0.0030624127283887573
get_robot_state_min	0.0030624127283887573
get_state_dump_max	0.019058424312474943
get_state_dump_mean	0.019058424312474943
get_state_dump_median	0.019058424312474943
get_state_dump_min	0.019058424312474943
get_ui_image_max	0.039342046304561167
get_ui_image_mean	0.039342046304561167
get_ui_image_median	0.039342046304561167
get_ui_image_min	0.039342046304561167
in-drivable-lane_max	11.400000000000029
in-drivable-lane_mean	11.400000000000029
in-drivable-lane_median	11.400000000000029
in-drivable-lane_min	11.400000000000029
per-episodes	details {"d60-ego0": {"driven_any": 1.0948597585370925, "get_ui_image": 0.039342046304561167, "step_physics": 0.06772759179361001, "survival_time": 11.400000000000029, "driven_lanedir": 0.0, "get_state_dump": 0.019058424312474943, "get_robot_state": 0.0030624127283887573, "sim_render-ego0": 0.0029996628324017254, "get_duckie_state": 0.09803093052326851, "in-drivable-lane": 11.400000000000029, "deviation-heading": 0.0, "agent_compute-ego0": 0.009809224366100594, "complete-iteration": 0.2519827784409169, "set_robot_commands": 0.0017917603905023966, "distance-from-start": 1.0924946461991134, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008526740636367465, "sim_compute_performance-ego0": 0.0015559102770542994}}
set_robot_commands_max	0.0017917603905023966
set_robot_commands_mean	0.0017917603905023966
set_robot_commands_median	0.0017917603905023966
set_robot_commands_min	0.0017917603905023966
sim_compute_performance-ego0_max	0.0015559102770542994
sim_compute_performance-ego0_mean	0.0015559102770542994
sim_compute_performance-ego0_median	0.0015559102770542994
sim_compute_performance-ego0_min	0.0015559102770542994
sim_compute_sim_state_max	0.008526740636367465
sim_compute_sim_state_mean	0.008526740636367465
sim_compute_sim_state_median	0.008526740636367465
sim_compute_sim_state_min	0.008526740636367465
sim_render-ego0_max	0.0029996628324017254
sim_render-ego0_mean	0.0029996628324017254
sim_render-ego0_median	0.0029996628324017254
sim_render-ego0_min	0.0029996628324017254
simulation-passed	1
step_physics_max	0.06772759179361001
step_physics_mean	0.06772759179361001
step_physics_median	0.06772759179361001
step_physics_min	0.06772759179361001
survival_time_max	11.400000000000029
survival_time_mean	11.400000000000029
survival_time_median	11.400000000000029
survival_time_min	11.400000000000029

No reset possible

79136

13798

Nicholas Kostelnik

template-random

aido-hello-sim-validation

370

aborted

nogpu-production-b-spot-0-01

2021-06-18 15:39:19+00:00

2021-06-18 15:39:41+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible