Evaluator 2505

ID	2505
evaluator	`nogpu-prod-03`
owner	I don't have one 😀
machine	nogpu-prod_cd8ed8cff8c3
process	nogpu-prod-03_cd8ed8cff8c3
version	6.1.27
first heard	2020-11-30 22:59:36+00:00
last heard	2020-12-01 00:02:01+00:00
status	inactive
# evaluating
# success	1 `45422`
# timeout	1 `45519`
# failed
# error
# aborted	1 `45386`
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

45519

11809

Bea Baselines 🐤

template-ros

aido5-LFP-sim-validation

LFP-sim

timeout

nogpu-prod-03

2020-11-30 23:04:48+00:00

No reset possible

45422

11783

Bea Baselines 🐤

template-random

aido5-LF-sanity-sim-validation

sanity-check

success

yes

nogpu-prod-03

2020-11-30 23:01:08+00:00

2020-11-30 23:01:53+00:00

0:00:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06871089847212986
survival_time_median	0.49999999999999994
deviation-center-line_median	0.008019844335283851
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.011228192936290394
agent_compute-ego_mean	0.011228192936290394
agent_compute-ego_median	0.011228192936290394
agent_compute-ego_min	0.011228192936290394
complete-iteration_max	0.15880912000482733
complete-iteration_mean	0.15880912000482733
complete-iteration_median	0.15880912000482733
complete-iteration_min	0.15880912000482733
deviation-center-line_max	0.008019844335283851
deviation-center-line_mean	0.008019844335283851
deviation-center-line_min	0.008019844335283851
deviation-heading_max	0.05040343959962079
deviation-heading_mean	0.05040343959962079
deviation-heading_median	0.05040343959962079
deviation-heading_min	0.05040343959962079
driven_any_max	0.0689817689678746
driven_any_mean	0.0689817689678746
driven_any_median	0.0689817689678746
driven_any_min	0.0689817689678746
driven_lanedir_consec_max	0.06871089847212986
driven_lanedir_consec_mean	0.06871089847212986
driven_lanedir_consec_min	0.06871089847212986
driven_lanedir_max	0.06871089847212986
driven_lanedir_mean	0.06871089847212986
driven_lanedir_median	0.06871089847212986
driven_lanedir_min	0.06871089847212986
get_duckie_state_max	0.002129142934625799
get_duckie_state_mean	0.002129142934625799
get_duckie_state_median	0.002129142934625799
get_duckie_state_min	0.002129142934625799
get_robot_state_max	0.007496660405939276
get_robot_state_mean	0.007496660405939276
get_robot_state_median	0.007496660405939276
get_robot_state_min	0.007496660405939276
get_state_dump_max	0.007334774190729315
get_state_dump_mean	0.007334774190729315
get_state_dump_median	0.007334774190729315
get_state_dump_min	0.007334774190729315
get_ui_image_max	0.029301144860007546
get_ui_image_mean	0.029301144860007546
get_ui_image_median	0.029301144860007546
get_ui_image_min	0.029301144860007546
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 0.0689817689678746, "get_ui_image": 0.029301144860007546, "step_physics": 0.07836894555525346, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06871089847212986, "get_state_dump": 0.007334774190729315, "sim_render-ego": 0.003932692787863992, "get_robot_state": 0.007496660405939276, "get_duckie_state": 0.002129142934625799, "in-drivable-lane": 0.0, "agent_compute-ego": 0.011228192936290394, "deviation-heading": 0.05040343959962079, "complete-iteration": 0.15880912000482733, "set_robot_commands": 0.0025333924727006392, "deviation-center-line": 0.008019844335283851, "driven_lanedir_consec": 0.06871089847212986, "sim_compute_sim_state": 0.013936909762295807, "sim_compute_performance-ego": 0.002474069595336914}}
set_robot_commands_max	0.0025333924727006392
set_robot_commands_mean	0.0025333924727006392
set_robot_commands_median	0.0025333924727006392
set_robot_commands_min	0.0025333924727006392
sim_compute_performance-ego_max	0.002474069595336914
sim_compute_performance-ego_mean	0.002474069595336914
sim_compute_performance-ego_median	0.002474069595336914
sim_compute_performance-ego_min	0.002474069595336914
sim_compute_sim_state_max	0.013936909762295807
sim_compute_sim_state_mean	0.013936909762295807
sim_compute_sim_state_median	0.013936909762295807
sim_compute_sim_state_min	0.013936909762295807
sim_render-ego_max	0.003932692787863992
sim_render-ego_mean	0.003932692787863992
sim_render-ego_median	0.003932692787863992
sim_render-ego_min	0.003932692787863992
simulation-passed	1
step_physics_max	0.07836894555525346
step_physics_mean	0.07836894555525346
step_physics_median	0.07836894555525346
step_physics_min	0.07836894555525346
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

45386

11772

Ehsan Ahmadi 🇨🇦

template-random

aido5-LF-sim-validation

LFv-sim

aborted

nogpu-prod-03

2020-11-30 23:00:09+00:00

2020-11-30 23:00:45+00:00

0:00:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible