Duckietown Challenges Home Challenges Submissions

Evaluator 5372

ID5372
evaluatorgpu-production-spot-0-04
ownerI don't have one 😀
machinegpu-production-spot-0_5abfe10c33c4
processgpu-production-spot-0-04_5abfe10c33c4
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success5 79768
# timeout
# failed1 79781
# error
# aborted1 79852
# host-error1 79763
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)245.9 GB
Disk (MB)969.3 GB
Disk available (MB)853.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7985213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7984916097Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.3
false_positive_rate0.01


other stats
nsamples200
No reset possible
7982316101Ghada Bouziditemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-040:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01223169673572887
agent_compute-ego0_mean0.01223169673572887
agent_compute-ego0_median0.01223169673572887
agent_compute-ego0_min0.01223169673572887
complete-iteration_max0.15671927820552478
complete-iteration_mean0.15671927820552478
complete-iteration_median0.15671927820552478
complete-iteration_min0.15671927820552478
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004750723188573664
get_duckie_state_mean0.004750723188573664
get_duckie_state_median0.004750723188573664
get_duckie_state_min0.004750723188573664
get_robot_state_max0.004040241241455078
get_robot_state_mean0.004040241241455078
get_robot_state_median0.004040241241455078
get_robot_state_min0.004040241241455078
get_state_dump_max0.006155284968289462
get_state_dump_mean0.006155284968289462
get_state_dump_median0.006155284968289462
get_state_dump_min0.006155284968289462
get_ui_image_max0.029233233495192093
get_ui_image_mean0.029233233495192093
get_ui_image_median0.029233233495192093
get_ui_image_min0.029233233495192093
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.029233233495192093, "step_physics": 0.08596307581121271, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.006155284968289462, "get_robot_state": 0.004040241241455078, "sim_render-ego0": 0.004177868366241455, "get_duckie_state": 0.004750723188573664, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01223169673572887, "complete-iteration": 0.15671927820552478, "set_robot_commands": 0.002498767592690208, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005416783419522372, "sim_compute_performance-ego0": 0.002158836884932085}}
set_robot_commands_max0.002498767592690208
set_robot_commands_mean0.002498767592690208
set_robot_commands_median0.002498767592690208
set_robot_commands_min0.002498767592690208
sim_compute_performance-ego0_max0.002158836884932085
sim_compute_performance-ego0_mean0.002158836884932085
sim_compute_performance-ego0_median0.002158836884932085
sim_compute_performance-ego0_min0.002158836884932085
sim_compute_sim_state_max0.005416783419522372
sim_compute_sim_state_mean0.005416783419522372
sim_compute_sim_state_median0.005416783419522372
sim_compute_sim_state_min0.005416783419522372
sim_render-ego0_max0.004177868366241455
sim_render-ego0_mean0.004177868366241455
sim_render-ego0_median0.004177868366241455
sim_render-ego0_min0.004177868366241455
simulation-passed1
step_physics_max0.08596307581121271
step_physics_mean0.08596307581121271
step_physics_median0.08596307581121271
step_physics_min0.08596307581121271
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7978816115Emanuele Noninobase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:15:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median2.828863661494929
driven_lanedir_consec_median6.154165372302858
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.006859054970403794
agent_compute-ego0_mean0.006759733979052846
agent_compute-ego0_median0.006759733979052846
agent_compute-ego0_min0.006660412987701899
complete-iteration_max0.11859814709767412
complete-iteration_mean0.11432424473028
complete-iteration_median0.11432424473028
complete-iteration_min0.11005034236288588
deviation-center-line_max3.6481533969569138
deviation-center-line_mean2.828863661494929
deviation-center-line_min2.009573926032945
deviation-heading_max9.493795311664956
deviation-heading_mean7.880901463484307
deviation-heading_median7.880901463484307
deviation-heading_min6.268007615303657
distance-from-start_max1.5637994459394564
distance-from-start_mean1.3093390788385288
distance-from-start_median1.3093390788385288
distance-from-start_min1.0548787117376013
driven_any_max6.248395093011943
driven_any_mean6.245753307656157
driven_any_median6.245753307656157
driven_any_min6.243111522300371
driven_lanedir_consec_max6.190971655850628
driven_lanedir_consec_mean6.154165372302858
driven_lanedir_consec_min6.117359088755087
driven_lanedir_max6.190971655850628
driven_lanedir_mean6.154165372302858
driven_lanedir_median6.154165372302858
driven_lanedir_min6.117359088755087
get_duckie_state_max1.989931587771909e-06
get_duckie_state_mean1.9127085842161155e-06
get_duckie_state_median1.9127085842161155e-06
get_duckie_state_min1.8354855806603224e-06
get_robot_state_max0.003786509479710105
get_robot_state_mean0.003785663599971927
get_robot_state_median0.003785663599971927
get_robot_state_min0.0037848177202337487
get_state_dump_max0.0047170444888735095
get_state_dump_mean0.004696428130608018
get_state_dump_median0.004696428130608018
get_state_dump_min0.004675811772342526
get_ui_image_max0.02676271260727653
get_ui_image_mean0.024103864047251376
get_ui_image_median0.024103864047251376
get_ui_image_min0.021445015487226222
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.243111522300371, "get_ui_image": 0.021445015487226222, "step_physics": 0.06100255643001305, "survival_time": 59.99999999999873, "driven_lanedir": 6.117359088755087, "get_state_dump": 0.004675811772342526, "get_robot_state": 0.003786509479710105, "sim_render-ego0": 0.003718440479084812, "get_duckie_state": 1.8354855806603224e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.493795311664956, "agent_compute-ego0": 0.006859054970403794, "complete-iteration": 0.11005034236288588, "set_robot_commands": 0.0027241303859205667, "distance-from-start": 1.0548787117376013, "deviation-center-line": 3.6481533969569138, "driven_lanedir_consec": 6.117359088755087, "sim_compute_sim_state": 0.0037864439691929494, "sim_compute_performance-ego0": 0.0019746317057486476}, "LF-small-loop-001-ego0": {"driven_any": 6.248395093011943, "get_ui_image": 0.02676271260727653, "step_physics": 0.06442623829265916, "survival_time": 59.99999999999873, "driven_lanedir": 6.190971655850628, "get_state_dump": 0.0047170444888735095, "get_robot_state": 0.0037848177202337487, "sim_render-ego0": 0.0036898506968146456, "get_duckie_state": 1.989931587771909e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.268007615303657, "agent_compute-ego0": 0.006660412987701899, "complete-iteration": 0.11859814709767412, "set_robot_commands": 0.002531254122795213, "distance-from-start": 1.5637994459394564, "deviation-center-line": 2.009573926032945, "driven_lanedir_consec": 6.190971655850628, "sim_compute_sim_state": 0.003967763581541953, "sim_compute_performance-ego0": 0.001977895122086575}}
set_robot_commands_max0.0027241303859205667
set_robot_commands_mean0.00262769225435789
set_robot_commands_median0.00262769225435789
set_robot_commands_min0.002531254122795213
sim_compute_performance-ego0_max0.001977895122086575
sim_compute_performance-ego0_mean0.0019762634139176114
sim_compute_performance-ego0_median0.0019762634139176114
sim_compute_performance-ego0_min0.0019746317057486476
sim_compute_sim_state_max0.003967763581541953
sim_compute_sim_state_mean0.003877103775367451
sim_compute_sim_state_median0.003877103775367451
sim_compute_sim_state_min0.0037864439691929494
sim_render-ego0_max0.003718440479084812
sim_render-ego0_mean0.0037041455879497287
sim_render-ego0_median0.0037041455879497287
sim_render-ego0_min0.0036898506968146456
simulation-passed1
step_physics_max0.06442623829265916
step_physics_mean0.0627143973613361
step_physics_median0.0627143973613361
step_physics_min0.06100255643001305
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7978116117Jieruei Changbase-image-mlmooc-visservoingsimfailednogpu-production-spot-0-040:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7977016126Arwa Alabdulkarimexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-040:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.419234491228236


other stats
agent_compute-ego0_max0.01160160012288852
agent_compute-ego0_mean0.01160160012288852
agent_compute-ego0_median0.01160160012288852
agent_compute-ego0_min0.01160160012288852
complete-iteration_max0.21579704673760736
complete-iteration_mean0.21579704673760736
complete-iteration_median0.21579704673760736
complete-iteration_min0.21579704673760736
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.419234491228236
distance-from-start_median4.419234491228236
distance-from-start_min4.419234491228236
driven_any_max5.546549009949132
driven_any_mean5.546549009949132
driven_any_median5.546549009949132
driven_any_min5.546549009949132
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08477786637464232
get_duckie_state_mean0.08477786637464232
get_duckie_state_median0.08477786637464232
get_duckie_state_min0.08477786637464232
get_robot_state_max0.004015033588520593
get_robot_state_mean0.004015033588520593
get_robot_state_median0.004015033588520593
get_robot_state_min0.004015033588520593
get_state_dump_max0.017993768982645077
get_state_dump_mean0.017993768982645077
get_state_dump_median0.017993768982645077
get_state_dump_min0.017993768982645077
get_ui_image_max0.01206606492511835
get_ui_image_mean0.01206606492511835
get_ui_image_median0.01206606492511835
get_ui_image_min0.01206606492511835
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 5.546549009949132, "get_ui_image": 0.01206606492511835, "step_physics": 0.06853365501098888, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.017993768982645077, "get_robot_state": 0.004015033588520593, "sim_render-ego0": 0.0037755007350772345, "get_duckie_state": 0.08477786637464232, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.01160160012288852, "complete-iteration": 0.21579704673760736, "set_robot_commands": 0.0024374347245266397, "distance-from-start": 4.419234491228236, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008486236958182127, "sim_compute_performance-ego0": 0.002006340781219}}
set_robot_commands_max0.0024374347245266397
set_robot_commands_mean0.0024374347245266397
set_robot_commands_median0.0024374347245266397
set_robot_commands_min0.0024374347245266397
sim_compute_performance-ego0_max0.002006340781219
sim_compute_performance-ego0_mean0.002006340781219
sim_compute_performance-ego0_median0.002006340781219
sim_compute_performance-ego0_min0.002006340781219
sim_compute_sim_state_max0.008486236958182127
sim_compute_sim_state_mean0.008486236958182127
sim_compute_sim_state_median0.008486236958182127
sim_compute_sim_state_min0.008486236958182127
sim_render-ego0_max0.0037755007350772345
sim_render-ego0_mean0.0037755007350772345
sim_render-ego0_median0.0037755007350772345
sim_render-ego0_min0.0037755007350772345
simulation-passed1
step_physics_max0.06853365501098888
step_physics_mean0.06853365501098888
step_physics_median0.06853365501098888
step_physics_min0.06853365501098888
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7976816130Euan Hopetemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-040:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011916041374206545
agent_compute-ego0_mean0.011916041374206545
agent_compute-ego0_median0.011916041374206545
agent_compute-ego0_min0.011916041374206545
complete-iteration_max0.14989287203008478
complete-iteration_mean0.14989287203008478
complete-iteration_median0.14989287203008478
complete-iteration_min0.14989287203008478
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004679728638042103
get_duckie_state_mean0.004679728638042103
get_duckie_state_median0.004679728638042103
get_duckie_state_min0.004679728638042103
get_robot_state_max0.0040104280818592415
get_robot_state_mean0.0040104280818592415
get_robot_state_median0.0040104280818592415
get_robot_state_min0.0040104280818592415
get_state_dump_max0.005936156619678844
get_state_dump_mean0.005936156619678844
get_state_dump_median0.005936156619678844
get_state_dump_min0.005936156619678844
get_ui_image_max0.029583985155278988
get_ui_image_mean0.029583985155278988
get_ui_image_median0.029583985155278988
get_ui_image_min0.029583985155278988
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.029583985155278988, "step_physics": 0.07968780127438632, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005936156619678844, "get_robot_state": 0.0040104280818592415, "sim_render-ego0": 0.0041412494399330835, "get_duckie_state": 0.004679728638042103, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011916041374206545, "complete-iteration": 0.14989287203008478, "set_robot_commands": 0.002354117957028476, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005340998822992498, "sim_compute_performance-ego0": 0.00214297663081776}}
set_robot_commands_max0.002354117957028476
set_robot_commands_mean0.002354117957028476
set_robot_commands_median0.002354117957028476
set_robot_commands_min0.002354117957028476
sim_compute_performance-ego0_max0.00214297663081776
sim_compute_performance-ego0_mean0.00214297663081776
sim_compute_performance-ego0_median0.00214297663081776
sim_compute_performance-ego0_min0.00214297663081776
sim_compute_sim_state_max0.005340998822992498
sim_compute_sim_state_mean0.005340998822992498
sim_compute_sim_state_median0.005340998822992498
sim_compute_sim_state_min0.005340998822992498
sim_render-ego0_max0.0041412494399330835
sim_render-ego0_mean0.0041412494399330835
sim_render-ego0_median0.0041412494399330835
sim_render-ego0_min0.0041412494399330835
simulation-passed1
step_physics_max0.07968780127438632
step_physics_mean0.07968780127438632
step_physics_median0.07968780127438632
step_physics_min0.07968780127438632
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7976316130Euan Hopetemplate-randomaido-hello-sim-validation370host-erroryesgpu-production-spot-0-040:02:41
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible