Duckietown Challenges Home Challenges Submissions

Submission 13693

Submission13693
Competingyes
Challengeaido-LF-sim-validation
UserSamuel Alexander
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 116147 sim-1of4: 116168 sim-2of4: 116151 sim-3of4: 116148
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

116168

Click the images to see detailed statistics about the episode.

zigzag-000

116151

Click the images to see detailed statistics about the episode.

autolab-000

116148

Click the images to see detailed statistics about the episode.

loop-000

116147

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
116168sim-1of4successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.259006805056737
survival_time_median13.600000000000058
deviation-center-line_median0.46714126467455247
in-drivable-lane_median8.350000000000048


other stats
deviation-center-line_max0.46714126467455247
deviation-center-line_mean0.46714126467455247
deviation-center-line_min0.46714126467455247
deviation-heading_max2.134518893343614
deviation-heading_mean2.134518893343614
deviation-heading_median2.134518893343614
deviation-heading_min2.134518893343614
distance-from-start_max3.4151088113880137
distance-from-start_mean3.4151088113880137
distance-from-start_median3.4151088113880137
distance-from-start_min3.4151088113880137
driven_any_max3.6229318610474937
driven_any_mean3.6229318610474937
driven_any_median3.6229318610474937
driven_any_min3.6229318610474937
driven_lanedir_consec_max1.259006805056737
driven_lanedir_consec_mean1.259006805056737
driven_lanedir_consec_min1.259006805056737
driven_lanedir_max1.259006805056737
driven_lanedir_mean1.259006805056737
driven_lanedir_median1.259006805056737
driven_lanedir_min1.259006805056737
in-drivable-lane_max8.350000000000048
in-drivable-lane_mean8.350000000000048
in-drivable-lane_min8.350000000000048
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.6229318610474937, "survival_time": 13.600000000000058, "driven_lanedir": 1.259006805056737, "in-drivable-lane": 8.350000000000048, "deviation-heading": 2.134518893343614, "distance-from-start": 3.4151088113880137, "deviation-center-line": 0.46714126467455247, "driven_lanedir_consec": 1.259006805056737}}
simulation-passed1
survival_time_max13.600000000000058
survival_time_mean13.600000000000058
survival_time_min13.600000000000058
No reset possible
116161sim-1of4successyes0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116158sim-1of4successyes0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116151sim-2of4successyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2669643235394621
survival_time_median5.699999999999988
deviation-center-line_median0.0890061994330822
in-drivable-lane_median4.349999999999987


other stats
deviation-center-line_max0.0890061994330822
deviation-center-line_mean0.0890061994330822
deviation-center-line_min0.0890061994330822
deviation-heading_max0.6097879864122965
deviation-heading_mean0.6097879864122965
deviation-heading_median0.6097879864122965
deviation-heading_min0.6097879864122965
distance-from-start_max1.4053659619841945
distance-from-start_mean1.4053659619841945
distance-from-start_median1.4053659619841945
distance-from-start_min1.4053659619841945
driven_any_max1.4185788538149735
driven_any_mean1.4185788538149735
driven_any_median1.4185788538149735
driven_any_min1.4185788538149735
driven_lanedir_consec_max0.2669643235394621
driven_lanedir_consec_mean0.2669643235394621
driven_lanedir_consec_min0.2669643235394621
driven_lanedir_max0.2669643235394621
driven_lanedir_mean0.2669643235394621
driven_lanedir_median0.2669643235394621
driven_lanedir_min0.2669643235394621
in-drivable-lane_max4.349999999999987
in-drivable-lane_mean4.349999999999987
in-drivable-lane_min4.349999999999987
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4185788538149735, "survival_time": 5.699999999999988, "driven_lanedir": 0.2669643235394621, "in-drivable-lane": 4.349999999999987, "deviation-heading": 0.6097879864122965, "distance-from-start": 1.4053659619841945, "deviation-center-line": 0.0890061994330822, "driven_lanedir_consec": 0.2669643235394621}}
simulation-passed1
survival_time_max5.699999999999988
survival_time_mean5.699999999999988
survival_time_min5.699999999999988
No reset possible
116148sim-3of4successyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2789598126712378
survival_time_median12.850000000000048
deviation-center-line_median0.16510428175121997
in-drivable-lane_median10.800000000000036


other stats
deviation-center-line_max0.16510428175121997
deviation-center-line_mean0.16510428175121997
deviation-center-line_min0.16510428175121997
deviation-heading_max1.6661962656866465
deviation-heading_mean1.6661962656866465
deviation-heading_median1.6661962656866465
deviation-heading_min1.6661962656866465
distance-from-start_max3.496740244771363
distance-from-start_mean3.496740244771363
distance-from-start_median3.496740244771363
distance-from-start_min3.496740244771363
driven_any_max3.5328514604820036
driven_any_mean3.5328514604820036
driven_any_median3.5328514604820036
driven_any_min3.5328514604820036
driven_lanedir_consec_max0.2789598126712378
driven_lanedir_consec_mean0.2789598126712378
driven_lanedir_consec_min0.2789598126712378
driven_lanedir_max0.2789598126712378
driven_lanedir_mean0.2789598126712378
driven_lanedir_median0.2789598126712378
driven_lanedir_min0.2789598126712378
in-drivable-lane_max10.800000000000036
in-drivable-lane_mean10.800000000000036
in-drivable-lane_min10.800000000000036
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5328514604820036, "survival_time": 12.850000000000048, "driven_lanedir": 0.2789598126712378, "in-drivable-lane": 10.800000000000036, "deviation-heading": 1.6661962656866465, "distance-from-start": 3.496740244771363, "deviation-center-line": 0.16510428175121997, "driven_lanedir_consec": 0.2789598126712378}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
116147sim-0of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5558600628924657
survival_time_median6.649999999999984
deviation-center-line_median0.21678820194677603
in-drivable-lane_median3.949999999999986


other stats
deviation-center-line_max0.21678820194677603
deviation-center-line_mean0.21678820194677603
deviation-center-line_min0.21678820194677603
deviation-heading_max1.4837925711457598
deviation-heading_mean1.4837925711457598
deviation-heading_median1.4837925711457598
deviation-heading_min1.4837925711457598
distance-from-start_max1.6639309320443805
distance-from-start_mean1.6639309320443805
distance-from-start_median1.6639309320443805
distance-from-start_min1.6639309320443805
driven_any_max1.6872727611744356
driven_any_mean1.6872727611744356
driven_any_median1.6872727611744356
driven_any_min1.6872727611744356
driven_lanedir_consec_max0.5558600628924657
driven_lanedir_consec_mean0.5558600628924657
driven_lanedir_consec_min0.5558600628924657
driven_lanedir_max0.5558600628924657
driven_lanedir_mean0.5558600628924657
driven_lanedir_median0.5558600628924657
driven_lanedir_min0.5558600628924657
in-drivable-lane_max3.949999999999986
in-drivable-lane_mean3.949999999999986
in-drivable-lane_min3.949999999999986
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6872727611744356, "survival_time": 6.649999999999984, "driven_lanedir": 0.5558600628924657, "in-drivable-lane": 3.949999999999986, "deviation-heading": 1.4837925711457598, "distance-from-start": 1.6639309320443805, "deviation-center-line": 0.21678820194677603, "driven_lanedir_consec": 0.5558600628924657}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_min6.649999999999984
No reset possible
116145sim-2of4successyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116142sim-3of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116141sim-0of4successyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116137sim-2of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116135sim-3of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95665sim-1of4successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95663sim-3of4successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95662sim-0of4successno0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95660sim-1of4successno0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95659sim-3of4successno0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95657sim-0of4successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95653sim-2of4successno0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74952sim-1of4successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74951sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74947sim-0of4successno0:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74945sim-2of4successno0:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63627sim-1of4successno0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63609sim-1of4successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63600sim-2of4successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63583sim-2of4successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63581sim-3of4successno0:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63547sim-1of4host-errorno0:02:50
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1144, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63544sim-0of4successno0:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63543sim-3of4host-errorno0:01:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [094265cf848ed491d8cbc9990b5819cb77bf65a56c757e8174c56872d145925d]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:9e75a97c5ca3980328379e3ae7dd1dceaa373d1d6d3ef26dc02e5fb43709979d
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-2-03_4b20b913ba9d
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_40-73404/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:6370979498ab7b803812db1cb98aac7264020bcf3a28d3c9bf9e6e65c42bdd40
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-2-03_4b20b913ba9d
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_40-73404/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/samy87/aido-submissions@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-2-03_4b20b913ba9d
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-3of4-nogpu-production-b-2-03_4b20b913ba9d-job63543-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_40-73404/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {solution-ego0: 094265cf848ed491d8cbc9990b5819cb77bf65a56c757e8174c56872d145925d}
│         names: dict[1]
│                │ 094265cf848ed491d8cbc9990b5819cb77bf65a56c757e8174c56872d145925d: nogpu-production-b-2-03_4b20b913ba9d-job63543-658909_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |094265cf848ed491d8cbc9990b5819cb77bf65a56c757e8174c56872d145925d
│         |
│  names: dict[1]
│         │ 094265cf848ed491d8cbc9990b5819cb77bf65a56c757e8174c56872d145925d: nogpu-production-b-2-03_4b20b913ba9d-job63543-658909_solution-ego0_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63541sim-2of4host-errorno0:01:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [d25b01962def48720caf44971d65efd68dc542c4d2a756afb274a9aa3466851b]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:9e75a97c5ca3980328379e3ae7dd1dceaa373d1d6d3ef26dc02e5fb43709979d
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 2, "total": 4}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-2of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-0-04_296f08e0edcd
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_39-11515/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:6370979498ab7b803812db1cb98aac7264020bcf3a28d3c9bf9e6e65c42bdd40
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 2, "total": 4}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-2of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-0-04_296f08e0edcd
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_39-11515/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/samy87/aido-submissions@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 2, "total": 4}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido-LF-sim-validation
│                │ │ │ challenge_step_name: sim-2of4
│                │ │ │ submission_id: 13693
│                │ │ │ submitter_name: Samuel Alexander
│                │ │ │ SUBMISSION_CONTAINER: docker.io/samy87/aido-submissions:2021_03_01_04_50_33@sha256:60834081b4bcd30c64a4de10d3e90723b7497530cacaefef33bf065fffd53abb
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-0-04_296f08e0edcd
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LF-sim-validation/submission13693/sim-2of4-nogpu-production-b-0-04_296f08e0edcd-job63541-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_08_23_58_39-11515/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {solution-ego0: d25b01962def48720caf44971d65efd68dc542c4d2a756afb274a9aa3466851b}
│         names: dict[1]
│                │ d25b01962def48720caf44971d65efd68dc542c4d2a756afb274a9aa3466851b: nogpu-production-b-0-04_296f08e0edcd-job63541-518377_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |d25b01962def48720caf44971d65efd68dc542c4d2a756afb274a9aa3466851b
│         |
│  names: dict[1]
│         │ d25b01962def48720caf44971d65efd68dc542c4d2a756afb274a9aa3466851b: nogpu-production-b-0-04_296f08e0edcd-job63541-518377_solution-ego0_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63521sim-3of4successno0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63520sim-0of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63518sim-2of4successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63516sim-1of4successno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62300347successyes0:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62175347successno0:13:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible