Submission 3535

Submission	`3535`

Competing	yes
Challenge	`aido2-LF-real-validation`
User	Peter Almasi 🇭🇺
Date submitted	2019-05-16 20:49:58+00:00
Last status update	2021-12-09 10:35:31+00:00
Complete	not complete
Details	Ready to do eval1.
Sisters
Result
Jobs	eval0: `22471` eval0-videos: `23099` eval0-videos-autobots: `23260` eval0-videos-watchtowers: `23442` eval1: `23913`
Next	eval1
User label	Baseline solution using reinforcement learning
Admin priority	100
Blessing	n/a
User priority	100

23442

clipped_watchtower21_2019-05-16-21-01-36

clipped_watchtower22_2019-05-16-21-01-35

clipped_watchtower23_2019-05-16-21-01-35

clipped_watchtower24_2019-05-16-21-01-35

clipped_watchtower25_2019-05-16-21-01-34

clipped_watchtower26_2019-05-16-21-01-35

clipped_watchtower27_2019-05-16-21-01-34

clipped_watchtower28_2019-05-16-21-01-36

clipped_watchtower29_2019-05-16-21-01-35

clipped_watchtower30_2019-05-16-21-01-35

clipped_watchtower31_2019-05-16-21-01-35

clipped_watchtower32_2019-05-16-21-01-36

clipped_watchtower33_2019-05-16-21-01-36

clipped_watchtower34_2019-05-16-21-01-36

clipped_watchtower35_2019-05-16-21-01-35

23260

clipped_autobot07_2019-05-16-21-01-32

23099

clipped_autobot07_2019-05-16-21-01-32

clipped_watchtower21_2019-05-16-21-01-36

clipped_watchtower22_2019-05-16-21-01-35

clipped_watchtower23_2019-05-16-21-01-35

clipped_watchtower24_2019-05-16-21-01-35

clipped_watchtower25_2019-05-16-21-01-34

clipped_watchtower26_2019-05-16-21-01-35

clipped_watchtower27_2019-05-16-21-01-34

clipped_watchtower28_2019-05-16-21-01-36

clipped_watchtower29_2019-05-16-21-01-35

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

23913

eval1

timeout

yes

2019-05-22 12:59:28+00:00

2019-05-22 18:05:08+00:00

5:05:40

I can see how the jo [...]

I can see how the job 23913 is timeout because passed 18340 seconds and the timeout is 18000.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23539

eval1

timeout

yes

2019-05-20 13:45:43+00:00

2019-05-20 18:51:21+00:00

5:05:38

I can see how the jo [...]

I can see how the job 23539 is timeout because passed 18338 seconds and the timeout is 18000.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23442

eval0-videos-watchtowers

success

yes

2019-05-20 01:23:17+00:00

2019-05-20 03:52:27+00:00

2:29:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23424

eval0-videos-watchtowers

host-error

yes

2019-05-20 01:13:18+00:00

2019-05-20 01:13:25+00:00

0:00:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/client.py", line 225, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 660, in run_single
    timeout_sec=timeout_sec)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 735, in run_one
    client = check_docker_environment()
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

Make sure the docker service is running.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23417

eval0-videos-watchtowers

host-error

yes

2019-05-20 01:07:02+00:00

2019-05-20 01:08:59+00:00

0:01:57

Error while running [...]


stderr | Creating job23417-941491_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23417-941491_evaluator_1  Cannot start service evaluator: error while creating mount source path '/ipfs': mkdir /ipfs: file exists
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: error while creating mount source path '/ipfs': mkdir /ipfs: file exists
stderr | Encountered errors while bringing up the project.
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23413

eval0-videos-watchtowers

host-error

yes

2019-05-20 01:02:36+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/home/andrea/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 517, in get_cr
    os.makedirs(wd)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 211, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 211, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/home/andrea/.local/share/virtualenvs/dt-env-developer-q48V9oeQ/lib/python3.7/os.py", line 221, in makedirs
    mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23346

eval1-videos-watchtowers

success

2019-05-19 04:03:54+00:00

2019-05-19 04:07:46+00:00

0:03:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23345

eval1-videos-autobots

success

2019-05-19 04:01:59+00:00

2019-05-19 04:03:33+00:00

0:01:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23340

eval1

success

yes

2019-05-18 19:17:48+00:00

2019-05-18 20:02:03+00:00

0:44:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23337

eval1

host-error

yes

2019-05-18 19:09:47+00:00

2019-05-18 19:11:53+00:00

0:02:06

Error while running [...]


stderr | Creating job23337-933120_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23337-933120_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23337-933120_evaluator_1 (dee705c1c8e0afce3de43b404ddbadda8c892e68fc05add75e251340651150a5): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23337-933120_evaluator_1 (dee705c1c8e0afce3de43b404ddbadda8c892e68fc05add75e251340651150a5): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23267

eval0-videos-watchtowers

success

2019-05-17 20:20:23+00:00

2019-05-17 20:30:53+00:00

0:10:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23264

eval0-videos-autobots

success

2019-05-17 20:19:39+00:00

2019-05-17 20:19:59+00:00

0:00:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23261

eval0-videos-watchtowers

aborted

yes

2019-05-17 20:15:21+00:00

2019-05-17 20:15:52+00:00

0:00:31

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1375, in upload
    aws_object.load()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/utils.py", line 1146, in redirect_from_error
    new_region = self.get_bucket_region(bucket, response)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/utils.py", line 1203, in get_bucket_region
    response = self._client.head_bucket(Bucket=bucket)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 135, in _send_request
    request, operation_model, context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 167, in _get_response
    request, operation_model)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 244, in _send
    return self.http_session.send(request)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 343, in _make_request
    self._validate_conn(conn)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 839, in _validate_conn
    conn.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connection.py", line 344, in connect
    ssl_context=context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 344, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 412, in wrap_socket
    session=session
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 853, in _create
    self.do_handshake()
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 1117, in do_handshake
    self._sslobj.do_handshake()
KeyboardInterrupt

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23260

eval0-videos-autobots

success

yes

2019-05-17 20:14:34+00:00

2019-05-17 20:15:00+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23254

eval0-videos-watchtowers

success

2019-05-17 20:01:43+00:00

2019-05-17 20:02:46+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23253

eval0-videos-autobots

success

2019-05-17 20:00:54+00:00

2019-05-17 20:01:14+00:00

0:00:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23250

eval0-videos-autobots

error

2019-05-17 19:50:44+00:00

2019-05-17 19:51:03+00:00

0:00:19

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23248

eval0-videos-autobots

error

2019-05-17 19:47:49+00:00

2019-05-17 19:48:57+00:00

0:01:08

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23245

eval0-videos-autobots

timeout

2019-05-17 19:42:00+00:00

2019-05-17 19:42:26+00:00

0:00:26

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23241

eval0-videos-autobots

timeout

2019-05-17 19:38:04+00:00

2019-05-17 19:39:21+00:00

0:01:17

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23239

eval0-videos-autobots

timeout

2019-05-17 19:34:10+00:00

2019-05-17 19:36:16+00:00

0:02:06

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23224

eval0-videos-autobots

aborted

2019-05-17 19:05:54+00:00

2019-05-17 19:08:14+00:00

0:02:20

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23221

eval0-videos-autobots

timeout

2019-05-17 18:45:21+00:00

2019-05-17 19:50:28+00:00

1:05:07

I can see how the jo [...]

I can see how the job 23221 is timeout because passed 3907 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23219

eval0-videos-autobots

timeout

2019-05-17 18:44:19+00:00

2019-05-17 18:45:00+00:00

0:00:41

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23202

eval0-videos-autobots

timeout

2019-05-17 16:53:11+00:00

2019-05-17 16:53:37+00:00

0:00:26

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23198

eval0-videos-autobots

timeout

2019-05-17 16:39:07+00:00

2019-05-17 16:39:50+00:00

0:00:43

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23197

eval0-videos-autobots

timeout

2019-05-17 16:38:56+00:00

2019-05-17 16:39:25+00:00

0:00:29

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23195

eval0-videos-autobots

timeout

2019-05-17 16:36:29+00:00

2019-05-17 16:38:16+00:00

0:01:47

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23165

eval0-videos-autobots

aborted

2019-05-17 16:15:16+00:00

2019-05-17 16:16:06+00:00

0:00:50

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23157

eval1

success

yes

2019-05-17 15:38:49+00:00

2019-05-17 19:39:12+00:00

4:00:23

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23156

eval1

host-error

yes

2019-05-17 15:28:27+00:00

2019-05-17 15:28:30+00:00

0:00:03

Could not access IPF [...]

Could not access IPFS data:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1176, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Need IPFS for this submission

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23154

eval1

host-error

yes

2019-05-17 14:49:19+00:00

2019-05-17 14:49:25+00:00

0:00:06

Could not access IPF [...]

Could not access IPFS data:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1176, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Need IPFS for this submission

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23148

eval1

host-error

yes

2019-05-17 14:43:43+00:00

2019-05-17 14:43:49+00:00

0:00:06

Could not access IPF [...]

Could not access IPFS data:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1176, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Need IPFS for this submission

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23116

eval0-videos-watchtowers

host-error

2019-05-17 13:41:08+00:00

2019-05-17 16:38:09+00:00

2:57:01

Could not access IPF [...]

Could not access IPFS data:
Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1182, in download_artefacts
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 81, in new_function
    return function(*args, **kwargs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1133, in try_to_get_hash
    res = client.file_ls(qm)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/ipfsapi/client.py", line 764, in file_ls
    return self._client.request('/file/ls', args, decoder='json', **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/ipfsapi/http.py", line 38, in wrapper
    return func(self, *args, **merged)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/ipfsapi/http.py", line 245, in request
    files, headers, data)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/ipfsapi/http.py", line 181, in _request
    files=files, headers=headers, data=data)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/ipfsapi/http.py", line 156, in _do_request
    return requests.request(*args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1321, in getresponse
    response.begin()
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 72, in handler
    _raise_exception(timeout_exception, exception_message)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 45, in _raise_exception
    raise exception()
timeout_decorator.timeout_decorator.TimeoutError: 'Timed Out'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1186, in download_artefacts
    msg = f'Could not get IPFS hash {sha256hex}'
duckietown_challenges_runner.runner.IPFSException: Could not get IPFS hash QmQffPn98k6FTfKxPSeN6arDbqxuaGZrJmavZMAgYyPhF4

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23113

eval0-videos-autobots

success

2019-05-17 13:37:44+00:00

2019-05-17 13:38:36+00:00

0:00:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23108

eval0-videos-watchtowers

success

2019-05-17 13:17:39+00:00

2019-05-17 13:56:38+00:00

0:38:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23107

eval0-videos-autobots

success

2019-05-17 13:16:11+00:00

2019-05-17 13:17:24+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23099

eval0-videos

success

yes

2019-05-17 12:43:57+00:00

2019-05-17 19:36:09+00:00

6:52:12

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23091

eval0-videos

host-error

yes

2019-05-17 12:15:09+00:00

2019-05-17 12:15:18+00:00

0:00:09

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 101, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 71, in create_connection
    raise err
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 62, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1144, in download_artefacts
    client = ipfsapi.connect('127.0.0.1', 5001)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 88, in connect
    assert_version(client.version()['Version'])
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/miscellaneous.py", line 204, in version
    return self._client.request('/version', decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 282, in _request
    timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 245, in _do_request
    return requests.request(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 240, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 219, in request
    return super(Session, self).request(method, url, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connection.py", line 181, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 108, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
pip._vendor.requests.packages.urllib3.exceptions.NewConnectionError: <ipfshttpclient.requests_wrapper.HTTPConnection object at 0x7f52b6936cf8>: Failed to establish a new connection: [Errno 111] Connection refused

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23082

eval0-extractATs

aborted

yes

2019-05-17 10:05:05+00:00

2019-05-17 10:05:51+00:00

0:00:46

The container "evalu [...]

The container "evaluator" exited with code 126.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23060

eval0-videos

success

2019-05-17 09:17:28+00:00

2019-05-17 10:04:46+00:00

0:47:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23057

eval0-extractATs

error

2019-05-17 08:47:26+00:00

2019-05-17 09:17:15+00:00

0:29:49

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-20461-job23057:

File '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-20461-job23057/challenge-results/challenge_results.yaml' does not exist. 

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22628

eval0-extractATs

aborted

2019-05-16 23:57:01+00:00

2019-05-17 00:20:13+00:00

0:23:12

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628:

File '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-real-validation/submission3535/eval0-extractATs-nutonomy-P50-9747-job22628/challenge-results/challenge_results.yaml' does not exist. 

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22619

eval0-videos

success

2019-05-16 23:37:21+00:00

2019-05-16 23:56:39+00:00

0:19:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22523

eval0-videos

aborted

2019-05-16 21:56:43+00:00

2019-05-16 22:05:12+00:00

0:08:29

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22471

eval0

success

yes

2019-05-16 20:55:17+00:00

2019-05-17 19:42:20+00:00

22:47:03

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.58
survival_time_median	2

other stats

01_start	details {"1_01attemptDate": {"name": "1_01attemptDate", "output": "2019-05-16", "readable_string": "Attempt date"}, "1_03autolabName": {"name": "1_03autolabName", "output": "ETHZ", "readable_string": "Autolab"}, "1_04operatorName": {"name": "1_04operatorName", "output": "Nicole", "readable_string": "Operator's name"}}
02_autolab_setup	details {"2_04ledLightsOn": {"name": "2_04ledLightsOn", "output": true, "readable_string": "Ceiling led lightbulbs are on with a bright white color"}, "2_01mapConformity": {"name": "2_01mapConformity", "output": true, "readable_string": "Conformity of the map"}, "2_05curtainsClosed": {"name": "2_05curtainsClosed", "output": true, "readable_string": "The curtains are closed"}, "2_02pairedHostnames": {"name": "2_02pairedHostnames", "output": true, "readable_string": "Pairing hostnames to duckiebot-IDs"}, "2_03ceilingLightsOff": {"name": "2_03ceilingLightsOff", "output": true, "readable_string": "Ceiling default neon lights are off"}, "2_multi01_duckiebot_select_autobot01": {"name": "2_multi01_duckiebot_select_autobot01", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot02": {"name": "2_multi01_duckiebot_select_autobot02", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot03": {"name": "2_multi01_duckiebot_select_autobot03", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot04": {"name": "2_multi01_duckiebot_select_autobot04", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot05": {"name": "2_multi01_duckiebot_select_autobot05", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot06": {"name": "2_multi01_duckiebot_select_autobot06", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot07": {"name": "2_multi01_duckiebot_select_autobot07", "output": "active", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot08": {"name": "2_multi01_duckiebot_select_autobot08", "output": "not_used", "readable_string": "Selection among available duckiebot"}}
03_setup_validation	details {"3_11freeMemory": {"name": "3_11freeMemory", "output": true, "readable_string": "All agents have enough free memory"}, "3_01robotsAreOn": {"name": "3_01robotsAreOn", "output": true, "readable_string": "All duckiebots are on"}, "3_09agentsPinged": {"name": "3_09agentsPinged", "output": true, "readable_string": "All agents have been pinged"}, "3_03duckiesOnBots": {"name": "3_03duckiesOnBots", "output": true, "readable_string": "All autobots received yeelow or black duckies (according to active of passive)"}, "3_08attemptNumber": {"name": "3_08attemptNumber", "output": "1", "readable_string": "Attempt number"}, "3_04batteryChecked": {"name": "3_04batteryChecked", "output": true, "readable_string": "All duckiebots have enough battery"}, "3_06agentPlacement": {"name": "3_06agentPlacement", "output": true, "readable_string": "Placement of the duckiebots"}, "3_02aprilTagsPlates": {"name": "3_02aprilTagsPlates", "output": true, "readable_string": "All duckiebots have their april tag backplate, in the right orientation"}, "3_05agentsPluggedIn": {"name": "3_05agentsPluggedIn", "output": true, "readable_string": "All non-movable agents (watchtowers and trafficlights) are plugged in (alimentation and ethernet)"}, "3_10readWriteMemory": {"name": "3_10readWriteMemory", "output": true, "readable_string": "All agents have been tested for read and write on their logging device (USB stick)"}, "3_07lightCheckedReport": {"name": "3_07lightCheckedReport", "output": true, "readable_string": "Report on light conditions"}, "3_hidden_autolab_helper_command": {"name": "3_hidden_autolab_helper_command", "output": "python3 autolab_helper_script.py 3535 aido2-LF-real-validation autobot07 ", "readable_string": "The autolab helper script launch command"}}
04_initialization	details {"4_01duckiebotInterfaceStarted": {"name": "4_01duckiebotInterfaceStarted", "output": true, "readable_string": "All duckiebots have stared their duckiebot interface container"}, "4_02submissionContainerLoaded": {"name": "4_02submissionContainerLoaded", "output": true, "readable_string": "All active duckiebots have loaded the submission container"}, "4_04agentsStartedLoggerContainers": {"name": "4_04agentsStartedLoggerContainers", "output": true, "readable_string": "All agents have loaded and started the logger container"}, "4_03passiveDuckiebotsContainerLoaded": {"name": "4_03passiveDuckiebotsContainerLoaded", "output": false, "readable_string": "All passive duckiebots have loaded the passive behavior container"}}
05_confirmation	details {"5_01operatorIsReady": {"name": "5_01operatorIsReady", "output": true, "readable_string": "The operator is ready to start"}, "5_02serverInitializationError": {"name": "5_02serverInitializationError", "output": "", "readable_string": "The server initialization error message"}}
06_execution	details {"6_06visualCheck": {"name": "6_06visualCheck", "output": "", "readable_string": "Comment from operator on visual check of launching"}, "6_03beginTimeStamp": {"name": "6_03beginTimeStamp", "output": "1558040507.343545", "readable_string": "Beginning timestamp (useful for attempt evaluation)"}, "6_01launchedAttempt": {"name": "6_01launchedAttempt", "output": true, "readable_string": "The attempt was successfully launched"}, "6_02serverLaunchError": {"name": "6_02serverLaunchError", "output": "", "readable_string": "The server launch error message"}, "6_09watchtowerLoggings": {"name": "6_09watchtowerLoggings", "output": false, "readable_string": "Watchtowers started logging data"}, "6_10serverLoggingCheck": {"name": "6_10serverLoggingCheck", "output": "", "readable_string": "Logging error message from the server"}, "6_07activeDuckiebotLogging": {"name": "6_07activeDuckiebotLogging", "output": false, "readable_string": "Active duckiebots started logging data"}, "6_08passiveDuckiebotLogging": {"name": "6_08passiveDuckiebotLogging", "output": false, "readable_string": "Passive duckiebots started logging data"}, "6_04activeDuckiebotsAreRunningVisualCheck": {"name": "6_04activeDuckiebotsAreRunningVisualCheck", "output": true, "readable_string": "Active duckiebots started moving after launch"}, "6_05passiveDuckiebotsAreRunningVisualCheck": {"name": "6_05passiveDuckiebotsAreRunningVisualCheck", "output": false, "readable_string": "Passive duckiebots started moving after launch"}}
07_monitoring_and_termination	details {"7_05errorReason": {"name": "7_05errorReason", "output": "no_error", "readable_string": "Reason for error"}, "7_01endTimeStamp": {"name": "7_01endTimeStamp", "output": "1558040515.917442", "readable_string": "end of the experiment timestamp"}, "7_03failureReason": {"name": "7_03failureReason", "output": "no_failure", "readable_string": "Reason for failure"}, "7_06errorComments": {"name": "7_06errorComments", "output": "", "readable_string": "Comment on error reason"}, "7_02attemptSuccess": {"name": "7_02attemptSuccess", "output": "success", "readable_string": "Outcome of the attempt"}, "7_04failureComments": {"name": "7_04failureComments", "output": "", "readable_string": "Comment on failure reason"}, "7_07outcomechecking": {"name": "7_07outcomechecking", "output": false, "readable_string": "Checked that the outcome matched the given reasons"}}
08_retrieving_and_checking_logs	details {"8_01bagsCopied": {"name": "8_01bagsCopied", "output": true, "readable_string": "All bags were successfully copied"}, "8_03bagsClipped": {"name": "8_03bagsClipped", "output": false, "readable_string": "All bags were clipped with the time stamps"}, "8_02bagsVerified": {"name": "8_02bagsVerified", "output": true, "readable_string": "The contents of all bags was verified"}, "8_04agentsCleaned": {"name": "8_04agentsCleaned", "output": true, "readable_string": "All agents were cleaned from bags"}}
09_evaluation	details {"9_02timeTravelled": {"name": "9_02timeTravelled", "output": "2", "readable_string": "How many seconds did the Duckiebot successfully travel"}, "9_01tilesTravelled": {"name": "9_01tilesTravelled", "output": "1", "readable_string": "How many tiles did the Duckiebot successfully travel"}}
10_saving_data	details {"10_02dataIpfsHash": {"name": "10_02dataIpfsHash", "output": "QmZhSFy7rzDhcTuuosA7ueSen5aKF5A5R3CmAkcw6A9tZo", "readable_string": "IPFS hash of the experiment"}, "10_04cleanupCheck": {"name": "10_04cleanupCheck", "output": false, "readable_string": "The IPFS Docker terminal and the local storage were cleaned"}, "10_05autolabCleaned": {"name": "10_05autolabCleaned", "output": true, "readable_string": "Autolab was cleaned after the end of the experiment"}, "10_01dataUploadCheck": {"name": "10_01dataUploadCheck", "output": false, "readable_string": "The data was uploaded to the IDSC NAS"}, "10_03dataPinningCheck": {"name": "10_03dataPinningCheck", "output": false, "readable_string": "The data is accessible through IPFS"}}

No reset possible