Evaluator 785

aido2-LF-sim-validation

2019-04-24 15:14:25+00:00

2019-04-24 16:20:17+00:00

1:05:52

I can see how the jo [...]

I can see how the job 19476 is timeout because passed 3952 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19461

2653

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

aido2-LFV-sim-validation

2019-04-24 15:01:24+00:00

2019-04-24 15:13:59+00:00

0:12:35

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19413

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

aido2-LFV-sim-validation

2019-04-24 14:31:38+00:00

2019-04-24 15:00:57+00:00

0:29:19

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19369

2771

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-24 14:13:01+00:00

2019-04-24 14:31:25+00:00

0:18:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1184, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1194, in upload
    aws_object.upload_file(realfile, ExtraArgs={'ContentType': mime_type})
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 280, in object_upload_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 131, in upload_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 176, in _send_output
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 176, in _send_output
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 176, in _send_output
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 722, in _main
    Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 244, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 278, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/frankfurt/by-value/sha256/2d176d3c9c819708f62812f7c9dbb8e585e1a4625b64b8c2e24d261998a8ce34?uploadId=.ukJ9veKprayboqG8Rgo6DiUuco8nagW8x5mF7XIPv.27YWETtfZXW.GWh_pUbNYIqBgd0Xb03GwQVMfpcMX0zjIUvr2CK4oIUed4aushYJ804LEDbYKvmhO7a9hpfct&partNumber=2"

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19363

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

error

2019-04-24 14:11:41+00:00

2019-04-24 14:12:47+00:00

0:01:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19359

2795

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-testing

step1-simulation

failed

2019-04-24 14:09:12+00:00

2019-04-24 14:11:06+00:00

0:01:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19355

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

failed

2019-04-24 14:07:08+00:00

2019-04-24 14:09:05+00:00

0:01:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19350

2984

Python template

step2-scoring

success

yes

2019-04-24 14:06:13+00:00

2019-04-24 14:07:00+00:00

0:00:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.0723295662771

other stats

efficiency	-62.623038265105144
fleet_size	-1000000000

No reset possible

19344

2984

Python template

step1-simulation

success

yes

2019-04-24 14:02:40+00:00

2019-04-24 14:05:56+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19291

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

aido2-LFVI-sim-testing

step1-simulation

success

aido2-LFVI-sim-validation

2019-04-24 13:46:18+00:00

2019-04-24 14:02:32+00:00

0:16:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6900582707828695
survival_time_median	14.700000000000074
deviation-center-line_median	0.3591683262706219
in-drivable-lane_median	1.200000000000017

other stats

agent_compute-ego_max	0.08803842911103955
agent_compute-ego_mean	0.08384075803882411
agent_compute-ego_median	0.08195193449656168
agent_compute-ego_min	0.08110756073554937
deviation-center-line_max	0.5528244200733968
deviation-center-line_mean	0.3250388716749043
deviation-center-line_min	0.12474392863155234
deviation-heading_max	1.7841667326335335
deviation-heading_mean	1.0687591038626745
deviation-heading_median	0.9805073681793997
deviation-heading_min	0.6869591234399757
driven_any_max	2.196039556148948
driven_any_mean	1.706254237612001
driven_any_median	2.1660738591449116
driven_any_min	0.9910472848979056
driven_lanedir_consec_max	1.8205635516580176
driven_lanedir_consec_mean	1.3480125540484669
driven_lanedir_consec_min	0.616683423521228
driven_lanedir_max	2.1929637182965305
driven_lanedir_mean	1.482287538796306
driven_lanedir_median	1.8205635516580176
driven_lanedir_min	0.616683423521228
in-drivable-lane_max	2.3999999999999915
in-drivable-lane_mean	1.250000000000006
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1660738591449116, "sim_physics": 0.018506993241861565, "survival_time": 14.700000000000074, "driven_lanedir": 1.961201560444252, "sim_render-ego": 0.03518822241802605, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.08803842911103955, "deviation-heading": 0.9805073681793997, "set_robot_commands": 0.05283498196374802, "deviation-center-line": 0.3591683262706219, "driven_lanedir_consec": 1.6900582707828695, "sim_compute_sim_state": 0.021775759807249315, "sim_compute_performance-ego": 0.038081465124272976, "sim_compute_robot_state-ego": 0.03926071666535877, "sim_compute_robot_state-npc0": 0.03895964346775392, "sim_compute_robot_state-npc1": 0.038387139638264976, "sim_compute_robot_state-npc2": 0.03846313758772247, "sim_compute_robot_state-npc3": 0.038604388431626925}, "udem1-1-0": {"driven_any": 1.0094322716915194, "sim_physics": 0.01783115930960212, "survival_time": 7.099999999999983, "driven_lanedir": 0.616683423521228, "sim_render-ego": 0.032853148352931925, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.08171625876090896, "deviation-heading": 0.7757170340260829, "set_robot_commands": 0.05092070472072547, "deviation-center-line": 0.12474392863155234, "driven_lanedir_consec": 0.616683423521228, "sim_compute_sim_state": 0.02083218769288399, "sim_compute_performance-ego": 0.03546366725169437, "sim_compute_robot_state-ego": 0.03684782646071743, "sim_compute_robot_state-npc0": 0.03650191132451447, "sim_compute_robot_state-npc1": 0.03642524799830477, "sim_compute_robot_state-npc2": 0.036142847907375285, "sim_compute_robot_state-npc3": 0.036710250545555434}, "udem1-2-0": {"driven_any": 2.168678216176718, "sim_physics": 0.017780779984037754, "survival_time": 14.750000000000076, "driven_lanedir": 1.8205635516580176, "sim_render-ego": 0.03550867145344362, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.086389607090061, "deviation-heading": 1.7841667326335335, "set_robot_commands": 0.05229742244138556, "deviation-center-line": 0.38105433778148035, "driven_lanedir_consec": 1.8205635516580176, "sim_compute_sim_state": 0.021534146292734955, "sim_compute_performance-ego": 0.03753868927389888, "sim_compute_robot_state-ego": 0.03862183861813303, "sim_compute_robot_state-npc0": 0.03846808692156258, "sim_compute_robot_state-npc1": 0.038880989107034976, "sim_compute_robot_state-npc2": 0.03771497597128658, "sim_compute_robot_state-npc3": 0.03827657618765103}, "udem1-3-0": {"driven_any": 2.196039556148948, "sim_physics": 0.01754659175872803, "survival_time": 14.950000000000076, "driven_lanedir": 2.1929637182965305, "sim_render-ego": 0.03331644376118978, "in-drivable-lane": 0, "agent_compute-ego": 0.08195193449656168, "deviation-heading": 0.6869591234399757, "set_robot_commands": 0.05059731403986613, "deviation-center-line": 0.5528244200733968, "driven_lanedir_consec": 1.792732084218717, "sim_compute_sim_state": 0.020840903123219807, "sim_compute_performance-ego": 0.03542014439900716, "sim_compute_robot_state-ego": 0.03708198070526123, "sim_compute_robot_state-npc0": 0.03744139194488525, "sim_compute_robot_state-npc1": 0.03614476521809896, "sim_compute_robot_state-npc2": 0.03598997116088867, "sim_compute_robot_state-npc3": 0.03634913365046184}, "udem1-4-0": {"driven_any": 0.9910472848979056, "sim_physics": 0.01802157485572091, "survival_time": 6.849999999999984, "driven_lanedir": 0.8200254400615028, "sim_render-ego": 0.032482631015081476, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08110756073554937, "deviation-heading": 1.116445261034381, "set_robot_commands": 0.04959516455657291, "deviation-center-line": 0.20740334561747012, "driven_lanedir_consec": 0.8200254400615028, "sim_compute_sim_state": 0.02073685792240783, "sim_compute_performance-ego": 0.03568007302110213, "sim_compute_robot_state-ego": 0.0370025634765625, "sim_compute_robot_state-npc0": 0.03615674659283492, "sim_compute_robot_state-npc1": 0.03584890470017482, "sim_compute_robot_state-npc2": 0.035646821460584656, "sim_compute_robot_state-npc3": 0.035716521478917476}}
set_robot_commands_max	0.05283498196374802
set_robot_commands_mean	0.05124911754445962
set_robot_commands_median	0.05092070472072547
set_robot_commands_min	0.04959516455657291
sim_compute_performance-ego_max	0.038081465124272976
sim_compute_performance-ego_mean	0.0364368078139951
sim_compute_performance-ego_median	0.03568007302110213
sim_compute_performance-ego_min	0.03542014439900716
sim_compute_robot_state-ego_max	0.03926071666535877
sim_compute_robot_state-ego_mean	0.03776298518520659
sim_compute_robot_state-ego_median	0.03708198070526123
sim_compute_robot_state-ego_min	0.03684782646071743
sim_compute_robot_state-npc0_max	0.03895964346775392
sim_compute_robot_state-npc0_mean	0.037505556050310224
sim_compute_robot_state-npc0_median	0.03744139194488525
sim_compute_robot_state-npc0_min	0.03615674659283492
sim_compute_robot_state-npc1_max	0.038880989107034976
sim_compute_robot_state-npc1_mean	0.0371374093323757
sim_compute_robot_state-npc1_median	0.03642524799830477
sim_compute_robot_state-npc1_min	0.03584890470017482
sim_compute_robot_state-npc2_max	0.03846313758772247
sim_compute_robot_state-npc2_mean	0.03679155081757153
sim_compute_robot_state-npc2_median	0.036142847907375285
sim_compute_robot_state-npc2_min	0.035646821460584656
sim_compute_robot_state-npc3_max	0.038604388431626925
sim_compute_robot_state-npc3_mean	0.03713137405884254
sim_compute_robot_state-npc3_median	0.036710250545555434
sim_compute_robot_state-npc3_min	0.035716521478917476
sim_compute_sim_state_max	0.021775759807249315
sim_compute_sim_state_mean	0.021143970967699176
sim_compute_sim_state_median	0.020840903123219807
sim_compute_sim_state_min	0.02073685792240783
sim_physics_max	0.018506993241861565
sim_physics_mean	0.017937419829990076
sim_physics_median	0.01783115930960212
sim_physics_min	0.01754659175872803
sim_render-ego_max	0.03550867145344362
sim_render-ego_mean	0.03386982340013457
sim_render-ego_median	0.03331644376118978
sim_render-ego_min	0.032482631015081476
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.67000000000004
survival_time_min	6.849999999999984

No reset possible

19267

2908

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 13:30:03+00:00

2019-04-24 13:46:04+00:00

0:16:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8271231506019276
survival_time_median	12.650000000000045
deviation-center-line_median	0.19422385038083248
in-drivable-lane_median	1.3500000000000192

other stats

agent_compute-ego_max	0.12088955815130543
agent_compute-ego_mean	0.11276113103526546
agent_compute-ego_median	0.11259168227513631
agent_compute-ego_min	0.10748051194583667
deviation-center-line_max	0.3673522427484443
deviation-center-line_mean	0.2004244972541601
deviation-center-line_min	0.09249158498161757
deviation-heading_max	1.247355347484076
deviation-heading_mean	0.8337819790887163
deviation-heading_median	0.7341811531555407
deviation-heading_min	0.6083993837505045
driven_any_max	2.560662072301928
driven_any_mean	1.7710044930965032
driven_any_median	2.15884516313558
driven_any_min	0.9883350327659728
driven_lanedir_consec_max	2.411593141590049
driven_lanedir_consec_mean	1.5113977634838711
driven_lanedir_consec_min	0.6580933868519545
driven_lanedir_max	2.411593141590049
driven_lanedir_mean	1.5113979328039633
driven_lanedir_median	1.8271231506019276
driven_lanedir_min	0.6580933868519545
in-drivable-lane_max	1.649999999999994
in-drivable-lane_mean	1.2500000000000075
in-drivable-lane_min	0.4500000000000064
per-episodes	details {"udem1-0-0": {"driven_any": 2.1588451644447373, "sim_physics": 0.017460088956026222, "survival_time": 12.650000000000045, "driven_lanedir": 1.904348335715376, "sim_render-ego": 0.033452052843900536, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.11397683856044362, "deviation-heading": 0.6256771825392189, "set_robot_commands": 0.05098682712660477, "deviation-center-line": 0.22832154901414045, "driven_lanedir_consec": 1.9043474891149144, "sim_compute_sim_state": 0.020983787393381474, "sim_compute_performance-ego": 0.03624843891430278, "sim_compute_robot_state-ego": 0.03750494252080503, "sim_compute_robot_state-npc0": 0.03743208915348581, "sim_compute_robot_state-npc1": 0.03721456282694821, "sim_compute_robot_state-npc2": 0.036678306670056976, "sim_compute_robot_state-npc3": 0.03686566315149601}, "udem1-1-0": {"driven_any": 0.988335032834298, "sim_physics": 0.017640398330047352, "survival_time": 5.949999999999987, "driven_lanedir": 0.6580933868519545, "sim_render-ego": 0.03170664370560847, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10886706424360516, "deviation-heading": 0.7341811531555407, "set_robot_commands": 0.04879620896667993, "deviation-center-line": 0.09249158498161757, "driven_lanedir_consec": 0.6580933868519545, "sim_compute_sim_state": 0.02004389402245273, "sim_compute_performance-ego": 0.03409320366482775, "sim_compute_robot_state-ego": 0.03589129247585265, "sim_compute_robot_state-npc0": 0.03555364368342552, "sim_compute_robot_state-npc1": 0.03565663049201004, "sim_compute_robot_state-npc2": 0.0354227558905337, "sim_compute_robot_state-npc3": 0.03501994669938288}, "udem1-2-0": {"driven_any": 2.15884516313558, "sim_physics": 0.01848648093905845, "survival_time": 12.650000000000045, "driven_lanedir": 1.8271231506019276, "sim_render-ego": 0.037183435538069534, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.12088955815130543, "deviation-heading": 0.9532968285142414, "set_robot_commands": 0.05506078527850125, "deviation-center-line": 0.19422385038083248, "driven_lanedir_consec": 1.8271231506019276, "sim_compute_sim_state": 0.032934498881162864, "sim_compute_performance-ego": 0.03923606307139039, "sim_compute_robot_state-ego": 0.04169152565153219, "sim_compute_robot_state-npc0": 0.03990958142186342, "sim_compute_robot_state-npc1": 0.03986643802507121, "sim_compute_robot_state-npc2": 0.040997340273951355, "sim_compute_robot_state-npc3": 0.03999028375497449}, "udem1-3-0": {"driven_any": 2.560662072301928, "sim_physics": 0.017468746503194174, "survival_time": 14.950000000000076, "driven_lanedir": 2.411593141590049, "sim_render-ego": 0.03350884914398193, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.11259168227513631, "deviation-heading": 1.247355347484076, "set_robot_commands": 0.05157626708348592, "deviation-center-line": 0.3673522427484443, "driven_lanedir_consec": 2.411593141590049, "sim_compute_sim_state": 0.0207731302579244, "sim_compute_performance-ego": 0.03567875067392985, "sim_compute_robot_state-ego": 0.037297494411468506, "sim_compute_robot_state-npc0": 0.03750341733296712, "sim_compute_robot_state-npc1": 0.03773792902628581, "sim_compute_robot_state-npc2": 0.036634867191314695, "sim_compute_robot_state-npc3": 0.03665344556172689}, "udem1-4-0": {"driven_any": 0.9883350327659728, "sim_physics": 0.01732286284951603, "survival_time": 5.949999999999987, "driven_lanedir": 0.7558316492605099, "sim_render-ego": 0.03140283231975652, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.10748051194583667, "deviation-heading": 0.6083993837505045, "set_robot_commands": 0.04800186638070756, "deviation-center-line": 0.11973325914576528, "driven_lanedir_consec": 0.7558316492605099, "sim_compute_sim_state": 0.019750701279199423, "sim_compute_performance-ego": 0.03357697134258367, "sim_compute_robot_state-ego": 0.035275419219201354, "sim_compute_robot_state-npc0": 0.03528238144241461, "sim_compute_robot_state-npc1": 0.03520178394157346, "sim_compute_robot_state-npc2": 0.03656589083310937, "sim_compute_robot_state-npc3": 0.03469112540493492}}
set_robot_commands_max	0.05506078527850125
set_robot_commands_mean	0.050884390967195894
set_robot_commands_median	0.05098682712660477
set_robot_commands_min	0.04800186638070756
sim_compute_performance-ego_max	0.03923606307139039
sim_compute_performance-ego_mean	0.03576668553340689
sim_compute_performance-ego_median	0.03567875067392985
sim_compute_performance-ego_min	0.03357697134258367
sim_compute_robot_state-ego_max	0.04169152565153219
sim_compute_robot_state-ego_mean	0.03753213485577195
sim_compute_robot_state-ego_median	0.037297494411468506
sim_compute_robot_state-ego_min	0.035275419219201354
sim_compute_robot_state-npc0_max	0.03990958142186342
sim_compute_robot_state-npc0_mean	0.0371362226068313
sim_compute_robot_state-npc0_median	0.03743208915348581
sim_compute_robot_state-npc0_min	0.03528238144241461
sim_compute_robot_state-npc1_max	0.03986643802507121
sim_compute_robot_state-npc1_mean	0.03713546886237775
sim_compute_robot_state-npc1_median	0.03721456282694821
sim_compute_robot_state-npc1_min	0.03520178394157346
sim_compute_robot_state-npc2_max	0.040997340273951355
sim_compute_robot_state-npc2_mean	0.037259832171793225
sim_compute_robot_state-npc2_median	0.036634867191314695
sim_compute_robot_state-npc2_min	0.0354227558905337
sim_compute_robot_state-npc3_max	0.03999028375497449
sim_compute_robot_state-npc3_mean	0.03664409291450303
sim_compute_robot_state-npc3_median	0.03665344556172689
sim_compute_robot_state-npc3_min	0.03469112540493492
sim_compute_sim_state_max	0.032934498881162864
sim_compute_sim_state_mean	0.022897202366824177
sim_compute_sim_state_median	0.0207731302579244
sim_compute_sim_state_min	0.019750701279199423
sim_physics_max	0.01848648093905845
sim_physics_mean	0.017675715515568447
sim_physics_median	0.017468746503194174
sim_physics_min	0.01732286284951603
sim_render-ego_max	0.037183435538069534
sim_render-ego_mean	0.0334507627102634
sim_render-ego_median	0.033452052843900536
sim_render-ego_min	0.03140283231975652
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.430000000000028
survival_time_min	5.949999999999987

No reset possible

19265

2914

Python template

aido2-AMOD-efficiency

step2-scoring

success

yes

2019-04-24 13:29:04+00:00

2019-04-24 13:29:23+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-63.526214330432005

other stats

fleet_size	-1000000000
service_quality	-32.56412358260868

No reset possible

19262

2915

Python template

step2-scoring

success

yes

2019-04-24 13:28:02+00:00

2019-04-24 13:28:25+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.64669427156592

other stats

efficiency	-63.78657708626075
fleet_size	-1000000000

No reset possible

19253

2915

Python template

step1-simulation

success

yes

aido2-LF-sim-validation

2019-04-24 13:24:57+00:00

2019-04-24 13:27:49+00:00

0:02:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19245

2945

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

success

aido2-LFV-sim-validation

2019-04-24 13:19:48+00:00

2019-04-24 13:24:15+00:00

0:04:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13466707717166138
survival_time_median	1.2500000000000004
deviation-center-line_median	0.0557348641954442
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09844604134559631
agent_compute-ego_mean	0.09357872068523164
agent_compute-ego_median	0.09347088440604832
agent_compute-ego_min	0.08742251396179199
deviation-center-line_max	0.05645943635809242
deviation-center-line_mean	0.05505024071592932
deviation-center-line_min	0.05178164008839599
deviation-heading_max	0.6634096327819101
deviation-heading_mean	0.6117129144559605
deviation-heading_median	0.6114803517152034
deviation-heading_min	0.5468581874194114
driven_any_max	0.21992823735345857
driven_any_mean	0.19053594626758685
driven_any_median	0.1896375298740462
driven_any_min	0.16879849937949568
driven_lanedir_consec_max	0.1750508646569564
driven_lanedir_consec_mean	0.13952669766026032
driven_lanedir_consec_min	0.11401079809030978
driven_lanedir_max	0.1750508646569564
driven_lanedir_mean	0.13952669766026032
driven_lanedir_median	0.13466707717166138
driven_lanedir_min	0.11401079809030978
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21992823735345857, "sim_physics": 0.009703443600581242, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1750508646569564, "sim_render-ego": 0.031572433618398815, "in-drivable-lane": 0, "agent_compute-ego": 0.09171484066889836, "deviation-heading": 0.5468581874194114, "set_robot_commands": 0.04836267691392165, "deviation-center-line": 0.05585446258112939, "driven_lanedir_consec": 0.1750508646569564, "sim_compute_sim_state": 0.019875095440791204, "sim_compute_performance-ego": 0.034882646340590254, "sim_compute_robot_state-ego": 0.035644127772404596}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20011486609534443, "sim_physics": 0.009525861740112305, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1554723636108849, "sim_render-ego": 0.03214668273925781, "in-drivable-lane": 0, "agent_compute-ego": 0.08742251396179199, "deviation-heading": 0.577315825447828, "set_robot_commands": 0.04966856956481933, "deviation-center-line": 0.0557348641954442, "driven_lanedir_consec": 0.1554723636108849, "sim_compute_sim_state": 0.019762001037597655, "sim_compute_performance-ego": 0.034803762435913085, "sim_compute_robot_state-ego": 0.03669743537902832}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17420059863558943, "sim_physics": 0.01115297277768453, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1184323847714892, "sim_render-ego": 0.03598191340764364, "in-drivable-lane": 0, "agent_compute-ego": 0.09844604134559631, "deviation-heading": 0.6634096327819101, "set_robot_commands": 0.05306788285573324, "deviation-center-line": 0.055420800356584594, "driven_lanedir_consec": 0.1184323847714892, "sim_compute_sim_state": 0.021538664897282917, "sim_compute_performance-ego": 0.044600615898768105, "sim_compute_robot_state-ego": 0.03900795181592306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16879849937949568, "sim_physics": 0.010531456574149754, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11401079809030978, "sim_render-ego": 0.03435329768968665, "in-drivable-lane": 0, "agent_compute-ego": 0.09347088440604832, "deviation-heading": 0.6114803517152034, "set_robot_commands": 0.05231888397880222, "deviation-center-line": 0.05178164008839599, "driven_lanedir_consec": 0.11401079809030978, "sim_compute_sim_state": 0.021321047907290253, "sim_compute_performance-ego": 0.03538282021232273, "sim_compute_robot_state-ego": 0.03775653631790825}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1896375298740462, "sim_physics": 0.011243057250976563, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13466707717166138, "sim_render-ego": 0.03638649940490723, "in-drivable-lane": 0, "agent_compute-ego": 0.09683932304382324, "deviation-heading": 0.6595005749154499, "set_robot_commands": 0.05497519493103027, "deviation-center-line": 0.05645943635809242, "driven_lanedir_consec": 0.13466707717166138, "sim_compute_sim_state": 0.023829030990600585, "sim_compute_performance-ego": 0.03895589828491211, "sim_compute_robot_state-ego": 0.039439945220947265}}
set_robot_commands_max	0.05497519493103027
set_robot_commands_mean	0.051678641648861344
set_robot_commands_median	0.05231888397880222
set_robot_commands_min	0.04836267691392165
sim_compute_performance-ego_max	0.044600615898768105
sim_compute_performance-ego_mean	0.03772514863450126
sim_compute_performance-ego_median	0.03538282021232273
sim_compute_performance-ego_min	0.034803762435913085
sim_compute_robot_state-ego_max	0.039439945220947265
sim_compute_robot_state-ego_mean	0.037709199301242294
sim_compute_robot_state-ego_median	0.03775653631790825
sim_compute_robot_state-ego_min	0.035644127772404596
sim_compute_sim_state_max	0.023829030990600585
sim_compute_sim_state_mean	0.021265168054712524
sim_compute_sim_state_median	0.021321047907290253
sim_compute_sim_state_min	0.019762001037597655
sim_physics_max	0.011243057250976563
sim_physics_mean	0.01043135838870088
sim_physics_median	0.010531456574149754
sim_physics_min	0.009525861740112305
sim_render-ego_max	0.03638649940490723
sim_render-ego_mean	0.034088165371978826
sim_render-ego_median	0.03435329768968665
sim_render-ego_min	0.031572433618398815
simulation-passed	1
survival_time_max	1.3000000000000005
survival_time_mean	1.2300000000000004
survival_time_min	1.1500000000000004

No reset possible

19237

2949

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

success