AI Driving Olympics Home Challenges Submissions Jobs

Submission 3505

Submission3505
Competingyes
Challengeaido2-LF-real-validation
UserBea Baselines
Date submitted
Complete⏲️
DetailsReady to do eval1.
Sisters
Result
Jobseval0: 23062 eval0-videos: 23095 eval0-videos-autobots: 23443 eval0-videos-watchtowers: 23520 eval1: 23342
Nexteval1
User labelchallenge-aido_LF-template-pytorch
Admin priority90
Blessing90
User priority

23520

23443

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
235203505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-watchtowerssuccessyes-0:22:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
234503505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-watchtowersabortedyes-3:00:37
Waited 10802 seconds [...]
Waited 10802 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
234433505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotssuccessyes-0:11:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
234283505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotshost-erroryes-0:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/client.py", line 225, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 660, in run_single
    timeout_sec=timeout_sec)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 735, in run_one
    client = check_docker_environment()
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

Make sure the docker service is running.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
234193505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotshost-erroryes-0:01:08
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23419-246731', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23419-246731', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Some networks were defined but are not used by any service: evaluation
stderr | Creating volume "job23419-246731_fifos" with default driver
stderr | Creating job23419-246731_evaluator_1 ...
stderr | 
stderr | Creating job23419-246731_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23419-246731_evaluator_1  Cannot start service evaluator: error while creating mount source path '/ipfs': mkdir /ipfs: file exists
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: error while creating mount source path '/ipfs': mkdir /ipfs: file exists
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233503505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval1-videos-watchtowerssuccessno-0:07:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
233483505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval1-videos-autobotssuccessno-0:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
233423505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval1successyes-0:33:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0
survival_time_median0.5


other stats
01_start
details{"1_01attemptDate": {"name": "1_01attemptDate", "output": "2019-05-18", "readable_string": "Attempt date"}, "1_03autolabName": {"name": "1_03autolabName", "output": "ETHZ", "readable_string": "Autolab"}, "1_04operatorName": {"name": "1_04operatorName", "output": "Pascal", "readable_string": "Operator's name"}}
02_autolab_setup
details{"2_04ledLightsOn": {"name": "2_04ledLightsOn", "output": true, "readable_string": "Ceiling led lightbulbs are on with a bright white color"}, "2_01mapConformity": {"name": "2_01mapConformity", "output": true, "readable_string": "Conformity of the map"}, "2_05curtainsClosed": {"name": "2_05curtainsClosed", "output": true, "readable_string": "The curtains are closed"}, "2_02pairedHostnames": {"name": "2_02pairedHostnames", "output": true, "readable_string": "Pairing hostnames to duckiebot-IDs"}, "2_03ceilingLightsOff": {"name": "2_03ceilingLightsOff", "output": true, "readable_string": "Ceiling default neon lights are off"}, "2_multi01_duckiebot_select_autobot01": {"name": "2_multi01_duckiebot_select_autobot01", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot02": {"name": "2_multi01_duckiebot_select_autobot02", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot03": {"name": "2_multi01_duckiebot_select_autobot03", "output": "active", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot04": {"name": "2_multi01_duckiebot_select_autobot04", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot05": {"name": "2_multi01_duckiebot_select_autobot05", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot06": {"name": "2_multi01_duckiebot_select_autobot06", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot07": {"name": "2_multi01_duckiebot_select_autobot07", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot08": {"name": "2_multi01_duckiebot_select_autobot08", "output": "not_used", "readable_string": "Selection among available duckiebot"}}
03_setup_validation
details{"3_11freeMemory": {"name": "3_11freeMemory", "output": true, "readable_string": "All agents have enough free memory"}, "3_01robotsAreOn": {"name": "3_01robotsAreOn", "output": true, "readable_string": "All duckiebots are on"}, "3_09agentsPinged": {"name": "3_09agentsPinged", "output": true, "readable_string": "All agents have been pinged"}, "3_03duckiesOnBots": {"name": "3_03duckiesOnBots", "output": true, "readable_string": "All autobots received yeelow or black duckies (according to active of passive)"}, "3_08attemptNumber": {"name": "3_08attemptNumber", "output": "7", "readable_string": "Attempt number"}, "3_04batteryChecked": {"name": "3_04batteryChecked", "output": true, "readable_string": "All duckiebots have enough battery"}, "3_06agentPlacement": {"name": "3_06agentPlacement", "output": true, "readable_string": "Placement of the duckiebots"}, "3_02aprilTagsPlates": {"name": "3_02aprilTagsPlates", "output": true, "readable_string": "All duckiebots have their april tag backplate, in the right orientation"}, "3_05agentsPluggedIn": {"name": "3_05agentsPluggedIn", "output": true, "readable_string": "All non-movable agents (watchtowers and trafficlights) are plugged in (alimentation and ethernet)"}, "3_10readWriteMemory": {"name": "3_10readWriteMemory", "output": true, "readable_string": "All agents have been tested for read and write on their logging device (USB stick)"}, "3_07lightCheckedReport": {"name": "3_07lightCheckedReport", "output": true, "readable_string": "Report on light conditions"}, "3_hidden_autolab_helper_command": {"name": "3_hidden_autolab_helper_command", "output": "python3 autolab_helper_script.py 3505 aido2-LF-real-validation autobot03 ", "readable_string": "The autolab helper script launch command"}}
04_initialization
details{"4_01duckiebotInterfaceStarted": {"name": "4_01duckiebotInterfaceStarted", "output": true, "readable_string": "All duckiebots have stared their duckiebot interface container"}, "4_02submissionContainerLoaded": {"name": "4_02submissionContainerLoaded", "output": true, "readable_string": "All active duckiebots have loaded the submission container"}, "4_04agentsStartedLoggerContainers": {"name": "4_04agentsStartedLoggerContainers", "output": true, "readable_string": "All agents have loaded and started the logger container"}, "4_03passiveDuckiebotsContainerLoaded": {"name": "4_03passiveDuckiebotsContainerLoaded", "output": false, "readable_string": "All passive duckiebots have loaded the passive behavior container"}}
05_confirmation
details{"5_01operatorIsReady": {"name": "5_01operatorIsReady", "output": true, "readable_string": "The operator is ready to start"}, "5_02serverInitializationError": {"name": "5_02serverInitializationError", "output": "", "readable_string": "The server initialization error message"}}
06_execution
details{"6_06visualCheck": {"name": "6_06visualCheck", "output": "", "readable_string": "Comment from operator on visual check of launching"}, "6_03beginTimeStamp": {"name": "6_03beginTimeStamp", "output": "1558213372.980365", "readable_string": "Beginning timestamp (useful for attempt evaluation)"}, "6_01launchedAttempt": {"name": "6_01launchedAttempt", "output": true, "readable_string": "The attempt was successfully launched"}, "6_02serverLaunchError": {"name": "6_02serverLaunchError", "output": "", "readable_string": "The server launch error message"}, "6_09watchtowerLoggings": {"name": "6_09watchtowerLoggings", "output": false, "readable_string": "Watchtowers started logging data"}, "6_10serverLoggingCheck": {"name": "6_10serverLoggingCheck", "output": "", "readable_string": "Logging error message from the server"}, "6_07activeDuckiebotLogging": {"name": "6_07activeDuckiebotLogging", "output": false, "readable_string": "Active duckiebots started logging data"}, "6_08passiveDuckiebotLogging": {"name": "6_08passiveDuckiebotLogging", "output": false, "readable_string": "Passive duckiebots started logging data"}, "6_04activeDuckiebotsAreRunningVisualCheck": {"name": "6_04activeDuckiebotsAreRunningVisualCheck", "output": true, "readable_string": "Active duckiebots started moving after launch"}, "6_05passiveDuckiebotsAreRunningVisualCheck": {"name": "6_05passiveDuckiebotsAreRunningVisualCheck", "output": false, "readable_string": "Passive duckiebots started moving after launch"}}
07_monitoring_and_termination
details{"7_05errorReason": {"name": "7_05errorReason", "output": "no_error", "readable_string": "Reason for error"}, "7_01endTimeStamp": {"name": "7_01endTimeStamp", "output": "1558213379.500927", "readable_string": "end of the experiment timestamp"}, "7_03failureReason": {"name": "7_03failureReason", "output": "no_failure", "readable_string": "Reason for failure"}, "7_06errorComments": {"name": "7_06errorComments", "output": "", "readable_string": "Comment on error reason"}, "7_02attemptSuccess": {"name": "7_02attemptSuccess", "output": "success", "readable_string": "Outcome of the attempt"}, "7_04failureComments": {"name": "7_04failureComments", "output": "", "readable_string": "Comment on failure reason"}, "7_07outcomechecking": {"name": "7_07outcomechecking", "output": false, "readable_string": "Checked that the outcome matched the given reasons"}}
08_retrieving_and_checking_logs
details{"8_01bagsCopied": {"name": "8_01bagsCopied", "output": true, "readable_string": "All bags were successfully copied"}, "8_03bagsClipped": {"name": "8_03bagsClipped", "output": false, "readable_string": "All bags were clipped with the time stamps"}, "8_02bagsVerified": {"name": "8_02bagsVerified", "output": true, "readable_string": "The contents of all bags was verified"}, "8_04agentsCleaned": {"name": "8_04agentsCleaned", "output": true, "readable_string": "All agents were cleaned from bags"}}
09_evaluation
details{"9_02timeTravelled": {"name": "9_02timeTravelled", "output": ".5", "readable_string": "How many seconds did the Duckiebot successfully travel"}, "9_01tilesTravelled": {"name": "9_01tilesTravelled", "output": "0", "readable_string": "How many tiles did the Duckiebot successfully travel"}}
10_saving_data
details{"10_02dataIpfsHash": {"name": "10_02dataIpfsHash", "output": "QmRUJteuSEb8msBxqqSuxmhfAe7uBhsDhWz9w8MATGLQn9", "readable_string": "IPFS hash of the experiment"}, "10_04cleanupCheck": {"name": "10_04cleanupCheck", "output": false, "readable_string": "The IPFS Docker terminal and the local storage were cleaned"}, "10_05autolabCleaned": {"name": "10_05autolabCleaned", "output": true, "readable_string": "Autolab was cleaned after the end of the experiment"}, "10_01dataUploadCheck": {"name": "10_01dataUploadCheck", "output": false, "readable_string": "The data was uploaded to the IDSC NAS"}, "10_03dataPinningCheck": {"name": "10_03dataPinningCheck", "output": false, "readable_string": "The data is accessible through IPFS"}}
233393505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval1host-erroryes-0:02:03
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23339-766489', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23339-766489', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job23339-766489_evaluation" with the default driver
stderr | Creating volume "job23339-766489_fifos" with default driver
stderr | Creating job23339-766489_evaluator_1 ...
stderr | 
stderr | Creating job23339-766489_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23339-766489_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23339-766489_evaluator_1 (b815c74b51c4ebeba24564c26b7b719e3b8f6ef94d8417c3140d86d74feaf0be): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23339-766489_evaluator_1 (b815c74b51c4ebeba24564c26b7b719e3b8f6ef94d8417c3140d86d74feaf0be): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233203505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-watchtowerssuccessno-0:09:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
232723505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-watchtowersabortedno-0:06:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
232663505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotssuccessno-0:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
232313505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotstimeoutno-1:05:47
I can see how the jo [...]
I can see how the job 23231 is timeout because passed 3947 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
232263505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotsabortedno-0:01:13
Timeout because eval [...]
Timeout because evaluator contacted us
Hidden. If you are the author, please login using the top-right link or use the dashboard.
232043505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotstimeoutno-0:00:57
Timeout because eval [...]
Timeout because evaluator contacted us
Hidden. If you are the author, please login using the top-right link or use the dashboard.
231513505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval1host-erroryes-0:00:05
Could not access IPF [...]
Could not access IPFS data:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1176, in download_artefacts
    raise IPFSException(msg)
duckietown_challenges_runner.runner.IPFSException: Need IPFS for this submission
Hidden. If you are the author, please login using the top-right link or use the dashboard.
231373505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-watchtowersabortedno-4:52:13
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1217, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner_cache.py", line 27, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1232, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1270, in get_object
    aws_object.download_file(fn)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/s3transfer-0.2.0-py3.7.egg/s3transfer/futures.py", line 109, in result
    raise e
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/s3transfer-0.2.0-py3.7.egg/s3transfer/futures.py", line 106, in result
    return self._coordinator.result()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/s3transfer-0.2.0-py3.7.egg/s3transfer/futures.py", line 260, in result
    self._done_event.wait(MAXINT)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/threading.py", line 552, in wait
    signaled = self._cond.wait(timeout)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/threading.py", line 296, in wait
    waiter.acquire()
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 1375, in upload
    aws_object.load()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/boto3-1.9.115-py3.7.egg/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 135, in _send_request
    request, operation_model, context)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 167, in _get_response
    request, operation_model)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/endpoint.py", line 244, in _send
    return self.http_session.send(request)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/botocore-1.12.115-py3.7.egg/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 343, in _make_request
    self._validate_conn(conn)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 839, in _validate_conn
    conn.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connection.py", line 301, in connect
    conn = self._new_conn()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection
    sock.connect(sa)
KeyboardInterrupt
Hidden. If you are the author, please login using the top-right link or use the dashboard.
231333505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videos-autobotssuccessno-0:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
230953505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0-videoshost-erroryes-0:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 101, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 71, in create_connection
    raise err
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 62, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1144, in download_artefacts
    client = ipfsapi.connect('127.0.0.1', 5001)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 88, in connect
    assert_version(client.version()['Version'])
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/miscellaneous.py", line 204, in version
    return self._client.request('/version', decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 282, in _request
    timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 245, in _do_request
    return requests.request(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 240, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 219, in request
    return super(Session, self).request(method, url, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connection.py", line 181, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/requests_wrapper.py", line 108, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
pip._vendor.requests.packages.urllib3.exceptions.NewConnectionError: <ipfshttpclient.requests_wrapper.HTTPConnection object at 0x7f52b5ce79b0>: Failed to establish a new connection: [Errno 111] Connection refused
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230623505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0successyes-7:29:12
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0
survival_time_median1


other stats
01_start
details{"1_01attemptDate": {"name": "1_01attemptDate", "output": "2019-05-17", "readable_string": "Attempt date"}, "1_03autolabName": {"name": "1_03autolabName", "output": "ETHZ", "readable_string": "Autolab"}, "1_04operatorName": {"name": "1_04operatorName", "output": "Nicole", "readable_string": "Operator's name"}}
02_autolab_setup
details{"2_04ledLightsOn": {"name": "2_04ledLightsOn", "output": true, "readable_string": "Ceiling led lightbulbs are on with a bright white color"}, "2_01mapConformity": {"name": "2_01mapConformity", "output": true, "readable_string": "Conformity of the map"}, "2_05curtainsClosed": {"name": "2_05curtainsClosed", "output": true, "readable_string": "The curtains are closed"}, "2_02pairedHostnames": {"name": "2_02pairedHostnames", "output": true, "readable_string": "Pairing hostnames to duckiebot-IDs"}, "2_03ceilingLightsOff": {"name": "2_03ceilingLightsOff", "output": true, "readable_string": "Ceiling default neon lights are off"}, "2_multi01_duckiebot_select_autobot01": {"name": "2_multi01_duckiebot_select_autobot01", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot02": {"name": "2_multi01_duckiebot_select_autobot02", "output": "active", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot03": {"name": "2_multi01_duckiebot_select_autobot03", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot04": {"name": "2_multi01_duckiebot_select_autobot04", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot05": {"name": "2_multi01_duckiebot_select_autobot05", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot06": {"name": "2_multi01_duckiebot_select_autobot06", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot07": {"name": "2_multi01_duckiebot_select_autobot07", "output": "not_used", "readable_string": "Selection among available duckiebot"}, "2_multi01_duckiebot_select_autobot08": {"name": "2_multi01_duckiebot_select_autobot08", "output": "not_used", "readable_string": "Selection among available duckiebot"}}
03_setup_validation
details{"3_11freeMemory": {"name": "3_11freeMemory", "output": true, "readable_string": "All agents have enough free memory"}, "3_01robotsAreOn": {"name": "3_01robotsAreOn", "output": true, "readable_string": "All duckiebots are on"}, "3_09agentsPinged": {"name": "3_09agentsPinged", "output": true, "readable_string": "All agents have been pinged"}, "3_03duckiesOnBots": {"name": "3_03duckiesOnBots", "output": true, "readable_string": "All autobots received yeelow or black duckies (according to active of passive)"}, "3_08attemptNumber": {"name": "3_08attemptNumber", "output": "6", "readable_string": "Attempt number"}, "3_04batteryChecked": {"name": "3_04batteryChecked", "output": true, "readable_string": "All duckiebots have enough battery"}, "3_06agentPlacement": {"name": "3_06agentPlacement", "output": true, "readable_string": "Placement of the duckiebots"}, "3_02aprilTagsPlates": {"name": "3_02aprilTagsPlates", "output": true, "readable_string": "All duckiebots have their april tag backplate, in the right orientation"}, "3_05agentsPluggedIn": {"name": "3_05agentsPluggedIn", "output": true, "readable_string": "All non-movable agents (watchtowers and trafficlights) are plugged in (alimentation and ethernet)"}, "3_10readWriteMemory": {"name": "3_10readWriteMemory", "output": true, "readable_string": "All agents have been tested for read and write on their logging device (USB stick)"}, "3_07lightCheckedReport": {"name": "3_07lightCheckedReport", "output": true, "readable_string": "Report on light conditions"}, "3_hidden_autolab_helper_command": {"name": "3_hidden_autolab_helper_command", "output": "python3 autolab_helper_script.py 3505 aido2-LF-real-validation autobot02 ", "readable_string": "The autolab helper script launch command"}}
04_initialization
details{"4_01duckiebotInterfaceStarted": {"name": "4_01duckiebotInterfaceStarted", "output": true, "readable_string": "All duckiebots have stared their duckiebot interface container"}, "4_02submissionContainerLoaded": {"name": "4_02submissionContainerLoaded", "output": true, "readable_string": "All active duckiebots have loaded the submission container"}, "4_04agentsStartedLoggerContainers": {"name": "4_04agentsStartedLoggerContainers", "output": true, "readable_string": "All agents have loaded and started the logger container"}, "4_03passiveDuckiebotsContainerLoaded": {"name": "4_03passiveDuckiebotsContainerLoaded", "output": false, "readable_string": "All passive duckiebots have loaded the passive behavior container"}}
05_confirmation
details{"5_01operatorIsReady": {"name": "5_01operatorIsReady", "output": true, "readable_string": "The operator is ready to start"}, "5_02serverInitializationError": {"name": "5_02serverInitializationError", "output": "", "readable_string": "The server initialization error message"}}
06_execution
details{"6_06visualCheck": {"name": "6_06visualCheck", "output": "", "readable_string": "Comment from operator on visual check of launching"}, "6_03beginTimeStamp": {"name": "6_03beginTimeStamp", "output": "1558083541.6722953", "readable_string": "Beginning timestamp (useful for attempt evaluation)"}, "6_01launchedAttempt": {"name": "6_01launchedAttempt", "output": true, "readable_string": "The attempt was successfully launched"}, "6_02serverLaunchError": {"name": "6_02serverLaunchError", "output": "", "readable_string": "The server launch error message"}, "6_09watchtowerLoggings": {"name": "6_09watchtowerLoggings", "output": false, "readable_string": "Watchtowers started logging data"}, "6_10serverLoggingCheck": {"name": "6_10serverLoggingCheck", "output": "", "readable_string": "Logging error message from the server"}, "6_07activeDuckiebotLogging": {"name": "6_07activeDuckiebotLogging", "output": false, "readable_string": "Active duckiebots started logging data"}, "6_08passiveDuckiebotLogging": {"name": "6_08passiveDuckiebotLogging", "output": false, "readable_string": "Passive duckiebots started logging data"}, "6_04activeDuckiebotsAreRunningVisualCheck": {"name": "6_04activeDuckiebotsAreRunningVisualCheck", "output": true, "readable_string": "Active duckiebots started moving after launch"}, "6_05passiveDuckiebotsAreRunningVisualCheck": {"name": "6_05passiveDuckiebotsAreRunningVisualCheck", "output": false, "readable_string": "Passive duckiebots started moving after launch"}}
07_monitoring_and_termination
details{"7_05errorReason": {"name": "7_05errorReason", "output": "no_error", "readable_string": "Reason for error"}, "7_01endTimeStamp": {"name": "7_01endTimeStamp", "output": "1558083580.5647707", "readable_string": "end of the experiment timestamp"}, "7_03failureReason": {"name": "7_03failureReason", "output": "other", "readable_string": "Reason for failure"}, "7_06errorComments": {"name": "7_06errorComments", "output": "", "readable_string": "Comment on error reason"}, "7_02attemptSuccess": {"name": "7_02attemptSuccess", "output": "failure", "readable_string": "Outcome of the attempt"}, "7_04failureComments": {"name": "7_04failureComments", "output": "Duckiebot turned on the spot", "readable_string": "Comment on failure reason"}, "7_07outcomechecking": {"name": "7_07outcomechecking", "output": false, "readable_string": "Checked that the outcome matched the given reasons"}}
08_retrieving_and_checking_logs
details{"8_01bagsCopied": {"name": "8_01bagsCopied", "output": true, "readable_string": "All bags were successfully copied"}, "8_03bagsClipped": {"name": "8_03bagsClipped", "output": false, "readable_string": "All bags were clipped with the time stamps"}, "8_02bagsVerified": {"name": "8_02bagsVerified", "output": true, "readable_string": "The contents of all bags was verified"}, "8_04agentsCleaned": {"name": "8_04agentsCleaned", "output": true, "readable_string": "All agents were cleaned from bags"}}
09_evaluation
details{"9_02timeTravelled": {"name": "9_02timeTravelled", "output": "1", "readable_string": "How many seconds did the Duckiebot successfully travel"}, "9_01tilesTravelled": {"name": "9_01tilesTravelled", "output": "0", "readable_string": "How many tiles did the Duckiebot successfully travel"}}
10_saving_data
details{"10_02dataIpfsHash": {"name": "10_02dataIpfsHash", "output": "QmVpsJY9CSJcrCQCXCXaxuopKk5HALN52VGGZPfHzTVRpc", "readable_string": "IPFS hash of the experiment"}, "10_04cleanupCheck": {"name": "10_04cleanupCheck", "output": false, "readable_string": "The IPFS Docker terminal and the local storage were cleaned"}, "10_05autolabCleaned": {"name": "10_05autolabCleaned", "output": true, "readable_string": "Autolab was cleaned after the end of the experiment"}, "10_01dataUploadCheck": {"name": "10_01dataUploadCheck", "output": false, "readable_string": "The data was uploaded to the IDSC NAS"}, "10_03dataPinningCheck": {"name": "10_03dataPinningCheck", "output": false, "readable_string": "The data is accessible through IPFS"}}
230613505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0abortedyes-----
230563505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0abortedyes-----
230493505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23049-936973', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23049-936973', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job23049-936973_evaluation" with the default driver
stderr | Creating volume "job23049-936973_fifos" with default driver
stderr | Creating job23049-936973_evaluator_1 ...
stderr | 
stderr | Creating job23049-936973_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23049-936973_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23049-936973_evaluator_1 (971b4fede6e1003e054f8924cadc44a4342022873acc259983c5bcc6730f0a56): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23049-936973_evaluator_1 (971b4fede6e1003e054f8924cadc44a4342022873acc259983c5bcc6730f0a56): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230463505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23046-169880', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23046-169880', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job23046-169880_evaluation" with the default driver
stderr | Creating volume "job23046-169880_fifos" with default driver
stderr | Creating job23046-169880_evaluator_1 ...
stderr | 
stderr | Creating job23046-169880_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23046-169880_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23046-169880_evaluator_1 (83381970bdacfdf43d0751efad26de340fc321b94810263a222e496e93acc014): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23046-169880_evaluator_1 (83381970bdacfdf43d0751efad26de340fc321b94810263a222e496e93acc014): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230413505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23041-347407', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23041-347407', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job23041-347407_evaluation" with the default driver
stderr | Creating volume "job23041-347407_fifos" with default driver
stderr | Creating job23041-347407_evaluator_1 ...
stderr | 
stderr | Creating job23041-347407_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23041-347407_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23041-347407_evaluator_1 (ba01e24c480c3378e3602e29b4b54dad27db5bce61e16c330e53d45380d01649): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23041-347407_evaluator_1 (ba01e24c480c3378e3602e29b4b54dad27db5bce61e16c330e53d45380d01649): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230373505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job23037-755466', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job23037-755466', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job23037-755466_evaluation" with the default driver
stderr | Creating volume "job23037-755466_fifos" with default driver
stderr | Creating job23037-755466_evaluator_1 ...
stderr | 
stderr | Creating job23037-755466_evaluator_1 ... error
stderr | 
stderr | ERROR: for job23037-755466_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23037-755466_evaluator_1 (cc287e463382e8aab0e5cdfc997c78c80b608ff6e22eca4c0d932a3deb22a450): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job23037-755466_evaluator_1 (cc287e463382e8aab0e5cdfc997c78c80b608ff6e22eca4c0d932a3deb22a450): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222873505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0timeoutyes-5:05:06
I can see how the jo [...]
I can see how the job 22287 is timeout because passed 18306 seconds and the timeout is 18000.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222843505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0erroryes-1 day, 3:48:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222713505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0successyes-1 day, 3:39:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2086526332348972
survival_time_median6.949999999999983


other stats
agent_compute-ego_max0.21067889725289693
agent_compute-ego_mean0.19979256113053545
agent_compute-ego_median0.19943488359451297
agent_compute-ego_min0.1930861194928487
deviation-center-line_max0.8522349806648031
deviation-center-line_mean0.4449430938506552
deviation-center-line_median0.2444485956279509
deviation-center-line_min0.120055287485535
deviation-heading_max4.20826178279054
deviation-heading_mean1.7906793549290585
deviation-heading_median1.2107298375230828
deviation-heading_min0.4894725258848177
driven_any_max4.1786078491146315
driven_any_mean2.3851656267103616
driven_any_median1.5947865260211784
driven_any_min1.0026705755585852
driven_lanedir_consec_max3.8559408153063943
driven_lanedir_consec_mean1.773103070747665
driven_lanedir_consec_min0.6694022467545477
driven_lanedir_max3.8559408153063943
driven_lanedir_mean2.0867141795163726
driven_lanedir_median1.2264238812789394
driven_lanedir_min0.6694022467545477
in-drivable-lane_max3.050000000000037
in-drivable-lane_mean2.0700000000000025
in-drivable-lane_median2.3999999999999915
in-drivable-lane_min0.799999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0026705755585852, "sim_physics": 0.09920056660970052, "survival_time": 2.549999999999999, "driven_lanedir": 0.6694022467545477, "sim_render-ego": 0.06026520448572496, "in-drivable-lane": 0.799999999999998, "agent_compute-ego": 0.19331231771730908, "deviation-heading": 0.4894725258848177, "set_robot_commands": 0.07784188494962804, "deviation-center-line": 0.120055287485535, "driven_lanedir_consec": 0.6694022467545477, "sim_compute_sim_state": 0.03474931155934053, "sim_compute_performance-ego": 0.05914783477783203, "sim_compute_robot_state-ego": 0.06001787092171464, "sim_compute_robot_state-npc0": 0.06795707403444777, "sim_compute_robot_state-npc1": 0.06130747234120088, "sim_compute_robot_state-npc2": 0.06115430009131338, "sim_compute_robot_state-npc3": 0.06217150594673905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.1786078491146315, "sim_physics": 0.10075597683588663, "survival_time": 14.950000000000076, "driven_lanedir": 3.8559408153063943, "sim_render-ego": 0.05658923228581746, "in-drivable-lane": 3.050000000000037, "agent_compute-ego": 0.19943488359451297, "deviation-heading": 2.4469227190218192, "set_robot_commands": 0.07467744509379069, "deviation-center-line": 0.8522349806648031, "driven_lanedir_consec": 3.8559408153063943, "sim_compute_sim_state": 0.03481680949529012, "sim_compute_performance-ego": 0.05884217023849488, "sim_compute_robot_state-ego": 0.060478603839874266, "sim_compute_robot_state-npc0": 0.0657290530204773, "sim_compute_robot_state-npc1": 0.06167898019154867, "sim_compute_robot_state-npc2": 0.06108651240666707, "sim_compute_robot_state-npc3": 0.06154445091883341}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.647810777351925, "sim_physics": 0.10150828202565512, "survival_time": 14.950000000000076, "driven_lanedir": 3.473151321007083, "sim_render-ego": 0.05503617127736409, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.1930861194928487, "deviation-heading": 4.20826178279054, "set_robot_commands": 0.07688252131144206, "deviation-center-line": 0.8013348352795534, "driven_lanedir_consec": 1.9468901471543223, "sim_compute_sim_state": 0.03451348384221395, "sim_compute_performance-ego": 0.05894213755925497, "sim_compute_robot_state-ego": 0.05888108491897583, "sim_compute_robot_state-npc0": 0.06452495336532593, "sim_compute_robot_state-npc1": 0.06160538832346598, "sim_compute_robot_state-npc2": 0.060937782923380535, "sim_compute_robot_state-npc3": 0.06035191218058268}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5947865260211784, "sim_physics": 0.10548435478675657, "survival_time": 4.099999999999993, "driven_lanedir": 1.2086526332348972, "sim_render-ego": 0.0537164065896011, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.21067889725289693, "deviation-heading": 0.5980099094250326, "set_robot_commands": 0.0749673901534662, "deviation-center-line": 0.206641770195434, "driven_lanedir_consec": 1.2086526332348972, "sim_compute_sim_state": 0.034001318419851906, "sim_compute_performance-ego": 0.05765502336548596, "sim_compute_robot_state-ego": 0.058891895340710154, "sim_compute_robot_state-npc0": 0.06476544461599211, "sim_compute_robot_state-npc1": 0.06051057722510361, "sim_compute_robot_state-npc2": 0.06144691967382664, "sim_compute_robot_state-npc3": 0.059904921345594456}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5019524055054905, "sim_physics": 0.09468475177133684, "survival_time": 6.949999999999983, "driven_lanedir": 1.2264238812789394, "sim_render-ego": 0.0577845933626024, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.20245058759510945, "deviation-heading": 1.2107298375230828, "set_robot_commands": 0.07538263574778604, "deviation-center-line": 0.2444485956279509, "driven_lanedir_consec": 1.1846295112881622, "sim_compute_sim_state": 0.033905583319904134, "sim_compute_performance-ego": 0.06076561804298017, "sim_compute_robot_state-ego": 0.05929362688133185, "sim_compute_robot_state-npc0": 0.0683653303187528, "sim_compute_robot_state-npc1": 0.06235475334332144, "sim_compute_robot_state-npc2": 0.061021216481709654, "sim_compute_robot_state-npc3": 0.06055706181972147}}
set_robot_commands_max0.07784188494962804
set_robot_commands_mean0.0759503754512226
set_robot_commands_median0.07538263574778604
set_robot_commands_min0.07467744509379069
sim_compute_performance-ego_max0.06076561804298017
sim_compute_performance-ego_mean0.059070556796809594
sim_compute_performance-ego_median0.05894213755925497
sim_compute_performance-ego_min0.05765502336548596
sim_compute_robot_state-ego_max0.060478603839874266
sim_compute_robot_state-ego_mean0.05951261638052134
sim_compute_robot_state-ego_median0.05929362688133185
sim_compute_robot_state-ego_min0.05888108491897583
sim_compute_robot_state-npc0_max0.0683653303187528
sim_compute_robot_state-npc0_mean0.06626837107099917
sim_compute_robot_state-npc0_median0.0657290530204773
sim_compute_robot_state-npc0_min0.06452495336532593
sim_compute_robot_state-npc1_max0.06235475334332144
sim_compute_robot_state-npc1_mean0.06149143428492811
sim_compute_robot_state-npc1_median0.06160538832346598
sim_compute_robot_state-npc1_min0.06051057722510361
sim_compute_robot_state-npc2_max0.06144691967382664
sim_compute_robot_state-npc2_mean0.06112934631537946
sim_compute_robot_state-npc2_median0.06108651240666707
sim_compute_robot_state-npc2_min0.060937782923380535
sim_compute_robot_state-npc3_max0.06217150594673905
sim_compute_robot_state-npc3_mean0.06090597044229421
sim_compute_robot_state-npc3_median0.06055706181972147
sim_compute_robot_state-npc3_min0.059904921345594456
sim_compute_sim_state_max0.03481680949529012
sim_compute_sim_state_mean0.03439730132732013
sim_compute_sim_state_median0.03451348384221395
sim_compute_sim_state_min0.033905583319904134
sim_physics_max0.10548435478675657
sim_physics_mean0.10032678640586716
sim_physics_median0.10075597683588663
sim_physics_min0.09468475177133684
sim_render-ego_max0.06026520448572496
sim_render-ego_mean0.056678321600222
sim_render-ego_median0.05658923228581746
sim_render-ego_min0.0537164065896011
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.700000000000028
survival_time_min2.549999999999999
222333505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job22233-846314', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job22233-846314', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job22233-846314_evaluation" with the default driver
stderr | Creating volume "job22233-846314_fifos" with default driver
stderr | Creating job22233-846314_evaluator_1 ...
stderr | 
stderr | Creating job22233-846314_evaluator_1 ... error
stderr | 
stderr | ERROR: for job22233-846314_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job22233-846314_evaluator_1 (cdd507da1da4b78cf90dbe2e773d61e73c3bdd6ecaf6d48c22c067bb04b5f8a9): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job22233-846314_evaluator_1 (cdd507da1da4b78cf90dbe2e773d61e73c3bdd6ecaf6d48c22c067bb04b5f8a9): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222203505Bea Baselineschallenge-aido_LF-template-pytorchaido2-LF-real-validationeval0host-erroryes-0:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job22220-597382', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job22220-597382', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job22220-597382_evaluation" with the default driver
stderr | Creating volume "job22220-597382_fifos" with default driver
stderr | Creating job22220-597382_evaluator_1 ...
stderr | 
stderr | Creating job22220-597382_evaluator_1 ... error
stderr | 
stderr | ERROR: for job22220-597382_evaluator_1  Cannot start service evaluator: driver failed programming external connectivity on endpoint job22220-597382_evaluator_1 (cccb370478b69d35038af922e80f1973e5fa2cadc0c5c339835464fc258ccf27): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: driver failed programming external connectivity on endpoint job22220-597382_evaluator_1 (cccb370478b69d35038af922e80f1973e5fa2cadc0c5c339835464fc258ccf27): Bind for 0.0.0.0:8005 failed: port is already allocated
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.