Duckietown Challenges Home Challenges Submissions

Submission 28282

Submission28282
Competingyes
Challengelx22-BV1
Useruser9701
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 195952 sim-1of5: 195873 sim-2of5: 195881 sim-3of5: 195860 sim-4of5: 195879
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

195952

Click the images to see detailed statistics about the episode.

d30

195881

Click the images to see detailed statistics about the episode.

d40

195879

Click the images to see detailed statistics about the episode.

d60

195873

Click the images to see detailed statistics about the episode.

d45

195860

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
195952sim-0of5successyes0:17:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.36497939299940174


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.36497939299940174
distance-from-start_median0.36497939299940174
distance-from-start_min0.36497939299940174
driven_any_max0.9153950913483874
driven_any_mean0.9153950913483874
driven_any_median0.9153950913483874
driven_any_min0.9153950913483874
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 0.9153950913483874, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.36497939299940174, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
195930sim-0of5host-erroryes0:27:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 277, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown-services/evaluations/Archimede-prod-b/Archimede-prod-b-02-6.3.0/lx22-BV1/submission-28282/job-195930-step-sim-0of5-a-wd/challenge-evaluation-output/episodes/d30/ego0/camera.mp4-active.avi'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195928sim-0of5successyes0:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195925sim-0of5timeoutyes0:00:03
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195881sim-2of5successyes0:13:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.73799748222826


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.73799748222826
distance-from-start_median0.73799748222826
distance-from-start_min0.73799748222826
driven_any_max1.61177957440686
driven_any_mean1.61177957440686
driven_any_median1.61177957440686
driven_any_min1.61177957440686
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 1.61177957440686, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.73799748222826, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
195879sim-4of5successyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4707477352780303


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4707477352780303
distance-from-start_median0.4707477352780303
distance-from-start_min0.4707477352780303
driven_any_max0.7019081536079987
driven_any_mean0.7019081536079987
driven_any_median0.7019081536079987
driven_any_min0.7019081536079987
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.499999999999985
in-drivable-lane_mean6.499999999999985
in-drivable-lane_median6.499999999999985
in-drivable-lane_min6.499999999999985
per-episodes
details{"d60-ego0": {"driven_any": 0.7019081536079987, "survival_time": 6.499999999999985, "driven_lanedir": 0.0, "in-drivable-lane": 6.499999999999985, "deviation-heading": 0.0, "distance-from-start": 0.4707477352780303, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.499999999999985
survival_time_mean6.499999999999985
survival_time_median6.499999999999985
survival_time_min6.499999999999985
No reset possible
195877sim-0of5host-erroryes0:21:44
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1310, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 925, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 784, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195875sim-4of5successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195873sim-1of5successyes0:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6916074221760368


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6916074221760368
distance-from-start_median0.6916074221760368
distance-from-start_min0.6916074221760368
driven_any_max4.593006755630072
driven_any_mean4.593006755630072
driven_any_median4.593006755630072
driven_any_min4.593006755630072
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 4.593006755630072, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.6916074221760368, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
195871sim-0of5host-erroryes0:03:49
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-04-6.3.0-job195871-30750, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-04-6.3.0-job195871-30750', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195867sim-2of5successyes0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195866sim-0of5successyes0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195863sim-1of5successyes0:08:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195862sim-4of5successyes0:10:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195860sim-3of5successyes0:30:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5327472040227996


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5327472040227996
distance-from-start_median0.5327472040227996
distance-from-start_min0.5327472040227996
driven_any_max1.038209895840529
driven_any_mean1.038209895840529
driven_any_median1.038209895840529
driven_any_min1.038209895840529
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.200000000000095
in-drivable-lane_mean16.200000000000095
in-drivable-lane_median16.200000000000095
in-drivable-lane_min16.200000000000095
per-episodes
details{"d50-ego0": {"driven_any": 1.038209895840529, "survival_time": 16.200000000000095, "driven_lanedir": 0.0, "in-drivable-lane": 16.200000000000095, "deviation-heading": 0.0, "distance-from-start": 0.5327472040227996, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.200000000000095
survival_time_mean16.200000000000095
survival_time_median16.200000000000095
survival_time_min16.200000000000095
No reset possible
195856sim-2of5successyes0:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195855sim-4of5successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195854sim-0of5successyes0:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195852sim-0of5successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195848sim-4of5successyes0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195847sim-1of5successyes0:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195844sim-2of5successyes0:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195841sim-0of5successyes0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195839sim-4of5successyes0:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195835sim-4of5successyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195830sim-1of5successyes0:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195829sim-4of5successyes0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195828sim-4of5successyes0:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195827sim-2of5successyes0:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195822sim-1of5successyes0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195821sim-3of5successyes0:20:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195817sim-3of5successyes0:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195816sim-2of5successyes0:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195811sim-0of5successyes0:16:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195808sim-4of5successyes0:13:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195806sim-3of5successyes0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195801sim-4of5successyes0:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195799sim-2of5successyes0:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195796sim-3of5successyes0:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195795sim-0of5successyes0:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195786sim-0of5successyes0:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195781sim-2of5successyes0:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195779sim-1of5successyes0:22:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195774sim-3of5successyes0:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195773sim-1of5successyes0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195770sim-4of5successyes0:13:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195765sim-3of5successyes0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195764sim-1of5successyes0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195763sim-4of5successyes0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195761sim-2of5successyes0:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible