Duckietown Challenges Home Challenges Submissions

Submission 28281

Submission28281
Competingyes
Challengelx22-BV1
Useruser9701
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 195859 sim-1of5: 195858 sim-2of5: 195880 sim-3of5: 195953 sim-4of5: 195882
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

195953

Click the images to see detailed statistics about the episode.

d50

195882

Click the images to see detailed statistics about the episode.

d60

195880

Click the images to see detailed statistics about the episode.

d40

195859

Click the images to see detailed statistics about the episode.

d30

195858

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
195953sim-3of5successyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.6141218763197305


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.6141218763197305
distance-from-start_median4.6141218763197305
distance-from-start_min4.6141218763197305
driven_any_max6.070393875177625
driven_any_mean6.070393875177625
driven_any_median6.070393875177625
driven_any_min6.070393875177625
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max12.500000000000044
in-drivable-lane_mean12.500000000000044
in-drivable-lane_median12.500000000000044
in-drivable-lane_min12.500000000000044
per-episodes
details{"d50-ego0": {"driven_any": 6.070393875177625, "survival_time": 12.500000000000044, "driven_lanedir": 0.0, "in-drivable-lane": 12.500000000000044, "deviation-heading": 0.0, "distance-from-start": 4.6141218763197305, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max12.500000000000044
survival_time_mean12.500000000000044
survival_time_median12.500000000000044
survival_time_min12.500000000000044
No reset possible
195951sim-3of5successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195936sim-3of5host-erroryes0:13:30
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-05-6.3.0-job195936-630962, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-05-6.3.0-job195936-630962', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195932sim-3of5successyes0:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195926sim-3of5successyes0:12:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195923sim-3of5successyes0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195882sim-4of5successyes0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.630484652072978


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.630484652072978
distance-from-start_median2.630484652072978
distance-from-start_min2.630484652072978
driven_any_max2.7048578668040912
driven_any_mean2.7048578668040912
driven_any_median2.7048578668040912
driven_any_min2.7048578668040912
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.499999999999985
in-drivable-lane_mean6.499999999999985
in-drivable-lane_median6.499999999999985
in-drivable-lane_min6.499999999999985
per-episodes
details{"d60-ego0": {"driven_any": 2.7048578668040912, "survival_time": 6.499999999999985, "driven_lanedir": 0.0, "in-drivable-lane": 6.499999999999985, "deviation-heading": 0.0, "distance-from-start": 2.630484652072978, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.499999999999985
survival_time_mean6.499999999999985
survival_time_median6.499999999999985
survival_time_min6.499999999999985
No reset possible
195880sim-2of5successyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.3398761078687766


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.3398761078687766
distance-from-start_median1.3398761078687766
distance-from-start_min1.3398761078687766
driven_any_max1.3874238929347968
driven_any_mean1.3874238929347968
driven_any_median1.3874238929347968
driven_any_min1.3874238929347968
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.249999999999993
in-drivable-lane_mean4.249999999999993
in-drivable-lane_median4.249999999999993
in-drivable-lane_min4.249999999999993
per-episodes
details{"d40-ego0": {"driven_any": 1.3874238929347968, "survival_time": 4.249999999999993, "driven_lanedir": 0.0, "in-drivable-lane": 4.249999999999993, "deviation-heading": 0.0, "distance-from-start": 1.3398761078687766, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean4.249999999999993
survival_time_median4.249999999999993
survival_time_min4.249999999999993
No reset possible
195878sim-4of5successyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195876sim-3of5host-erroryes0:24:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1310, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 925, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 784, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195874sim-4of5successyes0:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195872sim-2of5successyes0:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195870sim-2of5successyes0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195869sim-4of5successyes0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195868sim-3of5host-erroryes0:04:03
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-01-6.3.0-job195868-158083, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-01-6.3.0-job195868-158083', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195865sim-4of5successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195864sim-4of5successyes0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195861sim-4of5successyes0:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195859sim-0of5successyes0:36:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5526915739997714


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5526915739997714
distance-from-start_median0.5526915739997714
distance-from-start_min0.5526915739997714
driven_any_max0.5713580925502193
driven_any_mean0.5713580925502193
driven_any_median0.5713580925502193
driven_any_min0.5713580925502193
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.3999999999999995
in-drivable-lane_mean2.3999999999999995
in-drivable-lane_median2.3999999999999995
in-drivable-lane_min2.3999999999999995
per-episodes
details{"d30-ego0": {"driven_any": 0.5713580925502193, "survival_time": 2.3999999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 2.3999999999999995, "deviation-heading": 0.0, "distance-from-start": 0.5526915739997714, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.3999999999999995
survival_time_mean2.3999999999999995
survival_time_median2.3999999999999995
survival_time_min2.3999999999999995
No reset possible
195858sim-1of5successyes0:30:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6404965084095755


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6404965084095755
distance-from-start_median2.6404965084095755
distance-from-start_min2.6404965084095755
driven_any_max2.7019015078790503
driven_any_mean2.7019015078790503
driven_any_median2.7019015078790503
driven_any_min2.7019015078790503
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.649999999999984
in-drivable-lane_mean6.649999999999984
in-drivable-lane_median6.649999999999984
in-drivable-lane_min6.649999999999984
per-episodes
details{"d60-ego0": {"driven_any": 2.7019015078790503, "survival_time": 6.649999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 6.649999999999984, "deviation-heading": 0.0, "distance-from-start": 2.6404965084095755, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.649999999999984
survival_time_mean6.649999999999984
survival_time_median6.649999999999984
survival_time_min6.649999999999984
No reset possible
195857sim-2of5successyes0:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195853sim-4of5successyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195851sim-4of5successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195850sim-3of5successyes0:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195849sim-4of5successyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195846sim-4of5successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195845sim-0of5successyes0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195843sim-1of5successyes0:09:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195840sim-4of5successyes0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195837sim-4of5successyes0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195834sim-0of5successyes0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195833sim-3of5successyes0:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195831sim-4of5successyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195825sim-4of5successyes0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195824sim-1of5successyes0:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195823sim-4of5successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195820sim-1of5successyes0:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195819sim-4of5successyes0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195818sim-1of5successyes0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195815sim-4of5successyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195814sim-1of5successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195813sim-0of5successyes0:12:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195812sim-3of5successyes0:11:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195810sim-0of5successyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195809sim-4of5successyes0:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195807sim-4of5successyes0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195805sim-0of5successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195803sim-0of5successyes0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195802sim-1of5failedyes0:06:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195800sim-3of5failedyes0:06:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible