Duckietown Challenges Home Challenges Submissions

Submission 6270

Submission6270
Competingyes
Challengeaido3-LF-sim-validation
UserAleksei Shpilman 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 30441
Next
User label0439 seasons
Admin priority50
Blessingn/a
User priority50

30441

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
30441step1-simulationsuccessyes0:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.302196268475182
survival_time_median14.950000000000076
deviation-center-line_median0.976001963034844
in-drivable-lane_median1.4500000000000206


other stats
agent_compute-ego_max0.018586866969991876
agent_compute-ego_mean0.01788744172713097
agent_compute-ego_median0.017724051674962497
agent_compute-ego_min0.0176803723971049
deviation-center-line_max1.0902687411526228
deviation-center-line_mean0.985139714603098
deviation-center-line_min0.8749237824885849
deviation-heading_max4.9849090209444
deviation-heading_mean4.355899896357222
deviation-heading_median4.3246579831328145
deviation-heading_min3.686549057318589
driven_any_max5.599889704687798
driven_any_mean4.901411150969085
driven_any_median5.002406121762833
driven_any_min4.283905479306437
driven_lanedir_consec_max5.2865630225161215
driven_lanedir_consec_mean4.278857191904891
driven_lanedir_consec_min3.329582570570153
driven_lanedir_max5.2865630225161215
driven_lanedir_mean4.278857191904891
driven_lanedir_median4.302196268475182
driven_lanedir_min3.329582570570153
in-drivable-lane_max2.200000000000024
in-drivable-lane_mean1.180000000000011
in-drivable-lane_min0.10000000000000142
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.283905479306437, "sim_physics": 0.0607321904594168, "survival_time": 13.550000000000058, "driven_lanedir": 3.329582570570153, "sim_render-ego": 0.007645123999057221, "in-drivable-lane": 2.200000000000024, "agent_compute-ego": 0.018586866969991876, "deviation-heading": 4.746689630037264, "set_robot_commands": 0.005767608480699828, "deviation-center-line": 0.8749237824885849, "driven_lanedir_consec": 3.329582570570153, "sim_compute_sim_state": 0.0033400322678344275, "sim_compute_performance-ego": 0.004528799620061783, "sim_compute_robot_state-ego": 0.005480328169256119}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.327991891771406, "sim_physics": 0.061125776160352585, "survival_time": 13.150000000000052, "driven_lanedir": 3.5641100036904367, "sim_render-ego": 0.0077575114290070624, "in-drivable-lane": 1.5500000000000007, "agent_compute-ego": 0.017724051674962497, "deviation-heading": 4.3246579831328145, "set_robot_commands": 0.005605163683002893, "deviation-center-line": 0.9419251394424166, "driven_lanedir_consec": 3.5641100036904367, "sim_compute_sim_state": 0.0033075419668915605, "sim_compute_performance-ego": 0.004462657319275598, "sim_compute_robot_state-ego": 0.0054960858232621455}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.599889704687798, "sim_physics": 0.059304497313738665, "survival_time": 14.950000000000076, "driven_lanedir": 5.2865630225161215, "sim_render-ego": 0.007603253807909912, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.0177507839075299, "deviation-heading": 3.686549057318589, "set_robot_commands": 0.005570638937296277, "deviation-center-line": 1.0425789468970212, "driven_lanedir_consec": 5.2865630225161215, "sim_compute_sim_state": 0.0033179796659029447, "sim_compute_performance-ego": 0.004395004100225443, "sim_compute_robot_state-ego": 0.00545993138316483}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.29286255731695, "sim_physics": 0.060280247529347734, "survival_time": 14.950000000000076, "driven_lanedir": 4.911834094272562, "sim_render-ego": 0.007678740819295247, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.017695133686065675, "deviation-heading": 4.036693790353042, "set_robot_commands": 0.005645941098531088, "deviation-center-line": 1.0902687411526228, "driven_lanedir_consec": 4.911834094272562, "sim_compute_sim_state": 0.00339736541112264, "sim_compute_performance-ego": 0.004415575663248698, "sim_compute_robot_state-ego": 0.00546951691309611}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.002406121762833, "sim_physics": 0.0627595599492391, "survival_time": 14.950000000000076, "driven_lanedir": 4.302196268475182, "sim_render-ego": 0.007673247655232748, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.0176803723971049, "deviation-heading": 4.9849090209444, "set_robot_commands": 0.005589044094085694, "deviation-center-line": 0.976001963034844, "driven_lanedir_consec": 4.302196268475182, "sim_compute_sim_state": 0.003292972246805827, "sim_compute_performance-ego": 0.004443194071451823, "sim_compute_robot_state-ego": 0.0055121525128682455}}
set_robot_commands_max0.005767608480699828
set_robot_commands_mean0.005635679258723156
set_robot_commands_median0.005605163683002893
set_robot_commands_min0.005570638937296277
sim_compute_performance-ego_max0.004528799620061783
sim_compute_performance-ego_mean0.004449046154852669
sim_compute_performance-ego_median0.004443194071451823
sim_compute_performance-ego_min0.004395004100225443
sim_compute_robot_state-ego_max0.0055121525128682455
sim_compute_robot_state-ego_mean0.005483602960329489
sim_compute_robot_state-ego_median0.005480328169256119
sim_compute_robot_state-ego_min0.00545993138316483
sim_compute_sim_state_max0.00339736541112264
sim_compute_sim_state_mean0.00333117831171148
sim_compute_sim_state_median0.0033179796659029447
sim_compute_sim_state_min0.003292972246805827
sim_physics_max0.0627595599492391
sim_physics_mean0.06084045428241898
sim_physics_median0.0607321904594168
sim_physics_min0.059304497313738665
sim_render-ego_max0.0077575114290070624
sim_render-ego_mean0.0076715755421004365
sim_render-ego_median0.007673247655232748
sim_render-ego_min0.007603253807909912
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.310000000000068
survival_time_min13.150000000000052
No reset possible
30438step1-simulationhost-erroryes0:10:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30436step1-simulationsuccessyes0:08:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30433step1-simulationsuccessyes0:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30415step1-simulationabortedyes0:08:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30414step1-simulationabortedyes0:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible