Duckietown Challenges Home Challenges Submissions

Submission 10026

Submission10026
Competingyes
Challengeaido5-LF-sim-validation
UserJean-Sébastien Grondin 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 58053
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

58053

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58053LFv-simsuccessyes0:36:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.641534461054037
survival_time_median59.99999999999873
deviation-center-line_median2.3500275640462247
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03569384220736311
agent_compute-ego0_mean0.034589209127783474
agent_compute-ego0_median0.03478132288819249
agent_compute-ego0_min0.03310034852738583
complete-iteration_max0.21300152576932505
complete-iteration_mean0.19919888740971525
complete-iteration_median0.2002470157823396
complete-iteration_min0.18329999230485672
deviation-center-line_max3.646105952879875
deviation-center-line_mean2.4671454549307734
deviation-center-line_min1.522420738750769
deviation-heading_max9.721961991904951
deviation-heading_mean8.07340185784435
deviation-heading_median8.14904437443245
deviation-heading_min6.273556690607552
driven_any_max5.962967053025877
driven_any_mean5.778719366762552
driven_any_median5.724831424517337
driven_any_min5.702247564989656
driven_lanedir_consec_max5.701919485694274
driven_lanedir_consec_mean5.642416091244156
driven_lanedir_consec_min5.584675957174277
driven_lanedir_max5.701919485694274
driven_lanedir_mean5.642416091244156
driven_lanedir_median5.641534461054037
driven_lanedir_min5.584675957174277
get_duckie_state_max2.2335116015584343e-06
get_duckie_state_mean2.15579230620601e-06
get_duckie_state_median2.152616038707571e-06
get_duckie_state_min2.084425545850463e-06
get_robot_state_max0.003808532924477405
get_robot_state_mean0.003782080571716969
get_robot_state_median0.00377393979811847
get_robot_state_min0.0037719097661535303
get_state_dump_max0.005705922569065268
get_state_dump_mean0.004972262694178572
get_state_dump_median0.004776529031034115
get_state_dump_min0.0046300701455807905
get_ui_image_max0.0365487653746593
get_ui_image_mean0.03165287846431049
get_ui_image_median0.030980621249749204
get_ui_image_min0.028101505983084266
in-drivable-lane_max1.8499999999998948
in-drivable-lane_mean0.4624999999999737
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.962967053025877, "get_ui_image": 0.02878762244384156, "step_physics": 0.10189878077034548, "survival_time": 59.99999999999873, "driven_lanedir": 5.701919485694274, "get_state_dump": 0.004780387401977844, "get_robot_state": 0.0037719097661535303, "sim_render-ego0": 0.003902807720098567, "get_duckie_state": 2.1975800754823456e-06, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 6.273556690607552, "agent_compute-ego0": 0.03446715598697964, "complete-iteration": 0.1926009204365828, "set_robot_commands": 0.0023077419655805425, "deviation-center-line": 3.646105952879875, "driven_lanedir_consec": 5.701919485694274, "sim_compute_sim_state": 0.010555724915020869, "sim_compute_performance-ego0": 0.0020300589632134356}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.742540134748534, "get_ui_image": 0.0365487653746593, "step_physics": 0.1124324784687814, "survival_time": 59.99999999999873, "driven_lanedir": 5.6302775727533785, "get_state_dump": 0.0047726706600903866, "get_robot_state": 0.003774630636299381, "sim_render-ego0": 0.003988070452243065, "get_duckie_state": 2.2335116015584343e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.572572625900216, "agent_compute-ego0": 0.03509548978940533, "complete-iteration": 0.21300152576932505, "set_robot_commands": 0.002341131286557568, "deviation-center-line": 2.3346332794530813, "driven_lanedir_consec": 5.6302775727533785, "sim_compute_sim_state": 0.01186522754602488, "sim_compute_performance-ego0": 0.0020861679270900756}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.70712271428614, "get_ui_image": 0.03317362005565685, "step_physics": 0.11149881602723236, "survival_time": 59.99999999999873, "driven_lanedir": 5.584675957174277, "get_state_dump": 0.0046300701455807905, "get_robot_state": 0.003808532924477405, "sim_render-ego0": 0.003988910177962965, "get_duckie_state": 2.1076520019327967e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.721961991904951, "agent_compute-ego0": 0.03310034852738583, "complete-iteration": 0.2078931111280964, "set_robot_commands": 0.0023475584638406595, "deviation-center-line": 2.365421848639369, "driven_lanedir_consec": 5.584675957174277, "sim_compute_sim_state": 0.013142051942938077, "sim_compute_performance-ego0": 0.0021063884430185744}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.702247564989656, "get_ui_image": 0.028101505983084266, "step_physics": 0.09489895362441088, "survival_time": 59.99999999999873, "driven_lanedir": 5.652791349354695, "get_state_dump": 0.005705922569065268, "get_robot_state": 0.00377324895993756, "sim_render-ego0": 0.004119611401839816, "get_duckie_state": 2.084425545850463e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.725516122964682, "agent_compute-ego0": 0.03569384220736311, "complete-iteration": 0.18329999230485672, "set_robot_commands": 0.0023966113494695174, "deviation-center-line": 1.522420738750769, "driven_lanedir_consec": 5.652791349354695, "sim_compute_sim_state": 0.006478518669452397, "sim_compute_performance-ego0": 0.00203624692785055}}
set_robot_commands_max0.0023966113494695174
set_robot_commands_mean0.002348260766362072
set_robot_commands_median0.0023443448751991136
set_robot_commands_min0.0023077419655805425
sim_compute_performance-ego0_max0.0021063884430185744
sim_compute_performance-ego0_mean0.0020647155652931586
sim_compute_performance-ego0_median0.002061207427470313
sim_compute_performance-ego0_min0.0020300589632134356
sim_compute_sim_state_max0.013142051942938077
sim_compute_sim_state_mean0.010510380768359057
sim_compute_sim_state_median0.011210476230522874
sim_compute_sim_state_min0.006478518669452397
sim_render-ego0_max0.004119611401839816
sim_render-ego0_mean0.003999849938036103
sim_render-ego0_median0.003988490315103015
sim_render-ego0_min0.003902807720098567
simulation-passed1
step_physics_max0.1124324784687814
step_physics_mean0.10518225722269252
step_physics_median0.10669879839878892
step_physics_min0.09489895362441088
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
58052LFv-simhost-erroryes0:30:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58051LFv-simsuccessyes0:32:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible