Duckietown Challenges Home Challenges Submissions

Submission 10029

Submission10029
Competingyes
Challengeaido5-LF-sim-validation
UserJean-Sébastien Grondin 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 58075
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

58075

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58075LFv-simsuccessyes0:33:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.203833932003182
survival_time_median59.99999999999873
deviation-center-line_median2.4025932955789915
in-drivable-lane_median4.024999999999888


other stats
agent_compute-ego0_max0.012634055402058546
agent_compute-ego0_mean0.01220389920210064
agent_compute-ego0_median0.01218299990788189
agent_compute-ego0_min0.011815541590580238
complete-iteration_max0.18222901624604923
complete-iteration_mean0.16663720372515256
complete-iteration_median0.1707446953339144
complete-iteration_min0.14283040798673224
deviation-center-line_max3.273247314288642
deviation-center-line_mean2.5218653337141212
deviation-center-line_min2.00902742940986
deviation-heading_max9.76991966258618
deviation-heading_mean7.794109251585867
deviation-heading_median9.189168556347898
deviation-heading_min3.0281802310614943
driven_any_max5.775077450276304
driven_any_mean5.68848350401926
driven_any_median5.673404344365721
driven_any_min5.632047877069289
driven_lanedir_consec_max5.5406320120894685
driven_lanedir_consec_mean4.941256899361573
driven_lanedir_consec_min3.816727721350459
driven_lanedir_max5.5406320120894685
driven_lanedir_mean4.941256899361573
driven_lanedir_median5.203833932003182
driven_lanedir_min3.816727721350459
get_duckie_state_max1.328275364503376e-06
get_duckie_state_mean1.2908053338577307e-06
get_duckie_state_median1.3269850058321352e-06
get_duckie_state_min1.1809759592632766e-06
get_robot_state_max0.003690572702120385
get_robot_state_mean0.0035816060315560145
get_robot_state_median0.0035500865891811553
get_robot_state_min0.003535678245741362
get_state_dump_max0.004639649569839363
get_state_dump_mean0.004490417157680566
get_state_dump_median0.004444637763113106
get_state_dump_min0.004432743534656686
get_ui_image_max0.03551937320845808
get_ui_image_mean0.030317416943479437
get_ui_image_median0.03018006535989855
get_ui_image_min0.02539016384566257
in-drivable-lane_max21.399999999998784
in-drivable-lane_mean7.36249999999964
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.775077450276304, "get_ui_image": 0.02828719752912815, "step_physics": 0.09946271144380976, "survival_time": 59.99999999999873, "driven_lanedir": 3.816727721350459, "get_state_dump": 0.004639649569839363, "get_robot_state": 0.003690572702120385, "sim_render-ego0": 0.0038232086699372223, "get_duckie_state": 1.1809759592632766e-06, "in-drivable-lane": 21.399999999998784, "deviation-heading": 3.0281802310614943, "agent_compute-ego0": 0.012634055402058546, "complete-iteration": 0.16732968676596455, "set_robot_commands": 0.002240610559417445, "deviation-center-line": 2.532127982025198, "driven_lanedir_consec": 3.816727721350459, "sim_compute_sim_state": 0.010502402728840673, "sim_compute_performance-ego0": 0.001968639875629562}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.632047877069289, "get_ui_image": 0.03551937320845808, "step_physics": 0.1074291260216655, "survival_time": 59.99999999999873, "driven_lanedir": 5.125837989836341, "get_state_dump": 0.0044366801211875645, "get_robot_state": 0.003561173747917893, "sim_render-ego0": 0.003638621670915919, "get_duckie_state": 1.328275364503376e-06, "in-drivable-lane": 4.74999999999973, "deviation-heading": 9.76991966258618, "agent_compute-ego0": 0.012151571634310071, "complete-iteration": 0.18222901624604923, "set_robot_commands": 0.002070842634926827, "deviation-center-line": 3.273247314288642, "driven_lanedir_consec": 5.125837989836341, "sim_compute_sim_state": 0.011455095181556466, "sim_compute_performance-ego0": 0.0018873016204961036}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.703488800195813, "get_ui_image": 0.03207293319066895, "step_physics": 0.1015401817579055, "survival_time": 59.99999999999873, "driven_lanedir": 5.281829874170024, "get_state_dump": 0.004452595405038648, "get_robot_state": 0.003535678245741362, "sim_render-ego0": 0.003610141072841012, "get_duckie_state": 1.328275364503376e-06, "in-drivable-lane": 3.300000000000047, "deviation-heading": 9.382837498443754, "agent_compute-ego0": 0.012214428181453707, "complete-iteration": 0.17415970390186422, "set_robot_commands": 0.002083453409479222, "deviation-center-line": 2.273058609132785, "driven_lanedir_consec": 5.281829874170024, "sim_compute_sim_state": 0.012689235506208612, "sim_compute_performance-ego0": 0.0018817139704161935}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.643319888535631, "get_ui_image": 0.02539016384566257, "step_physics": 0.08404310100977863, "survival_time": 59.99999999999873, "driven_lanedir": 5.5406320120894685, "get_state_dump": 0.004432743534656686, "get_robot_state": 0.0035389994304444172, "sim_render-ego0": 0.0035742921297198826, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.995499614252042, "agent_compute-ego0": 0.011815541590580238, "complete-iteration": 0.14283040798673224, "set_robot_commands": 0.002090148584332494, "deviation-center-line": 2.00902742940986, "driven_lanedir_consec": 5.5406320120894685, "sim_compute_sim_state": 0.00600548251086131, "sim_compute_performance-ego0": 0.001860748024209155}}
set_robot_commands_max0.002240610559417445
set_robot_commands_mean0.0021212637970389973
set_robot_commands_median0.002086800996905858
set_robot_commands_min0.002070842634926827
sim_compute_performance-ego0_max0.001968639875629562
sim_compute_performance-ego0_mean0.0018996008726877536
sim_compute_performance-ego0_median0.0018845077954561483
sim_compute_performance-ego0_min0.001860748024209155
sim_compute_sim_state_max0.012689235506208612
sim_compute_sim_state_mean0.010163053981866763
sim_compute_sim_state_median0.01097874895519857
sim_compute_sim_state_min0.00600548251086131
sim_render-ego0_max0.0038232086699372223
sim_render-ego0_mean0.0036615658858535098
sim_render-ego0_median0.003624381371878466
sim_render-ego0_min0.0035742921297198826
simulation-passed1
step_physics_max0.1074291260216655
step_physics_mean0.09811878005828983
step_physics_median0.10050144660085762
step_physics_min0.08404310100977863
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
58050LFv-simhost-erroryes0:34:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58049LFv-simhost-erroryes0:36:03
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58048LFv-simsuccessyes0:35:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible