Duckietown Challenges Home Challenges Submissions

Submission 10024

Submission10024
Competingyes
Challengeaido5-LF-sim-validation
UserJean-Sébastien Grondin 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 58076
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

58076

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58076LFv-simsuccessyes0:35:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.55503414638892
survival_time_median59.99999999999873
deviation-center-line_median2.8256491526745053
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.033835293351363184
agent_compute-ego0_mean0.01859453903646096
agent_compute-ego0_median0.01385355571426023
agent_compute-ego0_min0.01283575136596019
complete-iteration_max0.202226436505409
complete-iteration_mean0.1875199303837442
complete-iteration_median0.18765178072164695
complete-iteration_min0.17254972358627382
deviation-center-line_max3.111147326389904
deviation-center-line_mean2.6631365318254088
deviation-center-line_min1.89010049556272
deviation-heading_max11.514063800596308
deviation-heading_mean9.404961827921149
deviation-heading_median9.179278250147576
deviation-heading_min7.747227010793133
driven_any_max5.885867648486069
driven_any_mean5.74266038972747
driven_any_median5.702937568316041
driven_any_min5.678898773791725
driven_lanedir_consec_max5.605326598802633
driven_lanedir_consec_mean5.1221077888966215
driven_lanedir_consec_min3.77303626400601
driven_lanedir_max5.6406419840958595
driven_lanedir_mean5.589009218919084
driven_lanedir_median5.5844843534100965
driven_lanedir_min5.54642618476028
get_duckie_state_max1.528975767060978e-06
get_duckie_state_mean1.410957577822111e-06
get_duckie_state_median1.3862422463498842e-06
get_duckie_state_min1.3423700515276985e-06
get_robot_state_max0.0039155233114784105
get_robot_state_mean0.0038197755714340273
get_robot_state_median0.003852136426920895
get_robot_state_min0.003659306120415909
get_state_dump_max0.004831887204680812
get_state_dump_mean0.004705198698496441
get_state_dump_median0.004703557759300061
get_state_dump_min0.004581792070704833
get_ui_image_max0.03794056172176364
get_ui_image_mean0.03229305875192177
get_ui_image_median0.0323467644724024
get_ui_image_min0.026538144341118623
in-drivable-lane_max1.299999999999926
in-drivable-lane_mean0.3249999999999815
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.885867648486069, "get_ui_image": 0.03020059953224252, "step_physics": 0.1083049393017822, "survival_time": 59.99999999999873, "driven_lanedir": 5.6406419840958595, "get_state_dump": 0.004831887204680812, "get_robot_state": 0.003860949874420547, "sim_render-ego0": 0.004074048440124867, "get_duckie_state": 1.528975767060978e-06, "in-drivable-lane": 1.299999999999926, "deviation-heading": 7.778051441593689, "agent_compute-ego0": 0.01283575136596019, "complete-iteration": 0.17984703716687814, "set_robot_commands": 0.002330458233695939, "deviation-center-line": 3.111147326389904, "driven_lanedir_consec": 3.77303626400601, "sim_compute_sim_state": 0.0111816548785004, "sim_compute_performance-ego0": 0.002136438315754429}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.717451433443168, "get_ui_image": 0.03794056172176364, "step_physics": 0.1202759302029701, "survival_time": 59.99999999999873, "driven_lanedir": 5.56364210801756, "get_state_dump": 0.004673894299357062, "get_robot_state": 0.0038433229794212426, "sim_render-ego0": 0.004106662354798837, "get_duckie_state": 1.382867462132793e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.514063800596308, "agent_compute-ego0": 0.014608107041955292, "complete-iteration": 0.202226436505409, "set_robot_commands": 0.002343436462694561, "deviation-center-line": 2.8654404757923, "driven_lanedir_consec": 5.56364210801756, "sim_compute_sim_state": 0.012178510154514488, "sim_compute_performance-ego0": 0.0021658426121212264}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.6884237031889135, "get_ui_image": 0.03449292941256229, "step_physics": 0.11709475378311246, "survival_time": 59.99999999999873, "driven_lanedir": 5.54642618476028, "get_state_dump": 0.004733221219243059, "get_robot_state": 0.0039155233114784105, "sim_render-ego0": 0.004075649675977518, "get_duckie_state": 1.3896170305669754e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.580505058701462, "agent_compute-ego0": 0.013099004386565171, "complete-iteration": 0.19545652427641577, "set_robot_commands": 0.0023957422432752573, "deviation-center-line": 2.785857829556711, "driven_lanedir_consec": 5.54642618476028, "sim_compute_sim_state": 0.013361007347392798, "sim_compute_performance-ego0": 0.002198932966919962}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.678898773791725, "get_ui_image": 0.026538144341118623, "step_physics": 0.08949197539679712, "survival_time": 59.99999999999873, "driven_lanedir": 5.605326598802633, "get_state_dump": 0.004581792070704833, "get_robot_state": 0.003659306120415909, "sim_render-ego0": 0.003843010712622802, "get_duckie_state": 1.3423700515276985e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.747227010793133, "agent_compute-ego0": 0.033835293351363184, "complete-iteration": 0.17254972358627382, "set_robot_commands": 0.002284642560198146, "deviation-center-line": 1.89010049556272, "driven_lanedir_consec": 5.605326598802633, "sim_compute_sim_state": 0.0062401604394333055, "sim_compute_performance-ego0": 0.0019915179348706604}}
set_robot_commands_max0.0023957422432752573
set_robot_commands_mean0.002338569874965976
set_robot_commands_median0.0023369473481952502
set_robot_commands_min0.002284642560198146
sim_compute_performance-ego0_max0.002198932966919962
sim_compute_performance-ego0_mean0.0021231829574165696
sim_compute_performance-ego0_median0.0021511404639378276
sim_compute_performance-ego0_min0.0019915179348706604
sim_compute_sim_state_max0.013361007347392798
sim_compute_sim_state_mean0.010740333204960248
sim_compute_sim_state_median0.011680082516507444
sim_compute_sim_state_min0.0062401604394333055
sim_render-ego0_max0.004106662354798837
sim_render-ego0_mean0.004024842795881006
sim_render-ego0_median0.0040748490580511925
sim_render-ego0_min0.003843010712622802
simulation-passed1
step_physics_max0.1202759302029701
step_physics_mean0.10879189967116548
step_physics_median0.11269984654244732
step_physics_min0.08949197539679712
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
58054LFv-simhost-erroryes0:28:00
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58014LFv-simhost-erroryes0:02:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible