Duckietown Challenges Home Challenges Submissions

Submission 11404

Submission11404
Competingyes
Challengeaido5-LF-sim-validation
UserMarton Moro 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 54654
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

54654

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
54654LFv-simsuccessyes0:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011984606583913168
agent_compute-ego0_mean0.01118338445225094
agent_compute-ego0_median0.01095733348327347
agent_compute-ego0_min0.01083426425854365
complete-iteration_max0.20102247984512991
complete-iteration_mean0.17649779828455642
complete-iteration_median0.17303539564212164
complete-iteration_min0.15889792200885242
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.4199486261681665e-06
get_duckie_state_mean1.3565233548263563e-06
get_duckie_state_median1.3486630674721538e-06
get_duckie_state_min1.3088186581929524e-06
get_robot_state_max0.003795320789019266
get_robot_state_mean0.003693341346621506
get_robot_state_median0.003704619940352325
get_robot_state_min0.003568804716762108
get_state_dump_max0.005096733570098877
get_state_dump_mean0.004836070259098671
get_state_dump_median0.004791681105912822
get_state_dump_min0.0046641852544701615
get_ui_image_max0.034368356932764466
get_ui_image_mean0.029382899834350773
get_ui_image_median0.028165846235222287
get_ui_image_min0.02683154993419406
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02683154993419406, "step_physics": 0.09528503689584852, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.00474527968636042, "get_robot_state": 0.003568804716762108, "sim_render-ego0": 0.003861551043353503, "get_duckie_state": 1.4199486261681665e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010916000680078437, "complete-iteration": 0.15889792200885242, "set_robot_commands": 0.0021956585630585877, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009344007395490817, "sim_compute_performance-ego0": 0.002051635633541059}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.034368356932764466, "step_physics": 0.13025076233822366, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0046641852544701615, "get_robot_state": 0.0036191162855728817, "sim_render-ego0": 0.003811685935310696, "get_duckie_state": 1.316485197647758e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010998666286468506, "complete-iteration": 0.20102247984512991, "set_robot_commands": 0.002248383086660634, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008960226307744566, "sim_compute_performance-ego0": 0.0020031773525735607}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.029496722751193576, "step_physics": 0.11938748757044476, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004838082525465224, "get_robot_state": 0.003790123595131768, "sim_render-ego0": 0.003899872303009033, "get_duckie_state": 1.3808409372965495e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.011984606583913168, "complete-iteration": 0.18519203861554465, "set_robot_commands": 0.0021893978118896484, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007437696059544881, "sim_compute_performance-ego0": 0.0020723409122890895}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.026834969719250996, "step_physics": 0.10085032880306244, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.005096733570098877, "get_robot_state": 0.003795320789019266, "sim_render-ego0": 0.003868351380030314, "get_duckie_state": 1.3088186581929524e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01083426425854365, "complete-iteration": 0.16087875266869864, "set_robot_commands": 0.0022994577884674072, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.005089799563090007, "sim_compute_performance-ego0": 0.002110655109087626}}
set_robot_commands_max0.0022994577884674072
set_robot_commands_mean0.0022332243125190695
set_robot_commands_median0.002222020824859611
set_robot_commands_min0.0021893978118896484
sim_compute_performance-ego0_max0.002110655109087626
sim_compute_performance-ego0_mean0.0020594522518728336
sim_compute_performance-ego0_median0.002061988272915074
sim_compute_performance-ego0_min0.0020031773525735607
sim_compute_sim_state_max0.009344007395490817
sim_compute_sim_state_mean0.007707932331467567
sim_compute_sim_state_median0.008198961183644724
sim_compute_sim_state_min0.005089799563090007
sim_render-ego0_max0.003899872303009033
sim_render-ego0_mean0.0038603651654258862
sim_render-ego0_median0.003864951211691909
sim_render-ego0_min0.003811685935310696
simulation-passed1
step_physics_max0.13025076233822366
step_physics_mean0.11144340390189485
step_physics_median0.1101189081867536
step_physics_min0.09528503689584852
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
54639LFv-simsuccessyes0:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54637LFv-simsuccessyes0:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54626LFv-simhost-erroryes0:04:45
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54618LFv-simsuccessyes0:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible