Duckietown Challenges Home Challenges Submissions

Submission 11402

Submission11402
Competingyes
Challengeaido5-LF-sim-validation
UserMarton Moro 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 54656
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

54656

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
54656LFv-simsuccessyes0:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011308011909325918
agent_compute-ego0_mean0.010918075667116384
agent_compute-ego0_median0.010836463940294482
agent_compute-ego0_min0.010691362878550652
complete-iteration_max0.1783591793931049
complete-iteration_mean0.1600562074059189
complete-iteration_median0.16436942871109844
complete-iteration_min0.13312679280837378
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.3344817691379123e-06
get_duckie_state_mean1.198773154503547e-06
get_duckie_state_median1.177018830544838e-06
get_duckie_state_min1.1065731877866e-06
get_robot_state_max0.003375848134358724
get_robot_state_mean0.003314711523575972
get_robot_state_median0.0033483475397495235
get_robot_state_min0.003186302880446116
get_state_dump_max0.004305912388695611
get_state_dump_mean0.0041496272649966135
get_state_dump_median0.004183004534894054
get_state_dump_min0.003926587601502736
get_ui_image_max0.03138648167900417
get_ui_image_mean0.027349292499685898
get_ui_image_median0.0276591914867047
get_ui_image_min0.02269230534633001
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.026402361785309223, "step_physics": 0.0902848092815544, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004234531257725969, "get_robot_state": 0.0033312613451028173, "sim_render-ego0": 0.0035195773160910304, "get_duckie_state": 1.204164722297765e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010696732545200784, "complete-iteration": 0.15108252477042283, "set_robot_commands": 0.0020293736759620378, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.008716872975796083, "sim_compute_performance-ego0": 0.0017817156224311152}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03138648167900417, "step_physics": 0.11300416873848956, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0041314778120621395, "get_robot_state": 0.0033654337343962297, "sim_render-ego0": 0.0035351851712102475, "get_duckie_state": 1.1065731877866e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010691362878550652, "complete-iteration": 0.1783591793931049, "set_robot_commands": 0.0020606284556181536, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008157229941824207, "sim_compute_performance-ego0": 0.001940081948819368}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.028916021188100174, "step_physics": 0.11558159854676987, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004305912388695611, "get_robot_state": 0.003375848134358724, "sim_render-ego0": 0.003500256273481581, "get_duckie_state": 1.3344817691379123e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.010976195335388184, "complete-iteration": 0.17765633265177408, "set_robot_commands": 0.001982483598921034, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007110966576470269, "sim_compute_performance-ego0": 0.0018190443515777588}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02269230534633001, "step_physics": 0.08082922796408336, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.003926587601502736, "get_robot_state": 0.003186302880446116, "sim_render-ego0": 0.003278923531373342, "get_duckie_state": 1.1498729387919109e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011308011909325918, "complete-iteration": 0.13312679280837378, "set_robot_commands": 0.0018087973197301228, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.0043564314643541975, "sim_compute_performance-ego0": 0.001655163864294688}}
set_robot_commands_max0.0020606284556181536
set_robot_commands_mean0.001970320762557837
set_robot_commands_median0.002005928637441536
set_robot_commands_min0.0018087973197301228
sim_compute_performance-ego0_max0.001940081948819368
sim_compute_performance-ego0_mean0.0017990014467807326
sim_compute_performance-ego0_median0.001800379987004437
sim_compute_performance-ego0_min0.001655163864294688
sim_compute_sim_state_max0.008716872975796083
sim_compute_sim_state_mean0.00708537523961119
sim_compute_sim_state_median0.007634098259147238
sim_compute_sim_state_min0.0043564314643541975
sim_render-ego0_max0.0035351851712102475
sim_render-ego0_mean0.00345848557303905
sim_render-ego0_median0.0035099167947863054
sim_render-ego0_min0.003278923531373342
simulation-passed1
step_physics_max0.11558159854676987
step_physics_mean0.0999249511327243
step_physics_median0.101644489010022
step_physics_min0.08082922796408336
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
54635LFv-simsuccessyes0:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
54631LFv-simhost-erroryes0:02:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible