Duckietown Challenges Home Challenges Submissions

Submission 6148

Submission6148
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 30208
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

30208

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
30208step1-simulationsuccessyes0:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.120841924217262
survival_time_median5.599999999999988
deviation-center-line_median0.3782364103335421
in-drivable-lane_median0


other stats
agent_compute-ego_max0.058898581833135885
agent_compute-ego_mean0.03744520157083943
agent_compute-ego_median0.03256798267364502
agent_compute-ego_min0.025841529880251204
deviation-center-line_max0.8297707699828777
deviation-center-line_mean0.4024628747472576
deviation-center-line_min0.09950310559965204
deviation-heading_max2.31547923647238
deviation-heading_mean1.346048064931696
deviation-heading_median1.309770583868421
deviation-heading_min0.6515909010104917
driven_any_max5.345885784958272
driven_any_mean2.5864129292571456
driven_any_median2.2431766388174186
driven_any_min1.0054410226525208
driven_lanedir_consec_max5.254942413663555
driven_lanedir_consec_mean2.2862866357033704
driven_lanedir_consec_min0.7032317749721232
driven_lanedir_max5.254942413663555
driven_lanedir_mean2.2862866357033704
driven_lanedir_median2.120841924217262
driven_lanedir_min0.7032317749721232
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0054410226525208, "sim_physics": 0.1240319978623163, "survival_time": 3.149999999999997, "driven_lanedir": 0.7032317749721232, "sim_render-ego": 0.013845201522584944, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.04147839167761424, "deviation-heading": 0.6515909010104917, "set_robot_commands": 0.010233617964245025, "deviation-center-line": 0.09950310559965204, "driven_lanedir_consec": 0.7032317749721232, "sim_compute_sim_state": 0.005579728928823319, "sim_compute_performance-ego": 0.00838265721760099, "sim_compute_robot_state-ego": 0.009690288513425797}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2336557913729504, "sim_physics": 0.14396817566918546, "survival_time": 3.049999999999997, "driven_lanedir": 1.1624420730059235, "sim_render-ego": 0.01548722532928967, "in-drivable-lane": 0, "agent_compute-ego": 0.058898581833135885, "deviation-heading": 0.8824400928708209, "set_robot_commands": 0.011900338970246862, "deviation-center-line": 0.24088747348619, "driven_lanedir_consec": 1.1624420730059235, "sim_compute_sim_state": 0.0065567141673604, "sim_compute_performance-ego": 0.009082868450977765, "sim_compute_robot_state-ego": 0.011720207870983686}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.345885784958272, "sim_physics": 0.08377412160237631, "survival_time": 14.950000000000076, "driven_lanedir": 5.254942413663555, "sim_render-ego": 0.0096320907274882, "in-drivable-lane": 0, "agent_compute-ego": 0.03256798267364502, "deviation-heading": 2.31547923647238, "set_robot_commands": 0.007868505318959555, "deviation-center-line": 0.8297707699828777, "driven_lanedir_consec": 5.254942413663555, "sim_compute_sim_state": 0.004166350364685058, "sim_compute_performance-ego": 0.0056048695246378585, "sim_compute_robot_state-ego": 0.007077196439107259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1039054084845663, "sim_physics": 0.0780359499202752, "survival_time": 8.04999999999998, "driven_lanedir": 2.189974992657989, "sim_render-ego": 0.00954065855985843, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.02843952178955078, "deviation-heading": 1.309770583868421, "set_robot_commands": 0.00762629360886094, "deviation-center-line": 0.4639166143340261, "driven_lanedir_consec": 2.189974992657989, "sim_compute_sim_state": 0.004160393839297088, "sim_compute_performance-ego": 0.005536200837318941, "sim_compute_robot_state-ego": 0.006759616899194184}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2431766388174186, "sim_physics": 0.06907199323177338, "survival_time": 5.599999999999988, "driven_lanedir": 2.120841924217262, "sim_render-ego": 0.008632353373936244, "in-drivable-lane": 0, "agent_compute-ego": 0.025841529880251204, "deviation-heading": 1.5709595104363654, "set_robot_commands": 0.0063018351793289185, "deviation-center-line": 0.3782364103335421, "driven_lanedir_consec": 2.120841924217262, "sim_compute_sim_state": 0.003619751759937831, "sim_compute_performance-ego": 0.004903897643089294, "sim_compute_robot_state-ego": 0.006310861025537763}}
set_robot_commands_max0.011900338970246862
set_robot_commands_mean0.00878611820832826
set_robot_commands_median0.007868505318959555
set_robot_commands_min0.0063018351793289185
sim_compute_performance-ego_max0.009082868450977765
sim_compute_performance-ego_mean0.006702098734724969
sim_compute_performance-ego_median0.0056048695246378585
sim_compute_performance-ego_min0.004903897643089294
sim_compute_robot_state-ego_max0.011720207870983686
sim_compute_robot_state-ego_mean0.008311634149649737
sim_compute_robot_state-ego_median0.007077196439107259
sim_compute_robot_state-ego_min0.006310861025537763
sim_compute_sim_state_max0.0065567141673604
sim_compute_sim_state_mean0.0048165878120207395
sim_compute_sim_state_median0.004166350364685058
sim_compute_sim_state_min0.003619751759937831
sim_physics_max0.14396817566918546
sim_physics_mean0.09977644765718532
sim_physics_median0.08377412160237631
sim_physics_min0.06907199323177338
sim_render-ego_max0.01548722532928967
sim_render-ego_mean0.011427505902631498
sim_render-ego_median0.0096320907274882
sim_render-ego_min0.008632353373936244
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.960000000000008
survival_time_min3.049999999999997
No reset possible
30198step1-simulationsuccessyes0:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30176step1-simulationsuccessyes0:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30175step1-simulationsuccessyes0:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30168step1-simulationhost-erroryes0:08:56
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30167step1-simulationsuccessyes0:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible