Duckietown Challenges Home Challenges Submissions

Submission 3661

Submission3661
Competingyes
Challengeaido2-LF-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23488
Next
User labelRL-TH-xyz
Admin priority50
Blessingn/a
User priority50

23488

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23488step1-simulationsuccessyes0:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2716505619864509
survival_time_median6.8999999999999835
deviation-center-line_median0.2447015744035076
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.10284648945457056
agent_compute-ego_mean0.10208125807517653
agent_compute-ego_median0.10224942366282146
agent_compute-ego_min0.10141625139448378
deviation-center-line_max0.3233946791443165
deviation-center-line_mean0.25269386695357127
deviation-center-line_min0.2035165316000184
deviation-heading_max1.0865573324409477
deviation-heading_mean0.7514760261389386
deviation-heading_median0.652792515157392
deviation-heading_min0.38168788924040487
driven_any_max2.572039895430136
driven_any_mean1.5937171668276118
driven_any_median1.6059482679887973
driven_any_min1.0189512979685746
driven_lanedir_consec_max1.404956996152074
driven_lanedir_consec_mean1.0980602133100767
driven_lanedir_consec_min0.66575836897275
driven_lanedir_max1.404956996152074
driven_lanedir_mean1.0980602133100767
driven_lanedir_median1.2716505619864509
driven_lanedir_min0.66575836897275
in-drivable-lane_max4.900000000000032
in-drivable-lane_mean1.9400000000000035
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0800965569347067, "sim_physics": 0.05950226281818591, "survival_time": 4.749999999999991, "driven_lanedir": 0.66575836897275, "sim_render-ego": 0.036840777648122686, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10284648945457056, "deviation-heading": 0.38168788924040487, "set_robot_commands": 0.05676897450497276, "deviation-center-line": 0.2758536730512279, "driven_lanedir_consec": 0.66575836897275, "sim_compute_sim_state": 0.02391592075950221, "sim_compute_performance-ego": 0.04063398963526676, "sim_compute_robot_state-ego": 0.042379682942440634}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0189512979685746, "sim_physics": 0.05752625200483534, "survival_time": 4.499999999999992, "driven_lanedir": 0.8074827780868857, "sim_render-ego": 0.037110757827758786, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10141625139448378, "deviation-heading": 0.652792515157392, "set_robot_commands": 0.05637216567993164, "deviation-center-line": 0.2035165316000184, "driven_lanedir_consec": 0.8074827780868857, "sim_compute_sim_state": 0.02396213478512234, "sim_compute_performance-ego": 0.04003926383124457, "sim_compute_robot_state-ego": 0.04280171129438612}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6059482679887973, "sim_physics": 0.05793840643288432, "survival_time": 6.8999999999999835, "driven_lanedir": 1.404956996152074, "sim_render-ego": 0.03703906570655712, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10224942366282146, "deviation-heading": 1.0865573324409477, "set_robot_commands": 0.05609669028848842, "deviation-center-line": 0.3233946791443165, "driven_lanedir_consec": 1.404956996152074, "sim_compute_sim_state": 0.024211627849634144, "sim_compute_performance-ego": 0.04117174597753995, "sim_compute_robot_state-ego": 0.04255924708601357}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.572039895430136, "sim_physics": 0.061171860189481814, "survival_time": 10.85000000000002, "driven_lanedir": 1.3404523613522228, "sim_render-ego": 0.03704599191516226, "in-drivable-lane": 4.900000000000032, "agent_compute-ego": 0.1016150103186682, "deviation-heading": 0.9960906661348286, "set_robot_commands": 0.05691262544025474, "deviation-center-line": 0.216002876568786, "driven_lanedir_consec": 1.3404523613522228, "sim_compute_sim_state": 0.024369551838817685, "sim_compute_performance-ego": 0.040282176936277045, "sim_compute_robot_state-ego": 0.042438179666545534}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.691549815815845, "sim_physics": 0.05824106150660022, "survival_time": 7.249999999999982, "driven_lanedir": 1.2716505619864509, "sim_render-ego": 0.03682125683488517, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1022791155453386, "deviation-heading": 0.6402517277211202, "set_robot_commands": 0.0579462692655366, "deviation-center-line": 0.2447015744035076, "driven_lanedir_consec": 1.2716505619864509, "sim_compute_sim_state": 0.02404162965971848, "sim_compute_performance-ego": 0.040504590396223394, "sim_compute_robot_state-ego": 0.04249955045765843}}
set_robot_commands_max0.0579462692655366
set_robot_commands_mean0.056819345035836834
set_robot_commands_median0.05676897450497276
set_robot_commands_min0.05609669028848842
sim_compute_performance-ego_max0.04117174597753995
sim_compute_performance-ego_mean0.04052635335531034
sim_compute_performance-ego_median0.040504590396223394
sim_compute_performance-ego_min0.04003926383124457
sim_compute_robot_state-ego_max0.04280171129438612
sim_compute_robot_state-ego_mean0.04253567428940886
sim_compute_robot_state-ego_median0.04249955045765843
sim_compute_robot_state-ego_min0.042379682942440634
sim_compute_sim_state_max0.024369551838817685
sim_compute_sim_state_mean0.024100172978558973
sim_compute_sim_state_median0.02404162965971848
sim_compute_sim_state_min0.02391592075950221
sim_physics_max0.061171860189481814
sim_physics_mean0.05887596859039752
sim_physics_median0.05824106150660022
sim_physics_min0.05752625200483534
sim_render-ego_max0.037110757827758786
sim_render-ego_mean0.0369715699864972
sim_render-ego_median0.03703906570655712
sim_render-ego_min0.03682125683488517
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean6.849999999999994
survival_time_min4.499999999999992
No reset possible
23487step1-simulationhost-erroryes0:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/transport/unixconn.py", line 42, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/docker/api/client.py", line 225, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/Users/andrea/.local/share/virtualenvs/pipenv4-5FQVYY7K/lib/python3.7/site-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 660, in run_single
    timeout_sec=timeout_sec)
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-challenges-runner/src/duckietown_challenges_runner/runner.py", line 735, in run_one
    client = check_docker_environment()
  File "/data/work/vmware-michela-shared/DT/dt-env/dt-env-developer/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(61, 'Connection refused'))

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible