Duckietown Challenges Home Challenges Submissions

Submission 6146

Submission6146
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 30222
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

30222

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
30222step1-simulationsuccessyes0:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.041148932906539
survival_time_median6.699999999999984
deviation-center-line_median0.35471934801547267
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09848983608075042
agent_compute-ego_mean0.05199890007980927
agent_compute-ego_median0.04082784006151102
agent_compute-ego_min0.036999698895127026
deviation-center-line_max0.5371417917581655
deviation-center-line_mean0.3966651366113411
deviation-center-line_min0.22407851766857448
deviation-heading_max2.559475091354961
deviation-heading_mean1.5843908835142626
deviation-heading_median1.531159395220447
deviation-heading_min0.8125848262454058
driven_any_max2.967073562677598
driven_any_mean2.3072127745528563
driven_any_median2.2343834311251665
driven_any_min1.2555803614144587
driven_lanedir_consec_max2.908397046647063
driven_lanedir_consec_mean2.1040012734100504
driven_lanedir_consec_min1.1976327777039992
driven_lanedir_max2.908397046647063
driven_lanedir_mean2.1040012734100504
driven_lanedir_median2.041148932906539
driven_lanedir_min1.1976327777039992
in-drivable-lane_max0.6000000000000085
in-drivable-lane_mean0.24000000000000127
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9462260253041395, "sim_physics": 0.08526580013445954, "survival_time": 10.050000000000008, "driven_lanedir": 2.4804830489519007, "sim_render-ego": 0.012830724763633007, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.036999698895127026, "deviation-heading": 2.559475091354961, "set_robot_commands": 0.008870179380350444, "deviation-center-line": 0.5130124101098537, "driven_lanedir_consec": 2.4804830489519007, "sim_compute_sim_state": 0.006136857455049581, "sim_compute_performance-ego": 0.008168882398463008, "sim_compute_robot_state-ego": 0.00995118107961778}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2555803614144587, "sim_physics": 0.08924369273647186, "survival_time": 3.099999999999997, "driven_lanedir": 1.1976327777039992, "sim_render-ego": 0.01347147649334323, "in-drivable-lane": 0, "agent_compute-ego": 0.04033361711809712, "deviation-heading": 0.8125848262454058, "set_robot_commands": 0.008979074416622039, "deviation-center-line": 0.22407851766857448, "driven_lanedir_consec": 1.1976327777039992, "sim_compute_sim_state": 0.00594782829284668, "sim_compute_performance-ego": 0.008615789874907463, "sim_compute_robot_state-ego": 0.010549222269365863}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.967073562677598, "sim_physics": 0.0862714695930481, "survival_time": 14.950000000000076, "driven_lanedir": 2.908397046647063, "sim_render-ego": 0.013214126427968344, "in-drivable-lane": 0, "agent_compute-ego": 0.04334350824356079, "deviation-heading": 2.0707565354024364, "set_robot_commands": 0.009037145773569745, "deviation-center-line": 0.5371417917581655, "driven_lanedir_consec": 2.908397046647063, "sim_compute_sim_state": 0.006066036224365234, "sim_compute_performance-ego": 0.008242602348327637, "sim_compute_robot_state-ego": 0.010053903261820474}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2343834311251665, "sim_physics": 0.08259356555654042, "survival_time": 6.699999999999984, "driven_lanedir": 1.8923445608407496, "sim_render-ego": 0.01256809127864553, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09848983608075042, "deviation-heading": 0.9479785693480632, "set_robot_commands": 0.00813527783351158, "deviation-center-line": 0.3543736155046395, "driven_lanedir_consec": 1.8923445608407496, "sim_compute_sim_state": 0.007217457045370073, "sim_compute_performance-ego": 0.00749300842854514, "sim_compute_robot_state-ego": 0.009237211142013322}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.132800492242918, "sim_physics": 0.08429625680891134, "survival_time": 5.899999999999987, "driven_lanedir": 2.041148932906539, "sim_render-ego": 0.012732554290254236, "in-drivable-lane": 0, "agent_compute-ego": 0.04082784006151102, "deviation-heading": 1.531159395220447, "set_robot_commands": 0.007537150787094892, "deviation-center-line": 0.35471934801547267, "driven_lanedir_consec": 2.041148932906539, "sim_compute_sim_state": 0.005713458788596978, "sim_compute_performance-ego": 0.007733518794431525, "sim_compute_robot_state-ego": 0.009380839638790842}}
set_robot_commands_max0.009037145773569745
set_robot_commands_mean0.008511765638229741
set_robot_commands_median0.008870179380350444
set_robot_commands_min0.007537150787094892
sim_compute_performance-ego_max0.008615789874907463
sim_compute_performance-ego_mean0.008050760368934954
sim_compute_performance-ego_median0.008168882398463008
sim_compute_performance-ego_min0.00749300842854514
sim_compute_robot_state-ego_max0.010549222269365863
sim_compute_robot_state-ego_mean0.009834471478321656
sim_compute_robot_state-ego_median0.00995118107961778
sim_compute_robot_state-ego_min0.009237211142013322
sim_compute_sim_state_max0.007217457045370073
sim_compute_sim_state_mean0.0062163275612457086
sim_compute_sim_state_median0.006066036224365234
sim_compute_sim_state_min0.005713458788596978
sim_physics_max0.08924369273647186
sim_physics_mean0.08553415696588626
sim_physics_median0.08526580013445954
sim_physics_min0.08259356555654042
sim_render-ego_max0.01347147649334323
sim_render-ego_mean0.012963394650768867
sim_render-ego_median0.012830724763633007
sim_render-ego_min0.01256809127864553
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.140000000000011
survival_time_min3.099999999999997
No reset possible
30220step1-simulationsuccessyes0:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30217step1-simulationhost-erroryes0:06:22
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job30217-138194', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job30217-138194', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job30217-138194_evaluation" with the default driver
stderr | Creating volume "job30217-138194_fifos" with default driver
stderr | Creating job30217-138194_solution_1 ...
stderr | Creating job30217-138194_scenario_maker_1 ...
stderr | Creating job30217-138194_evaluator_1      ...
stderr | Creating job30217-138194_simulator_1      ...
stderr | 
stderr | ERROR: for job30217-138194_scenario_maker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30217-138194_simulator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30217-138194_solution_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30217-138194_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for scenario_maker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for simulator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for solution  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for evaluator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30215step1-simulationhost-erroryes0:06:34
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job30215-883713', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job30215-883713', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job30215-883713_evaluation" with the default driver
stderr | Creating volume "job30215-883713_fifos" with default driver
stderr | Creating job30215-883713_solution_1 ...
stderr | Creating job30215-883713_simulator_1 ...
stderr | Creating job30215-883713_scenario_maker_1 ...
stderr | Creating job30215-883713_evaluator_1      ...
stderr | 
stderr | ERROR: for job30215-883713_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30215-883713_scenario_maker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30215-883713_solution_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30215-883713_simulator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for evaluator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for scenario_maker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for solution  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for simulator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30211step1-simulationhost-erroryes0:04:01
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job30211-418490', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job30211-418490', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job30211-418490_evaluation" with the default driver
stderr | Creating volume "job30211-418490_fifos" with default driver
stderr | Creating job30211-418490_solution_1 ...
stderr | Creating job30211-418490_simulator_1 ...
stderr | Creating job30211-418490_evaluator_1 ...
stderr | Creating job30211-418490_scenario_maker_1 ...
stderr | 
stderr | ERROR: for job30211-418490_scenario_maker_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30211-418490_solution_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30211-418490_simulator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for job30211-418490_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for scenario_maker  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for solution  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for simulator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for evaluator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30201step1-simulationhost-erroryes0:08:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 372, in setup_logging
    my_stderr.flush()
  File "/project/src/duckietown_challenges_runner/runner.py", line 1247, in flush
    self.file.flush()
OSError: [Errno 28] No space left on device

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30199step1-simulationsuccessyes0:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30170step1-simulationsuccessyes0:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30164step1-simulationhost-erroryes0:04:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 67, in check_docker_environment
    _containers = client.containers.list(filters=dict(status="running"))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 795, in run_single
    write_logs(wd, project, services=config["services"])
  File "/project/src/duckietown_challenges_runner/runner.py", line 1172, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 74, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30163step1-simulationsuccessyes0:10:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible