Duckietown Challenges Home Challenges Submissions

Submission 6307

Submission6307
Competingyes
Challengeaido3-off-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 31093
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

31093

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
31093step1-simulationsuccessyes0:09:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5610231748459023
survival_time_median14.950000000000076
deviation-center-line_median0.8503148810421579
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029336007436116536
agent_compute-ego_mean0.02755485757191976
agent_compute-ego_median0.02698678493499756
agent_compute-ego_min0.0259134840965271
deviation-center-line_max1.3985668502805628
deviation-center-line_mean0.9176924123784692
deviation-center-line_min0.6523187076991652
deviation-heading_max3.315743267333215
deviation-heading_mean3.0271651988968764
deviation-heading_median3.078291526048747
deviation-heading_min2.6690406605715418
driven_any_max2.941243181836407
driven_any_mean2.693066740076489
driven_any_median2.654175070737925
driven_any_min2.591962399087951
driven_lanedir_consec_max2.8772042039220036
driven_lanedir_consec_mean2.56381292931032
driven_lanedir_consec_min2.2629610313046227
driven_lanedir_max2.8772042039220036
driven_lanedir_mean2.56381292931032
driven_lanedir_median2.5610231748459023
driven_lanedir_min2.2629610313046227
in-drivable-lane_max2.4500000000000117
in-drivable-lane_mean0.4900000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.654175070737925, "sim_physics": 0.07532024621963501, "survival_time": 14.950000000000076, "driven_lanedir": 2.5610231748459023, "sim_render-ego": 0.010613289674123129, "in-drivable-lane": 0, "agent_compute-ego": 0.029336007436116536, "deviation-heading": 3.315743267333215, "set_robot_commands": 0.008059705893198649, "deviation-center-line": 1.3985668502805628, "driven_lanedir_consec": 2.5610231748459023, "sim_compute_sim_state": 0.005112537542978923, "sim_compute_performance-ego": 0.006476489702860514, "sim_compute_robot_state-ego": 0.007811409632364909}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.591962399087951, "sim_physics": 0.07284094015757243, "survival_time": 14.950000000000076, "driven_lanedir": 2.5268660485637486, "sim_render-ego": 0.010406317710876464, "in-drivable-lane": 0, "agent_compute-ego": 0.02660330136617025, "deviation-heading": 2.8768629820690377, "set_robot_commands": 0.008015195528666178, "deviation-center-line": 0.9071811713990992, "driven_lanedir_consec": 2.5268660485637486, "sim_compute_sim_state": 0.0049351390202840165, "sim_compute_performance-ego": 0.006330657005310059, "sim_compute_robot_state-ego": 0.007558305263519288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5942802274111147, "sim_physics": 0.07575632651646932, "survival_time": 14.950000000000076, "driven_lanedir": 2.2629610313046227, "sim_render-ego": 0.010782888730367025, "in-drivable-lane": 2.4500000000000117, "agent_compute-ego": 0.0259134840965271, "deviation-heading": 3.078291526048747, "set_robot_commands": 0.008351348241170247, "deviation-center-line": 0.8503148810421579, "driven_lanedir_consec": 2.2629610313046227, "sim_compute_sim_state": 0.005089627901713053, "sim_compute_performance-ego": 0.006517554918924967, "sim_compute_robot_state-ego": 0.007786955833435059}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.683672821309047, "sim_physics": 0.07396379947662353, "survival_time": 14.950000000000076, "driven_lanedir": 2.591010187915323, "sim_render-ego": 0.010834904511769612, "in-drivable-lane": 0, "agent_compute-ego": 0.02893471002578735, "deviation-heading": 3.195887558461839, "set_robot_commands": 0.00817975123723348, "deviation-center-line": 0.6523187076991652, "driven_lanedir_consec": 2.591010187915323, "sim_compute_sim_state": 0.004861870606740316, "sim_compute_performance-ego": 0.006502467791239421, "sim_compute_robot_state-ego": 0.00762985626856486}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.941243181836407, "sim_physics": 0.06710405190785726, "survival_time": 14.950000000000076, "driven_lanedir": 2.8772042039220036, "sim_render-ego": 0.009992934862772624, "in-drivable-lane": 0, "agent_compute-ego": 0.02698678493499756, "deviation-heading": 2.6690406605715418, "set_robot_commands": 0.007943329811096191, "deviation-center-line": 0.78008045147136, "driven_lanedir_consec": 2.8772042039220036, "sim_compute_sim_state": 0.004782559871673584, "sim_compute_performance-ego": 0.005919271310170491, "sim_compute_robot_state-ego": 0.007296341260274251}}
set_robot_commands_max0.008351348241170247
set_robot_commands_mean0.008109866142272949
set_robot_commands_median0.008059705893198649
set_robot_commands_min0.007943329811096191
sim_compute_performance-ego_max0.006517554918924967
sim_compute_performance-ego_mean0.00634928814570109
sim_compute_performance-ego_median0.006476489702860514
sim_compute_performance-ego_min0.005919271310170491
sim_compute_robot_state-ego_max0.007811409632364909
sim_compute_robot_state-ego_mean0.007616573651631674
sim_compute_robot_state-ego_median0.00762985626856486
sim_compute_robot_state-ego_min0.007296341260274251
sim_compute_sim_state_max0.005112537542978923
sim_compute_sim_state_mean0.004956346988677978
sim_compute_sim_state_median0.0049351390202840165
sim_compute_sim_state_min0.004782559871673584
sim_physics_max0.07575632651646932
sim_physics_mean0.0729970728556315
sim_physics_median0.07396379947662353
sim_physics_min0.06710405190785726
sim_render-ego_max0.010834904511769612
sim_render-ego_mean0.010526067097981772
sim_render-ego_median0.010613289674123129
sim_render-ego_min0.009992934862772624
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
31047step1-simulationerrorno0:00:42
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31022step1-simulationhost-errorno0:00:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 67, in check_docker_environment
    _containers = client.containers.list(filters=dict(status="running"))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/78895ba0d9796a37fef6e3eea8835f56d33e5620d229271ab624bdb86c1b14a2/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 911, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 74, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/78895ba0d9796a37fef6e3eea8835f56d33e5620d229271ab624bdb86c1b14a2/json

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31013step1-simulationhost-errorno0:00:45
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 67, in check_docker_environment
    _containers = client.containers.list(filters=dict(status="running"))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ed897b661055c970e3676d53f9507c24632bfe27ec84b6bd3c892266c5de1038/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 911, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 74, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ed897b661055c970e3676d53f9507c24632bfe27ec84b6bd3c892266c5de1038/json

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30897step1-simulationerrorno0:00:43
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30873step1-simulationerrorno0:00:42
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30871step1-simulationerrorno0:00:44
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30767step1-simulationsuccessno0:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30766step1-simulationsuccessno0:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible