Duckietown Challenges Home Challenges Submissions

Submission 6301

Submission6301
Competingyes
Challengeaido3-off-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 31100
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

31100

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
31100step1-simulationsuccessyes0:10:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.926442712635655
survival_time_median14.950000000000076
deviation-center-line_median0.5976709653793476
in-drivable-lane_median0


other stats
agent_compute-ego_max0.027914956410725913
agent_compute-ego_mean0.026095606803894045
agent_compute-ego_median0.025927159786224365
agent_compute-ego_min0.02492864926656087
deviation-center-line_max0.6360502114938639
deviation-center-line_mean0.5909993524906352
deviation-center-line_min0.5418061779854934
deviation-heading_max2.972388475726345
deviation-heading_mean2.07515920095503
deviation-heading_median1.8613709419794953
deviation-heading_min1.318388077799844
driven_any_max3.706457137391138
driven_any_mean3.093372045770651
driven_any_median2.955295829585697
driven_any_min2.7550201202598585
driven_lanedir_consec_max3.6875649850126
driven_lanedir_consec_mean2.886596503857988
driven_lanedir_consec_min2.1784515587597855
driven_lanedir_max3.6875649850126
driven_lanedir_mean2.886596503857988
driven_lanedir_median2.926442712635655
driven_lanedir_min2.1784515587597855
in-drivable-lane_max4.250000000000024
in-drivable-lane_mean1.3400000000000118
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.799963122708498, "sim_physics": 0.06814916054407756, "survival_time": 14.950000000000076, "driven_lanedir": 2.419348620858755, "sim_render-ego": 0.011781588395436604, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.027914956410725913, "deviation-heading": 2.972388475726345, "set_robot_commands": 0.00873399019241333, "deviation-center-line": 0.5798226422805339, "driven_lanedir_consec": 2.419348620858755, "sim_compute_sim_state": 0.005704020659128825, "sim_compute_performance-ego": 0.007034843762715658, "sim_compute_robot_state-ego": 0.008254710038503012}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.25012401890806, "sim_physics": 0.07576686382293701, "survival_time": 14.950000000000076, "driven_lanedir": 3.2211746420231444, "sim_render-ego": 0.013292487462361653, "in-drivable-lane": 0, "agent_compute-ego": 0.02611380974451701, "deviation-heading": 1.7409260717858568, "set_robot_commands": 0.008997643788655599, "deviation-center-line": 0.6360502114938639, "driven_lanedir_consec": 3.2211746420231444, "sim_compute_sim_state": 0.005433668295542399, "sim_compute_performance-ego": 0.007073819637298584, "sim_compute_robot_state-ego": 0.008557035128275553}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7550201202598585, "sim_physics": 0.07610617478688558, "survival_time": 14.950000000000076, "driven_lanedir": 2.1784515587597855, "sim_render-ego": 0.012190292676289877, "in-drivable-lane": 4.250000000000024, "agent_compute-ego": 0.02492864926656087, "deviation-heading": 2.482722437483609, "set_robot_commands": 0.008900803724924723, "deviation-center-line": 0.5976709653793476, "driven_lanedir_consec": 2.1784515587597855, "sim_compute_sim_state": 0.00575539509455363, "sim_compute_performance-ego": 0.007475886344909668, "sim_compute_robot_state-ego": 0.008620129426320395}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.706457137391138, "sim_physics": 0.0763572637240092, "survival_time": 14.950000000000076, "driven_lanedir": 3.6875649850126, "sim_render-ego": 0.01234349012374878, "in-drivable-lane": 0, "agent_compute-ego": 0.025927159786224365, "deviation-heading": 1.318388077799844, "set_robot_commands": 0.008949283758799236, "deviation-center-line": 0.5418061779854934, "driven_lanedir_consec": 3.6875649850126, "sim_compute_sim_state": 0.005431279341379802, "sim_compute_performance-ego": 0.007493545214335123, "sim_compute_robot_state-ego": 0.008595460255940756}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.955295829585697, "sim_physics": 0.07527643283208212, "survival_time": 14.950000000000076, "driven_lanedir": 2.926442712635655, "sim_render-ego": 0.01207685629526774, "in-drivable-lane": 0, "agent_compute-ego": 0.02559345881144206, "deviation-heading": 1.8613709419794953, "set_robot_commands": 0.009128999710083009, "deviation-center-line": 0.599646765313937, "driven_lanedir_consec": 2.926442712635655, "sim_compute_sim_state": 0.0053088680903116865, "sim_compute_performance-ego": 0.007214581966400147, "sim_compute_robot_state-ego": 0.008414436976114908}}
set_robot_commands_max0.009128999710083009
set_robot_commands_mean0.00894214423497518
set_robot_commands_median0.008949283758799236
set_robot_commands_min0.00873399019241333
sim_compute_performance-ego_max0.007493545214335123
sim_compute_performance-ego_mean0.007258535385131835
sim_compute_performance-ego_median0.007214581966400147
sim_compute_performance-ego_min0.007034843762715658
sim_compute_robot_state-ego_max0.008620129426320395
sim_compute_robot_state-ego_mean0.008488354365030924
sim_compute_robot_state-ego_median0.008557035128275553
sim_compute_robot_state-ego_min0.008254710038503012
sim_compute_sim_state_max0.00575539509455363
sim_compute_sim_state_mean0.005526646296183268
sim_compute_sim_state_median0.005433668295542399
sim_compute_sim_state_min0.0053088680903116865
sim_physics_max0.0763572637240092
sim_physics_mean0.0743311791419983
sim_physics_median0.07576686382293701
sim_physics_min0.06814916054407756
sim_render-ego_max0.013292487462361653
sim_render-ego_mean0.01233694299062093
sim_render-ego_median0.012190292676289877
sim_render-ego_min0.011781588395436604
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
31037step1-simulationerrorno0:00:44
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31032step1-simulationerrorno0:00:53
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31024step1-simulationhost-errorno0:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 67, in check_docker_environment
    _containers = client.containers.list(filters=dict(status="running"))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ebc74663f6aed558c3e130905d455f5280dff8e1618d0b6c48bfefca84821281/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 792, in run_single
    timeout_sec=timeout_sec,
  File "/project/src/duckietown_challenges_runner/runner.py", line 870, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 74, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ebc74663f6aed558c3e130905d455f5280dff8e1618d0b6c48bfefca84821281/json

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31020step1-simulationerrorno0:00:54
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30915step1-simulationerrorno0:00:47
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30910step1-simulationerrorno0:00:49
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30889step1-simulationerrorno0:00:47
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30886step1-simulationerrorno0:00:44
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30885step1-simulationerrorno0:00:43
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30756step1-simulationsuccessno0:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible