Duckietown Challenges Home Challenges Submissions

Submission 5251

Submission5251
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28209
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

28209

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28209step1-simulationsuccessyes0:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.938197285609042
survival_time_median14.950000000000076
deviation-center-line_median0.6542451476259076
in-drivable-lane_median0


other stats
agent_compute-ego_max0.016445732116699217
agent_compute-ego_mean0.015869728088378908
agent_compute-ego_median0.015762530167897543
agent_compute-ego_min0.015537749926249188
deviation-center-line_max0.7433683951446879
deviation-center-line_mean0.6616678126960933
deviation-center-line_min0.5875091095450102
deviation-heading_max4.20980808188313
deviation-heading_mean3.738844916185579
deviation-heading_median3.663992759937949
deviation-heading_min3.4105709834251714
driven_any_max3.9045486257828106
driven_any_mean3.2811076737801934
driven_any_median3.1665194203572957
driven_any_min3.022486485494088
driven_lanedir_consec_max3.7759460316288105
driven_lanedir_consec_mean3.086443014488053
driven_lanedir_consec_min2.7366630784887183
driven_lanedir_max3.7759460316288105
driven_lanedir_mean3.086443014488053
driven_lanedir_median2.938197285609042
driven_lanedir_min2.7366630784887183
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.4699999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2276306824148455, "sim_physics": 0.05892182032267253, "survival_time": 14.950000000000076, "driven_lanedir": 2.937340259402012, "sim_render-ego": 0.007014563083648681, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.016445732116699217, "deviation-heading": 4.20980808188313, "set_robot_commands": 0.007292633851369222, "deviation-center-line": 0.7101702658580404, "driven_lanedir_consec": 2.937340259402012, "sim_compute_sim_state": 0.003816985289255778, "sim_compute_performance-ego": 0.004137655893961588, "sim_compute_robot_state-ego": 0.0052225176493326825}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0843531548519283, "sim_physics": 0.05542843023935954, "survival_time": 14.950000000000076, "driven_lanedir": 2.938197285609042, "sim_render-ego": 0.007022485733032226, "in-drivable-lane": 0, "agent_compute-ego": 0.015537749926249188, "deviation-heading": 3.746662759857964, "set_robot_commands": 0.007005066871643067, "deviation-center-line": 0.6542451476259076, "driven_lanedir_consec": 2.938197285609042, "sim_compute_sim_state": 0.003534971078236898, "sim_compute_performance-ego": 0.0039577937126159665, "sim_compute_robot_state-ego": 0.0049858196576436364}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.022486485494088, "sim_physics": 0.05574689388275147, "survival_time": 14.950000000000076, "driven_lanedir": 2.7366630784887183, "sim_render-ego": 0.0070663038889567055, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.015585898558298748, "deviation-heading": 3.663189995823682, "set_robot_commands": 0.007007380326588948, "deviation-center-line": 0.7433683951446879, "driven_lanedir_consec": 2.7366630784887183, "sim_compute_sim_state": 0.003634055455525716, "sim_compute_performance-ego": 0.0039822522799173995, "sim_compute_robot_state-ego": 0.005105538368225098}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.9045486257828106, "sim_physics": 0.055915350119272865, "survival_time": 14.950000000000076, "driven_lanedir": 3.7759460316288105, "sim_render-ego": 0.007050567468007405, "in-drivable-lane": 0, "agent_compute-ego": 0.01601672967274984, "deviation-heading": 3.4105709834251714, "set_robot_commands": 0.007118073304494222, "deviation-center-line": 0.5875091095450102, "driven_lanedir_consec": 3.7759460316288105, "sim_compute_sim_state": 0.003524274031321208, "sim_compute_performance-ego": 0.003986744085947672, "sim_compute_robot_state-ego": 0.0051008987426757815}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1665194203572957, "sim_physics": 0.05647069295247396, "survival_time": 14.950000000000076, "driven_lanedir": 3.0440684173116823, "sim_render-ego": 0.007029428482055664, "in-drivable-lane": 0, "agent_compute-ego": 0.015762530167897543, "deviation-heading": 3.663992759937949, "set_robot_commands": 0.0071205838521321615, "deviation-center-line": 0.6130461453068202, "driven_lanedir_consec": 3.0440684173116823, "sim_compute_sim_state": 0.003626392682393392, "sim_compute_performance-ego": 0.0039774847030639646, "sim_compute_robot_state-ego": 0.005033707618713379}}
set_robot_commands_max0.007292633851369222
set_robot_commands_mean0.007108747641245525
set_robot_commands_median0.007118073304494222
set_robot_commands_min0.007005066871643067
sim_compute_performance-ego_max0.004137655893961588
sim_compute_performance-ego_mean0.004008386135101318
sim_compute_performance-ego_median0.0039822522799173995
sim_compute_performance-ego_min0.0039577937126159665
sim_compute_robot_state-ego_max0.0052225176493326825
sim_compute_robot_state-ego_mean0.005089696407318116
sim_compute_robot_state-ego_median0.0051008987426757815
sim_compute_robot_state-ego_min0.0049858196576436364
sim_compute_sim_state_max0.003816985289255778
sim_compute_sim_state_mean0.003627335707346598
sim_compute_sim_state_median0.003626392682393392
sim_compute_sim_state_min0.003524274031321208
sim_physics_max0.05892182032267253
sim_physics_mean0.05649663750330608
sim_physics_median0.055915350119272865
sim_physics_min0.05542843023935954
sim_render-ego_max0.0070663038889567055
sim_render-ego_mean0.007036669731140137
sim_render-ego_median0.007029428482055664
sim_render-ego_min0.007014563083648681
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
28208step1-simulationsuccessyes0:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28207step1-simulationhost-erroryes0:00:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/614b4975466d7bb0533fa9c5d45d44ba6f67b852861b6a7c8e5b92d14a2a7c96/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible