Duckietown Challenges Home Challenges Submissions

Submission 5263

Submission5263
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28229
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

28229

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28229step1-simulationsuccessyes0:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.024343160254481
survival_time_median14.950000000000076
deviation-center-line_median0.8012410365447158
in-drivable-lane_median2.4999999999999916


other stats
agent_compute-ego_max0.05632918039957682
agent_compute-ego_mean0.05200492341618708
agent_compute-ego_median0.05220579385757446
agent_compute-ego_min0.04795395930608114
deviation-center-line_max1.1239510857726904
deviation-center-line_mean0.758865122594695
deviation-center-line_min0.34597666306135944
deviation-heading_max4.803764163105722
deviation-heading_mean3.32229874378888
deviation-heading_median3.33343284591997
deviation-heading_min1.5731080882871755
driven_any_max4.96209571682615
driven_any_mean4.076901091343892
driven_any_median3.9310421925860943
driven_any_min2.9555834800802563
driven_lanedir_consec_max4.811506154191676
driven_lanedir_consec_mean3.3042390609185888
driven_lanedir_consec_min1.8387071216050808
driven_lanedir_max4.811506154191676
driven_lanedir_mean3.57676824288677
driven_lanedir_median3.2013530314459913
driven_lanedir_min2.544041977019598
in-drivable-lane_max3.6500000000000288
in-drivable-lane_mean2.3600000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.653438655321126, "sim_physics": 0.08018506368001302, "survival_time": 14.950000000000076, "driven_lanedir": 3.024343160254481, "sim_render-ego": 0.013906208674112956, "in-drivable-lane": 2.100000000000013, "agent_compute-ego": 0.04795395930608114, "deviation-heading": 4.803764163105722, "set_robot_commands": 0.009629770914713542, "deviation-center-line": 1.1239510857726904, "driven_lanedir_consec": 3.024343160254481, "sim_compute_sim_state": 0.005865241686503092, "sim_compute_performance-ego": 0.008386487166086833, "sim_compute_robot_state-ego": 0.010035181045532226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.9310421925860943, "sim_physics": 0.07737514893213908, "survival_time": 14.950000000000076, "driven_lanedir": 3.2013530314459913, "sim_render-ego": 0.013322157859802246, "in-drivable-lane": 3.6500000000000288, "agent_compute-ego": 0.051066071192423505, "deviation-heading": 4.086124799724751, "set_robot_commands": 0.00959407885869344, "deviation-center-line": 0.8012410365447158, "driven_lanedir_consec": 1.8387071216050808, "sim_compute_sim_state": 0.005904552141825358, "sim_compute_performance-ego": 0.00817230463027954, "sim_compute_robot_state-ego": 0.009817434946695965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.882345411905832, "sim_physics": 0.07659402370452881, "survival_time": 14.950000000000076, "driven_lanedir": 4.302596891522107, "sim_render-ego": 0.013168373902638753, "in-drivable-lane": 2.4999999999999916, "agent_compute-ego": 0.05220579385757446, "deviation-heading": 2.815063821906783, "set_robot_commands": 0.009277362028757731, "deviation-center-line": 0.802061754515051, "driven_lanedir_consec": 4.302596891522107, "sim_compute_sim_state": 0.00562859296798706, "sim_compute_performance-ego": 0.00789445400238037, "sim_compute_robot_state-ego": 0.009485882918039958}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.96209571682615, "sim_physics": 0.07998338460922241, "survival_time": 14.950000000000076, "driven_lanedir": 4.811506154191676, "sim_render-ego": 0.014040040175120037, "in-drivable-lane": 0, "agent_compute-ego": 0.05632918039957682, "deviation-heading": 3.33343284591997, "set_robot_commands": 0.010284204483032229, "deviation-center-line": 0.7210950730796579, "driven_lanedir_consec": 4.811506154191676, "sim_compute_sim_state": 0.006174233754475912, "sim_compute_performance-ego": 0.008575250307718912, "sim_compute_robot_state-ego": 0.010223821798960368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9555834800802563, "sim_physics": 0.08307779529719676, "survival_time": 10.300000000000011, "driven_lanedir": 2.544041977019598, "sim_render-ego": 0.01424715356919372, "in-drivable-lane": 3.5500000000000274, "agent_compute-ego": 0.052469612325279455, "deviation-heading": 1.5731080882871755, "set_robot_commands": 0.010487561087006504, "deviation-center-line": 0.34597666306135944, "driven_lanedir_consec": 2.544041977019598, "sim_compute_sim_state": 0.006211463687489334, "sim_compute_performance-ego": 0.008340729093088688, "sim_compute_robot_state-ego": 0.010394664644037635}}
set_robot_commands_max0.010487561087006504
set_robot_commands_mean0.009854595474440689
set_robot_commands_median0.009629770914713542
set_robot_commands_min0.009277362028757731
sim_compute_performance-ego_max0.008575250307718912
sim_compute_performance-ego_mean0.008273845039910868
sim_compute_performance-ego_median0.008340729093088688
sim_compute_performance-ego_min0.00789445400238037
sim_compute_robot_state-ego_max0.010394664644037635
sim_compute_robot_state-ego_mean0.009991397070653227
sim_compute_robot_state-ego_median0.010035181045532226
sim_compute_robot_state-ego_min0.009485882918039958
sim_compute_sim_state_max0.006211463687489334
sim_compute_sim_state_mean0.005956816847656151
sim_compute_sim_state_median0.005904552141825358
sim_compute_sim_state_min0.00562859296798706
sim_physics_max0.08307779529719676
sim_physics_mean0.07944308324462002
sim_physics_median0.07998338460922241
sim_physics_min0.07659402370452881
sim_render-ego_max0.01424715356919372
sim_render-ego_mean0.013736786836173544
sim_render-ego_median0.013906208674112956
sim_render-ego_min0.013168373902638753
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.020000000000064
survival_time_min10.300000000000011
No reset possible
28228step1-simulationhost-erroryes0:08:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ac04687a2c2b5e2de450367c656e45a0a636501c1937d039fd4b446f5a248de2/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible