Duckietown Challenges Home Challenges Submissions

Submission 3705

Submission3705
Competingyes
Challengeaido2-LF-sim-testing
UserTony Hsu 🇹🇼
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23619
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
23619step1-simulationsuccessyes0:49:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.307138938696771
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.2372602621714274
agent_compute-ego_mean0.2357968071831597
agent_compute-ego_median0.23606083313624063
agent_compute-ego_min0.23351913770039875
deviation-center-line_max0.7441993675765441
deviation-center-line_mean0.36818899156986545
deviation-center-line_min0.10083546877568052
deviation-heading_max5.990117020581061
deviation-heading_mean5.896451626677996
deviation-heading_median5.9380236931489225
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.1853065485311425
driven_any_median2.1853065485311416
driven_any_min2.1853065485311323
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.694822873038991
driven_lanedir_consec_min0.6925369611104519
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.694822873038991
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6925369611104519
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.236666666666703
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.056219104131062826, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03618796745936076, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23680371602376304, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.055389099915822346, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.023894519805908204, "sim_compute_performance-ego": 0.04007806062698365, "sim_compute_robot_state-ego": 0.041775345007578533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05633238315582276, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.036336069901784264, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23679224967956544, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.0553994623819987, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.023783466815948485, "sim_compute_performance-ego": 0.04018988291422526, "sim_compute_robot_state-ego": 0.04250307003657023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.057132825056711835, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03620422760645548, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23586845239003496, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.05573479811350505, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.023586674531300863, "sim_compute_performance-ego": 0.039875362714131675, "sim_compute_robot_state-ego": 0.041570406754811606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.05415695110956828, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.03629589319229126, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23606083313624063, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05477304458618164, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.0236421799659729, "sim_compute_performance-ego": 0.04000140031178792, "sim_compute_robot_state-ego": 0.042206497192382814}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.054609217643737794, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.036560664971669515, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23724227031071984, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.055363043944040936, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.024019014835357667, "sim_compute_performance-ego": 0.039914500713348386, "sim_compute_robot_state-ego": 0.0417566458384196}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.1853065485311394, "sim_physics": 0.05440897862116496, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957599080131578, "sim_render-ego": 0.036585330963134766, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23688955227533975, "deviation-heading": 5.818542702573388, "set_robot_commands": 0.05585407495498657, "deviation-center-line": 0.7441993675765441, "driven_lanedir_consec": 0.6957599080131578, "sim_compute_sim_state": 0.023798503875732423, "sim_compute_performance-ego": 0.03968492031097412, "sim_compute_robot_state-ego": 0.041690038045247395}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531151, "sim_physics": 0.05453683296839396, "survival_time": 14.950000000000076, "driven_lanedir": 0.6947112112972071, "sim_render-ego": 0.03654679695765178, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2371910301844279, "deviation-heading": 5.9347088906542345, "set_robot_commands": 0.05470743974049886, "deviation-center-line": 0.21723026496478212, "driven_lanedir_consec": 0.6947112112972071, "sim_compute_sim_state": 0.02377872546513875, "sim_compute_performance-ego": 0.04016470034917196, "sim_compute_robot_state-ego": 0.04135100444157918}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1853065485311323, "sim_physics": 0.05217970530192057, "survival_time": 14.950000000000076, "driven_lanedir": 0.6954494436503662, "sim_render-ego": 0.03602260669072469, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2372602621714274, "deviation-heading": 5.951584056210216, "set_robot_commands": 0.05456499179204305, "deviation-center-line": 0.26967879357000285, "driven_lanedir_consec": 0.6954494436503662, "sim_compute_sim_state": 0.02377602497736613, "sim_compute_performance-ego": 0.0396092168490092, "sim_compute_robot_state-ego": 0.041184771060943606}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.185306548531139, "sim_physics": 0.05522885560989379, "survival_time": 14.950000000000076, "driven_lanedir": 0.6951211993980144, "sim_render-ego": 0.03605405489603678, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23470171531041464, "deviation-heading": 5.9380236931489225, "set_robot_commands": 0.05435485521952311, "deviation-center-line": 0.19127509329278516, "driven_lanedir_consec": 0.6951211993980144, "sim_compute_sim_state": 0.02390628735224406, "sim_compute_performance-ego": 0.03965600887934367, "sim_compute_robot_state-ego": 0.04147425015767416}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531147, "sim_physics": 0.05486394087473551, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957742227582209, "sim_render-ego": 0.03597301403681437, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.23639575004577637, "deviation-heading": 5.84542238624642, "set_robot_commands": 0.05446603775024414, "deviation-center-line": 0.13803594115198106, "driven_lanedir_consec": 0.6957742227582209, "sim_compute_sim_state": 0.02387503385543823, "sim_compute_performance-ego": 0.04110508441925049, "sim_compute_robot_state-ego": 0.041235493024190266}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1853065485311443, "sim_physics": 0.05442051887512207, "survival_time": 14.950000000000076, "driven_lanedir": 0.6925369611104519, "sim_render-ego": 0.03614615281422933, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23504799286524455, "deviation-heading": 5.954990711277449, "set_robot_commands": 0.055364477634429934, "deviation-center-line": 0.30943438450656163, "driven_lanedir_consec": 0.6925369611104519, "sim_compute_sim_state": 0.023588735262552896, "sim_compute_performance-ego": 0.03963437557220459, "sim_compute_robot_state-ego": 0.0411237112681071}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.1853065485311416, "sim_physics": 0.05262575149536133, "survival_time": 14.950000000000076, "driven_lanedir": 0.6949038747368048, "sim_render-ego": 0.0359025247891744, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.234542076587677, "deviation-heading": 5.860593780739516, "set_robot_commands": 0.05444599469502767, "deviation-center-line": 0.10083546877568052, "driven_lanedir_consec": 0.6949038747368048, "sim_compute_sim_state": 0.0235660982131958, "sim_compute_performance-ego": 0.0397027571996053, "sim_compute_robot_state-ego": 0.040931255022684736}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.05420217752456665, "survival_time": 14.950000000000076, "driven_lanedir": 0.6952620692692497, "sim_render-ego": 0.0358279824256897, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23372559785842895, "deviation-heading": 5.922408824528451, "set_robot_commands": 0.05453328053156535, "deviation-center-line": 0.5431694946909088, "driven_lanedir_consec": 0.6952620692692497, "sim_compute_sim_state": 0.023416763146718342, "sim_compute_performance-ego": 0.03956336180369059, "sim_compute_robot_state-ego": 0.04075065930684407}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.185306548531144, "sim_physics": 0.05171666701634725, "survival_time": 14.950000000000076, "driven_lanedir": 0.6941725425290013, "sim_render-ego": 0.035717590649922686, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2349114712079366, "deviation-heading": 5.949714932679345, "set_robot_commands": 0.05467243909835815, "deviation-center-line": 0.17004088680976326, "driven_lanedir_consec": 0.6941725425290013, "sim_compute_sim_state": 0.023308780988057453, "sim_compute_performance-ego": 0.03931858857472738, "sim_compute_robot_state-ego": 0.041351764996846514}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1853065485311363, "sim_physics": 0.05443073987960816, "survival_time": 14.950000000000076, "driven_lanedir": 0.6940085325942875, "sim_render-ego": 0.03576557000478109, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23351913770039875, "deviation-heading": 5.948883981105356, "set_robot_commands": 0.05469905932744344, "deviation-center-line": 0.4328281184579712, "driven_lanedir_consec": 0.6940085325942875, "sim_compute_sim_state": 0.02330392201741537, "sim_compute_performance-ego": 0.03938270648320516, "sim_compute_robot_state-ego": 0.040738282203674314}}
set_robot_commands_max0.05585407495498657
set_robot_commands_mean0.05495480664571127
set_robot_commands_median0.05470743974049886
set_robot_commands_min0.05435485521952311
sim_compute_performance-ego_max0.04110508441925049
sim_compute_performance-ego_mean0.03985872851477729
sim_compute_performance-ego_median0.0397027571996053
sim_compute_performance-ego_min0.03931858857472738
sim_compute_robot_state-ego_max0.04250307003657023
sim_compute_robot_state-ego_mean0.04144287962383695
sim_compute_robot_state-ego_median0.041351764996846514
sim_compute_robot_state-ego_min0.040738282203674314
sim_compute_sim_state_max0.024019014835357667
sim_compute_sim_state_mean0.023682982073889844
sim_compute_sim_state_median0.02377602497736613
sim_compute_sim_state_min0.02330392201741537
sim_physics_max0.057132825056711835
sim_physics_mean0.05447097661760118
sim_physics_median0.05443073987960816
sim_physics_min0.05171666701634725
sim_render-ego_max0.036585330963134766
sim_render-ego_mean0.03614176315731472
sim_render-ego_median0.03614615281422933
sim_render-ego_min0.035717590649922686
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
23618step1-simulationhost-erroryes0:50:08
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 783, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/3df138cbcb18a27a56fd2f074194d43dc0e0ab1e1b614e718c9eae66c6056c70/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23617step1-simulationerroryes0:51:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible