Duckietown Challenges Home Challenges Submissions

Submission 6236

Submission6236
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 30357
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

30357

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
30357step1-simulationsuccessyes0:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7589591106763385
survival_time_median9.750000000000004
deviation-center-line_median0.655736741898446
in-drivable-lane_median0


other stats
agent_compute-ego_max0.020848370515383206
agent_compute-ego_mean0.019828149828515513
agent_compute-ego_median0.01962552309036255
agent_compute-ego_min0.01948515329605494
deviation-center-line_max0.9530321290114064
deviation-center-line_mean0.6605311017716718
deviation-center-line_min0.2877465026687667
deviation-heading_max2.0542408806089925
deviation-heading_mean1.2877125187275442
deviation-heading_median1.1860172239405686
deviation-heading_min0.6594439571156266
driven_any_max3.1888275055718593
driven_any_mean2.056354782050608
driven_any_median1.8799657906526843
driven_any_min1.1473471731758986
driven_lanedir_consec_max3.150103631641294
driven_lanedir_consec_mean1.9849137013078029
driven_lanedir_consec_min1.0693340451649176
driven_lanedir_max3.150103631641294
driven_lanedir_mean1.9849137013078029
driven_lanedir_median1.7589591106763385
driven_lanedir_min1.0693340451649176
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.16000000000000175
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8799657906526843, "sim_physics": 0.05693313135550572, "survival_time": 10.400000000000013, "driven_lanedir": 1.6919425553364378, "sim_render-ego": 0.007290960504458501, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.020848370515383206, "deviation-heading": 1.3593370846645263, "set_robot_commands": 0.005136650342207689, "deviation-center-line": 0.7998351543138937, "driven_lanedir_consec": 1.6919425553364378, "sim_compute_sim_state": 0.0030653660113994893, "sim_compute_performance-ego": 0.004238046132601225, "sim_compute_robot_state-ego": 0.00528247425189385}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2782057062220575, "sim_physics": 0.05932179964505709, "survival_time": 9.750000000000004, "driven_lanedir": 2.254229163720027, "sim_render-ego": 0.007281668980916341, "in-drivable-lane": 0, "agent_compute-ego": 0.01948515329605494, "deviation-heading": 1.1795234473080074, "set_robot_commands": 0.004970142168876452, "deviation-center-line": 0.655736741898446, "driven_lanedir_consec": 2.254229163720027, "sim_compute_sim_state": 0.002983391590607472, "sim_compute_performance-ego": 0.004065259297688802, "sim_compute_robot_state-ego": 0.005231239856817784}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1473471731758986, "sim_physics": 0.058968846253522736, "survival_time": 6.349999999999985, "driven_lanedir": 1.0693340451649176, "sim_render-ego": 0.007516034944789616, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.019494103634451317, "deviation-heading": 0.6594439571156266, "set_robot_commands": 0.005123341177392194, "deviation-center-line": 0.6063049809658461, "driven_lanedir_consec": 1.0693340451649176, "sim_compute_sim_state": 0.0030495012839009445, "sim_compute_performance-ego": 0.004218450681431087, "sim_compute_robot_state-ego": 0.00547612933661994}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7874277346305412, "sim_physics": 0.05772103753479771, "survival_time": 7.94999999999998, "driven_lanedir": 1.7589591106763385, "sim_render-ego": 0.00726260928987707, "in-drivable-lane": 0, "agent_compute-ego": 0.019687598606325542, "deviation-heading": 1.1860172239405686, "set_robot_commands": 0.004984029434012167, "deviation-center-line": 0.2877465026687667, "driven_lanedir_consec": 1.7589591106763385, "sim_compute_sim_state": 0.002997665285314404, "sim_compute_performance-ego": 0.004056935040455944, "sim_compute_robot_state-ego": 0.005170564231632641}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1888275055718593, "sim_physics": 0.05817230701446533, "survival_time": 14.950000000000076, "driven_lanedir": 3.150103631641294, "sim_render-ego": 0.007233647505442301, "in-drivable-lane": 0, "agent_compute-ego": 0.01962552309036255, "deviation-heading": 2.0542408806089925, "set_robot_commands": 0.005062551498413086, "deviation-center-line": 0.9530321290114064, "driven_lanedir_consec": 3.150103631641294, "sim_compute_sim_state": 0.0030197834968566893, "sim_compute_performance-ego": 0.004095412095387776, "sim_compute_robot_state-ego": 0.005239657560984294}}
set_robot_commands_max0.005136650342207689
set_robot_commands_mean0.005055342924180318
set_robot_commands_median0.005062551498413086
set_robot_commands_min0.004970142168876452
sim_compute_performance-ego_max0.004238046132601225
sim_compute_performance-ego_mean0.004134820649512967
sim_compute_performance-ego_median0.004095412095387776
sim_compute_performance-ego_min0.004056935040455944
sim_compute_robot_state-ego_max0.00547612933661994
sim_compute_robot_state-ego_mean0.005280013047589701
sim_compute_robot_state-ego_median0.005239657560984294
sim_compute_robot_state-ego_min0.005170564231632641
sim_compute_sim_state_max0.0030653660113994893
sim_compute_sim_state_mean0.0030231415336158
sim_compute_sim_state_median0.0030197834968566893
sim_compute_sim_state_min0.002983391590607472
sim_physics_max0.05932179964505709
sim_physics_mean0.05822342436066972
sim_physics_median0.05817230701446533
sim_physics_min0.05693313135550572
sim_render-ego_max0.007516034944789616
sim_render-ego_mean0.007316984245096765
sim_render-ego_median0.007281668980916341
sim_render-ego_min0.007233647505442301
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.880000000000011
survival_time_min6.349999999999985
No reset possible
30356step1-simulationsuccessyes0:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30355step1-simulationhost-erroryes0:00:44
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/3e1dfaae404ce8de27d33abfe99adab7cd016a3cd173a9f5a9af66e171806278/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30354step1-simulationerroryes0:01:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible