Duckietown Challenges Home Challenges Submissions

Submission 2819

Submission2819
Competingyes
Challengeaido2-LF-sim-validation
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22760
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

22760

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22760step1-simulationsuccessyes0:05:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15226617513918408
agent_compute-ego_mean0.14444131860046333
agent_compute-ego_median0.14464850425720216
agent_compute-ego_min0.13723482805139878
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10430833145424172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05900004616490117, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1487106791249028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09096628648263436, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971023912783022, "sim_compute_performance-ego": 0.06606966919369167, "sim_compute_robot_state-ego": 0.07431791888342963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10403157215492398, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060144840502271465, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15226617513918408, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08579170002656825, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03728515494103525, "sim_compute_performance-ego": 0.06455132540534525, "sim_compute_robot_state-ego": 0.06786246860728544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10839073798235724, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05524265064912684, "in-drivable-lane": 0, "agent_compute-ego": 0.13723482805139878, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0963271084953757, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0372778247384464, "sim_compute_performance-ego": 0.05286411678089815, "sim_compute_robot_state-ego": 0.06323925186606015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11692477226257324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.055064363479614256, "in-drivable-lane": 0, "agent_compute-ego": 0.14464850425720216, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08280410766601562, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03682717323303222, "sim_compute_performance-ego": 0.06430780410766601, "sim_compute_robot_state-ego": 0.06965743064880371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09983240199994438, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05774584902992731, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13934640642962878, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08488985858386076, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03511207314986217, "sim_compute_performance-ego": 0.06217827978013437, "sim_compute_robot_state-ego": 0.06558218786988078}}
set_robot_commands_max0.0963271084953757
set_robot_commands_mean0.08815581225089093
set_robot_commands_median0.08579170002656825
set_robot_commands_min0.08280410766601562
sim_compute_performance-ego_max0.06606966919369167
sim_compute_performance-ego_mean0.06199423905354708
sim_compute_performance-ego_median0.06430780410766601
sim_compute_performance-ego_min0.05286411678089815
sim_compute_robot_state-ego_max0.07431791888342963
sim_compute_robot_state-ego_mean0.06813185157509194
sim_compute_robot_state-ego_median0.06786246860728544
sim_compute_robot_state-ego_min0.06323925186606015
sim_compute_sim_state_max0.03971023912783022
sim_compute_sim_state_mean0.03724249303804125
sim_compute_sim_state_median0.0372778247384464
sim_compute_sim_state_min0.03511207314986217
sim_physics_max0.11692477226257324
sim_physics_mean0.10669756317080813
sim_physics_median0.10430833145424172
sim_physics_min0.09983240199994438
sim_render-ego_max0.060144840502271465
sim_render-ego_mean0.0574395499651682
sim_render-ego_median0.05774584902992731
sim_render-ego_min0.055064363479614256
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
22755step1-simulationhost-erroryes0:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 255, in _do_raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+ip4://127.0.0.1:5001/api/v0/swarm/connect?stream-channels=true&arg=%2Fip4%2F129.132.0.37%2Ftcp%2F4001%2Fipfs%2FQmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 541, in get_cr
    allow_host_network=allow_host_network, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 605, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 877, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1151, in download_artefacts
    res = client.swarm_connect(peer)
  File "/usr/local/lib/python3.6/dist-packages/ipfsapi/client/__init__.py", line 205, in wrapper
    return value(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/base.py", line 15, in wrapper
    result = func(*args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/client/swarm.py", line 137, in connect
    return self._client.request('/swarm/connect', args, decoder='json', **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 44, in wrapper
    return func(self, *args, **merged)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 364, in request
    files, headers, data, timeout=timeout)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 286, in _request
    self._do_raise_for_status(res)
  File "/usr/local/lib/python3.6/dist-packages/ipfshttpclient/http.py", line 273, in _do_raise_for_status
    six.raise_from(exceptions.ErrorResponse(msg, error), error)
  File "<string>", line 3, in raise_from
ipfshttpclient.exceptions.ErrorResponse: connect QmW5P8PZhGYGoyGzAGZNKNTKrvbg8m7Wv4QF4o2ghYmuf9 failure: dial attempt failed: <peer.ID T35iPP> --> <peer.ID W5P8PZ> dial attempt failed: context deadline exceeded
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible