Duckietown Challenges Home Challenges Submissions

Submission 5403

Submission5403
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28482
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

28482

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28482step1-simulationsuccessyes0:09:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.9320048825774654
survival_time_median14.950000000000076
deviation-center-line_median0.6835473960972819
in-drivable-lane_median2.050000000000029


other stats
agent_compute-ego_max0.028793760935465495
agent_compute-ego_mean0.027634079615275062
agent_compute-ego_median0.028323609034220376
agent_compute-ego_min0.02592430353164673
deviation-center-line_max0.9140968747055538
deviation-center-line_mean0.7177477680158493
deviation-center-line_min0.578508516262473
deviation-heading_max3.5783286537853094
deviation-heading_mean3.042222652178745
deviation-heading_median3.12349508511156
deviation-heading_min2.4941602437996435
driven_any_max4.402603068535009
driven_any_mean4.117443564308229
driven_any_median4.236899569438092
driven_any_min3.5209720019473663
driven_lanedir_consec_max4.10931338888282
driven_lanedir_consec_mean3.26792355762055
driven_lanedir_consec_min1.3871605118478372
driven_lanedir_max4.10931338888282
driven_lanedir_mean3.775790032275048
driven_lanedir_median3.9320048825774654
driven_lanedir_min3.0011173693883024
in-drivable-lane_max4.15
in-drivable-lane_mean2.3000000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.1292639374565505, "sim_physics": 0.07121663649876912, "survival_time": 14.950000000000076, "driven_lanedir": 3.7668491226433143, "sim_render-ego": 0.012369271119435627, "in-drivable-lane": 3.2500000000000204, "agent_compute-ego": 0.026777464548746743, "deviation-heading": 3.12349508511156, "set_robot_commands": 0.009000742435455322, "deviation-center-line": 0.6835473960972819, "driven_lanedir_consec": 2.8414736069112925, "sim_compute_sim_state": 0.005176074504852295, "sim_compute_performance-ego": 0.007720406055450439, "sim_compute_robot_state-ego": 0.009205555121103924}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.297479244164128, "sim_physics": 0.07593537966410319, "survival_time": 14.950000000000076, "driven_lanedir": 3.9320048825774654, "sim_render-ego": 0.012807168165842693, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.02592430353164673, "deviation-heading": 2.4941602437996435, "set_robot_commands": 0.008982354799906413, "deviation-center-line": 0.578508516262473, "driven_lanedir_consec": 3.9320048825774654, "sim_compute_sim_state": 0.005256305535634359, "sim_compute_performance-ego": 0.007692429224650065, "sim_compute_robot_state-ego": 0.009421708583831788}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.402603068535009, "sim_physics": 0.07857534964879354, "survival_time": 14.950000000000076, "driven_lanedir": 4.069665397883337, "sim_render-ego": 0.013090970516204834, "in-drivable-lane": 2.0500000000000114, "agent_compute-ego": 0.028323609034220376, "deviation-heading": 2.5662515313778846, "set_robot_commands": 0.009226415157318117, "deviation-center-line": 0.9140968747055538, "driven_lanedir_consec": 4.069665397883337, "sim_compute_sim_state": 0.0056425690650939945, "sim_compute_performance-ego": 0.007988876501719156, "sim_compute_robot_state-ego": 0.009742646217346192}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5209720019473663, "sim_physics": 0.08219316323598226, "survival_time": 14.950000000000076, "driven_lanedir": 3.0011173693883024, "sim_render-ego": 0.013991549015045164, "in-drivable-lane": 4.15, "agent_compute-ego": 0.028793760935465495, "deviation-heading": 3.5783286537853094, "set_robot_commands": 0.009703954855600994, "deviation-center-line": 0.6363235179057638, "driven_lanedir_consec": 1.3871605118478372, "sim_compute_sim_state": 0.0061413995424906415, "sim_compute_performance-ego": 0.008505493005116781, "sim_compute_robot_state-ego": 0.01031680186589559}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.236899569438092, "sim_physics": 0.08016339222590128, "survival_time": 14.950000000000076, "driven_lanedir": 4.10931338888282, "sim_render-ego": 0.0131708025932312, "in-drivable-lane": 0, "agent_compute-ego": 0.02835126002629598, "deviation-heading": 3.448877746819329, "set_robot_commands": 0.00951141595840454, "deviation-center-line": 0.7762625351081738, "driven_lanedir_consec": 4.10931338888282, "sim_compute_sim_state": 0.005668241182963054, "sim_compute_performance-ego": 0.008014455636342366, "sim_compute_robot_state-ego": 0.00965819517771403}}
set_robot_commands_max0.009703954855600994
set_robot_commands_mean0.009284976641337078
set_robot_commands_median0.009226415157318117
set_robot_commands_min0.008982354799906413
sim_compute_performance-ego_max0.008505493005116781
sim_compute_performance-ego_mean0.007984332084655762
sim_compute_performance-ego_median0.007988876501719156
sim_compute_performance-ego_min0.007692429224650065
sim_compute_robot_state-ego_max0.01031680186589559
sim_compute_robot_state-ego_mean0.009668981393178306
sim_compute_robot_state-ego_median0.00965819517771403
sim_compute_robot_state-ego_min0.009205555121103924
sim_compute_sim_state_max0.0061413995424906415
sim_compute_sim_state_mean0.005576917966206868
sim_compute_sim_state_median0.0056425690650939945
sim_compute_sim_state_min0.005176074504852295
sim_physics_max0.08219316323598226
sim_physics_mean0.07761678425470989
sim_physics_median0.07857534964879354
sim_physics_min0.07121663649876912
sim_render-ego_max0.013991549015045164
sim_render-ego_mean0.013085952281951904
sim_render-ego_median0.013090970516204834
sim_render-ego_min0.012369271119435627
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
28473step1-simulationhost-erroryes0:16:47
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connection.py", line 159, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/connection.py", line 57, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/lib/python3.6/socket.py", line 745, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 262, in send
    chunked=self._chunked(request.headers),
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 343, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 343, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 839, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connection.py", line 301, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connection.py", line 168, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <botocore.awsrequest.AWSHTTPSConnection object at 0x7fdec995fc88>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1577, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 244, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 282, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/4588b60c8c14cb9a9933ab72158cac72abf3f57ee0cb0ce7a85a87cdd34518ca"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28471step1-simulationsuccessyes0:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible