Duckietown Challenges Home Challenges Submissions

Submission 4026

Submission4026
Competingyes
Challengeaido2-LF-sim-validation-offseason
UserAndrew VennekotterΒ πŸ‡ΊπŸ‡Έ
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
ResultπŸ’š
Jobsstep1-simulation: 24250
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

24250

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24250step1-simulationsuccessyes0:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06764961440318373
survival_time_median1.5500000000000007
deviation-center-line_median0.05353922704599162
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.17584759189236548
agent_compute-ego_mean0.15967225935874169
agent_compute-ego_median0.1637249443982099
agent_compute-ego_min0.13013916015625
deviation-center-line_max0.07228728063544432
deviation-center-line_mean0.05568939937029442
deviation-center-line_min0.04595955293841583
deviation-heading_max0.8102797062752097
deviation-heading_mean0.7189929988229335
deviation-heading_median0.7076820869772857
deviation-heading_min0.6413040214090833
driven_any_max0.23414043196558365
driven_any_mean0.1817946759897741
driven_any_median0.19494332741715545
driven_any_min0.07983512896685699
driven_lanedir_consec_max0.13269067689543812
driven_lanedir_consec_mean0.08174405942753796
driven_lanedir_consec_min0.031163125050107876
driven_lanedir_max0.13269067689543812
driven_lanedir_mean0.08174405942753796
driven_lanedir_median0.06764961440318373
driven_lanedir_min0.031163125050107876
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.3700000000000003
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20758257325870597, "sim_physics": 0.11502810426660486, "survival_time": 1.850000000000001, "driven_lanedir": 0.06764961440318373, "sim_render-ego": 0.06213520668648385, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1637249443982099, "deviation-heading": 0.7396387120695755, "set_robot_commands": 0.0851498487833384, "deviation-center-line": 0.05988062769741462, "driven_lanedir_consec": 0.06764961440318373, "sim_compute_sim_state": 0.038930544982085355, "sim_compute_performance-ego": 0.06618240717295054, "sim_compute_robot_state-ego": 0.07183823714385161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19494332741715545, "sim_physics": 0.11551086107889812, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12003769089090845, "sim_render-ego": 0.0598755677541097, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15996412436167398, "deviation-heading": 0.6960604673835139, "set_robot_commands": 0.09281915823618572, "deviation-center-line": 0.04595955293841583, "driven_lanedir_consec": 0.12003769089090845, "sim_compute_sim_state": 0.03924883206685384, "sim_compute_performance-ego": 0.06790339946746826, "sim_compute_robot_state-ego": 0.07411030133565268}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.07983512896685699, "sim_physics": 0.08087834119796752, "survival_time": 1.0000000000000002, "driven_lanedir": 0.031163125050107876, "sim_render-ego": 0.04409643411636353, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.13013916015625, "deviation-heading": 0.6413040214090833, "set_robot_commands": 0.06736184358596801, "deviation-center-line": 0.07228728063544432, "driven_lanedir_consec": 0.031163125050107876, "sim_compute_sim_state": 0.02943474054336548, "sim_compute_performance-ego": 0.05043606758117676, "sim_compute_robot_state-ego": 0.05418543815612793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1924719183405686, "sim_physics": 0.11269831657409668, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0571791898980516, "sim_render-ego": 0.06678268217271374, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17584759189236548, "deviation-heading": 0.8102797062752097, "set_robot_commands": 0.11099821521389867, "deviation-center-line": 0.0467803085342057, "driven_lanedir_consec": 0.0571791898980516, "sim_compute_sim_state": 0.08366520943180207, "sim_compute_performance-ego": 0.07453630047459756, "sim_compute_robot_state-ego": 0.08079055816896501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23414043196558365, "sim_physics": 0.10849816931618585, "survival_time": 1.800000000000001, "driven_lanedir": 0.13269067689543812, "sim_render-ego": 0.060362941688961454, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.16868547598520914, "deviation-heading": 0.7076820869772857, "set_robot_commands": 0.0898665255970425, "deviation-center-line": 0.05353922704599162, "driven_lanedir_consec": 0.13269067689543812, "sim_compute_sim_state": 0.03742991553412543, "sim_compute_performance-ego": 0.06548131174511379, "sim_compute_robot_state-ego": 0.06767360369364421}}
set_robot_commands_max0.11099821521389867
set_robot_commands_mean0.08923911828328666
set_robot_commands_median0.0898665255970425
set_robot_commands_min0.06736184358596801
sim_compute_performance-ego_max0.07453630047459756
sim_compute_performance-ego_mean0.06490789728826138
sim_compute_performance-ego_median0.06618240717295054
sim_compute_performance-ego_min0.05043606758117676
sim_compute_robot_state-ego_max0.08079055816896501
sim_compute_robot_state-ego_mean0.06971962769964829
sim_compute_robot_state-ego_median0.07183823714385161
sim_compute_robot_state-ego_min0.05418543815612793
sim_compute_sim_state_max0.08366520943180207
sim_compute_sim_state_mean0.045741848511646435
sim_compute_sim_state_median0.038930544982085355
sim_compute_sim_state_min0.02943474054336548
sim_physics_max0.11551086107889812
sim_physics_mean0.1065227584867506
sim_physics_median0.11269831657409668
sim_physics_min0.08087834119796752
sim_render-ego_max0.06678268217271374
sim_render-ego_mean0.05865056648372645
sim_render-ego_median0.060362941688961454
sim_render-ego_min0.04409643411636353
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5400000000000005
survival_time_min1.0000000000000002
No reset possible
24233step1-simulationhost-erroryes0:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 523, in get_cr
    try_s3(aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1258, in try_s3
    s3_object.upload_fileobj(data)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 621, in object_upload_fileobj
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 539, in upload_fileobj
    return future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 692, in _main
    client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidAccessKeyId) when calling the PutObject operation: The AWS Access Key Id you provided does not exist in our records.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible