Duckietown Challenges Home Challenges Submissions

Submission 4025

Submission4025
Competingyes
Challengeaido2-LF-sim-validation-offseason
UserAndrew Vennekotter 🇺🇸
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24251
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

24251

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24251step1-simulationsuccessyes0:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2390767607415909
survival_time_median1.7000000000000008
deviation-center-line_median0.08731774378025493
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16627474088926572
agent_compute-ego_mean0.1313293596330848
agent_compute-ego_median0.12806763819285802
agent_compute-ego_min0.09928670796481046
deviation-center-line_max0.12054118396669132
deviation-center-line_mean0.0943806886453727
deviation-center-line_min0.07236157409992623
deviation-heading_max0.8395823312464852
deviation-heading_mean0.6952558053777387
deviation-heading_median0.7189552202610832
deviation-heading_min0.45739388058973846
driven_any_max0.3749492126045942
driven_any_mean0.2776285226328782
driven_any_median0.3017614212335563
driven_any_min0.17025356377144965
driven_lanedir_consec_max0.3270190082975084
driven_lanedir_consec_mean0.22965679021530988
driven_lanedir_consec_min0.14686490694733578
driven_lanedir_max0.3270190082975084
driven_lanedir_mean0.22965679021530988
driven_lanedir_median0.2390767607415909
driven_lanedir_min0.14686490694733578
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3749492126045942, "sim_physics": 0.12693515339413206, "survival_time": 1.850000000000001, "driven_lanedir": 0.3270190082975084, "sim_render-ego": 0.06605729541263065, "in-drivable-lane": 0, "agent_compute-ego": 0.16627474088926572, "deviation-heading": 0.7189552202610832, "set_robot_commands": 0.09236621212314916, "deviation-center-line": 0.12054118396669132, "driven_lanedir_consec": 0.3270190082975084, "sim_compute_sim_state": 0.04001455049257021, "sim_compute_performance-ego": 0.07290745425868679, "sim_compute_robot_state-ego": 0.07285991874901024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3017614212335563, "sim_physics": 0.08956792074091294, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2564287352724717, "sim_render-ego": 0.052202484186957866, "in-drivable-lane": 0, "agent_compute-ego": 0.13587720955119414, "deviation-heading": 0.6733187045960338, "set_robot_commands": 0.07599426718319163, "deviation-center-line": 0.07236157409992623, "driven_lanedir_consec": 0.2564287352724717, "sim_compute_sim_state": 0.0335771686890546, "sim_compute_performance-ego": 0.061313993790570426, "sim_compute_robot_state-ego": 0.06306799019084257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17025356377144965, "sim_physics": 0.07938455451618541, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14686490694733578, "sim_render-ego": 0.042021328752691094, "in-drivable-lane": 0, "agent_compute-ego": 0.09928670796481046, "deviation-heading": 0.45739388058973846, "set_robot_commands": 0.056093421849337494, "deviation-center-line": 0.10546361989156476, "driven_lanedir_consec": 0.14686490694733578, "sim_compute_sim_state": 0.027623111551458187, "sim_compute_performance-ego": 0.04570894891565496, "sim_compute_robot_state-ego": 0.04802670262076638}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23782365344564824, "sim_physics": 0.08705323083060128, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1788945398176427, "sim_render-ego": 0.047928035259246826, "in-drivable-lane": 0, "agent_compute-ego": 0.12806763819285802, "deviation-heading": 0.8395823312464852, "set_robot_commands": 0.07527873345783778, "deviation-center-line": 0.08621932148842626, "driven_lanedir_consec": 0.1788945398176427, "sim_compute_sim_state": 0.03158831596374512, "sim_compute_performance-ego": 0.05270154135567801, "sim_compute_robot_state-ego": 0.05596248592649187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3033547621091426, "sim_physics": 0.07809444155011858, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2390767607415909, "sim_render-ego": 0.0470867361341204, "in-drivable-lane": 0, "agent_compute-ego": 0.12714050156729562, "deviation-heading": 0.7870288901953529, "set_robot_commands": 0.07119325229099818, "deviation-center-line": 0.08731774378025493, "driven_lanedir_consec": 0.2390767607415909, "sim_compute_sim_state": 0.02933272634233747, "sim_compute_performance-ego": 0.05213925497872489, "sim_compute_robot_state-ego": 0.06471589633396693}}
set_robot_commands_max0.09236621212314916
set_robot_commands_mean0.07418517738090284
set_robot_commands_median0.07527873345783778
set_robot_commands_min0.056093421849337494
sim_compute_performance-ego_max0.07290745425868679
sim_compute_performance-ego_mean0.05695423865986302
sim_compute_performance-ego_median0.05270154135567801
sim_compute_performance-ego_min0.04570894891565496
sim_compute_robot_state-ego_max0.07285991874901024
sim_compute_robot_state-ego_mean0.0609265987642156
sim_compute_robot_state-ego_median0.06306799019084257
sim_compute_robot_state-ego_min0.04802670262076638
sim_compute_sim_state_max0.04001455049257021
sim_compute_sim_state_mean0.03242717460783312
sim_compute_sim_state_median0.03158831596374512
sim_compute_sim_state_min0.027623111551458187
sim_physics_max0.12693515339413206
sim_physics_mean0.09220706020639004
sim_physics_median0.08705323083060128
sim_physics_min0.07809444155011858
sim_render-ego_max0.06605729541263065
sim_render-ego_mean0.05105917594912936
sim_render-ego_median0.047928035259246826
sim_render-ego_min0.042021328752691094
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5600000000000007
survival_time_min1.1000000000000003
No reset possible
24234step1-simulationhost-erroryes0:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 523, in get_cr
    try_s3(aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1258, in try_s3
    s3_object.upload_fileobj(data)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 621, in object_upload_fileobj
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 539, in upload_fileobj
    return future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 692, in _main
    client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidAccessKeyId) when calling the PutObject operation: The AWS Access Key Id you provided does not exist in our records.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24232step1-simulationhost-erroryes0:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 523, in get_cr
    try_s3(aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1258, in try_s3
    s3_object.upload_fileobj(data)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 621, in object_upload_fileobj
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 539, in upload_fileobj
    return future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 692, in _main
    client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidAccessKeyId) when calling the PutObject operation: The AWS Access Key Id you provided does not exist in our records.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible