Duckietown Challenges Home Challenges Submissions

Submission 1116

Submission1116
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12532 step2-scoring: 12544 step3-videos: 12548 step4-viz: 12555
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

12555

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12548

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12555step4-vizsuccessyes0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.828595680999447
deviation-center-line_median0.6764705733380706
in-drivable-lane_median4.5666666666666575


other stats
deviation-center-line_max1.602071038338727
deviation-center-line_mean0.7950356703897936
deviation-center-line_min0.04726619698241035
deviation-heading_max1.8235085267326503
deviation-heading_mean0.7179709476917961
deviation-heading_median0.4221104238109265
deviation-heading_min0.043767648089746966
driven_any_max18.58666472931012
driven_any_mean9.381488027592948
driven_any_median8.854102341866817
driven_any_min0.760000000000006
driven_lanedir_max9.882942241937432
driven_lanedir_mean4.843606091493271
driven_lanedir_min0.19218680376823505
in-drivable-lane_max7.799999999999995
in-drivable-lane_mean4.133333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 8.854102341866817, "driven_lanedir": 3.828595680999447, "in-drivable-lane": 4.5666666666666575, "deviation-heading": 0.4221104238109265, "deviation-center-line": 0.6764705733380706}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 18.58666472931012, "driven_lanedir": 9.882942241937432, "in-drivable-lane": 7.799999999999995, "deviation-heading": 1.1813191440166528, "deviation-center-line": 1.5908011402278106}, "ep003": {"driven_any": 1.177068445478427, "driven_lanedir": 0.19218680376823505, "in-drivable-lane": 0.933333333333334, "deviation-heading": 0.11914899580900468, "deviation-center-line": 0.04726619698241035}, "ep004": {"driven_any": 17.529604621309364, "driven_lanedir": 9.555943296466705, "in-drivable-lane": 7.366666666666673, "deviation-heading": 1.8235085267326503, "deviation-center-line": 1.602071038338727}}
No reset possible
12548step3-videossuccessyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12544step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.033333333333315


other stats
episodes
details{"ep000": {"nsteps": 241, "reward": -4.1999566237262504, "good_angle": 0.6205005013678521, "survival_time": 8.033333333333315, "traveled_tiles": 16, "valid_direction": 1.5666666666666629}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030329643810110985, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": 0.1317016957735177, "good_angle": 0.8860907338752273, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.066666666666676}, "ep003": {"nsteps": 38, "reward": -27.205095267952665, "good_angle": 0.4119190901087186, "survival_time": 1.2666666666666673, "traveled_tiles": 3, "valid_direction": 0.9000000000000006}, "ep004": {"nsteps": 500, "reward": -0.12587359219774952, "good_angle": 13.878548438248004, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.06666666666667}}
good_angle_max13.878548438248004
good_angle_mean3.160018345596163
good_angle_median0.6205005013678521
good_angle_min0.0030329643810110985
reward_max0.1317016957735177
reward_mean-15.735748828440755
reward_median-4.1999566237262504
reward_min-47.27952035410063
survival_time_max16.666666666666654
survival_time_mean8.666666666666657
survival_time_min0.7
traveled_tiles_max18
traveled_tiles_mean11.6
traveled_tiles_median16
traveled_tiles_min3
valid_direction_max4.06666666666667
valid_direction_mean1.7200000000000015
valid_direction_median1.5666666666666629
valid_direction_min0
No reset possible
12532step1-simulationsuccessyes0:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8812step4-vizsuccessyes0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8811step4-vizabortedyes0:00:13
Error while running [...]

Creating job8811-9738_visualization_1 ... error
stderr | ERROR: for job8811-9738_visualization_1  Cannot start service visualization: network job8811-9738_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8811-9738_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8810step3-videossuccessyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8809step2-scoringsuccessyes0:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8808step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8807step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8806step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8805step2-scoringabortedyes0:15:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 610, in _make_api_call
    operation_model, request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 136, in _send_request
    success_response, exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 210, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/be6c892ed4210246dbd123f76738d5eea52fa288c9c12ab870908ceb65609c11"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8804step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8803step2-scoringabortedyes0:00:13
Error while running [...]

Creating job8803-1261_scorer_1 ... error
stderr | ERROR: for job8803-1261_scorer_1  Cannot start service scorer: network job8803-1261_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8803-1261_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible