Duckietown Challenges Home Challenges Submissions

Submission 1122

Submission1122
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12594 step2-scoring: 12604 step3-videos: 12606 step4-viz: 12612
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

12612

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12606

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12612step4-vizsuccessyes0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.2356567166145154
deviation-center-line_median0.6676868989858831
in-drivable-lane_median4.333333333333321


other stats
deviation-center-line_max1.3124369036854944
deviation-center-line_mean0.648448453050447
deviation-center-line_min0.12974725479736493
deviation-heading_max1.466710172508223
deviation-heading_mean0.8638070534997864
deviation-heading_median0.7444965017880685
deviation-heading_min0.3697702195450471
driven_any_max18.016450332664796
driven_any_mean8.98271007125645
driven_any_median9.761526337380069
driven_any_min2.359824441287895
driven_lanedir_max8.043362454686946
driven_lanedir_mean3.949804099558895
driven_lanedir_min1.4646097203783457
in-drivable-lane_max9.200000000000005
in-drivable-lane_mean4.859999999999993
in-drivable-lane_min0.9333333333333336
per-episodes
details{"ep000": {"driven_any": 12.313400234463458, "driven_lanedir": 3.2356567166145154, "in-drivable-lane": 8.666666666666641, "deviation-heading": 0.7444965017880685, "deviation-center-line": 0.6676868989858831}, "ep001": {"driven_any": 9.761526337380069, "driven_lanedir": 5.4810312196972335, "in-drivable-lane": 4.333333333333321, "deviation-heading": 1.466710172508223, "deviation-center-line": 0.9285811099533426}, "ep002": {"driven_any": 18.016450332664796, "driven_lanedir": 8.043362454686946, "in-drivable-lane": 9.200000000000005, "deviation-heading": 1.3346730840571763, "deviation-center-line": 1.3124369036854944}, "ep003": {"driven_any": 2.359824441287895, "driven_lanedir": 1.4646097203783457, "in-drivable-lane": 1.1666666666666672, "deviation-heading": 0.3697702195450471, "deviation-center-line": 0.20379009783015}, "ep004": {"driven_any": 2.4623490104860277, "driven_lanedir": 1.5243603864174395, "in-drivable-lane": 0.9333333333333336, "deviation-heading": 0.4033852896004173, "deviation-center-line": 0.12974725479736493}}
No reset possible
12606step3-videossuccessyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12604step2-scoringsuccessyes0:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.099999999999977


other stats
episodes
details{"ep000": {"nsteps": 359, "reward": -3.045871700268514, "good_angle": 3.3325928379839715, "survival_time": 11.966666666666637, "traveled_tiles": 18, "valid_direction": 3.2333333333333263}, "ep001": {"nsteps": 303, "reward": -3.85777187785564, "good_angle": 22.515687694250197, "survival_time": 10.099999999999977, "traveled_tiles": 15, "valid_direction": 4.366666666666653}, "ep002": {"nsteps": 500, "reward": -0.0362132091387175, "good_angle": 3.896440313883758, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.399999999999998}, "ep003": {"nsteps": 81, "reward": -12.740001771702534, "good_angle": 4.310995759023758, "survival_time": 2.7, "traveled_tiles": 3, "valid_direction": 1.666666666666668}, "ep004": {"nsteps": 75, "reward": -13.29762760609078, "good_angle": 0.7188389776587142, "survival_time": 2.500000000000001, "traveled_tiles": 4, "valid_direction": 1.2000000000000006}}
good_angle_max22.515687694250197
good_angle_mean6.954911116560079
good_angle_median3.896440313883758
good_angle_min0.7188389776587142
reward_max-0.0362132091387175
reward_mean-6.595497233011237
reward_median-3.85777187785564
reward_min-13.29762760609078
survival_time_max16.666666666666654
survival_time_mean8.786666666666653
survival_time_min2.500000000000001
traveled_tiles_max18
traveled_tiles_mean11.6
traveled_tiles_median15
traveled_tiles_min3
valid_direction_max4.366666666666653
valid_direction_mean2.773333333333329
valid_direction_median3.2333333333333263
valid_direction_min1.2000000000000006
No reset possible
12594step1-simulationsuccessyes0:07:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8920step4-vizsuccessyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8919step4-vizsuccessyes0:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8918step4-vizabortedyes0:00:12
Error while running [...]

Creating job8918-8918_visualization_1 ... error
stderr | ERROR: for job8918-8918_visualization_1  Cannot start service visualization: network job8918-8918_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8918-8918_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8915step3-videossuccessyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8914step3-videosabortedyes0:00:13
Error while running [...]

Creating job8914-5957_videos_1 ... error
stderr | ERROR: for job8914-5957_videos_1  Cannot start service videos: network job8914-5957_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8914-5957_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8913step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8851step2-scoringabortedyes1:05:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 610, in _make_api_call
    operation_model, request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 136, in _send_request
    success_response, exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 210, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/be6c892ed4210246dbd123f76738d5eea52fa288c9c12ab870908ceb65609c11"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8850step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible