Duckietown Challenges Home Challenges Submissions

Submission 1174

Submission1174
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13121 step2-scoring: 13136 step3-videos: 13139 step4-viz: 13145
Next
User labelMy ROS solution
Admin priority72
Blessingn/a
User priority72

13145

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13139

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13145step4-vizsuccessyes0:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median13.539824840407508
deviation-center-line_median1.3572068573940068
in-drivable-lane_median4.166666666666654


other stats
deviation-center-line_max1.385338703051051
deviation-center-line_mean1.1651177279430218
deviation-center-line_min0.8359975073318936
deviation-heading_max2.500184615254698
deviation-heading_mean2.076252901806854
deviation-heading_median2.2122466469210154
deviation-heading_min1.6466432779095497
driven_any_max18.714325791753684
driven_any_mean15.645488719419244
driven_any_median18.598213268380608
driven_any_min10.355452231684668
driven_lanedir_max13.7407871715742
driven_lanedir_mean11.58719142945788
driven_lanedir_min8.013097054791466
in-drivable-lane_max4.333333333333331
in-drivable-lane_mean3.359999999999995
in-drivable-lane_min1.7999999999999947
per-episodes
details{"ep000": {"driven_any": 18.598213268380608, "driven_lanedir": 13.577659692028693, "in-drivable-lane": 4.166666666666654, "deviation-heading": 2.500184615254698, "deviation-center-line": 1.385338703051051}, "ep001": {"driven_any": 10.355452231684668, "driven_lanedir": 8.013097054791466, "in-drivable-lane": 1.7999999999999947, "deviation-heading": 1.6889371751057276, "deviation-center-line": 0.8359975073318936}, "ep002": {"driven_any": 18.714325791753684, "driven_lanedir": 13.539824840407508, "in-drivable-lane": 4.333333333333331, "deviation-heading": 2.3332527938432777, "deviation-center-line": 1.3572068573940068}, "ep003": {"driven_any": 11.883235299338043, "driven_lanedir": 9.064588388487536, "in-drivable-lane": 2.2999999999999927, "deviation-heading": 1.6466432779095497, "deviation-center-line": 0.8873192070651797}, "ep004": {"driven_any": 18.676217005939197, "driven_lanedir": 13.7407871715742, "in-drivable-lane": 4.200000000000001, "deviation-heading": 2.2122466469210154, "deviation-center-line": 1.3597263648729785}}
No reset possible
13139step3-videossuccessyes0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13136step2-scoringsuccessyes0:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.4392145617126953, "good_angle": 1.2704559609852857, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.5999999999999983}, "ep001": {"nsteps": 279, "reward": -3.1488777234249894, "good_angle": 0.8133051406954388, "survival_time": 9.299999999999978, "traveled_tiles": 18, "valid_direction": 2.266666666666662}, "ep002": {"nsteps": 500, "reward": 0.44904475499177354, "good_angle": 1.0994172914588018, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.500000000000002}, "ep003": {"nsteps": 319, "reward": -2.6534967401640075, "good_angle": 0.8013780529139101, "survival_time": 10.633333333333306, "traveled_tiles": 18, "valid_direction": 2.333333333333327}, "ep004": {"nsteps": 500, "reward": 0.48193283676030113, "good_angle": 1.0069551966998869, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.1000000000000045}}
good_angle_max1.2704559609852857
good_angle_mean0.9983023285506648
good_angle_median1.0069551966998869
good_angle_min0.8013780529139101
reward_max0.48193283676030113
reward_mean-0.8864364620248454
reward_median0.4392145617126953
reward_min-3.1488777234249894
survival_time_max16.666666666666654
survival_time_mean13.986666666666649
survival_time_min9.299999999999978
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max3.5999999999999983
valid_direction_mean2.959999999999998
valid_direction_median3.1000000000000045
valid_direction_min2.266666666666662
No reset possible
13121step1-simulationsuccessyes0:09:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10766step4-vizsuccessyes0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10765step4-vizsuccessyes0:06:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10757step3-videossuccessyes0:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10756step3-videossuccessyes0:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10752step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10751step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9220step2-scoringabortedyes0:25:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 610, in _make_api_call
    operation_model, request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 136, in _send_request
    success_response, exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 210, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/be6c892ed4210246dbd123f76738d5eea52fa288c9c12ab870908ceb65609c11"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9219step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible