Submission 1175

Submission

1175

Competing

yes

Challenge

aido1_LF1_r3-v3

User

Iban Harlouchet 🇨🇦

Date submitted

2018-11-15 01:06:51+00:00

Last status update

2021-12-04 20:56:56+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

step1-simulation: 13125 step2-scoring: 13130 step3-videos: 13132 step4-viz: 13141

User label

ROS-based Lane Following

Admin priority

Blessing

n/a

User priority

13141

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13132

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

13141

step4-viz

success

yes

2018-11-23 04:05:28+00:00

2018-11-23 04:08:07+00:00

0:02:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_median	0.46658475655616893
deviation-center-line_median	0.14340762045893649
in-drivable-lane_median	0

other stats

deviation-center-line_max	2.489110452554206
deviation-center-line_mean	0.948512295756529
deviation-center-line_min	0.04747652894053995
deviation-heading_max	1.828084559279352
deviation-heading_mean	0.7389538277144223
deviation-heading_median	0.2338596335315086
deviation-heading_min	0.17406266738794468
driven_any_max	5.335191952753496
driven_any_mean	2.3332558788789477
driven_any_median	0.47137521558131634
driven_any_min	0.13915394299814016
driven_lanedir_max	4.283320864634996
driven_lanedir_mean	1.7914773592448128
driven_lanedir_min	0.1245897234138773
in-drivable-lane_max	4.733333333333322
in-drivable-lane_mean	1.566666666666663
in-drivable-lane_min	0
per-episodes	details {"ep000": {"driven_any": 5.334960452335007, "driven_lanedir": 3.709964055293363, "in-drivable-lane": 4.733333333333322, "deviation-heading": 1.828084559279352, "deviation-center-line": 1.959682701116774}, "ep001": {"driven_any": 0.47137521558131634, "driven_lanedir": 0.46658475655616893, "in-drivable-lane": 0, "deviation-heading": 0.18217012466398955, "deviation-center-line": 0.14340762045893649}, "ep002": {"driven_any": 5.335191952753496, "driven_lanedir": 4.283320864634996, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 1.2765921537093172, "deviation-center-line": 2.489110452554206}, "ep003": {"driven_any": 0.3855978307267782, "driven_lanedir": 0.3729273963256592, "in-drivable-lane": 0, "deviation-heading": 0.2338596335315086, "deviation-center-line": 0.10288417571218952}, "ep004": {"driven_any": 0.13915394299814016, "driven_lanedir": 0.1245897234138773, "in-drivable-lane": 0, "deviation-heading": 0.17406266738794468, "deviation-center-line": 0.04747652894053995}}

No reset possible

13132

step3-videos

success

yes

2018-11-23 04:03:25+00:00

2018-11-23 04:04:53+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

videos

No reset possible

13130

step2-scoring

success

yes

2018-11-23 04:02:32+00:00

2018-11-23 04:02:55+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median

1.5333333333333348

other stats

episodes	details {"ep000": {"nsteps": 500, "reward": 0.19748858899902552, "good_angle": 1.0196650567787728, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.4000000000000057}, "ep001": {"nsteps": 46, "reward": -21.44666988985694, "good_angle": 0.031466713684025635, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 500, "reward": 0.23980551055408433, "good_angle": 0.7172013023369482, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.9333333333333316}, "ep003": {"nsteps": 38, "reward": -25.987511865402524, "good_angle": 0.15552267207845982, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 0.16666666666666718}, "ep004": {"nsteps": 15, "reward": -66.53614515289664, "good_angle": 0.14217682420107247, "survival_time": 0.49999999999999994, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}}
good_angle_max	1.0196650567787728
good_angle_mean	0.4132065138158558
good_angle_median	0.15552267207845982
good_angle_min	0.031466713684025635
reward_max	0.23980551055408433
reward_mean	-22.7066065617206
reward_median	-21.44666988985694
reward_min	-66.53614515289664
survival_time_max	16.666666666666654
survival_time_mean	7.326666666666663
survival_time_min	0.49999999999999994
traveled_tiles_max	10
traveled_tiles_mean	4.8
traveled_tiles_median	2
traveled_tiles_min	1
valid_direction_max	2.4000000000000057
valid_direction_mean	0.9733333333333342
valid_direction_median	0.29999999999999993
valid_direction_min	0.06666666666666665

No reset possible

13125

step1-simulation

success

yes

2018-11-23 03:55:33+00:00

2018-11-23 04:02:15+00:00

0:06:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed

No reset possible

9236

step4-viz

success

yes

2018-11-15 01:15:26+00:00

2018-11-15 01:16:57+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9235

step4-viz

success

yes

2018-11-15 01:15:20+00:00

2018-11-15 01:16:50+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9234

step4-viz

success

yes

2018-11-15 01:15:14+00:00

2018-11-15 01:16:45+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9233

step4-viz

success

yes

2018-11-15 01:15:03+00:00

2018-11-15 01:16:34+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9230

step3-videos

success

yes

2018-11-15 01:13:55+00:00

2018-11-15 01:14:45+00:00

0:00:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9229

step3-videos

success

yes

2018-11-15 01:13:45+00:00

2018-11-15 01:14:35+00:00

0:00:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9228

step3-videos

success

yes

2018-11-15 01:13:33+00:00

2018-11-15 01:14:23+00:00

0:00:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9227

step3-videos

success

yes

2018-11-15 01:13:21+00:00

2018-11-15 01:14:10+00:00

0:00:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9226

step3-videos

success

yes

2018-11-15 01:13:09+00:00

2018-11-15 01:14:01+00:00

0:00:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9225

step2-scoring

success

yes

2018-11-15 01:12:17+00:00

2018-11-15 01:12:37+00:00

0:00:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9224

step2-scoring

success

yes

2018-11-15 01:12:05+00:00

2018-11-15 01:12:26+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9223

step2-scoring

success

yes

2018-11-15 01:11:53+00:00

2018-11-15 01:12:14+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9222

step2-scoring

success

yes

2018-11-15 01:11:40+00:00

2018-11-15 01:12:01+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9221

step2-scoring

success

yes

2018-11-15 01:11:26+00:00

2018-11-15 01:11:49+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9218

step1-simulation

success

2018-11-15 01:07:53+00:00

2018-11-15 01:10:56+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9217

step1-simulation

success

2018-11-15 01:07:47+00:00

2018-11-15 01:11:32+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9216

step1-simulation

success

2018-11-15 01:07:38+00:00

2018-11-15 01:10:12+00:00

0:02:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9215

step1-simulation

success

2018-11-15 01:07:30+00:00

2018-11-15 01:10:26+00:00

0:02:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9214

step1-simulation

success

2018-11-15 01:07:22+00:00

2018-11-15 01:10:35+00:00

0:03:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9213

step1-simulation

aborted

2018-11-15 01:07:14+00:00

2018-11-15 01:38:02+00:00

0:30:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in upload
    aws_object.load()
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 320, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/client.py", line 610, in _make_api_call
    operation_model, request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 136, in _send_request
    success_response, exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/endpoint.py", line 210, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/frankfurt/by-value/sha256/d324607b930393f3447b0956126aa69d8b01523d5aa68d65d129ccc48036f3e5"

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible