Duckietown Challenges Home Challenges Submissions

Submission 4238

Submission4238
Competingyes
Challengeaido3-LF-real-validation
UserManfred Diaz
Date submitted
Last status update
Completenot complete
Details
Violations...
Ready to do eval0-visualize, eval0-videos, eval1-videos, eval2-videos, eval1-visualize, eval2-visualize.
Sisters
Result
Jobseval0: 28569 eval1: 28574 eval2: 28605
Next eval0-visualize eval0-videos eval1-videos eval2-videos eval1-visualize eval2-visualize
User labelBaseline-IL-logs-tensorflow
Admin priority100
Blessingn/a
User priority100

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
28611eval2-visualizesuccessno0:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28610eval2-visualizehost-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 612, in _main
    osutil.rename_file(fileobj.name, final_filename)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 256, in rename_file
    rename_file(current_filename, new_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-real-validation/submission4238/eval2-visualize-ip-172-31-35-218-10491-job28610/previous-steps/eval0/logs_raw/autobot02.bag.6CbDF67d' -> '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-real-validation/submission4238/eval2-visualize-ip-172-31-35-218-10491-job28610/previous-steps/eval0/logs_raw/autobot02.bag'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28609eval2-visualizeerrorno0:00:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28608eval2-visualizehost-errorno0:00:57
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/7d7d61f857c77fda11505883493945d46ec282a3f9b2017f3b1fd294e03c49b7/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28607eval2-videossuccessno0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28605eval2successyes0:06:18
Scores from the eval [...]
Scores from the evaluation of job: 28605
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median0.15651381322432076
survival_time_median36.79
No reset possible
28604eval1-videossuccessno0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28603eval1-visualizesuccessno0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28602eval1-videossuccessno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28601eval1-visualizesuccessno0:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28574eval1successyes0:19:01
Scores from the eval [...]
Scores from the evaluation of job: 28574
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median0.06805521118484373
survival_time_median17.948
No reset possible
28573eval0-videossuccessno0:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28572eval0-visualizesuccessno0:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28569eval0successyes0:11:40
Scores from the eval [...]
Scores from the evaluation of job: 28569
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median0.08385358048204615
survival_time_median14.674
No reset possible
28567eval0timeoutyes0:00:45
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26048eval2-visualizesuccessno0:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26046eval1-visualizesuccessno0:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26031eval2-visualizesuccessno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26028eval1-visualizesuccessno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26019eval0-visualizesuccessno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25796eval2successyes0:06:22
Scores from the eval [...]
Scores from the evaluation of job: 25796
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25795eval2abortedyes0:00:02
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25792eval2timeoutyes0:00:02
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25790eval1abortedyes0:08:45
Scores from the eval [...]
Scores from the evaluation of job: 25790
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25177153timeoutyes0:00:48
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25175eval0abortedyes0:05:21
Scores from the eval [...]
Scores from the evaluation of job: 25175
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25114eval0abortedyes0:07:55
Scores from the eval [...]
Scores from the evaluation of job: 25114
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25079eval0abortedyes0:01:27
Scores from the eval [...]
Scores from the evaluation of job: 25079
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25078eval0timeoutyes0:29:46
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25066eval0abortedyes0:03:43
Scores from the eval [...]
Scores from the evaluation of job: 25066
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25065eval0timeoutyes0:01:05
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25064eval0abortedyes0:05:55
Scores from the eval [...]
Scores from the evaluation of job: 25064
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25063eval0abortedyes0:12:18
Scores from the eval [...]
Scores from the evaluation of job: 25063
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25062eval0abortedyes----No reset possible
25061eval0abortedyes0:02:30
Scores from the eval [...]
Scores from the evaluation of job: 25061
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25060eval0abortedyes----No reset possible
25055eval0abortedyes0:05:28
Scores from the eval [...]
Scores from the evaluation of job: 25055
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25054eval0timeoutyes3:27:23
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25053eval0abortedyes0:05:15
Scores from the eval [...]
Scores from the evaluation of job: 25053
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25052eval0abortedyes----No reset possible
24470eval0abortedyes0:00:18
Scores from the eval [...]
Scores from the evaluation of job: 24470
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24469eval0timeoutyes0:00:22
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible