Duckietown Challenges Home Challenges Submissions

Submission 5941

Submission5941
Competingyes
Challengeaido3-LF-real-validation
UserAleksei Shpilman 🇷🇺
Date submitted
Last status update
Completenot complete
DetailsSister in aido3-LF-sim-testing: not-ready: Sister 5940 not ready.
Sisters5940
Result
Jobs
Next
User labelchallenge-aido_LF-baseline-IL-0226
Admin priority70
Blessingn/a
User priority70

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
30514eval2-visualizesuccessno0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30513eval2-visualizesuccessno0:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30512eval2-videossuccessno0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30507eval2-videoshost-errorno0:02:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 582, in _main
    fileobj.seek(offset)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 335, in seek
    self._open_if_needed()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 318, in _open_if_needed
    self._fileobj = self._open_function(self._filename, self._mode)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 244, in open
    return open(filename, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-real-validation/submission5941/eval2-videos-ip-172-31-45-34-10500-job30507/previous-steps/eval2-videos/logs/challenges-runner/stderr.log.FACfBBaa'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30506eval2-visualizeabortedno0:02:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(logdir, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 41, in evaluate_robotarium_log
    d = yaml.load(open(mapfile).read())
FileNotFoundError: [Errno 2] No such file or directory: '/challenges/previous-steps/eval2/trajectories/map.yaml'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(cie)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30505eval2successyes0:07:40
Scores from the eval [...]
Scores from the evaluation of job: 30505
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30484eval2-visualizesuccessno0:10:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30483eval2-videossuccessno0:11:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30481eval2abortedyes0:19:28
Scores from the eval [...]
Scores from the evaluation of job: 30481
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30446eval1-videossuccessno0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30445eval1-videossuccessno0:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30444eval1-visualizesuccessno0:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30426eval1successyes0:11:04
Scores from the eval [...]
Scores from the evaluation of job: 30426
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30419eval0-videossuccessno0:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30418eval0-visualizesuccessno0:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30417eval0-visualizesuccessno0:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30416eval0-videosabortedno0:04:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30408eval0successyes0:16:51
Scores from the eval [...]
Scores from the evaluation of job: 30408
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30014eval0abortedyes0:09:28
Scores from the eval [...]
Scores from the evaluation of job: 30014
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible