Duckietown Challenges Home Challenges Submissions

Submission 6609

Submission6609
Competingyes
Challengeaido3-off-LF-real-validation-p1
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completenot complete
DetailsReady to do eval2.
Sisters
Result
Jobseval0: 32885 eval0-videos: 32890 eval0-visualize: 32891 eval1: 32907 eval1-videos: 32913 eval1-visualize: 32910 eval2: 32842 eval2-videos: 32863 eval2-visualize: 32861
Next eval2
User labelTTIC
Admin priority60
Blessingn/a
User priority60

32913

autobot03

watchtower01

watchtower02

watchtower03

watchtower04

watchtower05

watchtower06

watchtower07

watchtower08

watchtower09

watchtower10

32910

Click the images to see detailed statistics about the episode.

index.html

32891

Click the images to see detailed statistics about the episode.

index.html

32890

autobot03

watchtower01

watchtower02

watchtower03

watchtower04

watchtower05

watchtower06

watchtower07

watchtower08

watchtower09

watchtower10

32863

autobot03

watchtower01

watchtower02

watchtower03

watchtower04

watchtower05

watchtower06

watchtower07

watchtower08

watchtower09

watchtower10

32861

Click the images to see detailed statistics about the episode.

index.html

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
32916eval2abortedyes0:01:18
Scores from the eval [...]
Scores from the evaluation of job: 32916
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32913eval1-videossuccessyes0:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32912eval1-videossuccessyes0:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32911eval1-videoshost-erroryes0:00:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 25, in get_file_from_cache
    shutil.copy(have, fn)
  File "/usr/lib/python3.6/shutil.py", line 246, in copy
    copymode(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 143, in copymode
    st = stat_func(src)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/cache/by-value/sha256hex/58720fae954e4f4b2f06bd756df439a9ea3e10e19325e8bba94a2ca67f7d718f'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32910eval1-visualizesuccessyes0:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec6.674466993952798
survival_time46.6666
deviation-center-line2.3526681615487
in-drivable-lane0


other stats
deviation-heading4.127884562691678
driven_any6.732763322781932
driven_lanedir6.674466993952798
visualized-eval1-passed1
No reset possible
32909eval1-videoshost-erroryes0:01:50
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 582, in _main
    fileobj.seek(offset)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 335, in seek
    self._open_if_needed()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 318, in _open_if_needed
    self._fileobj = self._open_function(self._filename, self._mode)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 244, in open
    return open(filename, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-off-LF-real-validation-p1/submission6609/eval1-videos-ip-172-31-45-34-10500-job32909/previous-steps/eval2-videos/logs/challenges-runner/stderr.html.967a7d8C'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32908eval1-visualizesuccessyes0:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32907eval1successyes0:09:29
Scores from the eval [...]
Scores from the evaluation of job: 32907
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median6.803205426859104
survival_time_median45.546
No reset possible
32898eval1timeoutyes0:01:44
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32893eval1abortedyes0:00:04
Scores from the eval [...]
Scores from the evaluation of job: 32893
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32891eval0-visualizesuccessyes0:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec6.733166626477537
survival_time44
deviation-center-line1.9899790161732316
in-drivable-lane0


other stats
deviation-heading3.6733842858881065
driven_any6.809614180996763
driven_lanedir6.733166626477537
visualized-eval0-passed1
No reset possible
32890eval0-videossuccessyes0:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32885eval0successyes0:06:43
Scores from the eval [...]
Scores from the evaluation of job: 32885
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median6.851471715025653
survival_time_median44.354
No reset possible
32863eval2-videossuccessyes0:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32862eval2-videossuccessyes0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32861eval2-visualizesuccessyes0:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec5.924162416622933
survival_time42.6666
deviation-center-line1.7537353176304993
in-drivable-lane0


other stats
deviation-heading3.5742778910014317
driven_any5.971164668454431
driven_lanedir5.924162416622933
visualized-eval2-passed1
No reset possible
32842eval2successyes0:59:16
Scores from the eval [...]
Scores from the evaluation of job: 32842
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median6.013889185451857
survival_time_median82.469
No reset possible
32841eval1-videossuccessyes0:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32840eval1-visualizesuccessyes0:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32837eval0-videossuccessyes0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32836eval0-visualizesuccessyes0:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32835eval1successyes0:05:37
Scores from the eval [...]
Scores from the evaluation of job: 32835
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32834eval0abortedyes0:08:19
Scores from the eval [...]
Scores from the evaluation of job: 32834
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible