Duckietown Challenges Home Challenges Submissions

Submission 6571

Submission6571
Competingyes
Challengeaido3-off-LF-real-validation
UserGianmarco Bernasconi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobseval0: 32356 eval0-videos: 32485 eval0-visualize: 32503 eval1: 32392 eval1-videos: 32453 eval1-visualize: 32508 eval2: 32394 eval2-videos: 32451 eval2-visualize: 32502
Next
User labelTest diffDB 04-0
Admin priority100
Blessingn/a
User priority100

32508

Click the images to see detailed statistics about the episode.

index.html

32503

Click the images to see detailed statistics about the episode.

index.html

32502

Click the images to see detailed statistics about the episode.

index.html

32485

autobot04

watchtower05

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

32453

autobot04

watchtower05

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

32451

autobot04

watchtower05

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
32508eval1-visualizesuccessyes0:16:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec8.69718488413821
survival_time46
deviation-center-line1.1168371361027385
in-drivable-lane0


other stats
deviation-heading2.1908093367845303
driven_any8.787561318862524
driven_lanedir8.69718488413821
visualized-eval1-passed1
No reset possible
32505eval1-visualizesuccessyes0:15:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32503eval0-visualizesuccessyes0:16:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec8.524070551503616
survival_time46
deviation-center-line1.4174123364200184
in-drivable-lane1.3332999999999977


other stats
deviation-heading3.6950956342638146
driven_any8.949785763816692
driven_lanedir8.524070551503616
visualized-eval0-passed1
No reset possible
32502eval2-visualizesuccessyes0:17:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec8.780787757890511
survival_time46.5333
deviation-center-line1.5053630230452526
in-drivable-lane0


other stats
deviation-heading3.672894954428615
driven_any8.928210790753273
driven_lanedir8.780787757890511
visualized-eval2-passed1
No reset possible
32501eval2-visualizesuccessyes0:17:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32493eval2-visualizehost-erroryes0:06:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 583, in _main
    fileobj.write(data)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 332, in write
    self._fileobj.write(data)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32492eval1-visualizehost-erroryes0:06:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1420, in download_artefacts
    copy_to_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 42, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32491eval0-visualizehost-erroryes0:06:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 25, in get_file_from_cache
    shutil.copy(have, fn)
  File "/usr/lib/python3.6/shutil.py", line 245, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.6/shutil.py", line 122, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python3.6/shutil.py", line 82, in copyfileobj
    fdst.write(buf)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32485eval0-videossuccessyes0:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32480eval0-videossuccessyes0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32479eval0-videossuccessyes0:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32474eval0-visualizesuccessyes0:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32473eval2-visualizesuccessyes0:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32472eval1-visualizesuccessyes0:09:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32471eval0-visualizesuccessyes0:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32456eval0-visualizesuccessyes0:48:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32455eval2-visualizehost-erroryes0:47:21
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job32455-837140', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job32455-837140', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job32455-837140_evaluation" with the default driver
stderr | Creating volume "job32455-837140_fifos" with default driver
stderr | Creating job32455-837140_evaluator_1 ...
stderr | 
stderr | ERROR: for job32455-837140_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for evaluator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32454eval0-videoshost-erroryes0:47:09
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job32454-73376', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job32454-73376', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job32454-73376_evaluation" with the default driver
stderr | Creating volume "job32454-73376_fifos" with default driver
stderr | Creating job32454-73376_evaluator_1 ...
stderr | 
stderr | ERROR: for job32454-73376_evaluator_1  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | 
stderr | ERROR: for evaluator  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
stderr | An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
stderr | If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32453eval1-videossuccessyes0:54:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32452eval1-visualizehost-erroryes0:06:41
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 583, in _main
    fileobj.write(data)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 332, in write
    self._fileobj.write(data)
OSError: [Errno 28] No space left on device
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32451eval2-videossuccessyes0:53:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32394eval2successyes0:25:11
Scores from the eval [...]
Scores from the evaluation of job: 32394
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median9.152140028436746
survival_time_median170.851
No reset possible
32392eval1successyes0:24:03
Scores from the eval [...]
Scores from the evaluation of job: 32392
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median8.886159684828122
survival_time_median47.179
No reset possible
32391eval1abortedyes0:00:04
Scores from the eval [...]
Scores from the evaluation of job: 32391
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32385eval1timeoutyes0:00:35
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32372eval1abortedyes0:05:19
Scores from the eval [...]
Scores from the evaluation of job: 32372
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32364eval1abortedyes0:00:04
Scores from the eval [...]
Scores from the evaluation of job: 32364
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32363eval1abortedyes0:02:08
Scores from the eval [...]
Scores from the evaluation of job: 32363
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32362eval1abortedyes0:00:47
Scores from the eval [...]
Scores from the evaluation of job: 32362
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32356eval0successyes0:12:58
Scores from the eval [...]
Scores from the evaluation of job: 32356
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median9.036187285792955
survival_time_median46.761
No reset possible
32355eval0abortedyes0:07:35
Scores from the eval [...]
Scores from the evaluation of job: 32355
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
32351eval0abortedyes0:13:53
Scores from the eval [...]
Scores from the evaluation of job: 32351
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible