AI Driving Olympics Home Challenges Submissions Jobs

Submission 5783

Submission5783
Competingyes
Challengeaido3-LF-real-validation
UserBME-Conti
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobseval0: 29557 eval0-videos: 29566 eval0-visualize: 29570 eval1: 29605 eval1-videos: 29615 eval1-visualize: 29616 eval2: 29878 eval2-videos: 29888 eval2-visualize: 29889
Next
User labelkaland-225210
Admin priority100
Blessing100
User priority

29889

Click the images to see detailed statistics about the episode.

29888

29616

Click the images to see detailed statistics about the episode.

29615

29570

Click the images to see detailed statistics about the episode.

29566

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
298895783BME-Contikaland-225210aido3-LF-real-validationeval2-visualizesuccessyes-0:19:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec9.790692052838706
survival_time40.6666
deviation-center-line2.4232077820657354
in-drivable-lane4.6667999999999985


other stats
deviation-heading10.933481540432318
driven_any11.78311742595495
driven_lanedir9.790692052838706
visualized-eval2-passed1
298885783BME-Contikaland-225210aido3-LF-real-validationeval2-videossuccessyes-0:20:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
298875783BME-Contikaland-225210aido3-LF-real-validationeval2-visualizesuccessyes-0:03:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec9.790692052838706
survival_time40.6666
deviation-center-line2.4232077820657354
in-drivable-lane4.6667999999999985


other stats
deviation-heading10.933481540432318
driven_any11.78311742595495
driven_lanedir9.790692052838706
visualized-eval2-passed1
298865783BME-Contikaland-225210aido3-LF-real-validationeval2-videossuccessyes-0:06:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
298855783BME-Contikaland-225210aido3-LF-real-validationeval2-visualizesuccessyes-0:04:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec9.790692052838706
survival_time40.6666
deviation-center-line2.4232077820657354
in-drivable-lane4.6667999999999985


other stats
deviation-heading10.933481540432318
driven_any11.78311742595495
driven_lanedir9.790692052838706
visualized-eval2-passed1
298845783BME-Contikaland-225210aido3-LF-real-validationeval2-videoshost-erroryes-0:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 582, in _main
    fileobj.seek(offset)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 335, in seek
    self._open_if_needed()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 318, in _open_if_needed
    self._fileobj = self._open_function(self._filename, self._mode)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 244, in open
    return open(filename, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-real-validation/submission5783/eval2-videos-ip-172-31-45-34-10501-job29884/previous-steps/eval0/logs_processed/processed.bag.3a545cf6'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
298785783BME-Contikaland-225210aido3-LF-real-validationeval2successyes-0:15:35
Scores from the eval [...]
Scores from the evaluation of job: 29878
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median12.53274527496793
survival_time_median40.956
296165783BME-Contikaland-225210aido3-LF-real-validationeval1-visualizesuccessyes-0:06:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.3670396922598673
survival_time25.3333
deviation-center-line1.2919918393230252
in-drivable-lane14.6666


other stats
deviation-heading4.869949217695082
driven_any6.966802909012357
driven_lanedir2.3670396922598673
visualized-eval1-passed1
296155783BME-Contikaland-225210aido3-LF-real-validationeval1-videossuccessyes-0:07:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
296145783BME-Contikaland-225210aido3-LF-real-validationeval1-videossuccessyes-0:08:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
296135783BME-Contikaland-225210aido3-LF-real-validationeval1-visualizesuccessyes-0:07:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.3670396922598673
survival_time25.3333
deviation-center-line1.2919918393230252
in-drivable-lane14.6666


other stats
deviation-heading4.869949217695082
driven_any6.966802909012357
driven_lanedir2.3670396922598673
visualized-eval1-passed1
296055783BME-Contikaland-225210aido3-LF-real-validationeval1successyes-0:11:28
Scores from the eval [...]
Scores from the evaluation of job: 29605
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median7.686723093539186
survival_time_median25.195
295805783BME-Contikaland-225210aido3-LF-real-validationeval1abortedyes-0:05:58
Scores from the eval [...]
Scores from the evaluation of job: 29580
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
Reason"Submission aborted by the operator"
295705783BME-Contikaland-225210aido3-LF-real-validationeval0-visualizesuccessyes-0:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.40299991607665975
survival_time4.6667
deviation-center-line0.1579566023932099
in-drivable-lane2.6665999999999994


other stats
deviation-heading0.8937374573692229
driven_any1.4024942935697156
driven_lanedir0.40299991607665975
visualized-eval0-passed1
295695783BME-Contikaland-225210aido3-LF-real-validationeval0-visualizesuccessyes-0:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.40299991607665975
survival_time4.6667
deviation-center-line0.1579566023932099
in-drivable-lane2.6665999999999994


other stats
deviation-heading0.8937374573692229
driven_any1.4024942935697156
driven_lanedir0.40299991607665975
visualized-eval0-passed1
295675783BME-Contikaland-225210aido3-LF-real-validationeval0-visualizehost-erroryes-0:00:53
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 924, in run_one
    exit_code = exit_code_for_container(container_id)
  File "/project/src/duckietown_challenges_runner/runner.py", line 844, in exit_code_for_container
    out = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'inspect', 'cd5be29ca627f2df94050a07a98e06b031d717b37d31d6b2da835825dc2a9a79', '--format={{.State.ExitCode}}']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
295665783BME-Contikaland-225210aido3-LF-real-validationeval0-videossuccessyes-0:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
295655783BME-Contikaland-225210aido3-LF-real-validationeval0-visualizesuccessyes-0:02:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.40299991607665975
survival_time4.6667
deviation-center-line0.1579566023932099
in-drivable-lane2.6665999999999994


other stats
deviation-heading0.8937374573692229
driven_any1.4024942935697156
driven_lanedir0.40299991607665975
visualized-eval0-passed1
295645783BME-Contikaland-225210aido3-LF-real-validationeval0-videossuccessyes-0:03:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
295575783BME-Contikaland-225210aido3-LF-real-validationeval0successyes-0:06:31
Scores from the eval [...]
Scores from the evaluation of job: 29557
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median1.5977511430171962
survival_time_median4.663