AI Driving Olympics Home Challenges Submissions Jobs

Submission 5941

Submission5941
Competingyes
Challengeaido3-LF-real-validation
UserJBRRussia1
Date submitted
Complete⏲️
DetailsSister in aido3-LF-sim-testing: not-ready: Sister 5940 not ready.
Sisters5940
Result
Jobs
Next
User labelchallenge-aido_LF-baseline-IL-0226
Admin priority70
Blessing70
User priority

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
305145941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-visualizesuccessyes-0:03:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.5377141729936774
survival_time12.6667
deviation-center-line0.4422827113955372
in-drivable-lane7.3333


other stats
deviation-heading1.0903869835929014
driven_any3.0994588814589115
driven_lanedir1.5377141729936774
visualized-eval2-passed1
305135941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-visualizesuccessyes-0:04:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.5377141729936774
survival_time12.6667
deviation-center-line0.4422827113955372
in-drivable-lane7.3333


other stats
deviation-heading1.0903869835929014
driven_any3.0994588814589115
driven_lanedir1.5377141729936774
visualized-eval2-passed1
305125941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-videossuccessyes-0:05:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
305075941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-videoshost-erroryes-0:02:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 582, in _main
    fileobj.seek(offset)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 335, in seek
    self._open_if_needed()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 318, in _open_if_needed
    self._fileobj = self._open_function(self._filename, self._mode)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 244, in open
    return open(filename, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-real-validation/submission5941/eval2-videos-ip-172-31-45-34-10500-job30507/previous-steps/eval2-videos/logs/challenges-runner/stderr.log.FACfBBaa'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
305065941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-visualizeabortedyes-0:02:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(logdir, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 41, in evaluate_robotarium_log
    d = yaml.load(open(mapfile).read())
FileNotFoundError: [Errno 2] No such file or directory: '/challenges/previous-steps/eval2/trajectories/map.yaml'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(cie)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator
Hidden. If you are the author, please login using the top-right link or use the dashboard.
305055941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2successyes-0:07:40
Scores from the eval [...]
Scores from the evaluation of job: 30505
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median3.330252649925456
survival_time_median4.155
304845941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-visualizesuccessyes-0:10:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec11.4474832565209
survival_time47.3333
deviation-center-line2.6347348190759576
in-drivable-lane0.6666999999999987


other stats
deviation-heading8.75823955014417
driven_any11.88574156925971
driven_lanedir11.4474832565209
visualized-eval2-passed1
304835941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2-videossuccessyes-0:11:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
304815941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval2abortedyes-0:19:28
Scores from the eval [...]
Scores from the evaluation of job: 30481
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median12.00453490251115
survival_time_median47.805
304465941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval1-videossuccessyes-0:04:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
304455941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval1-videossuccessyes-0:06:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
304445941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval1-visualizesuccessyes-0:06:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec5.8456158735265005
survival_time29.3333
deviation-center-line1.7131872322188968
in-drivable-lane2.6666000000000007


other stats
deviation-heading7.940028857403615
driven_any6.51628328542116
driven_lanedir5.8456158735265005
visualized-eval1-passed1
304265941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval1successyes-0:11:04
Scores from the eval [...]
Scores from the evaluation of job: 30426
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median6.72396964302792
survival_time_median20.522
304195941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0-videossuccessyes-0:10:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
304185941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0-visualizesuccessyes-0:09:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec7.938105111033425
survival_time50
deviation-center-line2.6644833994592245
in-drivable-lane11.999900000000007


other stats
deviation-heading11.371375479042166
driven_any10.955110745088044
driven_lanedir7.938105111033425
visualized-eval0-passed1
304175941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0-visualizesuccessyes-0:10:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec7.938105111033425
survival_time50
deviation-center-line2.6644833994592245
in-drivable-lane11.999900000000007


other stats
deviation-heading11.371375479042166
driven_any10.955110745088044
driven_lanedir7.938105111033425
visualized-eval0-passed1
304165941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0-videosabortedyes-0:04:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
304085941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0successyes-0:16:51
Scores from the eval [...]
Scores from the evaluation of job: 30408
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
driven_lanedir_consec_median11.221006214300475
survival_time_median46.192
300145941JBRRussia1challenge-aido_LF-baseline-IL-0226aido3-LF-real-validationeval0abortedyes-0:09:28
Scores from the eval [...]
Scores from the evaluation of job: 30014
Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
Reason"Submission aborted by the operator"