Duckietown Challenges Home Challenges Submissions

Submission 13307

Submission13307
Competingyes
Challengeaido5-LF-real-validation
UserZoltan Lorincz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobseval0: 60698 eval0-videos: 61576 eval0-visualize: 61580 eval1: 60733 eval1-videos: 61578 eval1-visualize: 61575 eval2: 60822 eval2-videos: 61577 eval2-visualize: 61579
Next
User labellzoltan_drfe1
Admin priority100
Blessingn/a
User priority100

61580

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61579

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61578

robot

watchtower

61577

robot

watchtower

61576

robot

watchtower

61575

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

60822

scenario/drawing.html

60733

scenario/drawing.html

60698

scenario/drawing.html

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
61580eval0-visualizesuccessyes0:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.777483697436823
survival_time4.9920432567596436
deviation-center-line0.2995008232780278
in-drivable-lane1.3513364791870115


other stats
deviation-heading0.3070266909391687
driven_any1.394873867445906
driven_lanedir0.777483697436823
visualized-eval0-passed1
No reset possible
61579eval2-visualizesuccessyes0:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.414822209415724
survival_time35.52817392349243
deviation-center-line1.7260310375889625
in-drivable-lane17.10309910774231


other stats
deviation-heading7.5205076419404175
driven_any4.535819215801375
driven_lanedir1.536936051291545
visualized-eval2-passed1
No reset possible
61578eval1-videossuccessyes0:01:51
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61577eval2-videossuccessyes0:04:31
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61576eval0-videossuccessyes0:02:36
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61575eval1-visualizesuccessyes0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6102555669036639
survival_time5.013919115066528
deviation-center-line0.16715708680970978
in-drivable-lane2.0051920413970947


other stats
deviation-heading0.6095703826604912
driven_any0.9239625106600752
driven_lanedir0.6102555669036639
visualized-eval1-passed1
No reset possible
61403eval0-videossuccessno0:01:36
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61402eval1-videossuccessno0:01:33
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61401eval1-visualizesuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61400eval2-visualizeerrorno0:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139877988280304
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61399eval0-visualizesuccessno0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61346eval2-videossuccessno0:04:16
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61345eval0-visualizesuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61344eval2-visualizeerrorno0:01:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140530663963904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61343eval1-visualizesuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61342eval0-visualizesuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61210eval1-visualizesuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61194eval2-visualizeerrorno0:03:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140058122106720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61192eval0-visualizesuccessno0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61178eval2-visualizeabortedno0:02:21
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61172eval1-visualizeabortedno0:01:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61151eval0-visualizesuccessno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61150eval0-visualizesuccessno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61141eval1-visualizesuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61139eval1-visualizesuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61119eval2-visualizeerrorno0:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139752360006800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61113eval2-visualizeerrorno0:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140672530478944
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60945eval1-videossuccessno0:01:36
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60944eval1-videossuccessno0:01:44
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60943eval2-visualizeerrorno0:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 174, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 301, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 350, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139853700597888
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60939eval2-videossuccessno0:04:24
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60932eval0-visualizesuccessno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60930eval0-videossuccessno0:01:38
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60922eval1-visualizeerrorno0:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60822eval2successyes0:21:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60816eval0-visualizesuccessno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60796eval1-visualizeerrorno0:00:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60787eval1-visualizeerrorno0:00:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60758eval1-videossuccessno0:01:05
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60757eval1-videossuccessno0:01:06
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60756eval1-visualizeerrorno0:00:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60754eval2abortedyes0:13:17
DEBUG:commons:versio [...]
DEBUG:commons:version: 6.1.7 *
INFO:typing:version: 6.1.8
DEBUG:aido_schemas:aido-protocols version 6.0.33 path /usr/local/lib/python3.8/dist-packages
INFO:nodes:version 6.1.1 path /usr/local/lib/python3.8/dist-packages pyparsing 2.4.6
DEBUG:ipce:version 6.0.36 path /usr/local/lib/python3.8/dist-packages
INFO:nodes_wrapper:checking implementation
INFO:nodes_wrapper:checking implementation OK
DEBUG:nodes_wrapper:run_loop
  fin: /fifos/ego0-in
 fout: fifo:/fifos/ego0-out
INFO:nodes_wrapper:Fifo /fifos/ego0-out created. I will block until a reader appears.
INFO:nodes_wrapper:Fifo reader appeared for /fifos/ego0-out.
INFO:nodes_wrapper:Node PytorchILTemplateAgent starting reading
 fi_desc: /fifos/ego0-in
 fo_desc: fifo:/fifos/ego0-out
INFO:aido_schemas:PytorchILTemplateAgent init
/usr/local/lib/python3.8/dist-packages/torch/cuda/__init__.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at  /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
  return torch._C._cuda_getDeviceCount() > 0
INFO:aido_schemas:PytorchILTemplateAgent init complete
INFO:nodes_wrapper:2d883333e084:PytorchILTemplateAgent: Starting episode "episode".
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60753eval1-visualizeerrorno0:00:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60752eval1-visualizeerrorno0:00:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60742eval0-videossuccessno0:00:59
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60738eval0-videossuccessno0:01:00
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60734eval0-visualizeerrorno0:00:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval0/watchtowers/watchtower126/watchtower.bag', 'topic': '/watchtower126/camera_node/image/compressed', 't0': 10.120168685913086, 't1': 10.51915192604065, 'out': '/challenges/tmp/tmpg5pmdzuc/visualization/tmp/ego0-0-watchtower126-00000-00039.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f664c7d5970>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60733eval1successyes0:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60698eval0successyes0:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible