Duckietown Challenges Home Challenges Submissions

Submission 13277

Submission13277
Competingyes
Challengeaido5-LF-real-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobseval0: 60556 eval0-videos: 61563 eval0-visualize: 61573 eval1: 60594 eval1-videos: 61574 eval1-visualize: 61571 eval2: 60605 eval2-videos: 61572 eval2-visualize: 61566
Next
User label102-1-real
Admin priority120
Blessingn/a
User priority120

61574

robot

watchtower

61573

Click the images to see detailed statistics about the episode.

sync

visualization

61572

robot

watchtower

61571

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61566

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61563

robot

watchtower

60605

scenario/drawing.html

60594

scenario/drawing.html

60556

scenario/drawing.html

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
61574eval1-videossuccessyes0:02:18
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61573eval0-visualizesuccessyes0:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.010015950365367
survival_time5.209685564041138
deviation-center-line0.2939029143348458
in-drivable-lane1.207838535308838


other stats
deviation-heading0.9440969846552648
driven_any1.2392733340933495
driven_lanedir1.010015950365367
visualized-eval0-passed1
No reset possible
61572eval2-videossuccessyes0:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61571eval1-visualizesuccessyes0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
61566eval2-visualizesuccessyes0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.528507341980895
survival_time26.080227851867676
deviation-center-line0.7794176911610061
in-drivable-lane16.56039595603943


other stats
deviation-heading2.990060812855902
driven_any6.312330471831122
driven_lanedir2.528507341980895
visualized-eval2-passed1
No reset possible
61563eval0-videossuccessyes0:02:47
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61398eval0-visualizesuccessno0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61397eval1-visualizesuccessno0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61396eval2-visualizeerrorno0:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140459536225376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61391eval0-visualizeabortedno0:00:53
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61390eval0-videossuccessno0:01:32
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61389eval1-videossuccessno0:02:22
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61387eval0-visualizeabortedno0:00:51
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61385eval0-videossuccessno0:01:34
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61384eval1-visualizesuccessno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61382eval1-videossuccessno0:02:17
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61381eval0-videossuccessno0:01:31
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61379eval1-visualizesuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61377eval0-videossuccessno0:01:32
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61375eval1-videossuccessno0:02:19
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61374eval1-visualizesuccessno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61373eval0-visualizesuccessno0:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61372eval0-videossuccessno0:01:34
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61370eval1-visualizesuccessno0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61369eval0-visualizesuccessno0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61368eval0-videossuccessno0:01:37
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61341eval0-visualizesuccessno0:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61340eval1-visualizesuccessno0:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61339eval0-visualizesuccessno0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61338eval2-videossuccessno0:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61337eval2-visualizeerrorno0:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140636052052096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61199eval0-visualizesuccessno0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61196eval1-visualizesuccessno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61193eval0-visualizesuccessno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61189eval1-visualizesuccessno0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61183eval2-visualizeerrorno0:01:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140070471446192
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61167eval1-visualizehost-errorno0:03:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61166eval2-visualizehost-errorno0:03:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61165eval0-visualizehost-errorno0:03:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61096eval1-visualizesuccessno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61079eval2-visualizeerrorno0:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140334773045472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61071eval0-visualizeerrorno0:00:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
61060eval0-visualizeerrorno0:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60905eval2-videossuccessno0:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60879eval2-visualizeerrorno0:01:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 174, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 301, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 350, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140545170508096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60867eval1-visualizesuccessno0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60853eval0-videossuccessno0:01:28
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60835eval1-videossuccessno0:02:15
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60825eval0-visualizeerrorno0:00:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60776eval1-visualizeerrorno0:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140393600600528
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60605eval2successyes0:30:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60594eval1successyes0:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
60556eval0successyes0:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible