Evaluator 4944

András Kalapos 🇭🇺

real-v1.0-3092-363

eval1-visualize

error

2020-12-12 10:21:02+00:00

2020-12-12 10:22:02+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61135

András Kalapos 🇭🇺

real-v1.0-3092-363

eval0-visualize

host-error

2020-12-12 10:20:45+00:00

2020-12-12 10:20:54+00:00

0:00:09

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61124

exercise_state_estimation

eval0-visualize

host-error

2020-12-12 10:18:35+00:00

2020-12-12 10:19:49+00:00

0:01:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61104

András Kalapos 🇭🇺

real-v1.0-3092-363

eval2-visualize

host-error

2020-12-12 10:14:26+00:00

2020-12-12 10:15:37+00:00

0:01:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61083

13305

Melisande Teng

exercise_state_estimation

eval0-visualize

host-error

2020-12-12 10:11:36+00:00

2020-12-12 10:12:54+00:00

0:01:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61070

13289

Bea Baselines 🐤

baseline-duckietown

eval0-visualize

host-error

2020-12-12 10:10:09+00:00

2020-12-12 10:11:15+00:00

0:01:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60921

13305

Melisande Teng

exercise_state_estimation

eval1-visualize

host-error

2020-12-12 02:04:45+00:00

2020-12-12 02:05:56+00:00

0:01:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60798

exercise_state_estimation

eval0-visualize

error

2020-12-12 01:29:00+00:00

2020-12-12 01:30:22+00:00

0:01:22

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139679303006384
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60717

exercise_state_estimation

eval0-visualize

error

2020-12-12 01:02:04+00:00

2020-12-12 01:03:07+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval0/watchtowers/watchtower128/watchtower.bag', 'topic': '/watchtower128/camera_node/image/compressed', 't0': 16.759260654449463, 't1': 17.26535940170288, 'out': '/challenges/tmp/tmpw_tc0gas/visualization/tmp/ego0-0-watchtower128-00000-00050.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f13ab257ee0>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60690

13305

Melisande Teng

exercise_state_estimation

eval2-visualize

error

2020-12-12 00:57:21+00:00

2020-12-12 00:59:56+00:00

0:02:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval2/watchtowers/watchtower114/watchtower.bag', 'topic': '/watchtower114/camera_node/image/compressed', 't0': 13.198768854141235, 't1': 15.49433183670044, 'out': '/challenges/tmp/tmpcgwsijzl/visualization/tmp/ego0-0-watchtower114-00000-00229.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7ff8b05e78b0>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60677

exercise_state_estimation

eval1-visualize

host-error

2020-12-12 00:54:34+00:00

2020-12-12 00:56:07+00:00

0:01:33

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60645

András Kalapos 🇭🇺

real-v1.0-3092-363

eval1-visualize

error

2020-12-12 00:48:11+00:00

2020-12-12 00:49:35+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60523

13289

Bea Baselines 🐤

baseline-duckietown

eval0-visualize

error