Submission 17632

Submission	`17632`

Competing	yes
Challenge	`aido-LFI-full-sim-testing`
User	Bea Baselines 🐤
Date submitted	2021-11-02 08:54:56+00:00
Last status update	2021-12-04 20:48:19+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💔
Jobs	sim-0of4: `104613` sim-1of4: `104614` sim-2of4: `103859` sim-3of4: `104561`
Next
User label	minimal-agent-full
Admin priority	50
Blessing	n/a
User priority	50

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

104614

sim-1of4

failed

yes

2021-11-02 19:11:45+00:00

2021-11-02 19:12:59+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104613

sim-0of4

failed

yes

2021-11-02 19:11:05+00:00

2021-11-02 19:12:11+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104612

sim-1of4

failed

yes

2021-11-02 19:10:00+00:00

2021-11-02 19:11:03+00:00

0:01:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104610

sim-0of4

host-error

yes

2021-11-02 19:09:28+00:00

2021-11-02 19:10:38+00:00

0:01:10

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104609

sim-1of4

host-error

yes

2021-11-02 19:08:28+00:00

2021-11-02 19:09:45+00:00

0:01:17

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104608

sim-0of4

host-error

yes

2021-11-02 19:07:48+00:00

2021-11-02 19:09:15+00:00

0:01:27

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104607

sim-1of4

host-error

yes

2021-11-02 19:06:50+00:00

2021-11-02 19:07:59+00:00

0:01:09

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104596

sim-1of4

host-error

yes

2021-11-02 18:58:36+00:00

2021-11-02 18:59:56+00:00

0:01:20

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104592

sim-1of4

failed

yes

2021-11-02 18:57:12+00:00

2021-11-02 18:58:18+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104590

sim-0of4

host-error

yes

2021-11-02 18:56:40+00:00

2021-11-02 18:57:45+00:00

0:01:05

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104588

sim-1of4

failed

yes

2021-11-02 18:55:12+00:00

2021-11-02 18:56:41+00:00

0:01:29

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104587

sim-0of4

failed

yes

2021-11-02 18:55:10+00:00

2021-11-02 18:56:14+00:00

0:01:04

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104582

sim-1of4

host-error

yes

2021-11-02 18:53:27+00:00

2021-11-02 18:54:49+00:00

0:01:22

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104580

sim-0of4

host-error

yes

2021-11-02 18:53:26+00:00

2021-11-02 18:54:51+00:00

0:01:25

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104561

sim-3of4

success

yes

2021-11-02 18:47:27+00:00

2021-11-02 18:48:39+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

104558

sim-1of4

host-error

yes

2021-11-02 18:46:27+00:00

2021-11-02 18:47:28+00:00

0:01:01

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104557

sim-0of4

host-error

yes

2021-11-02 18:46:26+00:00

2021-11-02 18:47:30+00:00

0:01:04

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104555

sim-3of4

success

yes

2021-11-02 18:45:42+00:00

2021-11-02 18:47:06+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104550

sim-0of4

host-error

yes

2021-11-02 18:44:37+00:00

2021-11-02 18:45:40+00:00

0:01:03

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104549

sim-1of4

failed

yes

2021-11-02 18:44:36+00:00

2021-11-02 18:45:37+00:00

0:01:01

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104547

sim-3of4

success

yes

2021-11-02 18:44:00+00:00

2021-11-02 18:45:16+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104545

sim-1of4

host-error

yes

2021-11-02 18:42:50+00:00

2021-11-02 18:44:14+00:00

0:01:24

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104544

sim-0of4

host-error

yes

2021-11-02 18:42:50+00:00

2021-11-02 18:44:11+00:00

0:01:21

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104542

sim-3of4

success

yes

2021-11-02 18:41:47+00:00

2021-11-02 18:43:18+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103859

sim-2of4

success

yes

2021-11-02 15:27:30+00:00

2021-11-02 15:28:43+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

103833

sim-2of4

success

yes

2021-11-02 15:23:17+00:00

2021-11-02 15:24:35+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101561

sim-2of4

success

2021-11-02 09:02:38+00:00

2021-11-02 09:03:51+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101559

sim-3of4

success

2021-11-02 09:02:32+00:00

2021-11-02 09:03:43+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101556

sim-3of4

success

2021-11-02 09:00:37+00:00

2021-11-02 09:02:10+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101555

sim-2of4

success

2021-11-02 09:00:37+00:00

2021-11-02 09:02:04+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101549

sim-1of4

success

2021-11-02 08:59:03+00:00

2021-11-02 09:04:19+00:00

0:05:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101548

sim-0of4

success

2021-11-02 08:59:02+00:00

2021-11-02 09:04:04+00:00

0:05:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101545

sim-3of4

success

2021-11-02 08:58:33+00:00

2021-11-02 09:00:12+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

101544

sim-2of4

success

2021-11-02 08:58:33+00:00

2021-11-02 08:59:52+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible