Submission 17711

Submission	`17711`

Competing	yes
Challenge	`aido-LFI-state-sim-validation`
User	Bea Baselines 🐤
Date submitted	2021-11-02 09:07:50+00:00
Last status update	2021-12-04 20:47:42+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💔
Jobs	sim-0of4: `103847` sim-1of4: `103864` sim-2of4: `103846` sim-3of4: `103845`
Next
User label	baseline-simple-yield
Admin priority	50
Blessing	n/a
User priority	50

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

103864

sim-1of4

failed

yes

2021-11-02 15:28:09+00:00

2021-11-02 15:29:15+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103854

sim-1of4

host-error

yes

2021-11-02 15:26:33+00:00

2021-11-02 15:27:33+00:00

0:01:00

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103847

sim-0of4

failed

yes

2021-11-02 15:26:01+00:00

2021-11-02 15:27:07+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103846

sim-2of4

success

yes

2021-11-02 15:25:27+00:00

2021-11-02 15:26:44+00:00

0:01:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

103845

sim-3of4

success

yes

2021-11-02 15:25:27+00:00

2021-11-02 15:26:40+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

103844

sim-1of4

failed

yes

2021-11-02 15:24:59+00:00

2021-11-02 15:26:02+00:00

0:01:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103840

sim-0of4

host-error

yes

2021-11-02 15:24:25+00:00

2021-11-02 15:25:31+00:00

0:01:06

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103836

sim-2of4

success

yes

2021-11-02 15:23:50+00:00

2021-11-02 15:25:00+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103835

sim-3of4

success

yes

2021-11-02 15:23:48+00:00

2021-11-02 15:25:03+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103834

sim-1of4

host-error

yes

2021-11-02 15:23:19+00:00

2021-11-02 15:24:20+00:00

0:01:01

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103829

sim-0of4

failed

yes

2021-11-02 15:22:43+00:00

2021-11-02 15:23:45+00:00

0:01:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103824

sim-2of4

success

yes

2021-11-02 15:21:32+00:00

2021-11-02 15:23:17+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103823

sim-3of4

success

yes

2021-11-02 15:21:32+00:00

2021-11-02 15:23:17+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103822

sim-1of4

host-error

yes

2021-11-02 15:21:32+00:00

2021-11-02 15:22:48+00:00

0:01:16

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

103819

sim-0of4

host-error

yes

2021-11-02 15:21:28+00:00

2021-11-02 15:22:32+00:00

0:01:04

The container "simul [...]

The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102124

sim-3of4

success

2021-11-02 10:26:19+00:00

2021-11-02 10:27:35+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102122

sim-2of4

success

2021-11-02 10:26:18+00:00

2021-11-02 10:27:27+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102120

sim-1of4

success

2021-11-02 10:25:45+00:00

2021-11-02 10:30:13+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102116

sim-0of4

success

2021-11-02 10:25:42+00:00

2021-11-02 10:30:07+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102110

sim-3of4

success

2021-11-02 10:24:45+00:00

2021-11-02 10:25:54+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102109

sim-2of4

success

2021-11-02 10:24:44+00:00

2021-11-02 10:25:51+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102102

sim-2of4

success

2021-11-02 10:23:14+00:00

2021-11-02 10:24:29+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102101

sim-3of4

success

2021-11-02 10:23:14+00:00

2021-11-02 10:24:27+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102086

sim-2of4

success

2021-11-02 10:20:37+00:00

2021-11-02 10:22:54+00:00

0:02:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102083

sim-1of4

success

2021-11-02 10:20:34+00:00

2021-11-02 10:25:15+00:00

0:04:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102082

sim-3of4

success

2021-11-02 10:20:33+00:00

2021-11-02 10:22:54+00:00

0:02:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

102081

sim-0of4

success

2021-11-02 10:20:06+00:00

2021-11-02 10:25:19+00:00

0:05:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible