Submission 14822

Submission	`14822`

Competing	yes
Challenge	`aido-LFVI-sim-testing`
User	Bea Baselines 🐤
Date submitted	2021-04-20 22:23:18+00:00
Last status update	2021-12-04 20:48:04+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💔
Jobs	sim-0of4: `98657` sim-1of4: `98658` sim-2of4: `98641` sim-3of4: `98640`
Next
User label	straight
Admin priority	50
Blessing	n/a
User priority	50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

98658

sim-1of4

failed

yes

2021-11-02 01:13:48+00:00

2021-11-02 01:14:59+00:00

0:01:11

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98657

sim-0of4

failed

yes

2021-11-02 01:12:46+00:00

2021-11-02 01:13:48+00:00

0:01:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98653

sim-1of4

failed

yes

2021-11-02 01:12:16+00:00

2021-11-02 01:13:15+00:00

0:00:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98652

sim-0of4

failed

yes

2021-11-02 01:11:23+00:00

2021-11-02 01:12:33+00:00

0:01:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98651

sim-1of4

failed

yes

2021-11-02 01:10:54+00:00

2021-11-02 01:11:50+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98644

sim-1of4

failed

yes

2021-11-02 01:09:19+00:00

2021-11-02 01:10:15+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98641

sim-2of4

success

yes

2021-11-02 01:07:59+00:00

2021-11-02 01:09:11+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

98640

sim-3of4

success

yes

2021-11-02 01:07:59+00:00

2021-11-02 01:09:08+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

98636

sim-2of4

success

yes

2021-11-02 01:06:32+00:00

2021-11-02 01:07:42+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98630

sim-2of4

success

yes

2021-11-02 01:04:57+00:00

2021-11-02 01:06:07+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98626

sim-2of4

success

yes

2021-11-02 01:03:08+00:00

2021-11-02 01:04:18+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96715

sim-2of4

success

2021-11-01 13:01:07+00:00

2021-11-01 13:02:21+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96714

sim-1of4

success

2021-11-01 13:01:05+00:00

2021-11-01 13:03:25+00:00

0:02:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96713

sim-0of4

success

2021-11-01 13:00:42+00:00

2021-11-01 13:04:26+00:00

0:03:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96709

sim-3of4

success

2021-11-01 13:00:12+00:00

2021-11-01 13:02:25+00:00

0:02:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96704

sim-2of4

success

2021-11-01 12:59:41+00:00

2021-11-01 13:01:01+00:00

0:01:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96701

sim-0of4

host-error

2021-11-01 12:58:31+00:00

2021-11-01 13:00:19+00:00

0:01:48

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/containers/00e488959c01b9b0c50829a8e1fb6a599be756ab74120537568aff633a25baeb/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.41/containers/00e488959c01b9b0c50829a8e1fb6a599be756ab74120537568aff633a25baeb/json: Not Found ("No such container: 00e488959c01b9b0c50829a8e1fb6a599be756ab74120537568aff633a25baeb")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96700

sim-3of4

success

2021-11-01 12:58:29+00:00

2021-11-01 12:59:44+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96699

sim-1of4

success

2021-11-01 12:58:29+00:00

2021-11-01 13:00:35+00:00

0:02:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96698

sim-2of4

success

2021-11-01 12:58:00+00:00

2021-11-01 12:59:11+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87709

sim-0of4

success

2021-10-18 22:09:07+00:00

2021-10-18 22:13:27+00:00

0:04:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87707

sim-0of4

success

2021-10-18 22:07:31+00:00

2021-10-18 22:12:08+00:00

0:04:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87691

sim-0of4

success

2021-10-18 22:01:11+00:00

2021-10-18 22:05:05+00:00

0:03:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87687

sim-0of4

success

2021-10-18 22:00:21+00:00

2021-10-18 22:04:29+00:00

0:04:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87680

sim-0of4

success

2021-10-18 21:55:48+00:00

2021-10-18 22:00:31+00:00

0:04:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87678

sim-0of4

success

2021-10-18 21:54:48+00:00

2021-10-18 21:59:26+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87673

sim-0of4

success

2021-10-18 21:51:00+00:00

2021-10-18 21:55:01+00:00

0:04:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87670

sim-0of4

success

2021-10-18 21:50:20+00:00

2021-10-18 21:54:14+00:00

0:03:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87662

sim-2of4

success

2021-10-18 21:46:48+00:00

2021-10-18 21:47:58+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87661

sim-3of4

success

2021-10-18 21:46:16+00:00

2021-10-18 21:47:26+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87659

sim-0of4

success

2021-10-18 21:46:15+00:00

2021-10-18 21:50:08+00:00

0:03:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87658

sim-0of4

success

2021-10-18 21:45:43+00:00

2021-10-18 21:49:42+00:00

0:03:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87656

sim-2of4

success

2021-10-18 21:45:12+00:00

2021-10-18 21:46:20+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87655

sim-3of4

success

2021-10-18 21:44:39+00:00

2021-10-18 21:45:50+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87654

sim-1of4

success

2021-10-18 21:44:39+00:00

2021-10-18 21:48:43+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71087

sim-2of4

success

2021-04-21 14:35:57+00:00

2021-04-21 14:36:57+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71086

sim-3of4

success

2021-04-21 14:35:54+00:00

2021-04-21 14:36:55+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71083

sim-1of4

success

2021-04-21 14:35:30+00:00

2021-04-21 14:37:36+00:00

0:02:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71079

sim-2of4

success

2021-04-21 14:34:50+00:00

2021-04-21 14:35:51+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71077

sim-3of4

success

2021-04-21 14:34:30+00:00

2021-04-21 14:35:33+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71073

sim-2of4

success

2021-04-21 14:33:18+00:00

2021-04-21 14:34:18+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71072

sim-1of4

success

2021-04-21 14:33:15+00:00

2021-04-21 14:35:16+00:00

0:02:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71070

sim-0of4

success

2021-04-21 14:33:15+00:00

2021-04-21 14:37:26+00:00

0:04:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71067

sim-3of4

success

2021-04-21 14:32:41+00:00

2021-04-21 14:33:43+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68887

sim-3of4

success

2021-04-20 23:01:56+00:00

2021-04-20 23:02:55+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68886

sim-2of4

success

2021-04-20 23:01:55+00:00

2021-04-20 23:02:55+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68885

sim-1of4

success

2021-04-20 23:01:36+00:00

2021-04-20 23:03:38+00:00

0:02:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68882

sim-2of4

success

2021-04-20 23:00:17+00:00

2021-04-20 23:01:18+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68881

sim-3of4

success

2021-04-20 23:00:14+00:00

2021-04-20 23:01:18+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68876

sim-0of4

success

2021-04-20 22:58:59+00:00

2021-04-20 23:02:51+00:00

0:03:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible