Submission 14821

Submission	`14821`

Competing	yes
Challenge	`aido-LFVI-sim-validation`
User	Bea Baselines 🐤
Date submitted	2021-04-20 22:23:18+00:00
Last status update	2021-12-04 20:47:23+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💔
Jobs	sim-0of4: `98670` sim-1of4: `98668` sim-2of4: `98684` sim-3of4: `98671`
Next
User label	straight
Admin priority	50
Blessing	n/a
User priority	50

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

98684

sim-2of4

success

yes

2021-11-02 01:21:24+00:00

2021-11-02 01:22:42+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

98680

sim-2of4

success

yes

2021-11-02 01:19:48+00:00

2021-11-02 01:20:56+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98675

sim-2of4

success

yes

2021-11-02 01:18:17+00:00

2021-11-02 01:19:36+00:00

0:01:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98671

sim-3of4

success

yes

2021-11-02 01:17:28+00:00

2021-11-02 01:18:38+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

98670

sim-0of4

failed

yes

2021-11-02 01:16:52+00:00

2021-11-02 01:17:54+00:00

0:01:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98668

sim-1of4

failed

yes

2021-11-02 01:16:50+00:00

2021-11-02 01:17:50+00:00

0:01:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98666

sim-3of4

success

yes

2021-11-02 01:15:59+00:00

2021-11-02 01:17:08+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98665

sim-0of4

failed

yes

2021-11-02 01:15:18+00:00

2021-11-02 01:16:18+00:00

0:01:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98663

sim-1of4

failed

yes

2021-11-02 01:15:16+00:00

2021-11-02 01:16:14+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98662

sim-3of4

success

yes

2021-11-02 01:14:12+00:00

2021-11-02 01:15:24+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96725

sim-1of4

success

2021-11-01 13:04:17+00:00

2021-11-01 13:06:01+00:00

0:01:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96716

sim-1of4

success

2021-11-01 13:02:21+00:00

2021-11-01 13:04:00+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96712

sim-3of4

success

2021-11-01 13:00:40+00:00

2021-11-01 13:02:09+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96711

sim-0of4

success

2021-11-01 13:00:40+00:00

2021-11-01 13:02:55+00:00

0:02:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96710

sim-2of4

success

2021-11-01 13:00:39+00:00

2021-11-01 13:02:10+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96706

sim-0of4

host-error

2021-11-01 12:59:47+00:00

2021-11-01 13:00:28+00:00

0:00:41

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/6e00a7d1a4ca245c6cd4906436a7367d62c0b1f7834cdcacdd206a171bb19e41/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1212, in run_one
    container: Container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/6e00a7d1a4ca245c6cd4906436a7367d62c0b1f7834cdcacdd206a171bb19e41/json: Not Found ("No such container: 6e00a7d1a4ca245c6cd4906436a7367d62c0b1f7834cdcacdd206a171bb19e41")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96705

sim-1of4

success

2021-11-01 12:59:42+00:00

2021-11-01 13:01:36+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96703

sim-2of4

success

2021-11-01 12:59:03+00:00

2021-11-01 13:00:15+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96702

sim-3of4

success

2021-11-01 12:59:00+00:00

2021-11-01 13:00:16+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96697

sim-0of4

success

2021-11-01 12:57:37+00:00

2021-11-01 12:59:23+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96696

sim-2of4

success

2021-11-01 12:57:34+00:00

2021-11-01 12:58:46+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

96695

sim-3of4

success

2021-11-01 12:57:03+00:00

2021-11-01 12:58:17+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87481

sim-0of4

success

2021-10-18 20:23:57+00:00

2021-10-18 20:27:17+00:00

0:03:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87480

sim-3of4

success

2021-10-18 20:23:56+00:00

2021-10-18 20:25:06+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87479

sim-2of4

success

2021-10-18 20:23:52+00:00

2021-10-18 20:25:02+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87478

sim-2of4

success

2021-10-18 20:23:26+00:00

2021-10-18 20:24:36+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87477

sim-0of4

success

2021-10-18 20:23:23+00:00

2021-10-18 20:26:40+00:00

0:03:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87476

sim-3of4

success

2021-10-18 20:23:20+00:00

2021-10-18 20:24:31+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87475

sim-3of4

success

2021-10-18 20:22:26+00:00

2021-10-18 20:23:34+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87474

sim-2of4

success

2021-10-18 20:22:22+00:00

2021-10-18 20:23:32+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87473

sim-2of4

success

2021-10-18 20:21:49+00:00

2021-10-18 20:22:59+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87472

sim-3of4

success

2021-10-18 20:21:45+00:00

2021-10-18 20:22:54+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87471

sim-3of4

success

2021-10-18 20:19:52+00:00

2021-10-18 20:21:40+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87470

sim-1of4

success

2021-10-18 20:19:51+00:00

2021-10-18 20:24:26+00:00

0:04:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87469

sim-2of4

success

2021-10-18 20:19:51+00:00

2021-10-18 20:21:17+00:00

0:01:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87468

sim-0of4

success

2021-10-18 20:19:20+00:00

2021-10-18 20:23:05+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87466

sim-1of4

success

2021-10-18 20:18:52+00:00

2021-10-18 20:24:45+00:00

0:05:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87465

sim-3of4

success

2021-10-18 20:18:51+00:00

2021-10-18 20:21:23+00:00

0:02:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87463

sim-0of4

success

2021-10-18 20:18:50+00:00

2021-10-18 20:23:16+00:00

0:04:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87461

sim-2of4

success

2021-10-18 20:18:35+00:00

2021-10-18 20:21:17+00:00

0:02:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71092

sim-1of4

success

2021-04-21 14:36:51+00:00

2021-04-21 14:41:52+00:00

0:05:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71090

sim-0of4

success

2021-04-21 14:36:50+00:00

2021-04-21 14:39:57+00:00

0:03:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71089

sim-2of4

success

2021-04-21 14:35:59+00:00

2021-04-21 14:37:06+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71085

sim-3of4

success

2021-04-21 14:35:36+00:00

2021-04-21 14:36:38+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71078

sim-2of4

success

2021-04-21 14:34:50+00:00

2021-04-21 14:35:47+00:00

0:00:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71075

sim-3of4

success

2021-04-21 14:33:51+00:00

2021-04-21 14:34:50+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71069

sim-2of4

success

2021-04-21 14:33:14+00:00

2021-04-21 14:34:15+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68890

sim-0of4

success

2021-04-20 23:02:57+00:00

2021-04-20 23:06:13+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68889

sim-3of4

success

2021-04-20 23:02:56+00:00

2021-04-20 23:03:55+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

68888

sim-2of4

success

2021-04-20 23:01:58+00:00

2021-04-20 23:02:57+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible