Duckietown Challenges Home Challenges Submissions

Submission 15573

Submission15573
Competingyes
Challengeaido-LFVI_multi-sim-validation
UserAdriano Almeida
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104708 sim-1of4: 104766 sim-2of4: 104704 sim-3of4: 104703
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

104766

Click the images to see detailed statistics about the episode.

4way-000

104708

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104766sim-1of4successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.949999999999987
in-drivable-lane_median4.274999999999987
driven_lanedir_consec_median0.454334784364544
deviation-center-line_median0.12821689367703437


other stats
deviation-center-line_max0.15690877017584756
deviation-center-line_mean0.118617093766728
deviation-center-line_min0.0611258175369957
deviation-heading_max1.1209455199435732
deviation-heading_mean0.7259976678323835
deviation-heading_median0.7237421972891012
deviation-heading_min0.3355607568077583
distance-from-start_max2.207017088374742
distance-from-start_mean1.3615049232506973
distance-from-start_median1.42647256092055
distance-from-start_min0.3860574827869466
driven_any_max2.2111889959779174
driven_any_mean1.3640406022553069
driven_any_median1.4291756834816114
driven_any_min0.3866220460800857
driven_lanedir_consec_max0.6294063735407769
driven_lanedir_consec_mean0.42495036364308875
driven_lanedir_consec_min0.1617255123024901
driven_lanedir_max0.6294063735407769
driven_lanedir_mean0.42495036364308875
driven_lanedir_median0.454334784364544
driven_lanedir_min0.1617255123024901
in-drivable-lane_max5.149999999999987
in-drivable-lane_mean4.412499999999987
in-drivable-lane_min3.949999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 1.1596558864923543, "survival_time": 5.949999999999987, "driven_lanedir": 0.35471042714517953, "in-drivable-lane": 4.399999999999988, "deviation-heading": 1.1209455199435732, "distance-from-start": 1.1574772306695094, "deviation-center-line": 0.11558779639181373, "driven_lanedir_consec": 0.35471042714517953}, "4way-000-ego1": {"driven_any": 0.3866220460800857, "survival_time": 5.949999999999987, "driven_lanedir": 0.1617255123024901, "in-drivable-lane": 5.149999999999987, "deviation-heading": 0.404250778436123, "distance-from-start": 0.3860574827869466, "deviation-center-line": 0.0611258175369957, "driven_lanedir_consec": 0.1617255123024901}, "4way-000-ego2": {"driven_any": 1.6986954804708685, "survival_time": 5.949999999999987, "driven_lanedir": 0.5539591415839085, "in-drivable-lane": 3.949999999999987, "deviation-heading": 1.0432336161420792, "distance-from-start": 1.6954678911715906, "deviation-center-line": 0.14084599096225503, "driven_lanedir_consec": 0.5539591415839085}, "4way-000-ego3": {"driven_any": 2.2111889959779174, "survival_time": 5.949999999999987, "driven_lanedir": 0.6294063735407769, "in-drivable-lane": 4.149999999999986, "deviation-heading": 0.3355607568077583, "distance-from-start": 2.207017088374742, "deviation-center-line": 0.15690877017584756, "driven_lanedir_consec": 0.6294063735407769}}
simulation-passed1
survival_time_max5.949999999999987
survival_time_mean5.949999999999987
survival_time_min5.949999999999987
No reset possible
104747sim-1of4successyes0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104709sim-1of4host-erroryes0:02:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/e210d01f7d8f1e05dedd4b3e1062067c694f36aef358584b4bdd80a0ae56112b/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/e210d01f7d8f1e05dedd4b3e1062067c694f36aef358584b4bdd80a0ae56112b/json: Not Found ("No such container: e210d01f7d8f1e05dedd4b3e1062067c694f36aef358584b4bdd80a0ae56112b")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104708sim-0of4successyes0:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.249999999999993
in-drivable-lane_median2.4249999999999936
driven_lanedir_consec_median0.2933128014982085
deviation-center-line_median0.14629103385966363


other stats
deviation-center-line_max0.45510601549060353
deviation-center-line_mean0.20102538949313767
deviation-center-line_min0.056413474762619945
deviation-heading_max1.4549430409664144
deviation-heading_mean0.835106385775332
deviation-heading_median0.7406158618493957
deviation-heading_min0.404250778436123
distance-from-start_max1.4359928414801737
distance-from-start_mean0.7283494412805103
distance-from-start_median0.5456737204274604
distance-from-start_min0.38605748278694657
driven_any_max1.4389890505904546
driven_any_mean0.7295997511448962
driven_any_median0.546393953954526
driven_any_min0.38662204608007816
driven_lanedir_consec_max0.90349404576361
driven_lanedir_consec_mean0.4129612902656293
driven_lanedir_consec_min0.1617255123024901
driven_lanedir_max0.922841329171426
driven_lanedir_mean0.4177981111175833
driven_lanedir_median0.2933128014982085
driven_lanedir_min0.1617255123024901
in-drivable-lane_max3.449999999999993
in-drivable-lane_mean2.074999999999995
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.7061658618289596, "survival_time": 4.249999999999993, "driven_lanedir": 0.21552340575441553, "in-drivable-lane": 3.2999999999999927, "deviation-heading": 0.5098017840397021, "distance-from-start": 0.7052899580679743, "deviation-center-line": 0.056413474762619945, "driven_lanedir_consec": 0.21552340575441553}, "udem-000-ego1": {"driven_any": 0.38662204608007816, "survival_time": 4.249999999999993, "driven_lanedir": 0.1617255123024901, "in-drivable-lane": 3.449999999999993, "deviation-heading": 0.404250778436123, "distance-from-start": 0.3860574827869466, "deviation-center-line": 0.0611258175369957, "driven_lanedir_consec": 0.1617255123024901}, "udem-000-ego2": {"driven_any": 0.3866220460800922, "survival_time": 4.249999999999993, "driven_lanedir": 0.37110219724200144, "in-drivable-lane": 0.0, "deviation-heading": 1.4549430409664144, "distance-from-start": 0.38605748278694657, "deviation-center-line": 0.45510601549060353, "driven_lanedir_consec": 0.37110219724200144}, "udem-000-ego3": {"driven_any": 1.4389890505904546, "survival_time": 4.249999999999993, "driven_lanedir": 0.922841329171426, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.9714299396590892, "distance-from-start": 1.4359928414801737, "deviation-center-line": 0.2314562501823315, "driven_lanedir_consec": 0.90349404576361}}
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean4.249999999999993
survival_time_min4.249999999999993
No reset possible
104704sim-2of4successyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104703sim-3of4successyes0:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104698sim-1of4successyes0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104697sim-0of4successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104694sim-1of4successyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104692sim-0of4successyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99612sim-3of4successno0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99609sim-1of4failedno0:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99602sim-3of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99597sim-1of4failedno0:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99590sim-1of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99587sim-3of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99577sim-1of4failedno0:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99574sim-3of4successno0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99566sim-1of4failedno0:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99565sim-3of4successno0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99563sim-2of4successno0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99559sim-0of4failedno0:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99555sim-2of4successno0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99554sim-1of4failedno0:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99553sim-3of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99549sim-0of4failedno0:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99540sim-0of4failedno0:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99539sim-2of4successno0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96692sim-1of4successno0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96690sim-3of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96688sim-2of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96687sim-0of4successno0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96681sim-1of4successno0:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible