Submission 13595

Submission	`13595`

Competing	yes
Challenge	`aido-LF-sim-validation`
User	Andras Beres
Date submitted	2021-01-31 22:17:42+00:00
Last status update	2021-12-04 20:47:20+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💚
Jobs	sim-0of4: `105362` sim-1of4: `105366` sim-2of4: `105357` sim-3of4: `105369`
Next
User label	fsf+il
Admin priority	50
Blessing	n/a
User priority	50

105369

Click the images to see detailed statistics about the episode.

zigzag-000

105366

Click the images to see detailed statistics about the episode.

autolab-000

105362

Click the images to see detailed statistics about the episode.

loop2-000

105357

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

105369

sim-3of4

success

yes

2021-11-03 02:20:41+00:00

2021-11-03 02:27:11+00:00

0:06:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	26.37846848778875
survival_time_median	59.99999999999873
deviation-center-line_median	4.806573721641782
in-drivable-lane_median	3.9999999999999143

other stats

deviation-center-line_max	4.806573721641782
deviation-center-line_mean	4.806573721641782
deviation-center-line_min	4.806573721641782
deviation-heading_max	9.3692112783938
deviation-heading_mean	9.3692112783938
deviation-heading_median	9.3692112783938
deviation-heading_min	9.3692112783938
distance-from-start_max	4.421634476123848
distance-from-start_mean	4.421634476123848
distance-from-start_median	4.421634476123848
distance-from-start_min	4.421634476123848
driven_any_max	28.376293697871397
driven_any_mean	28.376293697871397
driven_any_median	28.376293697871397
driven_any_min	28.376293697871397
driven_lanedir_consec_max	26.37846848778875
driven_lanedir_consec_mean	26.37846848778875
driven_lanedir_consec_min	26.37846848778875
driven_lanedir_max	26.37846848778875
driven_lanedir_mean	26.37846848778875
driven_lanedir_median	26.37846848778875
driven_lanedir_min	26.37846848778875
in-drivable-lane_max	3.9999999999999143
in-drivable-lane_mean	3.9999999999999143
in-drivable-lane_min	3.9999999999999143
per-episodes	details {"zigzag-000-ego0": {"driven_any": 28.376293697871397, "survival_time": 59.99999999999873, "driven_lanedir": 26.37846848778875, "in-drivable-lane": 3.9999999999999143, "deviation-heading": 9.3692112783938, "distance-from-start": 4.421634476123848, "deviation-center-line": 4.806573721641782, "driven_lanedir_consec": 26.37846848778875}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105366

sim-1of4

success

yes

2021-11-03 02:19:40+00:00

2021-11-03 02:25:09+00:00

0:05:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	27.38930371799128
survival_time_median	59.99999999999873
deviation-center-line_median	4.350580826208776
in-drivable-lane_median	3.0999999999999552

other stats

deviation-center-line_max	4.350580826208776
deviation-center-line_mean	4.350580826208776
deviation-center-line_min	4.350580826208776
deviation-heading_max	9.058170218001154
deviation-heading_mean	9.058170218001154
deviation-heading_median	9.058170218001154
deviation-heading_min	9.058170218001154
distance-from-start_max	3.212880790224275
distance-from-start_mean	3.212880790224275
distance-from-start_median	3.212880790224275
distance-from-start_min	3.212880790224275
driven_any_max	29.056420761154943
driven_any_mean	29.056420761154943
driven_any_median	29.056420761154943
driven_any_min	29.056420761154943
driven_lanedir_consec_max	27.38930371799128
driven_lanedir_consec_mean	27.38930371799128
driven_lanedir_consec_min	27.38930371799128
driven_lanedir_max	27.38930371799128
driven_lanedir_mean	27.38930371799128
driven_lanedir_median	27.38930371799128
driven_lanedir_min	27.38930371799128
in-drivable-lane_max	3.0999999999999552
in-drivable-lane_mean	3.0999999999999552
in-drivable-lane_min	3.0999999999999552
per-episodes	details {"autolab-000-ego0": {"driven_any": 29.056420761154943, "survival_time": 59.99999999999873, "driven_lanedir": 27.38930371799128, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 9.058170218001154, "distance-from-start": 3.212880790224275, "deviation-center-line": 4.350580826208776, "driven_lanedir_consec": 27.38930371799128}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105362

sim-0of4

success

yes

2021-11-03 02:17:00+00:00

2021-11-03 02:22:32+00:00

0:05:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	26.94267730828907
survival_time_median	59.99999999999873
deviation-center-line_median	3.739901660640508
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	3.739901660640508
deviation-center-line_mean	3.739901660640508
deviation-center-line_min	3.739901660640508
deviation-heading_max	10.057960804664
deviation-heading_mean	10.057960804664
deviation-heading_median	10.057960804664
deviation-heading_min	10.057960804664
distance-from-start_max	1.126531355178793
distance-from-start_mean	1.126531355178793
distance-from-start_median	1.126531355178793
distance-from-start_min	1.126531355178793
driven_any_max	27.517914762447624
driven_any_mean	27.517914762447624
driven_any_median	27.517914762447624
driven_any_min	27.517914762447624
driven_lanedir_consec_max	26.94267730828907
driven_lanedir_consec_mean	26.94267730828907
driven_lanedir_consec_min	26.94267730828907
driven_lanedir_max	26.94267730828907
driven_lanedir_mean	26.94267730828907
driven_lanedir_median	26.94267730828907
driven_lanedir_min	26.94267730828907
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 27.517914762447624, "survival_time": 59.99999999999873, "driven_lanedir": 26.94267730828907, "in-drivable-lane": 0.0, "deviation-heading": 10.057960804664, "distance-from-start": 1.126531355178793, "deviation-center-line": 3.739901660640508, "driven_lanedir_consec": 26.94267730828907}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105357

sim-2of4

success

yes

2021-11-03 02:15:54+00:00

2021-11-03 02:21:24+00:00

0:05:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	28.707808169091308
survival_time_median	59.99999999999873
deviation-center-line_median	4.266787722529838
in-drivable-lane_median	1.29999999999999

other stats

deviation-center-line_max	4.266787722529838
deviation-center-line_mean	4.266787722529838
deviation-center-line_min	4.266787722529838
deviation-heading_max	7.920161762136099
deviation-heading_mean	7.920161762136099
deviation-heading_median	7.920161762136099
deviation-heading_min	7.920161762136099
distance-from-start_max	2.5726741589886144
distance-from-start_mean	2.5726741589886144
distance-from-start_median	2.5726741589886144
distance-from-start_min	2.5726741589886144
driven_any_max	29.593312009116698
driven_any_mean	29.593312009116698
driven_any_median	29.593312009116698
driven_any_min	29.593312009116698
driven_lanedir_consec_max	28.707808169091308
driven_lanedir_consec_mean	28.707808169091308
driven_lanedir_consec_min	28.707808169091308
driven_lanedir_max	28.707808169091308
driven_lanedir_mean	28.707808169091308
driven_lanedir_median	28.707808169091308
driven_lanedir_min	28.707808169091308
in-drivable-lane_max	1.29999999999999
in-drivable-lane_mean	1.29999999999999
in-drivable-lane_min	1.29999999999999
per-episodes	details {"loop-000-ego0": {"driven_any": 29.593312009116698, "survival_time": 59.99999999999873, "driven_lanedir": 28.707808169091308, "in-drivable-lane": 1.29999999999999, "deviation-heading": 7.920161762136099, "distance-from-start": 2.5726741589886144, "deviation-center-line": 4.266787722529838, "driven_lanedir_consec": 28.707808169091308}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105351

sim-3of4

success

yes

2021-11-03 02:14:24+00:00

2021-11-03 02:19:57+00:00

0:05:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105347

sim-1of4

success

yes

2021-11-03 02:13:49+00:00

2021-11-03 02:19:00+00:00

0:05:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100296

sim-1of4

failed

2021-11-02 05:52:44+00:00

2021-11-02 05:53:28+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100294

sim-0of4

failed

2021-11-02 05:52:41+00:00

2021-11-02 05:53:24+00:00

0:00:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100293

sim-2of4

failed

2021-11-02 05:52:40+00:00

2021-11-02 05:53:19+00:00

0:00:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100289

sim-3of4

failed

2021-11-02 05:52:04+00:00

2021-11-02 05:52:42+00:00

0:00:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100288

sim-0of4

failed

2021-11-02 05:51:37+00:00

2021-11-02 05:52:21+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100286

sim-2of4

failed

2021-11-02 05:51:35+00:00

2021-11-02 05:52:13+00:00

0:00:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100285

sim-1of4

failed

2021-11-02 05:51:35+00:00

2021-11-02 05:52:13+00:00

0:00:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100280

sim-3of4

failed

2021-11-02 05:51:02+00:00

2021-11-02 05:51:39+00:00

0:00:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100278

sim-0of4

failed

2021-11-02 05:50:35+00:00

2021-11-02 05:51:15+00:00

0:00:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100277

sim-2of4

failed

2021-11-02 05:50:33+00:00

2021-11-02 05:51:12+00:00

0:00:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100276

sim-1of4

failed

2021-11-02 05:50:31+00:00

2021-11-02 05:51:08+00:00

0:00:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100275

sim-3of4

failed

2021-11-02 05:50:06+00:00

2021-11-02 05:50:50+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100270

sim-1of4

failed

2021-11-02 05:49:29+00:00

2021-11-02 05:50:07+00:00

0:00:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100269

sim-2of4

failed

2021-11-02 05:49:28+00:00

2021-11-02 05:50:04+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98065

sim-2of4

success

2021-11-01 21:12:00+00:00

2021-11-01 21:16:37+00:00

0:04:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98063

sim-0of4

success

2021-11-01 21:10:19+00:00

2021-11-01 21:14:59+00:00

0:04:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98060

sim-3of4

success

2021-11-01 21:09:11+00:00

2021-11-01 21:14:57+00:00

0:05:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98059

sim-1of4

success

2021-11-01 21:08:45+00:00

2021-11-01 21:14:55+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88778

sim-1of4

success

2021-10-19 09:25:35+00:00

2021-10-19 09:42:29+00:00

0:16:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88764

sim-2of4

success

2021-10-19 09:06:00+00:00

2021-10-19 09:25:05+00:00

0:19:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88325

sim-0of4

success

2021-10-19 04:44:26+00:00

2021-10-19 05:03:13+00:00

0:18:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88300

sim-3of4

success

2021-10-19 04:23:17+00:00

2021-10-19 04:44:14+00:00

0:20:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71274

sim-2of4

success

2021-04-21 15:29:27+00:00

2021-04-21 15:37:34+00:00

0:08:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71244

sim-1of4

success

2021-04-21 15:21:41+00:00

2021-04-21 15:31:26+00:00

0:09:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71239

sim-0of4

success

2021-04-21 15:20:30+00:00

2021-04-21 15:28:49+00:00

0:08:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71225

sim-3of4

success

2021-04-21 15:18:11+00:00

2021-04-21 15:29:58+00:00

0:11:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

70683

sim-1of4

success

2021-04-21 13:16:45+00:00

2021-04-21 13:26:10+00:00

0:09:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

70677

sim-3of4

success

2021-04-21 13:15:24+00:00

2021-04-21 13:25:14+00:00

0:09:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

70651

sim-0of4

success

2021-04-21 13:09:53+00:00

2021-04-21 13:18:41+00:00

0:08:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

70641

sim-2of4

success

2021-04-21 13:08:10+00:00

2021-04-21 13:18:18+00:00

0:10:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

65693

sim-1of4

success

2021-04-09 08:51:44+00:00

2021-04-09 09:03:02+00:00

0:11:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

64597

sim-3of4

success

2021-04-09 02:14:30+00:00

2021-04-09 02:25:02+00:00

0:10:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

64320

sim-2of4

success

2021-04-09 01:52:28+00:00

2021-04-09 02:02:22+00:00

0:09:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

63674

sim-0of4

success

2021-04-09 00:14:11+00:00

2021-04-09 00:23:50+00:00

0:09:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62266

347

success

yes

2021-03-20 19:23:33+00:00

2021-03-20 20:30:05+00:00

1:06:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62078

347

success

2021-02-01 01:26:37+00:00

2021-02-01 02:38:36+00:00

1:11:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible