Duckietown Challenges Home Challenges Submissions

Submission 13602

Submission13602
Competingyes
Challengeaido-LFP-sim-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105354 sim-1of4: 105045 sim-2of4: 105043 sim-3of4: 105041
Next
User labelfsf+il
Admin priority50
Blessingn/a
User priority50

105354

Click the images to see detailed statistics about the episode.

loop2-000

105045

Click the images to see detailed statistics about the episode.

autolab-000

105043

Click the images to see detailed statistics about the episode.

loop-000

105041

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
105354sim-0of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.249999999999982
in-drivable-lane_median0.0
driven_lanedir_consec_median2.804841203157574
deviation-center-line_median0.44647849226525094


other stats
deviation-center-line_max0.44647849226525094
deviation-center-line_mean0.44647849226525094
deviation-center-line_min0.44647849226525094
deviation-heading_max1.6799780943340952
deviation-heading_mean1.6799780943340952
deviation-heading_median1.6799780943340952
deviation-heading_min1.6799780943340952
distance-from-start_max1.1203347273224074
distance-from-start_mean1.1203347273224074
distance-from-start_median1.1203347273224074
distance-from-start_min1.1203347273224074
driven_any_max2.8861391444981215
driven_any_mean2.8861391444981215
driven_any_median2.8861391444981215
driven_any_min2.8861391444981215
driven_lanedir_consec_max2.804841203157574
driven_lanedir_consec_mean2.804841203157574
driven_lanedir_consec_min2.804841203157574
driven_lanedir_max2.804841203157574
driven_lanedir_mean2.804841203157574
driven_lanedir_median2.804841203157574
driven_lanedir_min2.804841203157574
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.8861391444981215, "survival_time": 7.249999999999982, "driven_lanedir": 2.804841203157574, "in-drivable-lane": 0.0, "deviation-heading": 1.6799780943340952, "distance-from-start": 1.1203347273224074, "deviation-center-line": 0.44647849226525094, "driven_lanedir_consec": 2.804841203157574}}
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean7.249999999999982
survival_time_min7.249999999999982
No reset possible
105344sim-0of4successyes0:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105337sim-0of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105329sim-0of4successyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105045sim-1of4successyes0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.900000000000064
in-drivable-lane_median1.1500000000000004
driven_lanedir_consec_median5.374654687992238
deviation-center-line_median0.9062523985691604


other stats
deviation-center-line_max0.9062523985691604
deviation-center-line_mean0.9062523985691604
deviation-center-line_min0.9062523985691604
deviation-heading_max2.3718341207934284
deviation-heading_mean2.3718341207934284
deviation-heading_median2.3718341207934284
deviation-heading_min2.3718341207934284
distance-from-start_max3.476743250773437
distance-from-start_mean3.476743250773437
distance-from-start_median3.476743250773437
distance-from-start_min3.476743250773437
driven_any_max5.923623585418156
driven_any_mean5.923623585418156
driven_any_median5.923623585418156
driven_any_min5.923623585418156
driven_lanedir_consec_max5.374654687992238
driven_lanedir_consec_mean5.374654687992238
driven_lanedir_consec_min5.374654687992238
driven_lanedir_max5.374654687992238
driven_lanedir_mean5.374654687992238
driven_lanedir_median5.374654687992238
driven_lanedir_min5.374654687992238
in-drivable-lane_max1.1500000000000004
in-drivable-lane_mean1.1500000000000004
in-drivable-lane_min1.1500000000000004
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.923623585418156, "survival_time": 13.900000000000064, "driven_lanedir": 5.374654687992238, "in-drivable-lane": 1.1500000000000004, "deviation-heading": 2.3718341207934284, "distance-from-start": 3.476743250773437, "deviation-center-line": 0.9062523985691604, "driven_lanedir_consec": 5.374654687992238}}
simulation-passed1
survival_time_max13.900000000000064
survival_time_mean13.900000000000064
survival_time_min13.900000000000064
No reset possible
105043sim-2of4successyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2499999999999964
in-drivable-lane_median0.0
driven_lanedir_consec_median1.004711029699252
deviation-center-line_median0.18679957271397335


other stats
deviation-center-line_max0.18679957271397335
deviation-center-line_mean0.18679957271397335
deviation-center-line_min0.18679957271397335
deviation-heading_max0.9609398142312846
deviation-heading_mean0.9609398142312846
deviation-heading_median0.9609398142312846
deviation-heading_min0.9609398142312846
distance-from-start_max0.7381070125164336
distance-from-start_mean0.7381070125164336
distance-from-start_median0.7381070125164336
distance-from-start_min0.7381070125164336
driven_any_max1.0487009725803167
driven_any_mean1.0487009725803167
driven_any_median1.0487009725803167
driven_any_min1.0487009725803167
driven_lanedir_consec_max1.004711029699252
driven_lanedir_consec_mean1.004711029699252
driven_lanedir_consec_min1.004711029699252
driven_lanedir_max1.004711029699252
driven_lanedir_mean1.004711029699252
driven_lanedir_median1.004711029699252
driven_lanedir_min1.004711029699252
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.0487009725803167, "survival_time": 3.2499999999999964, "driven_lanedir": 1.004711029699252, "in-drivable-lane": 0.0, "deviation-heading": 0.9609398142312846, "distance-from-start": 0.7381070125164336, "deviation-center-line": 0.18679957271397335, "driven_lanedir_consec": 1.004711029699252}}
simulation-passed1
survival_time_max3.2499999999999964
survival_time_mean3.2499999999999964
survival_time_min3.2499999999999964
No reset possible
105041sim-3of4successyes0:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.350000000000296
in-drivable-lane_median2.7000000000000117
driven_lanedir_consec_median12.67313404736555
deviation-center-line_median2.2785759073712843


other stats
deviation-center-line_max2.2785759073712843
deviation-center-line_mean2.2785759073712843
deviation-center-line_min2.2785759073712843
deviation-heading_max5.043974123479479
deviation-heading_mean5.043974123479479
deviation-heading_median5.043974123479479
deviation-heading_min5.043974123479479
distance-from-start_max3.0570353761204077
distance-from-start_mean3.0570353761204077
distance-from-start_median3.0570353761204077
distance-from-start_min3.0570353761204077
driven_any_max14.015056449220616
driven_any_mean14.015056449220616
driven_any_median14.015056449220616
driven_any_min14.015056449220616
driven_lanedir_consec_max12.67313404736555
driven_lanedir_consec_mean12.67313404736555
driven_lanedir_consec_min12.67313404736555
driven_lanedir_max12.67313404736555
driven_lanedir_mean12.67313404736555
driven_lanedir_median12.67313404736555
driven_lanedir_min12.67313404736555
in-drivable-lane_max2.7000000000000117
in-drivable-lane_mean2.7000000000000117
in-drivable-lane_min2.7000000000000117
per-episodes
details{"zigzag-000-ego0": {"driven_any": 14.015056449220616, "survival_time": 30.350000000000296, "driven_lanedir": 12.67313404736555, "in-drivable-lane": 2.7000000000000117, "deviation-heading": 5.043974123479479, "distance-from-start": 3.0570353761204077, "deviation-center-line": 2.2785759073712843, "driven_lanedir_consec": 12.67313404736555}}
simulation-passed1
survival_time_max30.350000000000296
survival_time_mean30.350000000000296
survival_time_min30.350000000000296
No reset possible
105038sim-2of4successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105036sim-2of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100263sim-2of4failedno0:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100257sim-2of4failedno0:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100247sim-2of4failedno0:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100238sim-2of4failedno0:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100229sim-2of4failedno0:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100224sim-2of4failedno0:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100223sim-0of4failedno0:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100215sim-3of4failedno0:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100213sim-0of4failedno0:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100212sim-3of4failedno0:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100205sim-1of4failedno0:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100202sim-0of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100201sim-3of4failedno0:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98055sim-1of4successno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98045sim-1of4successno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98034sim-1of4successno0:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98024sim-2of4successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98023sim-3of4successno0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98021sim-1of4successno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98020sim-0of4successno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98018sim-2of4successno0:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98016sim-0of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98015sim-3of4successno0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98009sim-0of4successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90221sim-3of4successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90220sim-3of4successno0:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90218sim-2of4successno0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90213sim-1of4successno0:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90212sim-0of4successno0:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73639sim-3of4successno0:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73604sim-3of4successno0:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73519sim-2of4successno0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73503sim-1of4successno0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73484sim-2of4successno0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
71998sim-0of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65850sim-1of4successno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65849sim-1of4successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65848sim-3of4successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65847sim-3of4successno0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65846sim-2of4successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65843sim-0of4successno0:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible